Zum Inhalt springen

The History of Virtual Reality

Zusammenfassung

Virtual reality is one of computing’s oldest dreams and most persistent disappointments. Ivan Sutherland described the “Ultimate Display” in 1965 — a room where the computer controlled the physical environment, where bullets fired in software would kill. Jaron Lanier coined the term “virtual reality” in 1987, built the DataGlove and EyePhone, and sold a vision of shared virtual worlds that captured the public imagination before the technology’s limitations made it a joke. Two decades of failed consumer attempts — including Nintendo’s Virtual Boy (1995) and a wave of theme-park VR installations — convinced the industry that VR was permanently ten years away. Then Palmer Luckey built the Oculus Rift in his parents’ garage in 2012, Facebook acquired Oculus for $2 billion in 2014, and the industry restarted with better sensors, better displays, and better software. The dream has still not become mass market — but it has become real enough to be used seriously in surgery, therapy, training, and entertainment.

Sutherland and the Ultimate Display

The intellectual foundation of virtual reality is Ivan Sutherland’s 1965 paper “The Ultimate Display,” which described with unusual directness what immersive computing would require and accomplish:

“The ultimate display would, of course, be a room within which the computer can control the existence of matter. A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be lethal.”

Sutherland proceeded to build the first head-mounted display system. The Sword of Damocles (1968), built with student Bob Sproull at Harvard and MIT, suspended a mechanical tracking system from the ceiling (hence the name) and displayed wireframe graphics in stereo on two small CRT screens mounted in front of the user’s eyes. The system tracked head position and updated the displayed image accordingly — if the user turned their head, the virtual room rotated appropriately.

The Sword of Damocles was crude by any practical measure — the images were simple wireframe boxes, the tracking was mechanically limited, and the overhead mount made movement impossible. But it demonstrated the core principle: a head-mounted display that responded to head movement could create the experience of being inside a virtual space.

The Research Years

Through the 1970s and 1980s, VR remained a research topic, developed at universities, military contractors, and NASA:

NASA Ames Research Center built the VIEW (Virtual Interactive Environment Workstation) system in the 1980s under Michael McGreevy and Scott Fisher. VIEW used a head-mounted display with magnetic tracking, stereo sound, and data gloves that tracked hand position to enable interaction with virtual objects. NASA intended VIEW for training astronauts and remotely controlling robots in hostile environments. The system was impressive — and cost hundreds of thousands of dollars.

VPL Research, founded by Jaron Lanier in 1984, became the first commercial VR company. Lanier, a musician and programmer who had arrived in Silicon Valley as a teenager, coined the term “virtual reality” around 1987 and positioned VPL as the company that would commercialize immersive computing. VPL’s products — the DataGlove (a glove with fiber optic sensors tracking finger bends and a magnetic position sensor) and the EyePhone (a head-mounted display) — were sold to research institutions at prices of $9,000 and $49,000 respectively.

Lanier’s public presentations were vivid and persuasive. He described VR as the ultimate communication medium, a place where people could share experiences beyond what language could convey — a “post-symbolic communication” that would transform human interaction. The vision attracted enormous press attention. Time magazine, Newsweek, and dozens of mainstream publications covered VR breathlessly in 1990–1992 as the next transformation in computing.

VPL filed for bankruptcy in 1990 following investor disputes; Lanier lost control of the patents. The loss of VPL’s commercial momentum coincided with a broader reality check about the technology’s limitations.

The First Consumer Wave and Its Failure

The early 1990s produced a wave of consumer VR attempts, all of which failed:

Virtuality Group deployed VR arcade cabinets in malls and entertainment centers from 1991. The machines — enclosed pods with head-mounted displays and joysticks — let players shoot each other in simple 3D environments for a few minutes at a time, at $5–10 per session. Virtuality sold 1,000 pods by 1994. The experience was technically impressive for its time; the gameplay was too limited to sustain interest, and the hardware costs made the economics marginal.

Nintendo’s Virtual Boy (1995) was the most prominent consumer VR failure. Developed under Gunpei Yokoi (creator of the Game Boy), the Virtual Boy was a tabletop unit that displayed red monochrome stereoscopic 3D graphics at 50 Hz. Its displays (technology licensed from Reflection Technology) scanned a column of red LEDs across the field of view using oscillating mirrors — not the parallax-barrier or LCD panels of other headsets — and the unit sat on a stand that required the user to press their face against an eyepiece and hold still, producing eye strain and headaches in many users after minutes of play. Nintendo discontinued the Virtual Boy after 770,000 units sold, less than 10% of projections. It became the most prominent failure in a long series of hardware innovations from Yokoi, whose design philosophy emphasized using mature technology in novel ways — the Virtual Boy was the exception that proved the rule, using technology that was not yet mature enough.

VFX1 Headgear, Victormaxx Cybermaxx, Forte VFX1 — dozens of consumer VR headsets appeared between 1993 and 1996, priced between $300 and $800. All were limited by the same fundamental problems: LCD displays with insufficient resolution and refresh rates that caused motion sickness, tracking systems with latency high enough to break immersion, and computing hardware that could not render 3D environments fast enough to maintain smooth frame rates.

The motion sickness problem was particularly damaging. VR-induced nausea — cybersickness — resulted from a mismatch between the vestibular system (which sensed physical motion) and the visual system (which saw a moving image). When the display lagged even slightly behind head movement, the mismatch was enough to trigger nausea in many users. The tracking and rendering technology of the mid-1990s could not achieve the latency thresholds needed to prevent this reliably.

By 1997, consumer VR had become a punchline. The industry moved on. The term “virtual reality” acquired associations of hype and disappointment that would burden the next generation of developers.

The Long Interlude

Between 1997 and 2012, VR retreated to enterprise applications where the cost of hardware was justified by specific use cases:

Military simulation: VR-based flight simulators and combat training systems were deployed by the US military through the 2000s. The STRICOM (Simulation, Training, and Instrumentation Command) operated large-scale networked simulation environments. Military applications justified six-figure hardware costs and tolerated limited interactivity.

Medical training: Surgical simulators using haptic feedback and visual displays allowed surgeons to practice procedures without risk to patients. Laparoscopic surgery simulators became standard training tools in medical education.

Industrial design: Automotive manufacturers used VR environments to evaluate vehicle designs before physical prototypes were built — faster and cheaper than traditional clay modeling.

Architecture and real estate: Virtual walkthroughs of unbuilt buildings allowed clients to experience spaces before construction.

These applications kept VR research alive and accumulated knowledge about human factors — what display resolution, what refresh rates, what tracking latency would eliminate cybersickness. The medical and military communities were rigorous about measuring simulator sickness; their research would inform the consumer VR revival.

Oculus and the Second Wave

In 2011, Palmer Luckey — an 18-year-old student living in his parents’ garage in California and obsessed with head-mounted displays — began posting to Meant to Be Seen, a 3D display forum, about a new HMD prototype he was building. Luckey had collected dozens of vintage head-mounted displays and had strong opinions about their limitations. His prototype, built from salvaged parts, used a wide-angle lens in front of a high-resolution display to create a field of view much larger than any commercial HMD — and reduced the per-pixel cost by using a single display rather than separate screens for each eye.

Luckey posted a Kickstarter campaign for the Oculus Rift development kit in August 2012, asking for $250,000. He received $2.4 million from 9,522 backers.

John Carmack — id Software’s lead programmer, creator of Doom and Quake, one of the most respected technical figures in computing — obtained an early Luckey prototype and demonstrated a modified version of Doom 3 on it at E3 2012. Carmack’s endorsement gave the project credibility beyond its Kickstarter origins.

Brendan Iribe and Michael Antonov joined Luckey to co-found Oculus VR in July 2012. The company raised $2.55 million in seed funding in August 2012, $16 million Series A in June 2013, and $75 million Series B in December 2013 from Andreessen Horowitz.

In March 2014, Facebook acquired Oculus for approximately $2 billion ($400 million cash plus $1.6 billion in Facebook stock and earn-out provisions). Mark Zuckerberg, who had tried the Rift prototype, believed VR would be a major next computing platform and wanted Facebook positioned at its center. The acquisition shocked the VR community; the gaming-focused developer community’s reaction was largely negative, fearing corporate control of what had begun as an open platform.

The Modern Era

The Oculus acquisition triggered reinvestment across the industry:

Valve developed SteamVR and the HTC Vive (released 2016), using room-scale tracking technology that allowed users to walk around a physical space while tracked by infrared laser emitters — a significant improvement over the stationary experiences the original Rift supported.

Sony released PlayStation VR (2016) for the PlayStation 4, bringing VR to a platform with tens of millions of existing users. PlayStation VR’s lower price point and console integration made it the best-selling VR headset for several years.

Google released Cardboard (2014), a $15 cardboard viewer that worked with a smartphone to provide basic VR experiences. Cardboard was not a sophisticated device, but it put some form of VR experience in millions of hands and introduced many users to the concept.

Samsung Gear VR (2015), developed in partnership with Oculus, used Samsung Galaxy phones as the computing platform for a slightly more sophisticated mobile VR headset.

The Oculus Quest (2019) was the inflection point. The Quest was a standalone headset — it included its own processor, tracking cameras, and storage, requiring no PC or phone. It tracked the user’s hands natively through inside-out tracking (cameras on the headset itself rather than external sensors). It was wireless. At $399, it was priced for consumers rather than enterprise. The Quest 2 (2020), at $299, sold approximately 14 million units, making it the first VR headset to achieve meaningful consumer scale.

Mark Zuckerberg renamed Facebook as Meta in October 2021, explicitly positioning the company as building the “metaverse” — a persistent social virtual world accessed through VR headsets. Meta committed billions annually to VR hardware and software development.

Apple Vision Pro (announced 2023, shipped early 2024) brought Apple’s design and hardware manufacturing to mixed reality — displaying the physical environment through high-resolution passthrough cameras while overlaying virtual content. The Vision Pro’s $3,499 price positioned it as a professional tool rather than a consumer headset.

The Enduring Challenge

Despite two decades of renewed investment, VR has not achieved the mass adoption that its proponents have repeatedly predicted. In 2024, VR headset sales remain measured in millions per year, not hundreds of millions. The challenges are structural:

Isolation: A VR headset places the user in a private visual environment, disconnecting them from physical surroundings and other people in the room. Phones are addictive partly because they can be used while doing other things; VR cannot.

Comfort: Extended use of current headsets causes discomfort — physical weight on the face, heat, and for some users, residual cybersickness even at modern latencies. Sessions measured in hours are uncomfortable.

Content: The killer application — the experience that makes millions of people buy headsets specifically to access it — has not emerged. Social VR remains niche; VR gaming has produced excellent experiences but not must-own titles.

Vergence-accommodation conflict: Human vision naturally accommodates (focuses) to the distance of the object being looked at. Current VR displays present everything at a fixed focal distance regardless of virtual depth, creating a subtle but tiring conflict between accommodation and vergence (eye convergence). Solving this requires displays that can vary focal distance — a hardware challenge that remains unsolved at consumer price points.

VR’s uses in surgery, therapy (treating PTSD, phobias, and chronic pain), pilot training, and architectural visualization are well-established and growing. Consumer entertainment remains the unrealized potential of a technology that has been almost-ready for twenty years.

📚 Sources