Jump to content

Varifocal

From VR & AR Wiki

A varifocal display is a near-eye display for virtual reality (VR) or augmented reality (AR) whose focal distance can be changed at runtime, so that virtual content can be presented at the optical depth a user is actually looking at. The focal distance is adjusted dynamically, usually under the control of an eye tracker, by mechanically moving the display panel, by using a focus-tunable lens, or by switching between states of an electronically controlled lens stack. The purpose is to supply correct focus cues and reduce the vergence-accommodation conflict (VAC), a known source of visual discomfort in conventional headsets.[1][2]

Almost all consumer VR and AR headsets through the mid-2020s use a fixed focal plane: every pixel appears to come from a single optical distance regardless of where it is drawn in the virtual scene. Varifocal displays change that single distance over time to track the user's gaze. As of mid-2026 the technique remains a research and demonstration technology in VR; it has been shown in laboratory prototypes by Meta Platforms (the Half Dome and Butterscotch Varifocal series) and others, but no mass-market VR headset ships with a gaze-driven varifocal display.[3][4]

The problem it addresses

When a person looks at a real object, two ocular responses act together: vergence, the inward or outward rotation of the two eyes so their lines of sight meet on the object, and accommodation, the change in shape of each eye's crystalline lens that brings the object into sharp focus on the retina. In natural vision these two responses are neurally coupled and point to the same distance.[1]

A stereoscopic headset drives vergence correctly, because each eye sees a slightly different image and the brain converges the eyes on the intended depth. Accommodation, however, is fixed: all of the light reaches the eye from the display's single focal plane, so to keep the image sharp the eye must always focus at that one distance even when it is converging somewhere else. This mismatch is the vergence-accommodation conflict, and prolonged exposure to it is associated with eye strain, fatigue, and difficulty fusing close objects.[1][5] A varifocal display attacks the conflict directly by changing the display's focal distance to match the depth the eyes are verging on, restoring the link between the two cues.[1]

How it works

A varifocal display presents a single image plane at any instant, but moves that plane to the depth the user is currently fixating. Two components are therefore required: a way to measure where the user is looking, and a way to change the system's focal distance.[2][1]

Eye tracking supplies the gaze direction, and the convergence of the two gaze vectors gives an estimate of the fixation depth. The display then sets its focal distance to that depth, so the part of the scene the user is inspecting is rendered at the correct focus while the eye accommodates naturally. Because this depends on the gaze estimate, varifocal designs are sometimes called gaze-contingent displays, and they demand eye tracking that is both accurate and low-latency so the focus can keep up with rapid eye movements.[1][2]

The focus change itself has been implemented in several ways:

  • Mechanical actuation: the display panel is physically moved toward or away from the lens, changing the image distance. Actuators such as voice coils with flexure hinges have been used to make this motion fast, quiet, and durable.[6]
  • Focus-tunable lenses: a deformable or fluid-filled lens changes its optical power on command, shifting the focal plane without moving the panel. The Stanford prototype of Padmanaban et al. combined a focus-tunable lens with an integrated stereo eye tracker.[1]
  • Electronically switched lens stacks: a stack of polarization-dependent liquid crystal lenses and switchable wave plates is driven between discrete states, each combination producing a different focal distance, with no moving parts. Meta's Half Dome 3 used six such lenses to sweep through 64 focal planes.[6][2]

Software can supplement the optics. Because a varifocal display brings only one depth into focus at a time, content at other depths should appear blurred, as it would in the real world. Meta's DeepFocus system used a neural network to render this gaze-dependent defocus blur in real time for the Half Dome prototypes.[7]

Relation to other accommodation-supporting displays

Varifocal is one of several display architectures proposed to provide focus cues and address the vergence-accommodation conflict. In a 2017 review, Matsuda, Fix, and Lanman group these into varifocal, multifocal, accommodation-invariant, monovision, retinal scanning, light field, and holographic displays.[5]

The closest relative is the multifocal display. A varifocal display tracks the eye and presents one focal plane per frame at the gaze depth, so it relies on accurate eye tracking; a multifocal display instead presents several focal planes at fixed depths each frame and does not need to know where the eye is pointed. The trade-off is that varifocal designs cover a continuous depth range with simpler optics but are sensitive to eye-tracking error, whereas multifocal designs are robust to that error but reproduce only a few discrete depths.[8] Hybrid designs that combine a tunable focus with a small number of planes have been proposed to get both benefits.[8]

A related Meta research line, the Focal Surface Display, uses a spatial light modulator as a dynamic freeform lens to bend the single focal plane into a curved focal surface that approximates scene geometry, rather than keeping it flat as a basic varifocal display does.[5] Light field and holographic displays take a different route again, reconstructing the light leaving a scene so that focus cues emerge without an explicit eye-tracked focus mechanism.[5]

History

Work on supplying correct focus cues in stereo displays predates head-mounted varifocal systems. In 2004, Kurt Akeley, Simon Watt, Ahna Girshick, and Martin Banks built a benchtop stereo display with three image planes at different physical distances, a fixed-viewpoint volumetric design that produced near-correct focus cues without eye tracking. Their work helped establish that incorrect focus cues in conventional stereo displays cause measurable problems for the viewer.[9]

Gaze-contingent varifocal designs for VR were demonstrated in academic work in 2017. Padmanaban, Konrad, Stramer, Cooper, and Wetzstein of Stanford University presented a headset that paired focus-tunable lenses and a mechanically actuated display with eye tracking, and reported in PNAS that the adaptive-focus modes improved accommodative response and that users could also correct for their own refractive errors without glasses.[1]

The most visible engineering effort has been at Reality Labs, the hardware research division of Meta Platforms. Meta dates its varifocal program to about 2015, and first showed the work publicly as the Half Dome prototype at the F8 conference in May 2018.[10][3] Half Dome 1 used mechanically moving displays driven by eye tracking and offered a 140-degree field of view through Fresnel lenses. Half Dome 2 kept the mechanical approach but folded the optics into a smaller, roughly 200-gram-lighter package aimed at comfort. Half Dome 3, shown at Oculus Connect 6 in 2019, removed the moving parts entirely, using the stacked liquid crystal lenses described above to switch electronically among 64 focal planes.[6][10] At SPIE in early 2020, Reality Labs research lead Douglas Lanman described the electronic varifocal approach as "almost ready for primetime," while noting that no consumer headset yet supported vergence and accommodation together.[2]

In 2023 Meta showed Butterscotch Varifocal at SIGGRAPH, described as the first prototype to combine varifocal focus with a retinal-resolution display of about 60 pixels per degree, enough for 20/20 visual acuity. To prioritize image quality it returned to a mechanical varifocal mechanism (moving the display) rather than the electronic lens stack, and traded field of view down to about 50 degrees. It was shown alongside a computational-camera prototype called Flamera; Butterscotch Varifocal won the Audience Choice award at the conference, while Flamera won Best in Show in the Emerging Technologies program.[3]

Status and applications

As of mid-2026 gaze-driven varifocal remains a research technology in head-mounted VR. Meta has described a compact concept headset called Mirror Lake that would combine varifocal optics with its other display research in a single goggles-like device, but Reality Labs chief scientist Michael Abrash has said it remains a concept that has not been built into a fully functional headset. The company has meanwhile continued to ship consumer Quest headsets without eye tracking or varifocal optics.[11][4] Reaching consumer products is constrained by the need for fast, reliable eye tracking, by the added size, cost, and power of the focus mechanism, and by the rendering needed to produce realistic defocus blur.[2][7]

A related idea has reached a commercial enterprise product on the mixed-reality passthrough path. The Varjo XR-4 Focal Edition applies gaze-directed variable-focus to its passthrough cameras rather than to the display panel: fast focus actuators change the cameras' focus distance to where the user is looking so that near-field real objects appear sharp. The device is sold for professional training and simulation rather than the consumer market.[12]

The following table summarizes the principal varifocal VR research prototypes.

Prototype Year shown Developer Focus mechanism Notes
Padmanaban et al. (Stanford) 2017 Stanford University Focus-tunable lens + actuated display PNAS study; also corrected user refractive error
Half Dome 1 2018 Meta Platforms (Reality Labs) Mechanical, moving displays 140-degree FOV via Fresnel lenses
Half Dome 2 2019 Meta Platforms (Reality Labs) Mechanical, folded optics About 200 g lighter; comfort focus
Half Dome 3 2019 Meta Platforms (Reality Labs) Electronic liquid crystal lens stack Six lenses, 64 focal planes, no moving parts
Butterscotch Varifocal 2023 Meta Platforms (Reality Labs) Mechanical, moving display About 60 PPD retinal resolution; about 50-degree FOV

References

  1. 1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7
    Konrad, Robert(2017). "Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays".{Template:Journal. 114(9)
    2183-2188. https://www.computationalimaging.org/publications/varifocal-displays-virtual-reality/. Retrieved 2026-06-15.
  2. 2.0 2.1 2.2 2.3 2.4 2.5 "Facebook Reality Labs Says Varifocal Optics Are 'almost ready for primetime,' Details HDR Research". 2020-07-28. https://www.roadtovr.com/facebook-reality-labs-lanman-spie-xr-2020-varifocal-hdr/.
  3. 3.0 3.1 3.2 "Demo or Die: How Reality Labs' Display Systems Research Team Is Pushing the VR Industry Toward the Future". 2023-08-01. https://www.meta.com/blog/reality-labs-research-display-systems-siggraph-2023-butterscotch-varifocal-flamera/.
  4. 4.0 4.1 "Eye Tracking Is The Missing Piece In Mark Zuckerberg's VR Strategy". 2024-10-30. https://www.uploadvr.com/eye-tracking-missing-piece-mark-zuckerberg-vr-strategy/.
  5. 5.0 5.1 5.2 5.3
    Fix, Alexander(2017). "Focal surface displays".{Template:Journal. 36(4)
    1-14. https://dl.acm.org/doi/10.1145/3072959.3073590. Retrieved 2026-06-15.
  6. 6.0 6.1 6.2 "Half Dome Updates: FRL Explores More Comfortable, Compact VR Prototypes for Work". 2019-09-25. https://www.meta.com/blog/half-dome-updates-frl-explores-more-comfortable-compact-vr-prototypes-for-work/.
  7. 7.0 7.1 "Introducing DeepFocus: The AI Rendering System Powering Half Dome". 2018-12-19. https://www.meta.com/blog/introducing-deepfocus-the-ai-rendering-system-powering-half-dome/.
  8. 8.0 8.1
    Xiong, Jianghao(2020). "Multifocal displays
    review and prospect".{Template:Journal. 1(10). https://photonix.springeropen.com/articles/10.1186/s43074-020-00010-0. Retrieved 2026-06-15.
  9. Watt, Simon J.(2004). "A stereo display prototype with multiple focal distances".{Template:Journal. 23(3)
    804-813. https://dl.acm.org/doi/10.1145/1015706.1015804. Retrieved 2026-06-15.
  10. 10.0 10.1 "Introducing the Team Behind Half Dome, Facebook Reality Labs' Varifocal Prototype". 2018-12-11. https://www.meta.com/blog/introducing-the-team-behind-half-dome-facebook-reality-labs-varifocal-prototype/.
  11. "Meta Says New Prototype Will Put Its Cutting-edge R&D in a Market-viable Headset". 2022-08-02. https://www.roadtovr.com/meta-mirror-lake-prototype-concept-r-and-d/.
  12. "XR-4 Features Explained: World's First Gaze-Driven XR Autofocus Camera System". 2024. https://varjo.com/blog/xr-4-features-explained-worlds-first-gaze-driven-xr-autofocus-camera-system/.