Optics

See also: Pancake lenses, Fresnel lens and Waveguide display

Optics is the branch of physics that studies light and its interaction with matter, and, in the context of virtual reality (VR) and augmented reality (AR), the term refers to the optical system that relays the image from a display panel to the user's eyes inside a head-mounted display (HMD). Because the display in an HMD sits only a few centimetres from the face, far closer than the eye can focus, every headset places one or more lenses between the panel and each eye. These lenses magnify the image, set the apparent focal distance, and determine much of what the user perceives as image quality: sharpness, field of view, brightness, and the visibility of artifacts such as glare and distortion.

The optical design is one of the defining differences between device classes. VR headsets are typically opaque and use magnifying eyepieces over a microdisplay or larger panel. AR and smart glasses are usually see-through and use an optical combiner that overlays a generated image onto the real world. In both cases the optics must work within tight constraints on weight, thickness, and the position of the eye, and they introduce trade-offs between field of view, resolution, eye box size, and optical efficiency that have shaped the hardware of every commercial headset.

Role of optics in a head-mounted display

A display panel held close to the eye cannot be focused on directly, because the human eye cannot accommodate to objects nearer than roughly 10 cm. The eyepiece in a VR headset solves this by forming a magnified virtual image of the panel at a comfortable distance, usually set near optical infinity or a metre or two away. The lens therefore performs two jobs at once: it magnifies a small panel to fill a wide angular field, and it moves the focal plane outward so the relaxed eye can see it sharply.

The geometry of this arrangement defines several quantities that headset specifications report directly. The field of view is the angular extent of the image the user can see, the interpupillary distance (IPD) is the spacing between the optical centres of the two lenses, which should match the spacing of the user's pupils, and the eye relief is the distance from the back surface of the lens to the eye. The eye box (sometimes called the optical sweet spot at its centre) is the three-dimensional volume within which the pupil must sit to see the full image clearly; if the interpupillary distance or eye relief is wrong the eye falls outside this volume and the user sees optical distortions at the edges of the image.

Lens types in virtual reality

Fresnel lenses

A Fresnel lens collapses the smoothly curved surface of a conventional convex lens into a series of concentric ring-shaped facets, reducing the thickness and weight of the element while keeping most of its focusing power. This made Fresnel optics attractive for the first wave of consumer VR: the Oculus Rift, the original Oculus Quest, and the Meta Quest 2 all used hybrid Fresnel eyepieces.

The ring structure carries a cost. The boundaries between facets scatter and diffract light, and against a bright object on a dark background this produces streaks of glare radiating outward, an artifact widely called "god rays" that arises from reflections, internal reflections, and diffraction of light at high-contrast edges. Fresnel designs also tend to be sharp only near the centre of the lens, with image quality falling off toward the periphery, so the user must keep the eye well centred in the eye box.

Pancake lenses

A pancake lens is a folded catadioptric optical system that uses polarization to bounce light back and forth between optical surfaces before it reaches the eye, so the light travels a long optical path within a physically short space. Light from the panel passes through a partial mirror, reflects off a curved reflective polarizer, then reflects again, and a change of polarization at each stage controls whether each surface transmits or reflects. The result is a much thinner module than a Fresnel design of the same focal length, with sharper edge-to-edge clarity and far fewer god rays.

The principal drawback is efficiency. Because the light is partly reflected and partly absorbed by polarizers at several surfaces, only a fraction of the panel's light reaches the eye, so pancake headsets need brighter, more power-hungry displays. Pancake optics became the mainstream choice for higher-end headsets in the mid-2020s. The Meta Quest Pro (2022), the Meta Quest 3 (2023), and the Apple Vision Pro (2024) all use pancake lenses, giving them slimmer visors than the Fresnel-based Quest 2; the cheaper Meta Quest 3S retained the Quest 2's Fresnel optics as a cost measure.

Optics in augmented reality

See-through AR devices cannot simply place a lens over a panel, because the user must also see the real world. They use an optical combiner, an element that is transparent to the surrounding environment while reflecting or diffracting a generated image into the eye. Two families dominate.

Birdbath optics

In a birdbath combiner the image from a small display is sent to a beam splitter set at an angle, which reflects part of the light onto a concave, semi-transparent mirror; the curved mirror focuses the light and sends it back through the beam splitter to the eye, while the real world is still visible through the same elements. The name comes from the shape of the curved reflector. Because the display can sit relatively far from the eye, birdbath designs can reach a wider field of view than most waveguides, but the stacked elements make the optic bulkier and reduce the amount of ambient light that passes through.

Waveguides

A waveguide is a thin, flat slab of glass or plastic that carries light from a projector at its edge across to a point in front of the eye by total internal reflection, then couples it out toward the pupil. Waveguides let the bulk of the optics and the light engine sit at the temple of a pair of glasses while the lens in front of the eye stays slim and mostly transparent, which is why they are used by Microsoft HoloLens 2, Magic Leap One and most AR smart glasses.

Waveguides fall into two broad groups. Diffractive waveguides use nanometre-scale surface gratings to couple light in and out; the field of view they can achieve rises with the refractive index of the substrate. Reflective (geometric) waveguides instead embed an array of small partially-reflective mirrors in the slab. Diffractive types are easier to mass-produce but tend to be less optically efficient and can leak light, producing "eye glow" (light visible to onlookers) and reduced contrast; reflective types usually have higher brightness and better colour uniformity.

The dependence of field of view on substrate index drove a notable 2024 development. Meta's Orion AR glasses prototype, shown at Meta Connect in September 2024, reached a 70 degree diagonal field of view by making its diffractive waveguides from silicon carbide, which Meta says has a refractive index of about 2.7, the highest known for an optical application and well above the roughly 1.8 of the optical glass the team started with. The high index allowed a wide field of view in a glasses-sized lens, at the cost of an expensive and immature manufacturing process.

Distortion and aberration correction

The magnifying eyepieces in a VR headset bend straight lines: a wide-angle eyepiece produces pincushion distortion, in which the image appears pinched toward the centre. Headsets correct this in software by pre-warping the rendered frame with the opposite (barrel) distortion before it is sent to the panel, so that the lens cancels the pre-warp and the user sees straight lines. The radial distortion is commonly modelled as an odd polynomial in the distance from the optical axis, and the correction applies the inverse of that function.

Lenses also bend different wavelengths by different amounts, so red, green, and blue light land at slightly different positions and a high-contrast edge shows coloured fringes, an effect called chromatic aberration. VR rendering pipelines correct this by displacing each colour channel radially by a different, separately calibrated amount, so that after the light passes through the lens the three channels realign. Both corrections depend on the eye sitting in the eye box; if the pupil drifts, the calibrated correction no longer matches the light path and residual distortion or fringing reappears, an effect sometimes described as "pupil swim."

Vergence-accommodation conflict

Most consumer headsets present the image at a single fixed focal distance. The eyes still rotate inward or outward (verge) to fixate objects at different simulated depths, but the lens of each eye must always focus (accommodate) at the one distance the optics provide. This mismatch between where the eyes point and where they focus is the vergence-accommodation conflict (VAC), and it is a known cause of eye strain and discomfort in VR.

Resolving VAC is an active area of optical research, generally through varifocal or focal-adjustable displays that change the focal distance, often guided by eye tracking, to match the depth the user is looking at. Meta's Reality Labs research group has demonstrated several relevant prototypes, including the Half Dome series of varifocal headsets and, presented in June 2022, the Butterscotch prototype, which Meta reported reaches about 55 to 56 pixels per degree (approaching the resolving limit of 20/20 human vision) by trading away field of view, and the Holocake 2 prototype, which uses flat holographic pancake-style lenses to make a thinner headset. As of 2026 these remain research prototypes rather than shipping products.

Current status

In 2026 the dominant VR optical design is the pancake lens, used across Meta's higher-end Quest line, the Apple Vision Pro, and competing headsets, with Fresnel optics surviving mainly in lower-cost models. On the AR side, waveguide combiners remain standard for see-through glasses, with diffractive types most common and birdbath designs used where a wider field of view is wanted at the expense of bulk. The unsolved problems that continue to drive optical research are limited field of view in compact AR waveguides, the low light efficiency of both pancake lenses and diffractive waveguides, and the vergence-accommodation conflict in fixed-focus VR.

See also

• Pancake lenses
• Fresnel lens
• Waveguide display
• Optical combiner
• Field of view
• Interpupillary distance
• Vergence-accommodation conflict
• Head-mounted display