Stereopsis

Stereopsis is the perception of depth that the visual system computes from binocular disparity, the small difference between the two retinal images that arises because the eyes are separated horizontally on the face. Because each eye views a scene from a slightly different vantage point, the same object projects to slightly different positions on the two retinas; the brain measures these positional differences and converts them into a sensation of relative distance. Stereopsis cannot be obtained from one eye alone, which distinguishes it from the monocular depth cues such as perspective, occlusion and motion parallax.

Stereopsis is the perceptual basis of all stereoscopic three-dimensional media, including the stereoscope, 3D cinema and the head-mounted display used in virtual reality (VR) and augmented reality (AR). A VR or AR headset presents a separate image to each eye so that the artificial binocular disparity drives stereopsis and the virtual scene appears to have depth. The same physiology produces the vergence-accommodation conflict, a known source of visual fatigue in headsets, because the eyes converge to the simulated distance of an object while their lenses stay focused on the fixed display surface.

Binocular disparity and the geometry of depth

The two human eyes are separated by the interpupillary distance (IPD), on average about 63 mm in adults, with individual values ranging from roughly 50 mm to 75 mm. This lateral separation means the left and right eyes receive two slightly different views of the same scene. The difference between corresponding points in the two retinal images is the binocular disparity, and the magnitude and sign of that disparity vary with how far an object is from the point the eyes are fixating.

When both eyes fixate a point, that point and a curved surface of points around it project to corresponding (geometrically matching) locations on the two retinas and carry zero disparity. This surface is called the horopter. Points nearer than the horopter produce crossed disparity and points farther than it produce uncrossed disparity, and the sign tells the brain whether an object is nearer or farther than the fixation distance. Around the horopter lies a narrow region, Panum's fusional area, within which the two retinal images can be fused into a single percept; objects whose disparity exceeds this range are seen as double (physiological diplopia).

The relationship between disparity and distance is the same triangulation used in computer stereo vision: for a given eye separation, the depth recovered from a measured disparity follows approximately Z = b f / d, where Z is distance, b is the baseline between the two viewpoints, f is the focal length and d is the disparity. Because disparity falls off with the square of distance, stereopsis is most precise for nearby objects and contributes little beyond several metres, where monocular cues such as relative size and aerial perspective dominate.

Stereopsis is one of two binocular depth cues. The other is vergence, the inward or outward rotation of the eyes to fixate objects at different distances; vergence provides usable depth information out to roughly 10 m, while the monocular cue of accommodation (lens focusing) is effective only within about 2 m. Vergence and stereoscopic disparity are linked: when the eyes verge on an object they bring its images onto corresponding retinal points, setting the reference against which disparities of other objects are measured.

Stereoacuity

The finest depth difference a person can detect through stereopsis is called stereoacuity and is expressed as an angular disparity in seconds of arc (arcsec). Under optimal laboratory conditions the best human observers resolve disparities of only a few arcseconds; on standard clinical tests the best obtainable scores are about 5 arcsec on the revised FD2 test and 20 arcsec on the Frisby test, and the median for healthy younger adults is around 10 arcsec on the FD2 and 20 arcsec on the Frisby. Clinical screening instruments such as the Titmus stereo test use much larger disparities, from about 3,600 arcsec for the gross "fly" target down to 40 arcsec for the finest ring patterns.

Not everyone has functional stereopsis. People whose two eyes never developed coordinated binocular vision, often because of childhood strabismus or amblyopia, may be stereoblind or stereo-impaired. Prevalence estimates vary with the test and the population, because stereopsis is not a single measurable quantity: a 2019 best-evidence synthesis found that four different analytical approaches all converged on a stereoblindness prevalence of about 7 percent in adults under 60. Stereoblind users can still perceive depth in VR and AR through monocular cues and motion parallax, but they do not gain the additional depth precision that stereopsis provides.

History

The dependence of depth perception on the two eyes' differing views was established by the English scientist Charles Wheatstone, who described stereoscopic vision in a paper read to the Royal Society on 21 June 1838 and built the first stereoscope, a device using angled mirrors to present a separate drawing to each eye. Viewing two flat drawings of a cube taken from slightly offset positions, Wheatstone saw a single solid form, demonstrating that horizontal disparity alone is sufficient to evoke depth. Stereoscopes became a popular form of home entertainment in the second half of the 19th century once photography made stereo image pairs cheap to reproduce.

A second turning point came in 1960, when the Hungarian-born engineer and psychologist Bela Julesz, working at Bell Telephone Laboratories, introduced the random-dot stereogram. In "Binocular Depth Perception of Computer-Generated Patterns" (Bell System Technical Journal, vol. 39, no. 5, pp. 1125-1162, September 1960), Julesz generated pairs of fields of random dots that were identical except that a central region was shifted horizontally in one image. Each field looked like meaningless noise to either eye alone, but when the pair was viewed through a stereoscope the shifted region floated in depth. Because the depth shape was invisible to either eye on its own and only emerged when the brain combined the two images, Julesz called the percept "cyclopean," after the one-eyed Cyclops of Greek myth, and developed the idea in his 1971 book Foundations of Cyclopean Perception. The experiment showed that stereopsis can be computed purely from disparity, without any recognisable objects, perspective or other monocular cue, and that depth processing can precede the recognition of form.

Role in virtual and augmented reality

Stereoscopic displays exploit stereopsis by feeding each eye a distinct image. In a head-mounted display the left and right eyes look at separate views (or separate halves of one panel) through their own lenses, so that the difference between the two images is interpreted by the visual system as binocular disparity and the scene gains apparent depth. Rendering such content is called stereoscopic rendering: the engine places two virtual cameras in the scene, separated by a baseline that should match the user's IPD, and renders the entire scene twice, once for each eye. Setting the virtual camera separation equal to the viewer's real IPD yields a one-to-one scale world; a mismatch between the rendered separation and the user's actual IPD distorts perceived scale and depth and can add to visual discomfort. For this reason many headsets allow physical or software IPD adjustment.

Presenting separate per-eye images is not the same as reproducing natural binocular viewing, and the difference is the vergence-accommodation conflict (VAC). In the real world the distance the eyes converge to and the distance they focus to are always the same. In a conventional headset the imagery can simulate any vergence distance through disparity, but the light physically comes from a display at a fixed optical distance, so accommodation stays fixed while vergence changes. Hoffman, Girshick, Akeley and Banks measured the effects of this conflict in a 2008 Journal of Vision study using a multi-plane bench display that could present correct or incorrect focus cues. When focus cues matched the simulated depth, observers fused stereoscopic images faster, achieved higher stereoacuity in time-limited tasks, showed smaller distortions of perceived depth, and reported less fatigue and discomfort. The conflict is most pronounced for virtual objects close to the viewer, where the required change in focus is largest.

Several display approaches aim to relieve the conflict while preserving stereopsis. Varifocal displays use eye tracking to estimate where the user is looking and mechanically or optically shift the focal distance to match the vergence distance; Meta's Half Dome research prototypes demonstrated this, moving from motorised displays in the 2018 Half Dome to a solid-state stack of switchable liquid-crystal lenses in Half Dome 3. Other proposed solutions include multifocal, holographic and light-field displays, which attempt to reproduce focus cues more directly. As of 2026 these remain largely research or prototype technologies, and most shipping consumer headsets still use a single fixed focal plane and therefore exhibit the conflict.

Stereopsis is one cue among several that a headset uses to create presence and a convincing sense of depth. Motion parallax from head tracking, occlusion, relative size and perspective all contribute, and these monocular cues allow even stereoblind users to navigate virtual environments. The distinctive contribution of stereopsis is fine relative-depth judgement of nearby objects, which is why it matters most for close interaction such as reaching for or manipulating virtual objects with the hands.