Ocular parallax

Ocular parallax is the small, depth-dependent shift of the retinal image that occurs when the eye rotates. It arises because the eye's center of projection (often modeled as the front nodal point) does not coincide with its center of rotation, so every change in gaze direction also moves the eye's viewpoint along a small arc around the center of rotation. Objects at different distances therefore shift by different amounts relative to one another, and a nearer object can partly reveal or hide a farther one as the gaze moves.

The effect is a monocular depth cue that has been described in vision science since the 19th century. Conventional stereo rendering in head-mounted displays places each virtual camera at a fixed point and ignores it. In 2019 and 2020 researchers at Stanford University proposed ocular parallax rendering, a gaze-contingent technique that uses eye tracking to move each virtual camera with the eye's projection center. In their user studies the technique improved judgments of which of two surfaces was nearer and gave a stronger impression of realistic depth, but it did not improve absolute distance estimates.

Reviewed 6 October 2026. Claims checked against the full texts of the Konrad 2020, Krajancich 2020 and Kim 2024 papers, abstracts of the other cited studies, and Crossref records for every cited DOI. About review dates.

How it works

In schematic models of the human eye, the optical system can be reduced to a set of cardinal points. Konrad, Angelopoulos and Wetzstein model ocular parallax with two of them: the front nodal point, which they treat as the center of projection, and the center of rotation. They note that although published eye models place these points slightly differently, the distance between the center of rotation and the center of projection is 7 to 8 mm in all the common models; for their experiments they used the relaxed Gullstrand-Emsley eye, with a separation of 7.6916 mm. They also cite measurements by Fry and Hill (1962) placing the center of rotation on average 14.7536 mm behind the cornea in emmetropic subjects.

Because the projection center sits in front of the rotation center, rotating the eye sweeps the viewpoint along a small arc. Two points straight ahead at different distances, which overlap on the retina when the eye looks directly at them, separate once the eye rotates away. The separation grows with retinal eccentricity and with the dioptric difference between the two objects. Near an occlusion boundary the effect appears as gaze-contingent occlusion: as the gaze moves, texture on the farther surface is revealed or hidden at the edge of the nearer one. Bingham called this "ocular occlusion" in his 1993 study of optical flow produced by eye movement with the head immobilized.

The size of the effect is small. Konrad et al. modeled it against a linear model of how visual acuity falls off with eccentricity and found that, for static targets, the parallax within the foveola (eccentricities below 1 degree) may be too small to see, while for eccentricities above 1 degree relative object distances of 2 to 3 diopters could make it a useful cue. Since it is a motion cue, they argue that static acuity underestimates its visibility: earlier measurements by McKee and Nakayama had found motion thresholds well below resolution thresholds in the visual periphery.

The exact location of the eye's no-parallax point is not settled. Bingham's 1993 experiments were designed on the assumption that the point of observation lies in the entrance pupil, 11 mm from the center of rotation. Krajancich, Kellnhofer and Wetzstein later measured the distance psychophysically in eight adults using an adaptation of Bingham's setup and obtained a mean of 7.29 mm (standard deviation 1.25 mm), within the expected 7 to 8 mm range, with a spread of about 3.54 mm between subjects.

Relation to other kinds of parallax

Ocular parallax is distinct from the motion parallax created by head or body movement, which a headset reproduces through positional tracking, and from the binocular disparity between the two eyes' views. It is also distinguished from pupil swim, which Krajancich and colleagues describe as variation in lens distortion as the eye rotates off axis and across the headset lens. Konrad et al. note that Kudo and Ohnishi (2000) discussed gaze-contingent optical distortions in head-mounted displays, an effect commonly known as pupil swim, and attributed them in part to ocular parallax, but did not propose ocular parallax rendering. Krajancich et al. state that their gaze-contingent rendering does not correct pupil swim, which causes its own disparity distortion, though the two corrections could be combined.

History

Konrad et al. credit the first description of ocular parallax to a paper by David Brewster in the Proceedings of the Royal Society of Edinburgh, which they date to 1845; van Tonder and colleagues date Brewster's formal description to 1844.

In 1980, Hadani, Ishai and Gur proposed a mathematical model of monocular space perception in which changes in retinal luminance caused by involuntary eye movements are analyzed to extract a parallax field, from which the three-dimensional positions of viewed objects are reconstructed. In 1986, Alistair Mapp and Hiroshi Ono described the "rhino-optical phenomenon": because the nodal point and the center of rotation do not coincide, targets near the limit of the nasal visual field disappear behind the nose when the eye turns to look at them. They measured the effect in six adults and proposed it as a classroom demonstration of ocular parallax.

Bingham's 1993 study in Vision Research used a method of adjustment to measure how much optical structure eye rotation reveals at distances up to 1 m and a forced-choice task to test predictions based on an assumed point of observation; a third experiment tested whether ocular occlusion could be used to detect the separation of surfaces in depth. Hiroaki Kudo, Noboru Ohnishi and colleagues studied ocular parallax as a monocular depth cue in conference papers from 1998 and 1999, and in 2000 they examined its role in the distortions seen in head-mounted displays.

In a 2013 paper in Perception, van Tonder, Zavagno, Sakurai and Ono wrote that ocular parallax "remains mostly unknown" among monocular depth cues and that its role in perception had not been investigated scientifically, although every eye movement induces it. They considered its possible value to people who have lost one eye, using the examples of Federico da Montefeltro, Duke of Urbino, and the Japanese warlord Date Masamune.

The effect also has a counterpart in animal vision. Pettigrew, Collin and Ott report that chameleons and the sandlance, a fish, have a wide separation between the eye's nodal point and its axis of rotation, along with other shared visual specializations for striking at prey using monocular depth judgments. Citing this work and a 1995 paper by Michael Land, Konrad et al. write that both species rely on ocular parallax to judge distance.

Ocular parallax rendering in VR

Konrad, Angelopoulos and Wetzstein presented gaze-contingent ocular parallax rendering as a talk at SIGGRAPH 2019 in Los Angeles and published the full study in ACM Transactions on Graphics in January 2020. Konrad's 2020 Stanford doctoral dissertation, "Focus and ocular parallax cues for virtual and augmented reality displays", covers both focus cues and ocular parallax.

Rendering method

A binocular eye tracker estimates the three-dimensional fixation point. From it, the renderer computes the position of each eye's front nodal point relative to that eye's center of rotation, which is offset from the midpoint between the eyes by half the interpupillary distance. The per-eye view transform gets an extra translation by the nodal-point offset, and the asymmetric off-axis projection frustum is recomputed every frame from the tracked nodal points. With the virtual image assumed to be at optical infinity, distant objects stay fixed while nearer objects shift relative to the background as the gaze moves. The authors note that, given eye tracking, the change adds no computational cost over conventional stereo rendering, and that it can be combined with other gaze-contingent methods such as foveated rendering.

The prototype was an HTC Vive Pro (1440 x 1600 pixel OLED display, 110 degree field of view, 90 Hz, about 4.58 arcminutes per pixel) fitted with a Pupil Labs binocular eye tracker running at 120 Hz with a manufacturer-reported accuracy of about 1 degree; the software was written in Unity. The authors described the system's 20 ms latency for gaze-contingent ocular parallax rendering as high.

Perceptual results

The 2020 study ran five experiments with the prototype:

Experiment	Task	Main result
Detection threshold	Six subjects compared a scene with and without ocular parallax rendering while tracking a target 15 degrees from two overlapping surfaces	Detectable at a relative distance of about 0.36 diopters, independent of the absolute distance tested (1 to 3 diopters)
Discrimination threshold	Six subjects compared two near surfaces against a background at optical infinity	Thresholds rose linearly with offset; the fit had a slope of 0.11 and an intercept of 0.38 diopters
Ordinal depth	19 subjects judged which of two textured surfaces, 1 or 2 diopters apart, was nearer in a monocular view	Correct for 48.8% and 52.6% of trials with conventional rendering; 66.7% and 75.8% with ocular parallax rendering; 60.4% and 67.4% with deliberately reversed ocular parallax
Absolute depth	Subjects reached blindly toward a virtual pencil in a stereo scene	No significant difference between rendering with and without ocular parallax
Perceptual realism	19 subjects chose which rendering gave a stronger impression of realistic depth	Ocular parallax rendering chosen over conventional rendering in 76.8% of trials; reversed ocular parallax also chosen over conventional in 75.1%

The detection threshold was about an order of magnitude lower than an acuity-based model predicted, consistent with Bingham's measurements in physical viewing conditions. The authors concluded that ocular parallax rendering is an effective ordinal depth cue but not a reliable absolute one. Because reversed rendering also helped, they suggested that the relative size of the depth-dependent image motion matters more for perceived realism than its direction, while the better ordinal scores with correct rendering pointed to some role for extra-retinal signals about eye rotation.

The paper lists headsets that already had eye tracking at the time and could support the technique, including HoloLens 2, Magic Leap One, Varjo headsets, FOVE and the HTC Vive Pro Eye.

Gaze-contingent stereo rendering

Konrad et al. found no effect of ocular parallax on absolute depth in their blind-reaching task. Krajancich, Kellnhofer and Wetzstein revisited the binocular case in a paper presented at SIGGRAPH Asia 2020. Their eye model also accounts for the angle between the eye's optical and visual axes, and they focus on the disparity errors that arise when the renderer assumes the no-parallax point sits at the center of rotation. For an interpupillary distance of 64 mm and a fixation distance of 30 cm, their model gives an effective separation between the two eyes' viewpoints as low as 62.5 mm.

On an HTC Vive Pro, whose virtual image the authors measured at about 70 cm, subjects compared stereograms rendered with fine-tuned interpupillary distance alone and with gaze-contingent rendering; the gaze-contingent version was chosen as closer to the intended 90 degree angle between two planes in 73.6% of trials at 0.3 m and 62.5% at 0.5 m, falling to a near-chance 51.4% at the 0.7 m display distance. On a first-generation Microsoft HoloLens optical see-through display, subjects judged a virtual playing card to be better aligned with a physical target under gaze-contingent rendering than under conventional rendering with a fine-tuned interpupillary distance in 96.2% of trials at 0.5 m and 71.2% at 1.0 m. The authors note that the method needs gaze tracking but not extreme accuracy, since a 1 degree differential tracking error at 1 m produces a disparity error of 12 arcseconds, while latency is the harder constraint because a delayed update could produce visible jumps in disparity.

Latency and binocular fusion

Later research focused on latency. In a poster paper for IEEE VR 2023 in Shanghai, Yuri Mikawa, Masahiro Fujiwara, Yasutoshi Makino and Hiroyuki Shinoda built an ocular parallax rendering device running at 1,000 frames per second with an average latency of 4.072 ms, and reported that it improved binocular fusion of random-dot stereograms.

Mikawa, by then a research associate at NTT Communication Science Laboratories, and Taiki Fukiage followed with a 2024 paper in IEEE Transactions on Visualization and Computer Graphics, presented at IEEE VR 2024 in Orlando on 21 March 2024. Their system rendered at 360 Hz with 4.8 ms latency using a custom-built eye tracker, with stereo cameras tracking each eye and an anaglyph stereoscopic display in front of the subject. In binocular viewing, ocular parallax rendering was perceived as significantly less stable than conventional rendering once latency exceeded 43.72 ms at 1.3 diopters and 21.50 ms at 2.0 diopters. With latency minimized, the rendering enhanced binocular fusion but had a limited effect on monocular depth perception under free viewing.

Displays that reproduce ocular parallax optically

Konrad et al. note that, apart from rendering, the only display types described in the literature that inherently provide ocular parallax are near-eye multifocal displays, light field displays and holographic displays, although the effect had not been studied in any of them. In multifocal displays it can be undesirable because it exposes misalignment between the image planes; a 2017 multifocal design by Mercier and colleagues removed the cue by shifting the decomposed layers according to the tracked pupil position. Krajancich et al. add that light field and holographic headsets can in principle provide natural parallax within their eye box, but that the eye boxes of holographic displays at the time were too small to support a significant range of eye rotation.

In a 2024 study of computer-generated holography on a holographic near-eye display testbed, Kim, Nam, Choi, Seo, Wetzstein and Jeong found that holograms incorporating parallax cues consistently outperformed other target-content formats for perceived 3D realism. They chose a scene depth range over which, by the Konrad et al. model, the induced ocular parallax exceeds the minimal angular resolution of the fovea.

Applications in VR and AR

Most current headsets present the image at a single fixed focal distance; Konrad et al. give about 1.3 m for the Oculus Rift and about 2 m for the first Microsoft HoloLens. Under those conditions, and without depth-of-field rendering, ocular parallax is not masked by defocus blur, so it is limited mainly by peripheral acuity and motion sensitivity. The proposed uses are:

• Depth realism in eye-tracked VR headsets. Konrad et al. suggest ocular parallax rendering could become a standard part of the graphics pipeline of eye-tracked near-eye displays, alongside foveated rendering.
• Registration in optical see-through AR. Because users compare rendered objects with the real world, Konrad et al. argue that cue consistency may matter more in AR than in VR, and Krajancich et al. measured better virtual-to-physical alignment at near distances with gaze-contingent stereo rendering; they name AR-assisted surgery, maintenance and training as near-field tasks that could benefit.
• Gaze-based interaction. Konrad et al. suggest that an amplified version of the effect could serve as a hands-free user interface for moving objects or navigating virtual environments.

The open problems named in the research are eye-tracking latency and accuracy, the uncertain location of the eye's center of projection, and variation between users. Konrad et al. suggest that a per-user calibration of the distance between the centers of rotation and projection could further increase perceptual realism; Krajancich et al. see value in accounting for individual variation but call it impractical for now because the distance is difficult to measure.

See also

• Parallax
• Depth perception
• Eye tracking
• Gaze-contingent depth of field
• Pupil swim
• Vergence-accommodation conflict
• Varifocal display
• Peripheral vision