Retina

The retina is the light-sensitive layer of neural tissue that lines the inner back surface of the vertebrate eye. It converts incoming light into electrical and chemical signals that travel through the optic nerve to the brain, where they are interpreted as vision. Its non-uniform structure, with sharp central vision concentrated in a tiny region called the fovea and rapidly declining acuity toward the periphery, is the biological constraint that shapes much of how virtual reality (VR) and augmented reality (AR) display hardware is designed and how it is rated.

The retina is relevant to VR and AR in several distinct ways. The angular density of its central photoreceptors sets the practical resolution target for head-mounted displays, usually expressed in pixels per degree; the steep falloff of acuity away from the fovea is the principle behind foveated rendering; and the idea of writing an image straight onto the retina with a scanned light beam, rather than through a panel and lens, underlies virtual retinal display technology.

Structure

The retina is the innermost of the three main layers at the back of the eyeball, lying inside the vascular choroid and the fibrous sclera. It is organized into multiple cell layers. Light passes through the transparent inner layers before reaching the photoreceptor cells (rods and cones) at the outer surface; the photoreceptors pass signals to bipolar cells, which connect to ganglion cells whose axons gather at the optic disc and leave the eye as the optic nerve. Behind the photoreceptors, the retinal pigment epithelium (RPE) supports them, forms part of the blood-retinal barrier, and recycles the light-sensitive pigments.

Two specialized regions matter most for image quality. The macula is the central area of the retina with the highest visual acuity, and within it the fovea centralis, an avascular pit roughly 1.5 mm across, contains the densest packing of cone cells anywhere in the retina. The optic disc, where ganglion-cell axons exit, has no photoreceptors at all and produces the natural blind spot in each eye's visual field.

Photoreceptors and acuity

The retina contains two classes of photoreceptor. Cones operate in bright light (photopic vision) and mediate color discrimination; rods are far more sensitive and handle dim-light (scotopic) vision but do not distinguish color. Their spatial distribution is highly uneven. Cones are concentrated at the fovea, while rods are absent from the central foveola and reach their highest density in a ring around the fovea.

Counts in the literature vary with the counting method and the individual. A widely cited classical figure is roughly 120 million rods and about 6 million cones per retina, while the topographic study by Curcio and colleagues measured an average of about 4.6 million cones in adult human retinas. That same study found peak foveal cone density averaging about 199,000 cones per square millimeter, with large variation between people (roughly 100,000 to 324,000 cones per square millimeter).

The consequence for vision is that detail resolution is extremely localized. Cone density rises almost 200-fold toward the foveal center, and visual acuity drops steeply away from it: just 6 degrees off the line of sight, acuity falls by about 75 percent. Rod density peaks in a ring at roughly 18 degrees (about 4.5 mm) from the foveal pit, which is why faint objects, such as dim stars, are easier to see slightly off-center than by looking straight at them.

Rods and cones in the human retina

Property	Cones	Rods
Vision type	Photopic (bright light), color	Scotopic (dim light), no color
Approximate count per retina	About 6 million (Curcio et al. measured ~4.6 million)	About 120 million (classical figure)
Location of peak density	Foveal center (~199,000 per mm2, Curcio et al.)	Ring at ~18 degrees (~4.5 mm) from the fovea
Central foveola	Densest packing of cones	None (rod-free)

How the retina forms an image

The eye's cornea and lens focus light onto the retina, where photoreceptors absorb photons and trigger a cascade that changes the cell's electrical state. Bipolar and ganglion cells process and relay these signals, and ganglion-cell axons carry them along the optic nerve to the visual cortex. Because only the fovea provides high-resolution input, the eye constantly makes rapid movements (saccades) to point the fovea at whatever the viewer wants to examine in detail, and the brain assembles a stable, apparently uniform scene from these samples. This combination of a small high-acuity center, a low-acuity periphery, and constant gaze redirection is what VR and AR display engineering tries to exploit and to satisfy.

Relevance to virtual and augmented reality

Retinal resolution and pixels per degree

Because acuity is concentrated at the fovea, the meaningful measure of a head-mounted display's sharpness is its angular pixel density, or pixels per degree (PPD), rather than the raw panel count; PPD is found by dividing the horizontal pixels per eye by the horizontal field of view the optics present. The figure of about 60 pixels per degree at the fovea has long been treated as the "retinal resolution" target, the density above which a person with normal vision is assumed to gain no further detail. Early consumer headsets fell far short: the Oculus DK1 reached roughly 7 PPD and the original HTC Vive about 11 PPD, while later devices such as the Meta Quest Pro reach around 22 PPD and the Varjo Aero about 35 PPD over most of its field.

The 60 PPD assumption was challenged in 2025. A study by researchers at the University of Cambridge and Meta Reality Labs, published in Nature Communications in October 2025, used a sliding-display apparatus to measure the maximum resolvable detail of foveal vision and reported limits well above the traditional value: up to about 94 PPD for black-and-white patterns, 89 PPD for red-green, and 53 PPD for yellow-violet, with some individuals resolving as high as around 120 PPD. The finding implies that headsets have further to go before reaching the eye's true limit, and that the difference in sensitivity between color channels could inform display and rendering design.

Foveated rendering

The steep falloff of retinal acuity away from the fovea is the basis of foveated rendering, a technique that renders the small region a viewer is looking at in full detail while reducing detail in the periphery, where the retina cannot resolve it. Guenter and colleagues at Microsoft Research demonstrated this in the 2012 SIGGRAPH paper "Foveated 3D Graphics," tracking the gaze point and rendering three concentric image layers of increasing angular size but decreasing sampling rate, which reduced the number of shaded pixels and accelerated rendering by a factor of about 5 to 6 on a desktop display. The same group later extended the approach to gaze-tracked VR. Because the method requires knowing where the fovea is pointed, it depends on eye tracking; headsets without gaze tracking instead use fixed foveated rendering, which lowers detail toward the edges of the panel regardless of gaze. Gaze-tracked foveation has shipped in headsets such as the PlayStation VR2.

Virtual retinal displays

A more direct use of the retina is the virtual retinal display (VRD), also called retinal scan or retinal projection display, which forms an image by scanning a low-power modulated light beam (typically red, green, and blue laser or LED light) directly onto the retina, rather than illuminating a panel viewed through magnifying optics. The technology was developed in the early 1990s by Thomas A. Furness III and Joel S. Kollin at the University of Washington's Human Interface Technology Laboratory; their patent, "Virtual retinal display" (US 5,467,104), was filed on 22 October 1992 and granted on 14 November 1995, and describes projecting photons modulated with video information straight onto the retina without forming an intermediate aerial image. Furness and colleagues described the approach for VR and for augmented vision in medicine in a 1998 paper. The University of Washington spun the work out to MicroVision, founded in 1993, which built early laser-scanning head-mounted prototypes. Retinal projection remains attractive for AR because a scanned beam can produce a bright image with a large depth of focus, though aligning the beam with the moving pupil (the eye box problem) is a continuing engineering challenge.

Other connections

Several other VR and AR concepts trace back to retinal anatomy and physiology. Eye relief and eye box design exist because the optics must deliver light to a pupil that sits in front of the retina and moves as the eye rotates. The blind spot at the optic disc is normally masked by the brain and by the other eye, so it is rarely visible in a binocular headset. Reducing motion-to-photon latency and using high refresh rates limit the smearing the retina would otherwise integrate during head motion, which contributes to comfort. The mismatch between where the eyes converge and where the lens focuses, the vergence-accommodation conflict, is defined by what the retina receives in focus versus the depth cue from eye rotation, and is a target of light field display and varifocal research.

Current status

The retina is a fixed biological reference point: its photoreceptor topography does not change with display technology, so the targets it implies (on the order of 60 PPD by the traditional measure, and higher by the 2025 Cambridge and Meta results) remain the benchmark that VR and AR optics are measured against. As of 2026 no shipping consumer headset reaches full foveal acuity across its field of view, gaze-tracked foveated rendering is available in a small number of devices, and retinal-projection displays remain mostly in research and specialized AR prototypes rather than mass-market products.