Jump to content

Lens array: Difference between revisions

No edit summary
No edit summary
 
(7 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Lens array in virtual and augmented reality =
{{see also|Terms|Technical Terms}}
[[Lens array]]s are two-dimensional arrangements of many small lenses (often [[Microlens arrays]]) that manipulate [[light fields]] for imaging or display. In [[Virtual reality]] (VR) and [[Augmented reality]] (AR) systems, lens arrays serve two broad roles: as '''display optics''' that create 3D or light-field images, and as '''sensor optics''' that capture directional light for depth and eye tracking. In displays, lens arrays enable multi-view and focal-plane rendering (e.g. light-field displays or integral imaging) by splitting the image into many sub-images corresponding to different angles or depths.<ref name="Li2019"></ref><ref name="Ng2005"></ref> In sensing, microlens-based ''plenoptic'' or light-field cameras capture the full 4D light field, allowing computational refocusing and depth estimation.<ref name="Ng2005" /> <ref name="Yang2018"></ref> Modern VR/AR prototypes leverage microlens arrays, [[Light field display]] techniques, [[Integral imaging]], holographic waveguide couplers, and specialized lens-array modules for eye tracking and depth sensing. These components appear in devices such as wide-FOV near-eye displays and optical see-through [[Head-mounted display]]s.


Lens arrays are two-dimensional arrangements of many small lenses (often [[Microlens array]]s) that manipulate light fields for imaging or display. In [[Virtual reality]] (VR) and [[Augmented reality]] (AR) systems, lens arrays serve two broad roles: as '''display optics''' that create 3D or light-field images, and as '''sensor optics''' that capture directional light for depth and eye tracking. In displays, lens arrays enable multi-view and focal-plane rendering (e.g. light-field displays or integral imaging) by splitting the image into many sub-images corresponding to different angles or depths.<ref name="Li2019">Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref><ref name="Ng2005">Ng R, Levoy M, Brédif M, et al. Light field photography with a hand-held plenoptic camera. Computer Science Technical Report. 2005;2(11):1-11.</ref> In sensing, microlens-based ''plenoptic'' or light-field cameras capture the full 4D light field, allowing computational refocusing and depth estimation.<ref name="Ng2005" /> <ref name="Yang2018">Yang L, Guo Y. Eye tracking using a light field camera on a head-mounted display. US Patent Application US20180173303A1. 2018 Jun 21.</ref> Modern VR/AR prototypes leverage microlens arrays, [[Light field display]] techniques, [[Integral imaging]], holographic waveguide couplers, and specialized lens-array modules for eye tracking and depth sensing. These components appear in devices such as wide-FOV near-eye displays and optical see-through [[Head-mounted display]]s.
==History==
 
Lens-array technology traces back over a century. Gabriel Lippmann first proposed "integral photography" in 1908, capturing 3D scenes via a lens grid.<ref name="Li2019" /> Early implementations used pinhole arrays (circa 1911) and later simple microlens plates (around 1948) to record and replay light fields.<ref name="Li2019" /> In the mid-20th century, lenticular (cylindrical lens) sheets became popular for autostereoscopic prints and displays (e.g. 3D postcards and packaging), providing separate views for each eye. By the 2000s, advances in digital displays and microfabrication revived lens-array research for head-worn displays. For example, smartphone-scale integral imaging was demonstrated by pairing a display with a matching MLA.<ref name="Li2019" /> In recent years, VR/AR research has produced thin, wide-FOV near-eye displays using sophisticated lens arrays (e.g. polarization optics or metasurfaces)<ref name="Shin2023"></ref>, as well as compact eye-tracking and depth cameras using microlens arrays.<ref name="Yang2018" /><ref name="Microsoft2020"></ref>
== History ==
 
Lens-array technology traces back over a century. Gabriel Lippmann first proposed "integral photography" in 1908, capturing 3D scenes via a lens grid.<ref name="Li2019" /> Early implementations used pinhole arrays (circa 1911) and later simple microlens plates (around 1948) to record and replay light fields.<ref name="Li2019" /> In the mid-20th century, lenticular (cylindrical lens) sheets became popular for autostereoscopic prints and displays (e.g. 3D postcards and packaging), providing separate views for each eye. By the 2000s, advances in digital displays and microfabrication revived lens-array research for head-worn displays. For example, smartphone-scale integral imaging was demonstrated by pairing a display with a matching MLA.<ref name="Li2019" /> In recent years, VR/AR research has produced thin, wide-FOV near-eye displays using sophisticated lens arrays (e.g. polarization optics or metasurfaces)<ref name="Shin2023">Shin G, Lee Y, Kim J, et al. Field of view and angular-resolution enhancement in microlens array type virtual reality near-eye display using polarization grating. PubMed. 2023;39876217.</ref>, as well as compact eye-tracking and depth cameras using microlens arrays.<ref name="Yang2018" /><ref name="Microsoft2020">Microsoft. Camera comprising lens array. Patent Nweon. 2020;30768.</ref>


== Types of lens arrays ==
== Types of lens arrays ==
Line 11: Line 9:
Lens arrays in VR/AR come in several varieties:
Lens arrays in VR/AR come in several varieties:


'''Spherical microlens arrays:''' Regular arrays of small convex (often spherical or aspheric) lenses. These planar MLAs are common for light-field displays and cameras. Pitch (spacing) can range from tens of micrometers (in cameras) up to a few millimeters (in HMD displays).<ref name="Wei2023">Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref><ref name="Jang2021">Jang C, Bang K, Asaduzzaman A, Lee S, Lee B. Three-dimensional see-through augmented-reality display system using a holographic micromirror array. Applied Optics. 2021;60(25):7545-7553.</ref> Each lenslet has a focal length chosen to suit the application (e.g. to collimate a display or focus on a sensor).
'''Spherical microlens arrays:''' Regular arrays of small convex (often spherical or aspheric) lenses. These planar MLAs are common for light-field displays and cameras. Pitch (spacing) can range from tens of micrometers (in cameras) up to a few millimeters (in HMD displays).<ref name="Wei2023"></ref><ref name="Jang2021"></ref> Each lenslet has a focal length chosen to suit the application (e.g. to collimate a display or focus on a sensor).


'''Lenticular arrays:''' Arrays of cylindrical microlenses (lenticules) arranged one-dimensionally or two-dimensionally. These produce multiple horizontal viewing zones in glasses-free 3D displays. For example, a lenticular lens array can restrict the exit pupil to certain angles, enabling light-field panels that show different images to each eye.<ref name="Balogh2023">Balogh T, Nagy Z, Kerbel I, et al. Directional and Eye-Tracking Light Field Display with Efficient Rendering and Illumination. PMC. 2023;10385613.</ref> Such arrays are widely used in glasses-free 3D signage and have been adapted to VR/AR light-field display prototypes.
'''Lenticular arrays:''' Arrays of cylindrical microlenses (lenticules) arranged one-dimensionally or two-dimensionally. These produce multiple horizontal viewing zones in glasses-free 3D displays. For example, a lenticular lens array can restrict the exit pupil to certain angles, enabling light-field panels that show different images to each eye.<ref name="Balogh2023"></ref> Such arrays are widely used in glasses-free 3D signage and have been adapted to VR/AR light-field display prototypes.


'''Holographic optical element (HOE) arrays:''' These use diffractive hologram patterns that act like an array of lenses. In AR waveguide combiners, ''lens-array holographic optical elements'' have been used to form 2D/3D transparent display screens.<ref name="Liu2012">Liu YS, Kuo CY, Hwang CC, et al. Two-dimensional and three-dimensional see-through screen using holographic optical elements. Digital Holography and Three-Dimensional Imaging. 2012;DM2C.6.</ref> A HOE can replace a physical lens array by encoding lens behavior into a recorded interference pattern. In one prototype, a ''lens-array HOE'' was created to build a see-through AR screen.<ref name="Liu2012" /> Other works use holographic micromirror arrays in conjunction with MLAs to couple images into waveguides.<ref name="Jang2021" />
'''Holographic optical element (HOE) arrays:''' These use diffractive hologram patterns that act like an array of lenses. In AR waveguide combiners, ''lens-array holographic optical elements'' have been used to form 2D/3D transparent display screens.<ref name="Liu2012"></ref> A HOE can replace a physical lens array by encoding lens behavior into a recorded interference pattern. In one prototype, a ''lens-array HOE'' was created to build a see-through AR screen.<ref name="Liu2012" /> Other works use holographic micromirror arrays in conjunction with MLAs to couple images into waveguides.<ref name="Jang2021" />


'''Liquid crystal / tunable lens arrays:''' Some arrays use liquid crystal (LC) or fluidic lenses whose optical power can be electronically changed. For example, a chiral (polarization-sensitive) LC lens array was demonstrated in an AR system to steer light and break conventional FOV limits.<ref name="Wei2023" /> Variable-focus MLAs can allow dynamic focus adjustment or multi-focal displays.
'''Liquid crystal / tunable lens arrays:''' Some arrays use liquid crystal (LC) or fluidic lenses whose optical power can be electronically changed. For example, a chiral (polarization-sensitive) LC lens array was demonstrated in an AR system to steer light and break conventional FOV limits.<ref name="Wei2023" /> Variable-focus MLAs can allow dynamic focus adjustment or multi-focal displays.
Line 35: Line 33:
'''Focal cueing and depth enhancement:''' Some VR/AR displays incorporate multiple lens arrays for depth/focus manipulation. For instance, a light-field HMD may use two stacked MLA arrays (a so-called dual-focal arrangement) to enlarge the depth range so that virtual objects at different distances can appear simultaneously in focus. Polarization or liquid crystal arrays have been used to switch between focus planes. These advanced architectures aim to overcome the vergence-accommodation mismatch by aligning virtual image focus with convergence.
'''Focal cueing and depth enhancement:''' Some VR/AR displays incorporate multiple lens arrays for depth/focus manipulation. For instance, a light-field HMD may use two stacked MLA arrays (a so-called dual-focal arrangement) to enlarge the depth range so that virtual objects at different distances can appear simultaneously in focus. Polarization or liquid crystal arrays have been used to switch between focus planes. These advanced architectures aim to overcome the vergence-accommodation mismatch by aligning virtual image focus with convergence.


== Applications in sensing ==
==Applications in sensing==
 
'''Light-field (plenoptic) cameras for depth and eye tracking:''' Lens arrays are fundamental to plenoptic imaging. Placing an MLA a focal distance in front of an image sensor allows each micro-image to capture rays from different angles.<ref name="Ng2005" /> This effectively samples the full 4D light field of the scene. With computational processing, one can refocus the image after capture or compute depth maps from parallax between the micro-images.<ref name="Ng2005" /> In VR/AR, this is useful both for external depth sensing (scene reconstruction) and internal eye imaging. For example, patents describe using a light-field camera (with MLA) inside an HMD to capture the user's eye. The captured plenoptic data lets the system digitally refocus on various eye regions and compute gaze direction without needing precise IR glints.<ref name="Yang2018" /> This relaxes the geometric constraints on eye-tracker placement. Thus, microlens-based light-field cameras can support both environmental mapping and fine eye tracking in headsets.
'''Light-field (plenoptic) cameras for depth and eye tracking:''' Lens arrays are fundamental to plenoptic imaging. Placing an MLA a focal distance in front of an image sensor allows each micro-image to capture rays from different angles.<ref name="Ng2005" /> This effectively samples the full 4D light field of the scene. With computational processing, one can refocus the image after capture or compute depth maps from parallax between the micro-images.<ref name="Ng2005" /> In VR/AR, this is useful both for external depth sensing (scene reconstruction) and internal eye imaging. For example, patents describe using a light-field camera (with MLA) inside an HMD to capture the user's eye. The captured plenoptic data lets the system digitally refocus on various eye regions and compute gaze direction without needing precise IR glints.<ref name="Yang2018" /> This relaxes the geometric constraints on eye-tracker placement. Thus, microlens-based light-field cameras can support both environmental mapping and fine eye tracking in headsets.


Line 43: Line 40:
'''Depth sensors:''' Outside of full light-field cameras, some depth-sensing concepts also use microlenses. One approach is a multi-aperture structured-light projector: an array of tiny beams (formed by a lens array) projects a coded IR pattern for depth triangulation. Another is embedding micro-lenses over depth-sensing pixels to increase fill factor or directivity. In practice, however, most time-of-flight and stereo cameras in VR/AR do not use discrete lens arrays (they use single large lenses or laser projectors). The main use of lens arrays in sensing is thus in light-field capture (including gaze capture) rather than typical ToF or stereo modules.
'''Depth sensors:''' Outside of full light-field cameras, some depth-sensing concepts also use microlenses. One approach is a multi-aperture structured-light projector: an array of tiny beams (formed by a lens array) projects a coded IR pattern for depth triangulation. Another is embedding micro-lenses over depth-sensing pixels to increase fill factor or directivity. In practice, however, most time-of-flight and stereo cameras in VR/AR do not use discrete lens arrays (they use single large lenses or laser projectors). The main use of lens arrays in sensing is thus in light-field capture (including gaze capture) rather than typical ToF or stereo modules.


== Technical specifications ==
==Technical specifications==
Lens-array designs involve several key parameters:


Lens-array designs involve several key parameters:
'''Lens pitch (size):''' The center-to-center spacing of the lenslets. Near-eye display lens pitches are often on the order of 0.5–3 mm. For example, a wide-FOV scanning AR prototype used a "chiral" LC lens array of 8×15 lenses with 2 mm pitch.<ref name="Wei2023" /> An AR waveguide coupler in another system used spherical lenslets with 1 mm pitch.<ref name="Jang2021" /> Plenoptic camera MLAs, by contrast, have much finer pitch (tens to hundreds of µm) to densely sample the image plane. Pitch determines the tradeoff between image resolution and angular coverage: smaller pitch yields higher angular resolution (more sub-aperture views) but collects less light per lens.


'''Lens pitch (size):''' The center-to-center spacing of the lenslets. Near-eye display lens pitches are often on the order of 0.5–3 mm. For example, a wide-FOV scanning AR prototype used a "chiral" LC lens array of 8×15 lenses with 2 mm pitch.<ref name
'''Focal length and f-number:''' Each lenslet's focal length sets the viewing frustum of that micro-aperture. Low f-number (wide aperture) means a large view angle per lens, which broadens the overall FOV of the system. In the scanning waveguide example, the 2 mm lenslets had an f-number of about 0.41 at 639 nm.<ref name="Wei2023" /> In designs, the focal length is often chosen to collimate or focus light from the display panel to the eye (in displays) or from the scene to the sensor (in cameras). Mismatches in focal length across the array can create blurring or depth errors.


'''Aperture shape and fill factor:''' Lenslets may be round or hexagonal. Hexagonal or honeycomb layouts can achieve near-100% fill factor (no dead zones) which maximizes brightness. Fill-factor and uniformity are critical: any gap between lenses can cause vignetting or loss of resolution. In fabrication, arrays are usually molded or imprinted in photoresist, and then replicated in glass or plastic.
'''Aperture shape and fill factor:''' Lenslets may be round or hexagonal. Hexagonal or honeycomb layouts can achieve near-100% fill factor (no dead zones) which maximizes brightness. Fill-factor and uniformity are critical: any gap between lenses can cause vignetting or loss of resolution. In fabrication, arrays are usually molded or imprinted in photoresist, and then replicated in glass or plastic.


'''Resolution and eye-box:''' The number of lenses across an HMD display determines how many views can be presented. Each lens typically covers a few hundred display pixels. Alignment is crucial: each sub-image must align to the user's eye position. Systems often include pupil steering (moving images to follow the eye) to maintain the eye-box. In the aforementioned scanning AR system<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>, the wide-FOV was achieved by a large lens array, but the resulting resolution per view was low because the 2 mm pitch limited how many sub-images could be rendered.
'''Resolution and eye-box:''' The number of lenses across an HMD display determines how many views can be presented. Each lens typically covers a few hundred display pixels. Alignment is crucial: each sub-image must align to the user's eye position. Systems often include pupil steering (moving images to follow the eye) to maintain the eye-box. In the aforementioned scanning AR system<ref name="Wei2023" />, the wide-FOV was achieved by a large lens array, but the resulting resolution per view was low because the 2 mm pitch limited how many sub-images could be rendered.


'''Chromatic and optical aberrations:''' Simple refractive lenslets suffer from chromatic dispersion (different focal lengths per wavelength). As noted in integral imaging, chromatic aberration in MLAs "reduces viewing quality".<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> This is especially problematic for full-color displays. Achromatic doublet designs or advanced metalens lenses can correct this, but add complexity. Spherical aberration and field curvature within each lenslet also degrade sharpness if not carefully managed.
'''Chromatic and optical aberrations:''' Simple refractive lenslets suffer from chromatic dispersion (different focal lengths per wavelength). As noted in integral imaging, chromatic aberration in MLAs "reduces viewing quality".<ref name="Li2019" /> This is especially problematic for full-color displays. Achromatic doublet designs or advanced metalens lenses can correct this, but add complexity. Spherical aberration and field curvature within each lenslet also degrade sharpness if not carefully managed.


'''Materials and manufacturing:''' Lens arrays are typically made in glass, plastic or polymer (e.g. PMMA, silicone) for refractive types. Holographic HOEs are recorded in photopolymers (e.g. Bayfol HX). Metasurface MLAs use high-index nanostructures (e.g. TiO₂) on a substrate.<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> Manufacturing tolerances (surface roughness, lens height accuracy) critically affect performance. For example, a 1 µm error in a microlens height could shift focus by hundreds of micrometers.
'''Materials and manufacturing:''' Lens arrays are typically made in glass, plastic or polymer (e.g. PMMA, silicone) for refractive types. Holographic HOEs are recorded in photopolymers (e.g. Bayfol HX). Metasurface MLAs use high-index nanostructures (e.g. TiO₂) on a substrate.<ref name="Li2019" /> Manufacturing tolerances (surface roughness, lens height accuracy) critically affect performance. For example, a 1 µm error in a microlens height could shift focus by hundreds of micrometers.


Overall, the technical design of a lens array involves a trade-off between FOV, resolution, brightness, and physical thickness. Emerging approaches like metalens arrays promise thinner optics with engineered dispersion<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref><ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref>, which may shift these trade-offs in future systems.
Overall, the technical design of a lens array involves a trade-off between FOV, resolution, brightness, and physical thickness. Emerging approaches like metalens arrays promise thinner optics with engineered dispersion<ref name="Li2019" />, which may shift these trade-offs in future systems.
 
== Challenges ==


==Challenges==
Lens-array components face several challenges in VR/AR:
Lens-array components face several challenges in VR/AR:


'''FoV–Resolution trade-off:''' Expanding the user's field of view typically requires more lenslets or larger lens aperture, but this reduces the angular (and thus spatial) resolution per view. Shin ''et al.'' showed that using a polarization grating could enlarge an MLA display's FoV from ~59° to 95°, but this was at the expense of needing sophisticated polarization control.<ref>Shin G, Lee Y, Kim J, et al. Field of view and angular-resolution enhancement in microlens array type virtual reality near-eye display using polarization grating. PubMed. 2023;39876217.</ref> In many designs, improving one parameter (like FoV or brightness) degrades another.
'''FoV–Resolution trade-off:''' Expanding the user's field of view typically requires more lenslets or larger lens aperture, but this reduces the angular (and thus spatial) resolution per view. Shin ''et al.'' showed that using a polarization grating could enlarge an MLA display's FoV from ~59° to 95°, but this was at the expense of needing sophisticated polarization control.<ref name="Shin2023" /> In many designs, improving one parameter (like FoV or brightness) degrades another.


'''Chromatic aberration and color mixing:''' As noted earlier, MLAs inherently blur different colors unless achromatized. Achieving full-color images through a simple lens array is difficult.<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> Some systems use color filter arrays or sequential-color illumination to mitigate this, but this adds complexity and can reduce brightness.
'''Chromatic aberration and color mixing:''' As noted earlier, MLAs inherently blur different colors unless achromatized. Achieving full-color images through a simple lens array is difficult.<ref name="Li2019" /> Some systems use color filter arrays or sequential-color illumination to mitigate this, but this adds complexity and can reduce brightness.


'''Crosstalk and ghosting:''' In multi-view displays, the images for adjacent views must not overlap. Small misalignments or imperfections cause crosstalk, where one eye sees part of the image intended for the other. This degrades 3D effect. In holographic see-through designs, incomplete isolation can cause ghost images of virtual content. Accurate fabrication and calibration are needed to minimize these artifacts.
'''Crosstalk and ghosting:''' In multi-view displays, the images for adjacent views must not overlap. Small misalignments or imperfections cause crosstalk, where one eye sees part of the image intended for the other. This degrades 3D effect. In holographic see-through designs, incomplete isolation can cause ghost images of virtual content. Accurate fabrication and calibration are needed to minimize these artifacts.


'''Eye-box and alignment:''' For near-eye applications, the exit pupil (eye-box) must accommodate user movement. Simple lens arrays can produce small, fixed eye-boxes. Techniques like eye-tracking (to move the image) or pupil duplication (multiple layered arrays) are required to ensure a reasonable viewing region. The scanning waveguide example noted that despite a wide FoV, the eye-box remained limited, and they attributed low resolution partly to the relatively large 2 mm lens pitch<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref> (larger pitch reduced how finely the eye-box could be sampled).
'''Eye-box and alignment:''' For near-eye applications, the exit pupil (eye-box) must accommodate user movement. Simple lens arrays can produce small, fixed eye-boxes. Techniques like eye-tracking (to move the image) or pupil duplication (multiple layered arrays) are required to ensure a reasonable viewing region. The scanning waveguide example noted that despite a wide FoV, the eye-box remained limited, and they attributed low resolution partly to the relatively large 2 mm lens pitch<ref name="Wei2023" /> (larger pitch reduced how finely the eye-box could be sampled).


'''Optical efficiency:''' Each optical surface, grating, or holographic element can introduce loss. Adding an array of lenslets means more surfaces and potential Fresnel reflections. Diffractive elements (gratings, HOEs) often have limited efficiency bandwidth. Ensuring enough brightness in the final image is a common design hurdle, especially for battery-powered displays.
'''Optical efficiency:''' Each optical surface, grating, or holographic element can introduce loss. Adding an array of lenslets means more surfaces and potential Fresnel reflections. Diffractive elements (gratings, HOEs) often have limited efficiency bandwidth. Ensuring enough brightness in the final image is a common design hurdle, especially for battery-powered displays.
Line 75: Line 72:
'''Manufacturing scale and cost:''' Large, high-quality MLAs (especially with small lenslets) are challenging to produce over large areas. Holographic and metasurface arrays often require cleanroom fabrication. For consumer VR/AR, cost-effective replication (e.g. using nanoimprint or injection molding) is crucial but may not yet match the performance of lab prototypes.
'''Manufacturing scale and cost:''' Large, high-quality MLAs (especially with small lenslets) are challenging to produce over large areas. Holographic and metasurface arrays often require cleanroom fabrication. For consumer VR/AR, cost-effective replication (e.g. using nanoimprint or injection molding) is crucial but may not yet match the performance of lab prototypes.


== Future developments ==
==Future developments==


Research on lens-array technology is advancing rapidly. '''Adaptive optics''' will likely play a growing role. Arrays of liquid-crystal or shape-changing lenses could allow dynamic focus control and multi-focal displays (reducing vergence-accommodation conflict). Similarly, '''dynamic wavelength control''' (e.g. polarization or tunable filters in each lenslet) could enable spatiotemporal multiplexing for color and focus.
Research on lens-array technology is advancing rapidly. '''Adaptive optics''' will likely play a growing role. Arrays of liquid-crystal or shape-changing lenses could allow dynamic focus control and multi-focal displays (reducing vergence-accommodation conflict). Similarly, '''dynamic wavelength control''' (e.g. polarization or tunable filters in each lenslet) could enable spatiotemporal multiplexing for color and focus.


'''Metasurfaces and flat optics''' are a major trend. Recent work has demonstrated ''achromatic metasurface waveguides'' for AR: for example, a 2025 Light:Science &Apps paper introduced inverse-designed metasurface couplers that eliminate chromatic aberration across the full visible spectrum and achieve ~45° FOV.<ref>An achromatic metasurface waveguide for augmented reality displays. Light Sci Appl. 2025;41377-025-01761.</ref> These metasurface lens arrays are ultrathin and could replace bulky refractive MLAs in future headsets. Cholesteric liquid-crystal metasurface (chiral) lens arrays have already been used to break the field-of-view limit in a scanning AR display.<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>
'''Metasurfaces and flat optics''' are a major trend. Recent work has demonstrated ''achromatic metasurface waveguides'' for AR: for example, a 2025 Light:Science &Apps paper introduced inverse-designed metasurface couplers that eliminate chromatic aberration across the full visible spectrum and achieve ~45° FOV.<ref name="Achromatic2025"></ref> These metasurface lens arrays are ultrathin and could replace bulky refractive MLAs in future headsets. Cholesteric liquid-crystal metasurface (chiral) lens arrays have already been used to break the field-of-view limit in a scanning AR display.<ref name="Wei2023" />


'''Integration and compute-optics co-design''' will improve performance. Headsets may co-optimize lens arrays with on-sensor processing. For instance, a microlens array camera could perform onboard refocusing or eye-pose estimation in hardware. Conversely, display side, algorithms could pre-distort images to compensate residual lens aberrations.
'''Integration and compute-optics co-design''' will improve performance. Headsets may co-optimize lens arrays with on-sensor processing. For instance, a microlens array camera could perform onboard refocusing or eye-pose estimation in hardware. Conversely, display side, algorithms could pre-distort images to compensate residual lens aberrations.
Line 85: Line 82:
'''Higher-density arrays''' and '''monolithic fabrication''' may emerge. Advances in 3D printing and nanoimprint lithography could yield integrated "optical wafers" combining display and MLA. Also, developments in holographic printing may allow recording complex lens-array HOEs on demand.
'''Higher-density arrays''' and '''monolithic fabrication''' may emerge. Advances in 3D printing and nanoimprint lithography could yield integrated "optical wafers" combining display and MLA. Also, developments in holographic printing may allow recording complex lens-array HOEs on demand.


In sensing, ''light-field cameras'' in miniaturized form will likely become standard in AR glasses for robust gaze and hand tracking, thanks to the flexibility demonstrated in patents and prototypes.<ref>Yang L, Guo Y. Eye tracking using a light field camera on a head-mounted display. US Patent Application US20180173303A1. 2018 Jun 21.</ref><ref>Microsoft. Camera comprising lens array. Patent Nweon. 2020;30768.</ref>
In sensing, ''light-field cameras'' in miniaturized form will likely become standard in AR glasses for robust gaze and hand tracking, thanks to the flexibility demonstrated in patents and prototypes.<ref name="Yang2018" /><ref name="Microsoft2020" />
 
As VR/AR systems aim for wider FOV, thinner form factors, and better realism, custom lens-array designs will continue to evolve. Each new generation of headsets (for example, employing pancake optics, multi-zone optics, or holographic waveguides) tends to reinvigorate lens-array innovation. In sum, lens arrays remain a key enabling technology for immersive displays and interactive sensing, with ongoing research focusing on mitigating their limitations and leveraging novel materials and computation.<ref name="Achromatic2025" /><ref name="Wei2023" />


As VR/AR systems aim for wider FOV, thinner form factors, and better realism, custom lens-array designs will continue to evolve. Each new generation of headsets (for example, employing pancake optics, multi-zone optics, or holographic waveguides) tends to reinvigorate lens-array innovation. In sum, lens arrays remain a key enabling technology for immersive displays and interactive sensing, with ongoing research focusing on mitigating their limitations and leveraging novel materials and computation.<ref>An achromatic metasurface waveguide for augmented reality displays. Light Sci Appl. 2025;41377-025-01761.</ref><ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>
==References==
<references>
<ref name="Li2019">Li, X.; Chen, L.; Li, Y.; <i>et al.</i> “A Broadband Achromatic Metalens Array for Integral Imaging in the Visible.” ''Light: Science &amp; Applications'' <b>8</b>, 99 (2019). https://doi.org/10.1038/s41377‑019‑0197‑4</ref>
<ref name="Ng2005">Ng, R.; Levoy, M.; Brédif, M.; <i>et al.</i> “Light Field Photography with a Hand‑Held Plenoptic Camera.” Stanford CSTR 2005‑02 (2005). http://graphics.stanford.edu/papers/lfcamera/</ref>
<ref name="Yang2018">Yang, L.; Guo, Y. “Eye Tracking Using a Light Field Camera on a Head‑Mounted Display.” US Patent Application <b>US 2018/0173303 A1</b>, 21 June 2018.</ref>
<ref name="Shin2023">Shin, K‑S.; Hong, J.; Han, W.; Park, J‑H. “Field of View and Angular‑Resolution Enhancement in Microlens‑Array‑Type VR Near‑Eye Display Using Polarization Grating.” ''Optics Express'' <b>33</b>(1): 263‑278 (2025). https://doi.org/10.1364/OE.546812</ref>
<ref name="Microsoft2020">Microsoft Technology Licensing LLC. “Camera Comprising Lens Array.” US Patent Application <b>US 2023/0319428 A1</b>, 5 October 2023.</ref>
<ref name="Wei2023">Weng, Y.; Zhang, Y.; Wang, W.; <i>et al.</i> “High‑Efficiency and Compact Two‑Dimensional Exit Pupil Expansion Design for Diffractive Waveguide Based on Polarization Volume Grating.” ''Optics Express'' <b>31</b>(4): 6601‑6614 (2023). https://doi.org/10.1364/OE.482447</ref>
<ref name="Jang2021">Darkhanbaatar, N.; Erdenebat, M‑U.; Shin, C‑W.; <i>et al.</i> “Three‑Dimensional See‑Through Augmented‑Reality Display System Using a Holographic Micromirror Array.” ''Applied Optics'' <b>60</b>(25): 7545‑7551 (2021). https://doi.org/10.1364/AO.428364</ref>
<ref name="Balogh2023">Zhang, G.; He, Y.; Liang, H.; <i>et al.</i> “Directional and Eye‑Tracking Light Field Display with Efficient Rendering and Illumination.” ''Micromachines'' <b>14</b>(7): 1465 (2023). https://doi.org/10.3390/mi14071465</ref>
<ref name="Liu2012">Hong, K.; Hong, J.; Yeom, J.; Lee, B. “Two‑Dimensional and Three‑Dimensional See‑Through Screen Using Holographic Optical Elements.” In <i>Digital Holography and Three‑Dimensional Imaging 2012</i>, paper DM2C.6. Optical Society of America (2012). https://doi.org/10.1364/DH.2012.DM2C.6</ref>
<ref name="Achromatic2025">Tian, Z.; Zhu, X.; Surman, P.; <i>et al.</i> “An Achromatic Metasurface Waveguide for Augmented Reality Displays.” ''Light: Science &amp; Applications'' <b>14</b>, 94 (2025). https://doi.org/10.1038/s41377‑025‑01761‑w</ref>
</references>


== References ==
{{reflist}}


[[Category:Terms]]
[[Category:Technical Terms]]
[[Category:Virtual reality]]
[[Category:Virtual reality]]
[[Category:Augmented reality]]
[[Category:Augmented reality]]
[[Category:Optical devices]]
[[Category:Optical devices]]
[[Category:Display technology]]
[[Category:Display technology]]