Jump to content

Lens array: Difference between revisions

No edit summary
No edit summary
Line 47: Line 47:
Lens-array designs involve several key parameters:
Lens-array designs involve several key parameters:


'''Lens pitch (size):''' The center-to-center spacing of the lenslets. Near-eye display lens pitches are often on the order of 0.5–3 mm. For example, a wide-FOV scanning AR prototype used a "chiral" LC lens array of 8×15 lenses with 2 mm pitch.<ref name
'''Lens pitch (size):''' The center-to-center spacing of the lenslets. Near-eye display lens pitches are often on the order of 0.5–3 mm. For example, a wide-FOV scanning AR prototype used a "chiral" LC lens array of 8×15 lenses with 2 mm pitch.<ref name="Wei2023" /> An AR waveguide coupler in another system used spherical lenslets with 1 mm pitch.<ref name="Jang2021" /> Plenoptic camera MLAs, by contrast, have much finer pitch (tens to hundreds of µm) to densely sample the image plane. Pitch determines the tradeoff between image resolution and angular coverage: smaller pitch yields higher angular resolution (more sub-aperture views) but collects less light per lens.
 
'''Focal length and f-number:''' Each lenslet's focal length sets the viewing frustum of that micro-aperture. Low f-number (wide aperture) means a large view angle per lens, which broadens the overall FOV of the system. In the scanning waveguide example, the 2 mm lenslets had an f-number of about 0.41 at 639 nm.<ref name="Wei2023" /> In designs, the focal length is often chosen to collimate or focus light from the display panel to the eye (in displays) or from the scene to the sensor (in cameras). Mismatches in focal length across the array can create blurring or depth errors.


'''Aperture shape and fill factor:''' Lenslets may be round or hexagonal. Hexagonal or honeycomb layouts can achieve near-100% fill factor (no dead zones) which maximizes brightness. Fill-factor and uniformity are critical: any gap between lenses can cause vignetting or loss of resolution. In fabrication, arrays are usually molded or imprinted in photoresist, and then replicated in glass or plastic.
'''Aperture shape and fill factor:''' Lenslets may be round or hexagonal. Hexagonal or honeycomb layouts can achieve near-100% fill factor (no dead zones) which maximizes brightness. Fill-factor and uniformity are critical: any gap between lenses can cause vignetting or loss of resolution. In fabrication, arrays are usually molded or imprinted in photoresist, and then replicated in glass or plastic.


'''Resolution and eye-box:''' The number of lenses across an HMD display determines how many views can be presented. Each lens typically covers a few hundred display pixels. Alignment is crucial: each sub-image must align to the user's eye position. Systems often include pupil steering (moving images to follow the eye) to maintain the eye-box. In the aforementioned scanning AR system<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>, the wide-FOV was achieved by a large lens array, but the resulting resolution per view was low because the 2 mm pitch limited how many sub-images could be rendered.
'''Resolution and eye-box:''' The number of lenses across an HMD display determines how many views can be presented. Each lens typically covers a few hundred display pixels. Alignment is crucial: each sub-image must align to the user's eye position. Systems often include pupil steering (moving images to follow the eye) to maintain the eye-box. In the aforementioned scanning AR system<ref name="Wei2023" />, the wide-FOV was achieved by a large lens array, but the resulting resolution per view was low because the 2 mm pitch limited how many sub-images could be rendered.


'''Chromatic and optical aberrations:''' Simple refractive lenslets suffer from chromatic dispersion (different focal lengths per wavelength). As noted in integral imaging, chromatic aberration in MLAs "reduces viewing quality".<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> This is especially problematic for full-color displays. Achromatic doublet designs or advanced metalens lenses can correct this, but add complexity. Spherical aberration and field curvature within each lenslet also degrade sharpness if not carefully managed.
'''Chromatic and optical aberrations:''' Simple refractive lenslets suffer from chromatic dispersion (different focal lengths per wavelength). As noted in integral imaging, chromatic aberration in MLAs "reduces viewing quality".<ref name="Li2019" /> This is especially problematic for full-color displays. Achromatic doublet designs or advanced metalens lenses can correct this, but add complexity. Spherical aberration and field curvature within each lenslet also degrade sharpness if not carefully managed.


'''Materials and manufacturing:''' Lens arrays are typically made in glass, plastic or polymer (e.g. PMMA, silicone) for refractive types. Holographic HOEs are recorded in photopolymers (e.g. Bayfol HX). Metasurface MLAs use high-index nanostructures (e.g. TiO₂) on a substrate.<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> Manufacturing tolerances (surface roughness, lens height accuracy) critically affect performance. For example, a 1 µm error in a microlens height could shift focus by hundreds of micrometers.
'''Materials and manufacturing:''' Lens arrays are typically made in glass, plastic or polymer (e.g. PMMA, silicone) for refractive types. Holographic HOEs are recorded in photopolymers (e.g. Bayfol HX). Metasurface MLAs use high-index nanostructures (e.g. TiO₂) on a substrate.<ref name="Li2019" /> Manufacturing tolerances (surface roughness, lens height accuracy) critically affect performance. For example, a 1 µm error in a microlens height could shift focus by hundreds of micrometers.


Overall, the technical design of a lens array involves a trade-off between FOV, resolution, brightness, and physical thickness. Emerging approaches like metalens arrays promise thinner optics with engineered dispersion<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref><ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref>, which may shift these trade-offs in future systems.
Overall, the technical design of a lens array involves a trade-off between FOV, resolution, brightness, and physical thickness. Emerging approaches like metalens arrays promise thinner optics with engineered dispersion<ref name="Li2019" />, which may shift these trade-offs in future systems.


== Challenges ==
== Challenges ==
Line 63: Line 65:
Lens-array components face several challenges in VR/AR:
Lens-array components face several challenges in VR/AR:


'''FoV–Resolution trade-off:''' Expanding the user's field of view typically requires more lenslets or larger lens aperture, but this reduces the angular (and thus spatial) resolution per view. Shin ''et al.'' showed that using a polarization grating could enlarge an MLA display's FoV from ~59° to 95°, but this was at the expense of needing sophisticated polarization control.<ref>Shin G, Lee Y, Kim J, et al. Field of view and angular-resolution enhancement in microlens array type virtual reality near-eye display using polarization grating. PubMed. 2023;39876217.</ref> In many designs, improving one parameter (like FoV or brightness) degrades another.
'''FoV–Resolution trade-off:''' Expanding the user's field of view typically requires more lenslets or larger lens aperture, but this reduces the angular (and thus spatial) resolution per view. Shin ''et al.'' showed that using a polarization grating could enlarge an MLA display's FoV from ~59° to 95°, but this was at the expense of needing sophisticated polarization control.<ref name="Shin2023" /> In many designs, improving one parameter (like FoV or brightness) degrades another.


'''Chromatic aberration and color mixing:''' As noted earlier, MLAs inherently blur different colors unless achromatized. Achieving full-color images through a simple lens array is difficult.<ref>Li X, Chen L, Li Y, et al. A broadband achromatic metalens array for integral imaging in the visible. Light Sci Appl. 2019;8:99.</ref> Some systems use color filter arrays or sequential-color illumination to mitigate this, but this adds complexity and can reduce brightness.
'''Chromatic aberration and color mixing:''' As noted earlier, MLAs inherently blur different colors unless achromatized. Achieving full-color images through a simple lens array is difficult.<ref name="Li2019" /> Some systems use color filter arrays or sequential-color illumination to mitigate this, but this adds complexity and can reduce brightness.


'''Crosstalk and ghosting:''' In multi-view displays, the images for adjacent views must not overlap. Small misalignments or imperfections cause crosstalk, where one eye sees part of the image intended for the other. This degrades 3D effect. In holographic see-through designs, incomplete isolation can cause ghost images of virtual content. Accurate fabrication and calibration are needed to minimize these artifacts.
'''Crosstalk and ghosting:''' In multi-view displays, the images for adjacent views must not overlap. Small misalignments or imperfections cause crosstalk, where one eye sees part of the image intended for the other. This degrades 3D effect. In holographic see-through designs, incomplete isolation can cause ghost images of virtual content. Accurate fabrication and calibration are needed to minimize these artifacts.


'''Eye-box and alignment:''' For near-eye applications, the exit pupil (eye-box) must accommodate user movement. Simple lens arrays can produce small, fixed eye-boxes. Techniques like eye-tracking (to move the image) or pupil duplication (multiple layered arrays) are required to ensure a reasonable viewing region. The scanning waveguide example noted that despite a wide FoV, the eye-box remained limited, and they attributed low resolution partly to the relatively large 2 mm lens pitch<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref> (larger pitch reduced how finely the eye-box could be sampled).
'''Eye-box and alignment:''' For near-eye applications, the exit pupil (eye-box) must accommodate user movement. Simple lens arrays can produce small, fixed eye-boxes. Techniques like eye-tracking (to move the image) or pupil duplication (multiple layered arrays) are required to ensure a reasonable viewing region. The scanning waveguide example noted that despite a wide FoV, the eye-box remained limited, and they attributed low resolution partly to the relatively large 2 mm lens pitch<ref name="Wei2023" /> (larger pitch reduced how finely the eye-box could be sampled).


'''Optical efficiency:''' Each optical surface, grating, or holographic element can introduce loss. Adding an array of lenslets means more surfaces and potential Fresnel reflections. Diffractive elements (gratings, HOEs) often have limited efficiency bandwidth. Ensuring enough brightness in the final image is a common design hurdle, especially for battery-powered displays.
'''Optical efficiency:''' Each optical surface, grating, or holographic element can introduce loss. Adding an array of lenslets means more surfaces and potential Fresnel reflections. Diffractive elements (gratings, HOEs) often have limited efficiency bandwidth. Ensuring enough brightness in the final image is a common design hurdle, especially for battery-powered displays.
Line 79: Line 81:
Research on lens-array technology is advancing rapidly. '''Adaptive optics''' will likely play a growing role. Arrays of liquid-crystal or shape-changing lenses could allow dynamic focus control and multi-focal displays (reducing vergence-accommodation conflict). Similarly, '''dynamic wavelength control''' (e.g. polarization or tunable filters in each lenslet) could enable spatiotemporal multiplexing for color and focus.
Research on lens-array technology is advancing rapidly. '''Adaptive optics''' will likely play a growing role. Arrays of liquid-crystal or shape-changing lenses could allow dynamic focus control and multi-focal displays (reducing vergence-accommodation conflict). Similarly, '''dynamic wavelength control''' (e.g. polarization or tunable filters in each lenslet) could enable spatiotemporal multiplexing for color and focus.


'''Metasurfaces and flat optics''' are a major trend. Recent work has demonstrated ''achromatic metasurface waveguides'' for AR: for example, a 2025 Light:Science &Apps paper introduced inverse-designed metasurface couplers that eliminate chromatic aberration across the full visible spectrum and achieve ~45° FOV.<ref>An achromatic metasurface waveguide for augmented reality displays. Light Sci Appl. 2025;41377-025-01761.</ref> These metasurface lens arrays are ultrathin and could replace bulky refractive MLAs in future headsets. Cholesteric liquid-crystal metasurface (chiral) lens arrays have already been used to break the field-of-view limit in a scanning AR display.<ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>
'''Metasurfaces and flat optics''' are a major trend. Recent work has demonstrated ''achromatic metasurface waveguides'' for AR: for example, a 2025 Light:Science &Apps paper introduced inverse-designed metasurface couplers that eliminate chromatic aberration across the full visible spectrum and achieve ~45° FOV.<ref name="Achromatic2025">An achromatic metasurface waveguide for augmented reality displays. Light Sci Appl. 2025;41377-025-01761.</ref> These metasurface lens arrays are ultrathin and could replace bulky refractive MLAs in future headsets. Cholesteric liquid-crystal metasurface (chiral) lens arrays have already been used to break the field-of-view limit in a scanning AR display.<ref name="Wei2023" />


'''Integration and compute-optics co-design''' will improve performance. Headsets may co-optimize lens arrays with on-sensor processing. For instance, a microlens array camera could perform onboard refocusing or eye-pose estimation in hardware. Conversely, display side, algorithms could pre-distort images to compensate residual lens aberrations.
'''Integration and compute-optics co-design''' will improve performance. Headsets may co-optimize lens arrays with on-sensor processing. For instance, a microlens array camera could perform onboard refocusing or eye-pose estimation in hardware. Conversely, display side, algorithms could pre-distort images to compensate residual lens aberrations.
Line 85: Line 87:
'''Higher-density arrays''' and '''monolithic fabrication''' may emerge. Advances in 3D printing and nanoimprint lithography could yield integrated "optical wafers" combining display and MLA. Also, developments in holographic printing may allow recording complex lens-array HOEs on demand.
'''Higher-density arrays''' and '''monolithic fabrication''' may emerge. Advances in 3D printing and nanoimprint lithography could yield integrated "optical wafers" combining display and MLA. Also, developments in holographic printing may allow recording complex lens-array HOEs on demand.


In sensing, ''light-field cameras'' in miniaturized form will likely become standard in AR glasses for robust gaze and hand tracking, thanks to the flexibility demonstrated in patents and prototypes.<ref>Yang L, Guo Y. Eye tracking using a light field camera on a head-mounted display. US Patent Application US20180173303A1. 2018 Jun 21.</ref><ref>Microsoft. Camera comprising lens array. Patent Nweon. 2020;30768.</ref>
In sensing, ''light-field cameras'' in miniaturized form will likely become standard in AR glasses for robust gaze and hand tracking, thanks to the flexibility demonstrated in patents and prototypes.<ref name="Yang2018" /><ref name="Microsoft2020" />


As VR/AR systems aim for wider FOV, thinner form factors, and better realism, custom lens-array designs will continue to evolve. Each new generation of headsets (for example, employing pancake optics, multi-zone optics, or holographic waveguides) tends to reinvigorate lens-array innovation. In sum, lens arrays remain a key enabling technology for immersive displays and interactive sensing, with ongoing research focusing on mitigating their limitations and leveraging novel materials and computation.<ref>An achromatic metasurface waveguide for augmented reality displays. Light Sci Appl. 2025;41377-025-01761.</ref><ref>Wei K. Near-eye augmented reality display using wide field-of-view scanning polarization pupil replication. University of California, Berkeley. 2023.</ref>
As VR/AR systems aim for wider FOV, thinner form factors, and better realism, custom lens-array designs will continue to evolve. Each new generation of headsets (for example, employing pancake optics, multi-zone optics, or holographic waveguides) tends to reinvigorate lens-array innovation. In sum, lens arrays remain a key enabling technology for immersive displays and interactive sensing, with ongoing research focusing on mitigating their limitations and leveraging novel materials and computation.<ref name="Achromatic2025" /><ref name="Wei2023" />


== References ==
== References ==