Freeform optics
More actions
Freeform optics are lenses, mirrors and prisms whose optical surfaces lack the rotational symmetry of conventional spherical and aspheric optics. Aaron Bauer, Eric Schiesser and Jannick Rolland, writing in Nature Communications in 2018, define a freeform optic as "an optic whose surface shapes lack translational or rotational symmetry about axes normal to the mean plane".[1] Freeform surfaces give an optical designer more freedom than rotationally symmetric surfaces, so a system can be designed with fewer elements and made smaller and lighter.[2] A 2021 review in Optica by Rolland and colleagues states that over the preceding ten years freeform optics "has enabled compact and high-performance imaging systems", with applications spanning from extreme ultraviolet lithography to space optics.[3]
In virtual and augmented reality, freeform surfaces are used mainly in the eyepieces and optical combiners of head-mounted displays. One common form is the wedge-shaped freeform prism, a single molded block in which light from a microdisplay is folded by total internal reflection and a reflective surface before it reaches the eye. Olympus and Canon applied for patents on freeform wedge prism systems in 1995 and 1996,[4] and Canon's MR System, launched in 2012, uses a free-form prism with a three-sided configuration.[5] Freeform surfaces also appear in single-surface reflective combiners, in multichannel VR lenses such as the optics of the Lynx R-1, and in research prototypes that add focus cues to optical see-through displays.
Definition
The surfaces of conventional imaging lenses, whether spherical or aspheric, are rotationally symmetric about an optical axis. A freeform surface drops that constraint. In a 2022 article for SPIE's Photonics Focus, William G. Schulz defines freeform optics as "lenses or mirrors with surfaces that have no rotational symmetry".[6] The Center for Freeform Optics, an industry and university research center supported by the US National Science Foundation, describes the technology as enabling "compact optical solutions for complex light mapping as well as folding optical systems in three-dimensions".[7]
Surface descriptions
A freeform surface has to be written down mathematically before it can be designed, made and measured. In a 2017 review in Optical Engineering, Ye and colleagues call surface representation "a fundamental and key research topic" of freeform optics, closely tied to design, manufacturing and testing.[8] Descriptions used in head-mounted display work include x-y polynomial surfaces, which Zheng and colleagues used in a 2010 off-axis see-through HMD,[9] and Zernike polynomial surfaces, used in the design method of Bauer and colleagues.[1] In 2012 G. W. Forbes introduced new sets of orthogonal polynomials for freeform shapes that give "a rough interpretation of shape at a glance" and support estimates of manufacturability.[10]
Aberration theory and design
Kyle Fuerschbach, Jannick Rolland and Kevin Thompson extended nodal aberration theory to systems containing freeform surfaces in 2014. They showed that freeform surfaces introduce no new aberration types: the aberration fields that appear are the same ones nodal aberration theory already describes for tilted and decentered systems. A freeform surface placed at the aperture stop or pupil adds an aberration that is constant across the field, while the same surface moved away from the stop adds one that varies with field position.[11]
Bauer, Schiesser and Rolland note that a common first approach is to let ray-trace software vary every freeform coefficient on every surface. They describe this as rarely giving the best design for manufacture, because an excess of freeform terms can produce large departures from the base shape and steep local slopes, which raise assembly sensitivity and make the surface harder to fabricate and test. Their method instead picks an unobscured starting geometry from aberration theory and adds only the freeform shapes needed to correct the aberrations that limit it.[1]
History
Schulz's Photonics Focus article traces the idea back to progressive spectacle lenses, which vary optical power across a single lens.[6] In a patent filed on 3 December 1964 and granted on 21 February 1967, physicist Luis W. Alvarez described a "two-element variable-power spherical lens" in which one of two thin elements in tandem moves transverse to the optical axis to change focal power.[12] Wilson and Hua's 2019 see-through head-mounted display design uses a pair of laterally shifting "freeform Alvarez lenses" based on this principle.[13]
Schulz presents the Polaroid SX-70 camera of 1972 as an early commercial use. Optical engineer William T. Plummer helped develop the camera, and Schulz's article recounts how its design problems were solved with freeform elements: an eye lens whose power varies from top to bottom corrected field tilt, and a freeform aspheric corrector plate near the aperture stop corrected coma.[6] Plummer's own 1982 paper in Applied Optics on the camera's folding single-lens-reflex viewfinder reports that all of the viewing components are tilted or decentered, that two of its aspheres "are not figures of revolution", and that special technology was needed to produce millions of copies.[14]
For head-mounted displays, a 2021 review by Dewen Cheng and colleagues at the Beijing Institute of Technology dates the freeform wedge prism to the Olympus (1995) and Canon (1996) patent applications, and notes that those early systems were large, had a small field of view and used low-resolution microdisplays.[4] Rolland told Photonics Focus that her own interest in freeform optics began in the early 2000s while she was working on a head-worn display for augmented and virtual reality.[6] In 2009 Cheng, Yongtian Wang, Hong Hua and M. M. Talha published a design method for an optical see-through HMD built from a freeform prism cemented to a freeform lens, and in 2011 Cheng, Wang, Hua and J. Sasian tiled freeform optics from two display channels to widen the field of view.[15][16]
Canon announced its MR System for product design on 18 June 2012, with availability set for late July 2012. Canon said the free-form prism's "unique three-sided configuration" gives images with low distortion in the peripheral areas, and that the system's video cameras are aligned with the optical axes of the light entering the eyes from the small displays.[5] The Center for Freeform Optics was set up in 2013 by the University of Rochester and the University of North Carolina at Charlotte with NSF support.[6][7] The NSF lists augmented and virtual reality among the applications with "immediate benefit".[7]
Freeform prism eyepieces
In the design analyzed by Cheng and colleagues, light from the microdisplay enters the prism through one surface, undergoes total internal reflection at the surface facing the eye, reflects again from a second surface, and then leaves through the eye-facing surface toward the viewer. Because the prism would bend light arriving from the outside world, a freeform see-through compensation element is cemented to it so that the real scene passes through without distortion.[4] The 2009 Cheng design used three freeform surfaces on the prism, and both prism and compensator were made of plastic to save weight.[15] In their 2021 review of AR and VR displays, Xiong and colleagues describe this freeform prism with a compensator as having "a well-balanced performance between FoV, eyebox, and form factor".[17]
| Year | Authors | Design | Reported performance |
|---|---|---|---|
| 2009 | Cheng, Wang, Hua, Talha | Freeform wedge prism cemented to a freeform lens | 53.5 degree diagonal field of view, f/1.875, 8 mm exit pupil, 18.25 mm eye relief; optics per eye no larger than 25 by 22 by 12 mm and 8 g, with a 0.61 in. microdisplay[15] |
| 2011 | Cheng, Wang, Hua, Sasian | Two tiled freeform display channels | 56 by 45 degree field of view, 3.2 arcminute angular resolution[16] |
| 2013 | Wang, Cheng, Wang, Hua, Jin | Injection-molded freeform prism and lens | 36 degree field of view for the display path, 50 degree see-through field of view[2] |
| 2014 | Hu, Hua | Freeform prism eyepiece and freeform lens in a multi-focal-plane display | 40 degree diagonal field of view, 1.8 arcminute resolution in the virtual display path, 0.5 arcminute in the see-through path[18] |
| Reported in 2021 review | Cheng et al. | Spliced freeform prism | Monocular field of view of 82 by 32 degrees[4] |
The Cheng review also reports that NED Ltd. developed a binocular freeform AR-HMD optical module with a 120 degree diagonal field of view and an 8 mm exit pupil. Its comparison table lists freeform prism combiners as having under 50% efficiency and a large form factor, against medium or small form factors for geometric and diffractive waveguides.[4]
Other freeform combiners and VR optics
The simplest freeform combiner is a single freeform partially reflective surface in front of the eye. Xiong and colleagues note that it can reach a field of view of up to 90 degrees, but that one freeform surface gives limited design freedom, which leads to image distortion (pupil swim), and that the half-mirror makes the device bulky.[17]
In VR, Pablo Benitez, Juan C. Miñano and colleagues presented multichannel freeform lens designs at SPIE's Digital Optical Technologies conference in 2017. Each lens is split into several lenslets whose freeform surfaces keep image quality high across the whole field, even at very oblique incidence. The authors reported that headsets using the designs typically occupy about a fourth of the volume of a conventional headset with the same field of view. One family of designs uses refractive lenslets; the other uses prism-like three-surface lenslets in which rays are refracted, reflected, totally internally reflected and refracted again.[19]
The Lynx R-1 mixed reality headset, for which Lynx opened pre-orders in February 2020, uses what Lynx calls a "4-fold catadioptric freeform prism". According to founder Stan Larroque, the image on the display is divided into four quarters and reassembled into a single image by the optics. The short focal length lets the displays sit flush with the lenses, and the layout leaves a central position for an eye-tracking camera. Road to VR reported a 90 degree horizontal field of view and noted that the headset relies on a distortion map to correct the optics.[20] The optics came from Limbak, a Madrid optics company founded in 2013 that also supplied lenses for the Simula One. In January 2023 MIXED reported that display analyst Karl Guttag had described Limbak as acquired by an unnamed major US company, and that XR analyst Bradley Lynch, citing industry sources, named Apple as the buyer.[21]
Manufacturing and testing
The Rolland review covers deterministic computer numerical control (CNC) grinding, polishing and diamond machining as fabrication methods, and notes that these techniques leave mid-spatial frequency errors on freeform surfaces. It describes freeform metrology as "simultaneously sparse in their existence but diverse in their potential".[3]
For HMD prisms, the Cheng review sets out a nine-step process running from the initial optical layout and choice of surface description through optimization, surface fitting, mold-core machining, mold-core measurement, injection molding and final image-quality testing, with compensating re-machining of the mold core when image quality falls short. Machining methods include CNC grinding, grinding and polishing, flying knife machining and single-point diamond turning, and the review states that high-precision molds allow freeform prism elements to be mass-produced. Contact profilometers such as Panasonic's UA3P, with a shape measurement precision of 0.1 microns, are described as the mainstream way to measure small aspheric and freeform lenses, while non-contact multiwavelength interferometers such as Taylor Hobson's LUPHO Scan are faster and more precise but more expensive.[4] Wang and colleagues' 2013 injection-molded prism expanded the prism and lens at the edges during design to reduce the effects of surface deformation in the working area during molding, and its tolerances were analyzed with the Monte Carlo method.[2]
Research
Several freeform HMD research designs address the vergence-accommodation conflict of conventional stereoscopic displays:
- Hu and Hua's 2014 multi-focal-plane display used a freeform prism eyepiece and freeform lens to render nearly correct focus cues over a depth range of 0 to 3 diopters.[18]
- Huang and Hua's 2018 integral-imaging light field AR display used custom freeform optics, a tunable lens and an aperture array to give a true 3D view of 30 by 18 degrees with 3 arcminute spatial resolution across more than 3 diopters, and a 65 by 40 degree see-through field of view.[22]
- Wilson and Hua's 2019 varifocal see-through HMD paired a compact eyepiece with two laterally shifting freeform Alvarez lenses to tune focal depth from 0 to 3 diopters, with a 1920 by 1080 OLED microdisplay, a virtual field of view above 30 degrees diagonal and angular resolution below 0.85 arcminutes.[13]
Other work combines freeform surfaces with newer optical elements. In 2021 Daniel Nikolov, Rolland and colleagues introduced the "metaform", an optical surface that combines a freeform optic and a metasurface in one component, and built a miniature imager with a metaform mirror made by electron-beam lithography on a freeform substrate; the paper cites augmented reality displays among the compact systems that motivate the work.[23] Several groups pair freeform elements with holographic optical elements: a 2022 full-color near-eye display used a freeform relay of four freeform optics to correct aberrations from a holographic combiner, with a 20 degree diagonal field of view and a 5 by 5 mm eye box;[24] a 2025 design combined a three-surface freeform prism with two freeform holographic elements;[25] and a 2025 Beijing Institute of Technology prototype reported a depth of field from 0.25 to 10 m, a 50 degree field of view and a 10 by 10 mm eye box.[26] Xiong and colleagues' review argues that, despite progress with freeform surfaces, further gains in AR and VR need optics with more design freedom that are also thin and light, pointing to diffractive optics, metasurfaces and micro-LED panels.[17]
Outside near-eye displays, freeform mirrors are used in automotive AR head-up displays. Qin and colleagues described in 2019 an AR HUD with a single freeform mirror that shows a far image at 9 m and a near image at 2.5 m within a 120 by 60 mm eye box, built as an 8.5 L product.[27]
See also
References
- ↑ 1.0 1.1 1.2 Aaron Bauer, Eric M. Schiesser, Jannick P. Rolland (2018-05-01). "Starting geometry creation and design method for freeform optics". Nature Communications, vol. 9, article 1756. doi:10.1038/s41467-018-04186-9. https://doi.org/10.1038/s41467-018-04186-9. Retrieved 2026-09-29.
- ↑ 2.0 2.1 2.2 Q. Wang, D. Cheng, Y. Wang, H. Hua, G. Jin (2013-03-01). "Design, tolerance, and fabrication of an optical see-through head-mounted display with free-form surface elements". Applied Optics, vol. 52, no. 7. doi:10.1364/AO.52.000C88. https://doi.org/10.1364/AO.52.000C88. Retrieved 2026-09-29.
- ↑ 3.0 3.1 Jannick P. Rolland, Matthew A. Davies, Thomas J. Suleski, Chris Evans, Aaron Bauer, John C. Lambropoulos, Konstantinos Falaggis (2021-01-29). "Freeform optics for imaging". Optica, vol. 8, no. 2, pp. 161-176. doi:10.1364/OPTICA.413762. https://doi.org/10.1364/OPTICA.413762. Retrieved 2026-09-29.
- ↑ 4.0 4.1 4.2 4.3 4.4 4.5 Dewen Cheng, Qiwei Wang, Yue Liu, Hailong Chen, Dongwei Ni, Ximeng Wang, Cheng Yao, Qichao Hou, Weihong Hou, Gang Luo, Yongtian Wang (2021). "Design and manufacture AR head-mounted displays: A review and outlook". Light: Advanced Manufacturing, vol. 2, no. 3, article 24. doi:10.37188/lam.2021.024. https://doi.org/10.37188/lam.2021.024. Retrieved 2026-09-29.
- ↑ 5.0 5.1 "Canon launches new MR (Mixed Reality) System, contributing to shorter development times during product design". Canon Global. Canon Inc.. 2012-06-18. https://global.canon/en/news/2012/jun18e.html. Retrieved 2026-09-29.
- ↑ 6.0 6.1 6.2 6.3 6.4 William G. Schulz (2022-07). "A visionary revolution: Freeform optics and the Polaroid SX-70 Land Camera". Photonics Focus. SPIE. https://spie.org/news/photonics-focus/julyaug-2022/envisioning-freeform-optics. Retrieved 2026-09-29.
- ↑ 7.0 7.1 7.2 "Center for Freeform Optics (CeFO)". NSF Industry-University Cooperative Research Centers. U.S. National Science Foundation. https://iucrc.nsf.gov/centers/center-for-freeform-optics/. Retrieved 2026-09-29.
- ↑ Jingfei Ye, Lu Chen, Xinhua Li, Qun Yuan, Zhishan Gao (2017-11). "Review of optical freeform surface representation technique and its application". Optical Engineering, vol. 56, no. 11. doi:10.1117/1.OE.56.11.110901. https://doi.org/10.1117/1.OE.56.11.110901. Retrieved 2026-09-29.
- ↑ Zhenrong Zheng, Xu Liu, Haifeng Li, Liang Xu (2010). "Design and fabrication of an off-axis see-through head-mounted display with an x-y polynomial surface". Applied Optics, vol. 49, no. 19. doi:10.1364/AO.49.003661. https://doi.org/10.1364/AO.49.003661. Retrieved 2026-09-29.
- ↑ G. W. Forbes (2012). "Characterizing the shape of freeform optics". Optics Express, vol. 20, no. 3. doi:10.1364/OE.20.002483. https://doi.org/10.1364/OE.20.002483. Retrieved 2026-09-29.
- ↑ Kyle Fuerschbach, Jannick P. Rolland, Kevin P. Thompson (2014). "Theory of aberration fields for general optical systems with freeform surfaces". Optics Express, vol. 22, no. 22. doi:10.1364/OE.22.026585. https://doi.org/10.1364/OE.22.026585. Retrieved 2026-09-29.
- ↑ Luis W. Alvarez (1967-02-21). "US3305294A - Two-element variable-power spherical lens". Google Patents. https://patents.google.com/patent/US3305294A/en. Retrieved 2026-09-29.
- ↑ 13.0 13.1 A. Wilson, H. Hua (2019-05-27). "Design and demonstration of a vari-focal optical see-through head-mounted display using freeform Alvarez lenses". Optics Express, vol. 27, no. 11. doi:10.1364/OE.27.015627. https://doi.org/10.1364/OE.27.015627. Retrieved 2026-09-29.
- ↑ William T. Plummer (1982-01-15). "Unusual optics of the Polaroid SX-70 Land camera". Applied Optics, vol. 21, no. 2. doi:10.1364/AO.21.000196. https://doi.org/10.1364/AO.21.000196. Retrieved 2026-09-29.
- ↑ 15.0 15.1 15.2 Dewen Cheng, Yongtian Wang, Hong Hua, M. M. Talha (2009-05-10). "Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism". Applied Optics, vol. 48, no. 14. doi:10.1364/AO.48.002655. https://doi.org/10.1364/AO.48.002655. Retrieved 2026-09-29.
- ↑ 16.0 16.1 Dewen Cheng, Yongtian Wang, Hong Hua, J. Sasian (2011-06-01). "Design of a wide-angle, lightweight head-mounted display using free-form optics tiling". Optics Letters, vol. 36, no. 11. doi:10.1364/OL.36.002098. https://doi.org/10.1364/OL.36.002098. Retrieved 2026-09-29.
- ↑ 17.0 17.1 17.2 Jianghao Xiong, En-Lin Hsiang, Ziqian He, Tao Zhan, Shin-Tson Wu (2021-10-25). "Augmented reality and virtual reality displays: emerging technologies and future perspectives". Light: Science & Applications, vol. 10, article 216. doi:10.1038/s41377-021-00658-8. https://doi.org/10.1038/s41377-021-00658-8. Retrieved 2026-09-29.
- ↑ 18.0 18.1 X. Hu, H. Hua (2014-06-02). "High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics". Optics Express, vol. 22, no. 11. doi:10.1364/OE.22.013896. https://doi.org/10.1364/OE.22.013896. Retrieved 2026-09-29.
- ↑ Pablo Benitez, Juan C. Miñano, Pablo Zamora, Dejan Grabovičkić, Marina Buljan, Bharathwaj Narasimhan, Jorge Gorospe, Jesús López, Milena Nikolić, Eduardo Sánchez, Carmen Lastres, Ruben Mohedano (2017-06-26). "Advanced freeform optics enabling ultra-compact VR headsets". Proceedings of SPIE, vol. 10335, Digital Optical Technologies 2017. doi:10.1117/12.2270317. https://doi.org/10.1117/12.2270317. Retrieved 2026-09-29.
- ↑ Ben Lang (2020-02-05). "LYNX Founder Details Headset's Unique Optics, Pre-orders Available Now". Road to VR. https://www.roadtovr.com/lynx-r-1-optics-detailed-pre-order-available/. Retrieved 2026-09-29.
- ↑ Tomislav Bezmalinovic (2023-01-03). "Apple buys lens manufacturer Limbak - report". MIXED. https://mixed-news.com/en/apple-buys-lens-manufacturer-limbak-report/. Retrieved 2026-09-29.
- ↑ H. Huang, H. Hua (2018-06-25). "High-performance integral-imaging-based light field augmented reality display using freeform optics". Optics Express, vol. 26, no. 13. doi:10.1364/OE.26.017578. https://doi.org/10.1364/OE.26.017578. Retrieved 2026-09-29.
- ↑ Daniel K. Nikolov, Aaron M. Bauer, Fei Cheng, Hitoshi Kato, A. Nick Vamivakas, Jannick P. Rolland (2021-04-30). "Metaform optics: Bridging nanophotonics and freeform optics". Science Advances, vol. 7, no. 18. doi:10.1126/sciadv.abe5112. https://doi.org/10.1126/sciadv.abe5112. Retrieved 2026-09-29.
- ↑ T. Shu, G. Hu, R. Wu, H. Li, Z. Zhang, X. Liu (2022-08-29). "Compact full-color augmented reality near-eye display using freeform optics and a holographic optical combiner". Optics Express, vol. 30, no. 18. doi:10.1364/OE.465842. https://doi.org/10.1364/OE.465842. Retrieved 2026-09-29.
- ↑ G. Hu, C. Pei, H. Sun, R. Wu, H. Li (2025-06-02). "Design and fabrication of a compact augmented reality near-eye display with freeform holographic optics". Optics Express, vol. 33, no. 11. doi:10.1364/OE.554017. https://doi.org/10.1364/OE.554017. Retrieved 2026-09-29.
- ↑ Y. Wang, T. Yang, X. Lyu, D. Cheng, Y. Wang (2025). "Large Depth-of-Field, Large Eyebox, and Wide Field-of-View Freeform-Holographic Augmented Reality Near-Eye Display". Advanced Science, vol. 12, no. 37. doi:10.1002/advs.202508773. https://doi.org/10.1002/advs.202508773. Retrieved 2026-09-29.
- ↑ Z. Qin, S.-M. Lin, K.-T. Luo, C.-H. Chen, Y.-P. Huang (2019-07-10). "Dual-focal-plane augmented reality head-up display using a single picture generation unit and a single freeform mirror". Applied Optics, vol. 58, no. 20. doi:10.1364/AO.58.005366. https://doi.org/10.1364/AO.58.005366. Retrieved 2026-09-29.