Jump to content

Optical engine

From VR & AR Wiki

An optical engine (also called a light engine or, when it is a stand-alone image source, a micro-projector) is the image-generating part of an augmented reality (AR) display. In the usual division of an AR display, a light engine produces the picture and an optical combiner, such as a waveguide, carries that picture to the eye while letting light from the real world pass through. Xiong, Hsiang, He, Zhan and Wu summarize the split in their 2021 review of AR and VR displays: "The light engine serves as display image source, while the combiner delivers the displayed images to viewer's eye and in the meantime transmits the environment light."[1]

The engine is built around a microdisplay or a scanning laser source. The main technologies are liquid crystal on silicon (LCoS), the digital micromirror device (DMD) used in DLP projection, micro-LED, micro-OLED, and laser beam scanning with MEMS mirrors.[1] The engine largely determines the brightness, power consumption and frame rate of a pair of smart glasses and also affects its size.[1] Optics suppliers such as WaveOptics have sold engines, or engine-plus-waveguide modules, to other device makers.[2]

Reviewed 27 September 2026. Checked the Xiong et al. 2021 review figures and quotes, WaveOptics, Lumus, Avegant, JBD, Snap and Meta engine specifications, the HoloLens 2 display details and the Meta Ray-Ban Display component analysis against their cited sources. About review dates.

Definition and terminology

Usage of the term varies between the research literature and industry. In academic reviews, "light engine" usually means only the image source: the microdisplay together with its illumination and projection optics. Xiong et al. state that the light engine "determines several essential properties of the AR system like image brightness, power consumption, frame rate, and basic etendue", while field of view, eye box and image sharpness depend mainly on the combiner, and brightness, overall efficiency and form factor depend on both.[1] Microsoft's hardware specification for the Microsoft HoloLens 2 uses the same sense, listing the headset's holographic resolution as "2k 3:2 light engines".[3]

Some suppliers use "optical engine" for the complete display module instead. WaveOptics described its optical engines (also known as modules) as consisting principally of "a projector coupled to a diffractive waveguide combiner", sold in monocular or binocular configurations and with different fields of view; the company called the optical engine "the biggest driver of the industrial design and power consumption" of AR glasses and headsets.[2] Lumus likewise describes its Maximus and Z-Lens products as waveguide architectures that include an optical engine.[4] In both senses the engine is the part that turns an electronic video signal into light that the combiner can relay to the viewer.

How it works

In a waveguide-based near-eye display, the engine projects its image into the waveguide's in-coupler, and the waveguide then replicates the pupil across the lens. Because this exit pupil expansion spreads each input image across the eye box, Xiong et al. note that waveguide displays are insensitive to the exact spatial position of separate red, green and blue input images, so a three-panel engine does not always need extra combining optics.[1]

Supplier data sheets show the interface that such engines are designed around. WaveOptics' Mercury projector, intended for its 56 degree Merlin waveguide, was specified with an exit pupil diameter of 3 x 2.6 mm, an exit pupil standoff of 0.4 mm and a weight of 6 g, while its Saturn projector for the 40 degree D08 waveguide had a 4 mm exit pupil and weighed 9.1 g.[5][6] Lumus states that its Z-Lens architecture accepts "microLED, LCoS or laser based micro-projectors, integrated into the top perimeter corner of each lens cutout."[4]

Self-emissive engines

Micro-LED and micro-OLED panels emit their own light, so they need no illumination optics and are usually more compact than LCoS and DMD engines.[1] Full-color micro-LED is difficult because red LEDs are made from a different semiconductor material than green and blue ones. Two main approaches are used: combining three separate single-color panels with a trichroic prism, or placing color-conversion materials such as quantum dots on top of blue or ultraviolet micro-LEDs.[1] JBD's Hummingbird II projector is an example of the first approach: the company describes it as combining three 0.1 inch red, green and blue monochrome micro-LED microdisplays through an X-cube, in a 0.2 cc, 0.5 g package with a 25 degree field of view and 500 x 380 resolution.[7] Micro-OLED can reach full color on a single panel, but Xiong et al. note that driving it continuously above 10,000 nits "may dramatically shorten the device lifetime".[1]

A 2025 perspective in Nature Reviews Electrical Engineering groups the leading microdisplays for AR and VR light engines as LCoS, OLED-on-silicon (OLEDoS) and LED-on-silicon (LEDoS), all built on silicon CMOS backplanes. It describes OLEDoS as having high contrast and wide color gamut but limited brightness for AR, and LEDoS as bright, high in contrast and long-lived but still costly because of immature fabrication methods.[8]

Reflective light-modulating engines

LCoS and DMD panels do not emit light; they modulate light from an LED or laser illuminator. An LCoS pixel changes the polarization state of reflected light by reorienting its liquid crystal, while a DMD tilts bistable micromirrors.[1] LCoS needs linearly polarized light, so engines with unpolarized LEDs usually add a polarization recycling system; a DMD does not need polarized light and is generally more efficient than LCoS with an unpolarized source. Color is produced either with color filters on the LCoS panel or, in both technologies, by color-sequential illumination.[1] The illumination optics make LED-lit LCoS and DMD engines larger than self-emissive ones, but using lasers removes the need for collimation optics and "greatly reduces the form factor".[1] The Nature Reviews Electrical Engineering perspective notes that LCoS can reach high pixel density and brightness but loses light in its polarization and reflection steps.[8]

WaveOptics' Mercury projector was a full-color, color-sequential LED LCoS design with 1920 x 1080 resolution, and its Saturn projector used a color-sequential LED DMD from Texas Instruments' DLP line at 1280 x 720.[5][6]

Laser beam scanning engines

A MEMS laser beam scanning (LBS) engine draws the image directly by sweeping red, green and blue laser beams with one two-dimensional scanning mirror or two one-dimensional mirrors, and sets gray levels by pulse-width modulating the laser diodes.[1] The mirrors and laser module are tiny, which allows a very compact engine, and the image has a large depth of focus. The drawbacks are a small system etendue and a frame rate limited by the mirror: Xiong et al. state that 60 Hz at about 1K resolution already requires a mirror resonance of around 50 kHz.[1] The HoloLens 2 uses this type of engine. Wired reported in 2019 that its MEMS mirrors strobe 54,000 times per second, and that Microsoft's Zulfi Alam said the approach lets the field of view be increased by changing the angles of the mechanical system rather than building a bigger display backplane.[9]

Performance comparison

Because the light leaving an engine forms only an intermediate image, Xiong et al. argue that luminance alone is a misleading measure of engine brightness. They compare engines by luminous efficacy (output lumens per watt of input electrical power), and justify a 10,000 nit comparison point by the goal of delivering about 1,000 nits to the eye through a typical AR combiner whose efficiency is below 10 percent.[1] Their estimates, for chip sizes and components typical at the time of the review, are:

Engine type Estimated luminous efficacy Contrast ratio Frame rate limit
Micro-LED, separate RGB chips about 5 lm/W above 106:1 Driving circuit (nanosecond device response)
Micro-LED, quantum dot color conversion about 10 lm/W above 106:1 Driving circuit
Micro-OLED about 4-8 lm/W above 106:1 Driving circuit
LCoS, white LED with color filters about 12 lm/W about 2,000:1 to 5,000:1 Liquid crystal response (about 1 ms nematic, 200 microseconds ferroelectric)
LCoS, color-sequential RGB LEDs about 10 lm/W about 2,000:1 to 5,000:1 Liquid crystal response
LCoS, RGB lasers about 32 lm/W about 2,000:1 to 5,000:1 Liquid crystal response
DMD, RGB LEDs about 15 lm/W about 2,000:1 to 5,000:1 Micromirror response (up to 30 kHz binary frames)
DMD, RGB lasers about 32 lm/W about 2,000:1 to 5,000:1 Micromirror response
MEMS laser beam scanning about 40 lm/W about 106:1 Mirror scanning frequency (60 Hz demonstrated)

Xiong et al. conclude that micro-LED and micro-OLED have similar efficacy, that LCoS and DMD engines are similar in efficacy, size and contrast, and that MEMS laser scanning had the highest efficacy but a 60 Hz frame rate that could cause flicker. They add that the most efficient complete systems pair laser-based engines with Maxwellian-type combiners, and that the low efficiency of diffractive waveguides "can be remedied by an efficient light engine like MEMS-LBS".[1]

History and examples

The first Microsoft HoloLens used an LCoS projector; its successor, the HoloLens 2, announced in February 2019, moved to MEMS laser scanning.[9] Around the same time several optics firms began selling engines and modules to other device makers. WaveOptics offered engine modules such as Leopard (28 degrees), Titan (40 degrees) and Merlin (56 degrees), each pairing one of its projectors with one of its diffractive waveguides, and said the Titan had been used by ODMs including Pegatron, Wistron and Compal.[2][10] Snap Inc. agreed in May 2021 to acquire WaveOptics, which made waveguides, micro projectors and full AR modules, for more than US$500 million.[11]

Some suppliers specify engine volume in cubic centimeters, along with weight and power, next to resolution and field of view.[7] The table lists notable engines and products for which the display engine has been documented.

Engine or product Company Date Engine type Stated characteristics
Microsoft HoloLens 2 Microsoft February 2019 MEMS laser beam scanning MEMS mirrors strobing 54,000 times per second, per Wired[9]
Titan module WaveOptics Listed by 2022 DMD (Saturn projector) with D08 waveguide 40 degree field of view, 1280 x 720 binocular resolution, 875 nits, 2.0 W system power[10]
Merlin module WaveOptics Listed by 2022 LCoS (Mercury projector) with Odin waveguide 56 degree field of view, 1920 x 1080 binocular resolution, 250 nits[2][5]
Lumus Maximus Lumus 2021 LCoS with 2D-expansion reflective waveguide 50 degree field of view, 2048 x 2048 per eye; Lumus claimed 3,000 nits[12]
AG-30L and AG-50L Avegant September 2021 LED-illuminated engines 30 and 50 degree fields of view; mass production anticipated in 2023[13]
Z-Lens Lumus January 2023 Accepts micro-LED, LCoS or laser micro-projectors Optical engine 50 percent smaller than Maximus; 50 degree field of view in first prototypes[4]
Hummingbird Mini II JBD September 2024 Monochrome micro-LED 0.3 g, 8 lumens, over 8,000 nits with a waveguide, 60 mW[14]
Snap Spectacles 2024 Snap September 2024 LCoS micro-projectors with waveguides Engine designed in-house; 46 degree diagonal field of view at 37 pixels per degree[15]
Meta Orion (prototype) Meta September 2024 Micro-LED projectors with silicon carbide waveguides About 70 degree field of view[16]
Meta Ray-Ban Display Meta, engine by Goertek (per analysis) September 2025 LCoS with Lumus reflective waveguide (per analysis) 600 x 600 pixels, 20 degree field of view, 30 to 5,000 nits[17][18]
AG-30L3 Avegant January 2026 LCoS 0.7 cc, 1.4 g, 800 x 800 pixels, 150 mW, 1,000 nits to the eye at full white[19]

Road to VR's Ben Lang reported that Lumus Maximus reached about 60 pixels per degree at the center of its view, and quoted display analyst Karl Guttag's view that its color and brightness uniformity was "vastly better than any other waveguide-type optics" he had seen; whether Lumus could manufacture it cheaply at volume was still an open question at the time.[12] JBD said in September 2024 that 26 AR glasses models on the market used its technology, with cumulative shipments in the hundreds of thousands.[14] Avegant said that its AG-30L3 was half the size and half the weight of the AG-30L2 it replaced, with customer samples due in March 2026 and mass production expected later in 2026.[19]

Snap stated that the optical engine in the 2024 Spectacles "has been designed and built from the ground up here at Snap", using LCoS micro-projectors and waveguides with billions of nanostructures.[15] Meta chose micro-LED for the Orion prototype. In a March 2025 post on Meta's blog, display architecture technical director Mike Yee said that "as a wearable display, you're competing with the sun", and explained that Orion's micro-LED pixels had to be spaced only single-digit micrometers apart, which required Meta to design a silicon backplane for micro-LEDs.[20] For the Meta Ray-Ban Display, Karl Guttag's teardown-based analysis identified an OmniVision 600 x 600 LCoS panel lit by red and blue LEDs, a Lumus reflective waveguide, and an optical engine designed by Goertek, and estimated that the projector outputs about 1 lumen at full brightness.[18]

Research

Review articles treat the light engine as one of the main limits on AR glasses. Hsiang, Yang, Yang, Lai, Lin and Wu's 2022 review in Advances in Optics and Photonics compares six light engine technologies (transmissive LCD, reflective LCoS, DLP, micro-LED, OLED and laser beam scanning) on five metrics: resolution density, response time, efficiency/brightness/lifetime, dynamic range, and compactness.[21] The 2025 Nature Reviews Electrical Engineering perspective also examines how light-engine performance should be characterized and how microdisplays are paired with free-space, freeform and waveguide combiners.[8] Xiong et al. identify frame rate as a research direction: engines fast enough to deliver many views could help build light-field displays that address the vergence-accommodation conflict.[1]

See also

References

  1. ↑ 1.00 1.01 1.02 1.03 1.04 1.05 1.06 1.07 1.08 1.09 1.10 1.11 1.12 1.13 1.14 1.15 Jianghao Xiong, En-Lin Hsiang, Ziqian He, Tao Zhan, Shin-Tson Wu (2021). "Augmented reality and virtual reality displays: emerging technologies and future perspectives". Light: Science & Applications, vol. 10, article 216. doi:10.1038/s41377-021-00658-8. https://www.nature.com/articles/s41377-021-00658-8. Retrieved 2026-09-27.
  2. ↑ 2.0 2.1 2.2 2.3 "Optical Engines". WaveOptics. https://web.archive.org/web/20250317184813/https://waveoptics.ar/optical-engines/. Retrieved 2026-09-27.
  3. ↑ "HoloLens 2 hardware". Microsoft Learn. Microsoft. https://learn.microsoft.com/en-us/hololens/hololens2-hardware. Retrieved 2026-09-27.
  4. ↑ 4.0 4.1 4.2 "Lumus Launches Next Generation 2D "Z-Lens" Waveguide Architecture: Removing Key Obstacles to Consumer Augmented Reality Glasses". PR Newswire. Lumus. 2023-01-05. https://www.prnewswire.com/news-releases/lumus-launches-next-generation-2d-z-lens-waveguide-architecture-removing-key-obstacles-to-consumer-augmented-reality-glasses-301713879.html. Retrieved 2026-09-27.
  5. ↑ 5.0 5.1 5.2 "Mercury". WaveOptics. https://web.archive.org/web/20220528144151/https://waveoptics.ar/projectors/mercury/. Retrieved 2026-09-27.
  6. ↑ 6.0 6.1 "Saturn". WaveOptics. https://web.archive.org/web/20220528140149/https://waveoptics.ar/projectors/saturn2/. Retrieved 2026-09-27.
  7. ↑ 7.0 7.1 "Hummingbird II MicroLED Polychrome Projector". JBD. https://www.jb-display.com/product_des/17.html. Retrieved 2026-09-27.
  8. ↑ 8.0 8.1 8.2 Inbo Sim, Kyusung Choi, Yongmin Baek, et al. (2025-08-13). "Microdisplay technologies in augmented reality and virtual reality headsets". Nature Reviews Electrical Engineering, vol. 2, pp. 634-650. doi:10.1038/s44287-025-00199-x. https://www.nature.com/articles/s44287-025-00199-x. Retrieved 2026-09-27.
  9. ↑ 9.0 9.1 9.2 Lauren Goode (2019-02-24). "Microsoft's HoloLens 2 Puts a Full-Fledged Computer on Your Face". Wired. https://www.wired.com/story/microsoft-hololens-2-headset/. Retrieved 2026-09-27.
  10. ↑ 10.0 10.1 "Titan". WaveOptics. https://web.archive.org/web/20260710165435/https://waveoptics.ar/optical-engines/titan/. Retrieved 2026-09-27.
  11. ↑ Scott Hayden (2021-05-21). "Snap Acquires AR Display Startup WaveOptics for Over $500M". Road to VR. https://www.roadtovr.com/snap-acquires-ar-waveoptics-500m/. Retrieved 2026-09-27.
  12. ↑ 12.0 12.1 Ben Lang (2021-05-25). "Latest Lumus Waveguide Shows Retina Resolution & 50° FOV in AR Glasses Form-factor". Road to VR. https://roadtovr.com/lumus-maximus-impressive-image-clarity-uniformity-ar-glasses/. Retrieved 2026-09-27.
  13. ↑ "Avegant Introduces The World's Smallest LED Light Engines For Augmented Reality". PR Newswire. Avegant. 2021-09-07. https://www.prnewswire.com/news-releases/avegant-introduces-the-worlds-smallest-led-light-engines-for-augmented-reality-301370226.html. Retrieved 2026-09-27.
  14. ↑ 14.0 14.1 "CIOE 2024: JBD Showcases Groundbreaking Hummingbird Series Projector, Ushering in a New Era of AR". JBD. 2024-09-11. https://www.jb-display.com/newsdetails/50.html. Retrieved 2026-09-27.
  15. ↑ 15.0 15.1 "SPS 2024 - Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses". Snap Newsroom. Snap Inc.. 2024-09-17. https://newsroom.snap.com/sps-2024-spectacles-snapos. Retrieved 2026-09-27.
  16. ↑ "Orion: True AR Glasses Have Arrived". Meta Quest Blog. Meta Platforms. 2024-09-25. https://www.meta.com/blog/orion-ar-glasses-augmented-reality/. Retrieved 2026-09-27.
  17. ↑ Scott Hayden (2025-09-17). "Meta Unveils Ray-Ban Smart Glasses with Display, Launching for $800 This Month". Road to VR. https://roadtovr.com/meta-ray-ban-smart-glasses-display-price-release-date-specs/. Retrieved 2026-09-27.
  18. ↑ 18.0 18.1 Karl Guttag (2025-10-30). "Meta Ray-Ban Display Part 1 (Lumus Waveguide, OmniVision LCOS, and Goertek Projection Engine)". KGOnTech. https://kguttag.com/2025/10/30/meta-ray-ban-display-part-1-lumus-waveguide-omnivision-lcos-and-goertek-projection-engine/. Retrieved 2026-09-27.
  19. ↑ 19.0 19.1 "Avegant Introduces 0.7 cc AG-30L3 Full Color Light Engine, Redefining Efficiency and Miniaturization for AR Glasses". PR Newswire. Avegant. 2026-01-21. https://www.prnewswire.com/news-releases/avegant-introduces-0-7-cc-ag-30l3-full-color-light-engine-redefining-efficiency-and-miniaturization-for-ar-glasses-302666214.html. Retrieved 2026-09-27.
  20. ↑ "Zero to One: How Our Custom Silicon & Chips Are Revolutionizing AR". Meta Quest Blog. Meta Platforms. 2025-03-05. https://www.meta.com/blog/orion-custom-silicon-chips-ip-blocks-accelerators-ar-algorithms-energy-efficiency-reality-labs/. Retrieved 2026-09-27.
  21. ↑ En-Lin Hsiang, Zhiyong Yang, Qian Yang, Po-Cheng Lai, Chih-Lung Lin, Shin-Tson Wu (2022). "AR/VR light engines: perspectives and challenges". Advances in Optics and Photonics, vol. 14, no. 4, pp. 783-861. doi:10.1364/AOP.468066. https://opg.optica.org/aop/abstract.cfm?uri=aop-14-4-783. Retrieved 2026-09-27.