Ronald Azuma
More actions
Ronald Azuma (Ronald T. Azuma, also known as Ron Azuma) is an American computer scientist and augmented reality researcher. His 1997 paper "A Survey of Augmented Reality", published in the MIT Press journal Presence: Teleoperators and Virtual Environments, defined AR as systems that combine real and virtual, are interactive in real time, and are registered in 3-D.[1] The IEEE Visualization and Graphics Technical Community (VGTC) cited "his widely adopted definition of augmented reality systems" when it gave him its 2025 Virtual Reality Technical Achievement Award.[2]
As a graduate student at the University of North Carolina at Chapel Hill he worked on optical head tracking and on predictive tracking with inertial sensors to reduce dynamic registration error in see-through head-mounted displays.[3] He then spent more than 13 years at HRL Laboratories (formerly Hughes Research Laboratories), led a research group at Nokia Research Center Hollywood from 2008 to 2012, and worked at Intel Labs from June 2012 to October 2024, most recently as principal engineer and research manager.[4] He is an IEEE Fellow and was an inaugural member of the IEEE VGTC Virtual Reality Academy in 2022.[2] His website states that he has retired from full-time work.[5]
Early life and education
Azuma received a B.S. in electrical engineering and computer science from the University of California, Berkeley, in May 1988. His CV lists the degree as awarded with highest honors and notes Chancellor's and National Merit scholarships; it also lists summer work as a software engineer at Apple Computer in Cupertino in 1986, 1987 and 1988.[4] He says that his interest in interactive computer graphics as a Berkeley undergraduate led him to graduate study at UNC Chapel Hill, where he worked on tracking for virtual reality and on early AR systems.[5]
At UNC he earned an M.S. in computer science in 1990 and a Ph.D. in 1995.[2] His dissertation, Predictive Tracking for Augmented Reality (UNC technical report TR95-007, February 1995), was supervised by T. Gary Bishop, with Vernon Chi and Frederick P. Brooks, Jr. as readers.[6] The dissertation separates registration error into static errors, which occur even when the user holds still, and dynamic errors caused by system delays when the user moves, and identifies dynamic errors as usually the largest. It demonstrates that predicting future head locations with the aid of inertial sensors is an effective way to reduce them.[6] His CV lists him as a UNC research assistant from May 1989 to February 1995; he also taught a redesigned "Computers and Society" course there in summer 1992.[4]
Career
Tracking research at UNC
Azuma was a co-author of a 1990 SPIE paper on tracking a head-mounted display in a room-sized environment with head-mounted cameras, written with Jih-Fang Wang, Gary Bishop, Vern Chi, John Eyles and Henry Fuchs.[7] He was the second author of a 1992 paper describing an optoelectronic ceiling tracker. Four head-mounted imaging sensors viewed infrared LEDs set into a grid of 2 ft by 2 ft ceiling panels, the work area could be scaled by adding panels, and the system that was described covered 10 ft by 12 ft with an update rate of 20-100 Hz and 20-60 ms of delay. It was demonstrated in the Tomorrow's Realities gallery at SIGGRAPH 1991.[8] According to UNC's computer science department, Azuma helped design and build the HiBall optical ceiling tracker, which 3rdTech Inc. later commercialized.[2]
His 1994 SIGGRAPH paper with Bishop described an optical see-through HMD system that kept virtual objects registered with real ones across a wide range of viewpoints, using an optoelectronic tracker and three calibration steps for static registration. To reduce dynamic error when the user moved, it predicted future head locations with inertial sensors mounted on the HMD. The paper reported that on average, prediction with inertial sensors produced errors 2-3 times lower than prediction without them and 5-10 times lower than no prediction at all.[3] A follow-up SIGGRAPH 1995 paper with Bishop analyzed head-motion prediction in the frequency domain.[9] He also wrote a short 1993 Communications of the ACM article on tracking requirements for AR.[10] On his website Azuma describes his dissertation system as "the first AR system that worked", in the sense that virtual and real stayed registered while the viewer moved.[5]
HRL Laboratories (1995-2008)
Azuma joined Hughes Research Laboratories in Malibu, California, as a research staff member in March 1995. He became a senior research staff computer scientist at HRL Laboratories in November 1999 and stayed until October 2008.[4]
"A Survey of Augmented Reality" appeared in Presence in August 1997, with Azuma listed at Hughes Research Laboratories. The paper describes AR as a variation of virtual environments in which the user still sees the real world, so that AR "supplements reality, rather than completely replacing it." To avoid tying AR to head-mounted displays, it defines AR as systems with three characteristics: they combine real and virtual, are interactive in real time, and are registered in 3-D. Under this definition, films with photorealistic effects and 2-D overlays on live video do not count, while monitor-based, monocular and see-through HMD systems do. The survey covers medical, manufacturing, visualization, path planning, entertainment and military applications, compares optical and video blending, and treats registration and sensing errors as two of the biggest problems in building AR systems.[1] An earlier version appeared in the ACM SIGGRAPH 1995 course notes.[7] In a 2016 essay for the journal's 25th anniversary, Azuma wrote that the survey became the most cited reference in the field and had been included in a 2012 list of 50 influential articles selected from the history of MIT Press journals; the journal's editors described it as "one of the most influential MIT Press articles of all time."[11]
At HRL, Azuma worked on outdoor AR. A 1999 IEEE Virtual Reality paper by Azuma, Bruce Hoff, Howard Neely III and Ron Sarfaty presented a hybrid tracker that fused rate gyros with a compass and tilt orientation sensor to stabilize an outdoor AR display against user motion. From static locations with moderate head rotation it reported peak registration errors of about 2 degrees and typical errors under 1 degree, while noting that compass drift could increase error over long periods.[12] A companion paper at the same conference, with Suya You and Ulrich Neumann, combined inertial and vision tracking for AR registration.[13] Azuma's website describes this outdoor AR work as including one of the earliest hybrid visual-inertial trackers for AR and a predecessor of how AR tracking works on phones and tablets.[5]
In 2001 Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier and Blair MacIntyre published "Recent Advances in Augmented Reality" in IEEE Computer Graphics and Applications as a complement to the 1997 survey. It restates the definition as systems that combine real and virtual objects in a real environment, run interactively and in real time, and register real and virtual objects with each other. It notes that the definition is not limited to any display technology or to sight, treats the removal of real objects (diminished reality) as a subset of AR, and places AR within Paul Milgram's real-to-virtual continuum.[14] The same year he contributed the chapter "Augmented Reality: Approaches and Technical Challenges" to Fundamentals of Wearable Computers and Augmented Reality, edited by Woodrow Barfield and Thomas Caudell.[7]
His HRL publications also include ISMAR papers on AR label placement and cognition-guided visualization (2002-2003) and on outdoor tracking performance (2006), as well as visualization work for "free flight" air traffic management. His publication list states that a 1996 paper on human-computer interfaces for air traffic management and simulation received the best paper award at the AIAA Flight Simulation Technologies Conference.[7]
Nokia Research Center Hollywood (2008-2012)
From October 2008 to January 2012 Azuma was a research leader at Nokia Research Center Hollywood in Santa Monica, California, supervising two research areas in mobile AR and pervasive computing.[4] He says he helped start that lab, whose team worked on new forms of mobile media.[5] One project was the Westwood Experience, a location-based narrative presented at ISMAR 2010 in which a character playing the "mayor" of Westwood tells a love story mixed with local history on a mobile computer, using mixed reality effects to tie the story to real locations.[15] Other Nokia-era papers covered mobile AR at the Hollywood Walk of Fame and "indirect augmented reality" (2011).[7]
Intel Labs (2012-2024)
Azuma joined Intel Labs in Santa Clara in June 2012 as augmented reality leader. He became principal engineer and research manager in April 2016 and left in October 2024 after volunteering for a severance.[4][5] In the augmented reality leader role his team researched computational displays, head-worn displays and computational imaging.[4]
Intel chief executive Brian Krzanich's keynote at CES 2014 included an augmented reality segment in which a flying whale from the book Leviathan was overlaid onto the auditorium as seen through a tablet.[16] Azuma writes that he wrote the tracker for the tablet AR view in that keynote, operated the tablet himself, and was the main Intel technical expert advising the three Leviathan AR demonstrations, which drew on the world of Scott Westerfeld's novel. Intel Labs produced them in partnership with the USC World Building Media Lab; according to Azuma, Intel engaged Metaio to provide tracking for the two booth demonstrations and the production company Wondros to build the applications.[17]
In his 2016 Presence essay, written as an Intel Labs principal engineer, Azuma listed remaining technical obstacles to consumer AR: precise tracking over large areas, compact wide-field of view optical see-through displays that can block real-world light, interfaces that do not need a keyboard and mouse, and semantic understanding of real environments. He argued that the most important challenge was experiential: establishing AR as a new form of media in which the combination of real and virtual is crucial. He proposed three design strategies, which he called Reinforcing, Reskinning and Remembering, and gave 110 Stories and Pokémon Go as examples of the first two.[11] He followed this with an invited paper, "The Road to Ubiquitous Consumer Augmented Reality Systems", in the first issue of Human Behavior and Emerging Technologies in 2019.[18]
His Intel group also built display prototypes. At SIGGRAPH 2017 it showed a mid-air 3D aerial display, a re-imaged swept-volume display that let people interact with floating 3D objects without a head-mounted apparatus.[19] ThinVR, by Joshua Ratcliff, Alexey Supikov, Santiago Alfaro and Azuma, replaced conventional VR lenses with a curved microlens array of heterogeneous lenslets placed in front of a curved display, aiming for a 180-degree horizontal field of view in a thin head-worn display.[20] It was published in IEEE Transactions on Visualization and Computer Graphics and was listed among the TVCG best journal papers at IEEE VR 2020.[21] The team also published work on view-dependent light-field displays (2020) and on holography calibration (2023).[7]
Professional service
According to his website, Azuma served on the steering committee of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) from 2002 to 2020, chairing it from 2008 to 2012, and later became an emeritus member.[5]
Recognition
| Year | Honor | Notes |
|---|---|---|
| 2013 | Gilbreth Lecture, National Academy of Engineering | Listed among the 2013 Gilbreth lecturers while at Intel IXR.[22] His talk at the NAE National Meeting on 7 February 2013 was titled "Augmented Reality: Meaningful Connections and Compelling Experiences".[23] |
| 2016 | IEEE Fellow | Elected in 2016;[2] his website gives the citation as "for contributions to Augmented Reality".[5] |
| 2020 | IEEE VR 2020 TVCG best journal paper | For ThinVR, with Ratcliff, Supikov and Alfaro.[21] |
| 2022 | Inaugural member, IEEE VGTC Virtual Reality Academy | One of 49 inductees in the first class, announced on 5 May 2022.[24] |
| 2025 | IEEE VGTC Virtual Reality Technical Achievement Award | Presented at IEEE VR 2025 "for his seminal contributions to the field of augmented reality, his widely adopted definition of augmented reality systems, and his development of technology for mixed reality headsets and computational displays."[2][25] |
See also
References
- ↑ 1.0 1.1 Ronald T. Azuma (1997-08). "A Survey of Augmented Reality". Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385. MIT Press. https://doi.org/10.1162/pres.1997.6.4.355. Retrieved 2026-10-04.
- ↑ 2.0 2.1 2.2 2.3 2.4 2.5 "Alumnus Azuma receives 2025 IEEE VGTC Virtual Reality Technical Achievement Award". UNC Department of Computer Science. University of North Carolina at Chapel Hill. 2025-06-12. https://cs.unc.edu/news-article/alumnus-azuma-receives-2025-ieee-vgtc-virtual-reality-technical-achievement-award/. Retrieved 2026-10-04.
- ↑ 3.0 3.1 Ronald Azuma, Gary Bishop (1994). "Improving Static and Dynamic Registration in an Optical See-through HMD". Proceedings of ACM SIGGRAPH 1994, pp. 197-204. ACM. https://doi.org/10.1145/192161.192199. Retrieved 2026-10-04.
- ↑ 4.0 4.1 4.2 4.3 4.4 4.5 4.6 Ronald Azuma. "Ronald Azuma: Education, Experience". ronaldazuma.com. https://www.ronaldazuma.com/experience.html. Retrieved 2026-10-04.
- ↑ 5.0 5.1 5.2 5.3 5.4 5.5 5.6 5.7 Ronald Azuma. "Ronald Azuma: Home". ronaldazuma.com. https://ronaldazuma.com/. Retrieved 2026-10-04.
- ↑ 6.0 6.1 Ronald T. Azuma (1995-02). "Predictive Tracking for Augmented Reality". UNC Chapel Hill Department of Computer Science, technical report TR95-007. https://www.cs.unc.edu/techreports/95-007.pdf. Retrieved 2026-10-04.
- ↑ 7.0 7.1 7.2 7.3 7.4 7.5 Ronald Azuma. "Ronald Azuma: Publications". ronaldazuma.com. https://ronaldazuma.com/publications.html. Retrieved 2026-10-04.
- ↑ Mark Ward, Ronald Azuma, Robert Bennett, Stefan Gottschalk, Henry Fuchs (1992). "A Demonstrated Optical Tracker with Scalable Work Area for Head-Mounted Display Systems". Proceedings of the 1992 Symposium on Interactive 3D Graphics, pp. 43-52. ACM. https://doi.org/10.1145/147156.147162. Retrieved 2026-10-04.
- ↑ Ronald Azuma, Gary Bishop (1995). "A Frequency-Domain Analysis of Head-Motion Prediction". Proceedings of ACM SIGGRAPH 1995, pp. 401-408. ACM. https://doi.org/10.1145/218380.218496. Retrieved 2026-10-04.
- ↑ Ronald Azuma (1993-07). "Tracking Requirements for Augmented Reality". Communications of the ACM, vol. 36, no. 7, pp. 50-51. ACM. https://doi.org/10.1145/159544.159581. Retrieved 2026-10-04.
- ↑ 11.0 11.1 Ronald T. Azuma (2016). "The Most Important Challenge Facing Augmented Reality". Presence: Teleoperators and Virtual Environments, vol. 25, no. 3, pp. 234-238. MIT Press. https://doi.org/10.1162/PRES_a_00264. Retrieved 2026-10-04.
- ↑ Ronald Azuma, Bruce Hoff, Howard Neely III, Ron Sarfaty (1999). "A Motion-Stabilized Outdoor Augmented Reality System". Proceedings of IEEE Virtual Reality 1999, pp. 252-259. IEEE. https://doi.org/10.1109/VR.1999.756959. Retrieved 2026-10-04.
- ↑ Suya You, Ulrich Neumann, Ronald Azuma (1999). "Hybrid Inertial and Vision Tracking for Augmented Reality Registration". Proceedings of IEEE Virtual Reality 1999, pp. 260-267. IEEE. https://doi.org/10.1109/VR.1999.756960. Retrieved 2026-10-04.
- ↑ Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, Blair MacIntyre (2001). "Recent Advances in Augmented Reality". IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47. IEEE. https://doi.org/10.1109/38.963459. Retrieved 2026-10-04.
- ↑ Jason Wither, Rebecca Allen, Vids Samanta, Juha Hemanus, Yun-Ta Tsai, Ronald Azuma, Will Carter, Rachel Hinman, Thommen Korah (2010-10). "The Westwood Experience: Connecting Story to Locations Via Mixed Reality". IEEE International Symposium on Mixed and Augmented Reality 2010, Arts, Media and Humanities, pp. 39-46. IEEE. https://www.ronaldazuma.com/papers/ISMAR2010_paper.pdf. Retrieved 2026-10-04.
- ↑ Dylan Tweney (2014-01-06). "Intel CES demo includes 3D scanning, 3D printing, 3D interfaces, and a flying whale". VentureBeat. https://venturebeat.com/2014/01/06/intel-flying-whale/. Retrieved 2026-10-04.
- ↑ Ronald Azuma. "Leviathan at CES 2014". ronaldazuma.com. https://ronaldazuma.com/Leviathan_at_CES2014.html. Retrieved 2026-10-04.
- ↑ Ronald T. Azuma (2019-01). "The Road to Ubiquitous Consumer Augmented Reality Systems". Human Behavior and Emerging Technologies, vol. 1, no. 1, pp. 26-32. Wiley. https://doi.org/10.1002/hbe2.113. Retrieved 2026-10-04.
- ↑ Seth Hunter, Ron Azuma, Jonathan Moisant-Thompson, Dave MacLeod, Derek Disanjh (2017-07). "Mid-Air Interaction with a 3D Aerial Display". SIGGRAPH 2017 Emerging Technologies. ACM SIGGRAPH. https://www.ronaldazuma.com/papers/MidAir_SIGGRAPH2017.pdf. Retrieved 2026-10-04.
- ↑ Joshua Ratcliff, Alexey Supikov, Santiago Alfaro, Ronald Azuma (2020-05). "ThinVR: Heterogeneous microlens arrays for compact, 180 degree FOV VR near-eye displays". IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 5, pp. 1981-1990. IEEE. https://doi.org/10.1109/TVCG.2020.2973064. Retrieved 2026-10-04.
- ↑ 21.0 21.1 "IEEE VR 2020 Conference Awards". IEEE VR 2020. IEEE. https://ieeevr.org/2020/awards/conference.html. Retrieved 2026-10-04.
- ↑ "Armstrong Endowment for Young Engineers - Gilbreth Lectures". National Academy of Engineering. https://www.nae.edu/31202/Armstrong-Endowment-for-Young-Engineers-Gilbreth-Lectures-. Retrieved 2026-10-04.
- ↑ "Augmented Reality: Meaningful Connections and Compelling Experiences". National Academy of Engineering. 2013-02-07. https://www.nae.edu/67547/Augmented-Reality-Meaningful-Connections-and-Compelling-Experiences. Retrieved 2026-10-04.
- ↑ "IEEE Virtual Reality Academy Celebrates Inaugural Class of 2022 Inductees". IEEE Computer Society. 2022-05-05. https://www.computer.org/press-room/2022-news/ieee-virtual-reality-academy-2022-inductees. Retrieved 2026-10-04.
- ↑ "Virtual Reality Technical Awards". IEEE Computer Society Technical Community on Visualization and Graphics. https://tc.computer.org/vgtc/awards/virtual-augmented-reality-technical-awards/. Retrieved 2026-10-04.