Louis Rosenberg
More actions
Louis Rosenberg (published as Louis B. Rosenberg) is an American engineer, inventor and entrepreneur known for early work in augmented reality and haptics. As a Stanford University doctoral researcher funded by the United States Air Force's Armstrong Laboratory, he built the Virtual Fixtures system at Wright-Patterson Air Force Base in the early 1990s, a setup that eventually filled half a room and overlaid computer-generated guides and force sensations on a user's view of a real workspace.[1][2] In May 1993 he founded Immersion Corporation, a force-feedback company that he led as chief executive until October 2000 and took public on Nasdaq in November 1999.[3][4]
He later founded Outland Research, two of whose patents, covering location-based reminders and a head-worn see-through music display, were reassigned to Google in 2011, and in 2014 founded Unanimous AI, where he is chief executive officer and chief scientist.[5][6][7] Since the early 2020s he has written and spoken about the privacy and manipulation risks of AI-driven virtual and augmented reality, including as chief scientist of the Responsible Metaverse Alliance and as co-author, with Alvin Wang Graylin, of the 2024 book Our Next Reality.[8][5]
Education
Rosenberg holds bachelor of science, master of science and doctorate degrees in mechanical engineering from Stanford University.[4] He proposed the Virtual Fixtures project as his doctoral research in 1991, and his personal publication list gives his doctoral thesis, "Virtual Fixtures: Perceptual Overlays Enhance Operator Performance" (Stanford University, Center for Design Research), as completed in 1994.[1][9] During the same period he was a part-time researcher in the Advanced Displays and Spatial Perception Laboratory at NASA's Ames Research Center, which studied the parameters needed for realistic simulated environments.[1] NASA's Spinoff publication records that he collaborated there with Bernard Adelstein on studies of perception in virtual reality.[10]
Career
Virtual Fixtures (1991-1994)
In his 2022 account for IEEE Spectrum, Rosenberg wrote that he pitched the Virtual Fixtures concept to the Human Sensory Feedback Group of the Air Force's Armstrong Laboratory (now part of the Air Force Research Laboratory). The Air Force covered his Stanford expenses, gave him a small equipment budget and allowed him to use computers and equipment at Wright-Patterson Air Force Base near Dayton, Ohio.[1] The idea was to place perceptual aids, which he compared to a ruler that appears in the real world and feels physically real, into a real task so that an operator could work faster and more precisely.[1][2]
The user climbed into an upper-body exoskeleton fitted with sensors, motors, gears and bearings and looked into the eyepieces of a vision system hung from the ceiling. Motors in the exoskeleton produced the feel of virtual objects, and video cameras were needed to register those objects in three dimensions with a real pegboard. Rosenberg wrote that suitable cameras became available only after a parachute test at the base failed in the summer of 1992 and a dummy rig crashed; he assembled two working units from the six damaged cameras.[1] By the end of the project, after three years and several prototypes, the system filled half a room and used nearly US$1 million of hardware.[1]
Test subjects performed a peg-insertion task based on Fitts's law. Virtual fixtures such as cone-shaped guides, surfaces that stopped overshoot, and "magnetically attractive" surfaces that drew the peg to its target improved speed and dexterity in the trials by more than 100 percent, according to Rosenberg.[1] He published the concept in 1993 at the IEEE Virtual Reality Annual International Symposium (VRAIS) and at an SPIE telemanipulation conference.[2][11] At the same 1993 VRAIS symposium he presented a study of how interocular distance affects operator performance on virtual depth tasks with stereoscopic displays, and later that year he and Adelstein presented a paper on the perceptual decomposition of virtual haptic surfaces at the IEEE Research Properties in Virtual Reality Symposium.[12][13]
The term virtual fixture was later taken up in robotics research. In a paper on haptic virtual fixtures, Johns Hopkins University researchers Jake J. Abbott, Panadda Marayong and Allison M. Okamura cited Rosenberg's 1993 VRAIS paper as implementing forbidden-region virtual fixtures as impedance surfaces on the master device of a telemanipulation system to assist peg-in-hole tasks.[14] IEEE Spectrum captioned Rosenberg's 2022 account by calling Virtual Fixtures "the first interactive augmented-reality system", and biographies published by Unanimous AI and by his book publisher describe it as the first functional augmented reality system and the first mixed reality system respectively.[1][5][15] He revisited the project in a 2021 conference paper, "Augmented Reality: Reflections at Thirty Years".[16]
Immersion Corporation
Rosenberg wrote that the reactions to his Virtual Fixtures prototypes led him to found Immersion in 1993 to pursue consumer applications.[1] The company was incorporated in California in May 1993, and Rosenberg served as its chairman, president and chief executive officer from that month.[4] NASA's Spinoff publication traced the company's I-FORCE force feedback technology to the virtual environment and human factors research at the Ames Advanced Displays and Spatial Perception Laboratory and Stanford's Center for Design Research.[10]
According to Immersion's 1999 annual report, the company began developing touch-enabled computer peripherals in 1993, built its first three-dimensional digitizer in 1994 (later sold as the MicroScribe-3D), introduced its Impulse Engine line of high-end force-feedback devices in 1995, and launched the I-FORCE consumer licensing brand in 1996, the year the first joystick using it appeared. Its FEELit technology for touch-enabled mice followed in 1997 and was licensed to Logitech in 1998; Logitech began selling the first such mouse in the fourth quarter of 1999.[4] The same report listed specialized medical training and simulation products, including the Virtual Laparoscopic Interface, the Laparoscopic Impulse Engine for virtual reality simulations of laparoscopic and endoscopic surgery, and an Endoscopic Sinus Surgery Simulation Trainer.[4] Rosenberg co-authored research on this work, including a 1996 paper with Don Stredney on a haptic interface for simulating endoscopic surgery and a CHI 1996 paper with Scott Brave on using force feedback in graphical user interfaces.[17][18]
Immersion's initial public offering on the Nasdaq National Market, under the symbol IMMR, took place on November 12, 1999 at US$12.00 per share.[4] Rosenberg remained president and chief executive until October 2000 and was still chairman in March 2001.[3] The company's 2002 annual report describes him as its former chief executive officer, president and chairman and lists an independent consultant services agreement with him dated February 11, 2002.[19]
Outland Research
Rosenberg's publisher and his company biography give 2004 as the year he founded Outland Research, which the publisher describes as an early developer of augmented reality and spatial media technology.[5][15] Patents he filed through Outland include a spatially associated personal reminder system, in which a portable device shows a reminder when the user enters or leaves a trigger area defined on geospatial imagery, and a portable music player that sends visual content to a head-worn transmissive display, overlaid on the wearer's direct view of the surroundings and timed to the music.[20][6] Both patents, originally assigned to Outland Research LLC, were reassigned to Google Inc. in an assignment recorded on August 29, 2011.[20][6]
Academia
Rosenberg was a faculty member in the College of Engineering at California Polytechnic State University, San Luis Obispo.[21] His publisher's biography states that he was a tenured professor at California State University.[5]
Unanimous AI and XR advocacy
Rosenberg founded Unanimous AI in 2014 to develop "swarm" methods for combining the judgments of networked groups of people.[5][21] As of June 2026 the company identified him as its chief executive officer and chief scientist.[7]
He has also co-authored XR privacy research with researchers at the University of California, Berkeley. A 2023 USENIX Security Symposium paper, which lists him with a Unanimous AI affiliation, reported that, in a dataset of 55,541 real VR users, a user could be uniquely identified among the whole pool from head and hand motion data with 94.33 percent accuracy from 100 seconds of motion and 73.20 percent accuracy from 10 seconds.[22] The same group published the BOXRR-23 dataset of 4.7 million motion capture recordings from 105,000 XR users in IEEE Transactions on Visualization and Computer Graphics and a 2024 IEEE Security & Privacy article on the risks of XR motion data.[23][24] These topics are covered more broadly in Privacy in virtual and augmented reality.
As chief scientist of the Responsible Metaverse Alliance, Rosenberg submitted a comment to the U.S. Federal Trade Commission on October 18, 2022, arguing that metaverse platforms combining real-time surveillance with real-time promotional influence should be regulated to restrict behavioral and emotional profiling of users.[8] He set out a regulatory proposal in "Regulation of the Metaverse: A Roadmap" at the 6th International Conference on Virtual and Augmented Reality Simulations in 2022.[25] He wrote and produced Privacy Lost (2023), a micro short film directed by Peter Stoel and Robert Berger about a family wearing AI-powered mixed reality glasses that monitor behavior and emotions; it was made with support from Minderoo Pictures, the Responsible Metaverse Alliance and the XR Guild.[26] In his 2022 IEEE Spectrum article he predicted that "by the early 2030s augmented reality will replace the mobile phone as our primary interface to digital content."[1]
Our Next Reality: How the AI-powered Metaverse Will Reshape the World, co-written with former HTC China president Alvin Wang Graylin and with a foreword by Neal Stephenson, was published by Hachette's John Murray Business imprint in March 2024. Its publisher describes it as a debate between the two authors on whether AI combined with immersive eyewear will lead to a utopian or dystopian future, with section contributions from Peter H. Diamandis, Tom Furness and other industry figures.[5][27]
Recognition
Rosenberg is listed in the AWE XR Hall of Fame, maintained by the Augmented World Expo, as a "Haptics Pioneer, MR Pioneer, VR & AI Consumer Advocate"; the entry summarizes his 1991 to 1994 mixed reality research for the US Air Force at Wright-Patterson.[28] His publisher and his company biography state that he has been awarded more than 300 patents for VR, AR and AI technologies.[5][15]
References
- ↑ 1.00 1.01 1.02 1.03 1.04 1.05 1.06 1.07 1.08 1.09 1.10 Louis Rosenberg (2022-04-07). "How a Parachute Accident Helped Jump-start Augmented Reality". IEEE Spectrum. https://spectrum.ieee.org/history-of-augmented-reality. Retrieved 2026-10-04.
- ↑ 2.0 2.1 2.2 L. B. Rosenberg (1993). "Virtual fixtures: Perceptual tools for telerobotic manipulation". Proceedings of IEEE Virtual Reality Annual International Symposium, pp. 76-82. https://doi.org/10.1109/VRAIS.1993.380795. Retrieved 2026-10-04.
- ↑ 3.0 3.1 "Immersion Corporation Annual Report (Form 10-K) for fiscal year 2000". U.S. Securities and Exchange Commission. Immersion Corporation. 2001-04-02. https://www.sec.gov/Archives/edgar/data/1058811/000089161801000265/f70292e10-k405.txt. Retrieved 2026-10-04.
- ↑ 4.0 4.1 4.2 4.3 4.4 4.5 "Immersion Corporation Annual Report (Form 10-K) for fiscal year 1999". U.S. Securities and Exchange Commission. Immersion Corporation. 2000-03-23. https://www.sec.gov/Archives/edgar/data/1058811/000089161800001663/0000891618-00-001663.txt. Retrieved 2026-10-04.
- ↑ 5.0 5.1 5.2 5.3 5.4 5.5 5.6 5.7 "Our Next Reality: How the AI-powered Metaverse Will Reshape the World (press release)". Hachette UK. https://www.hachette.co.uk/wp-content/uploads/2023/10/Our-Next-Reality-Press-Release.pdf. Retrieved 2026-10-04.
- ↑ 6.0 6.1 6.2 "US7732694B2 - Portable music player with synchronized transmissive visual overlays". Google Patents. https://patents.google.com/patent/US7732694B2/en. Retrieved 2026-10-04.
- ↑ 7.0 7.1 "We've Been Busy: Four Milestones That Show Where Unanimous AI is Heading". Unanimous AI. 2026-06-16. https://unanimous.ai/weve-been-busy-four-milestones-that-show-where-unanimous-ai-is-heading/. Retrieved 2026-10-04.
- ↑ 8.0 8.1 Louis Rosenberg (2022-10-18). "The Metaverse: the Ultimate Tool of Persuasion (comment to the Federal Trade Commission)". Responsible Metaverse Alliance. https://responsiblemetaverse.org/wp-content/uploads/2022/10/The-Ultimate-Tool-of-Persuasion-FTC-Rosenberg-with-letter.pdf. Retrieved 2026-10-04.
- ↑ Louis B. Rosenberg. "Louis B. Rosenberg, PhD - Academic Papers". Louis B. Rosenberg (personal website). https://sites.google.com/view/louisrosenberg/academic-papers. Retrieved 2026-10-04.
- ↑ 10.0 10.1 "Force Feedback Joystick". NASA Spinoff. NASA. 1997. https://spinoff.nasa.gov/node/10009. Retrieved 2026-10-04.
- ↑ L. B. Rosenberg (1993-12-21). "Virtual fixtures as tools to enhance operator performance in telepresence environments". Proceedings of SPIE, vol. 2057, Telemanipulator Technology and Space Telerobotics, pp. 10-21. https://doi.org/10.1117/12.164901. Retrieved 2026-10-04.
- ↑ L. B. Rosenberg (1993). "The effect of interocular distance upon operator performance using stereoscopic displays to perform virtual depth tasks". Proceedings of IEEE Virtual Reality Annual International Symposium, pp. 27-32. https://doi.org/10.1109/VRAIS.1993.380802. Retrieved 2026-10-04.
- ↑ L. B. Rosenberg, B. D. Adelstein (1993). "Perceptual decomposition of virtual haptic surfaces". Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium, pp. 46-53. https://doi.org/10.1109/VRAIS.1993.378264. Retrieved 2026-10-04.
- ↑ Jake J. Abbott, Panadda Marayong, Allison M. Okamura. "Haptic Virtual Fixtures for Robot-Assisted Manipulation". Robotics Research (Springer Tracts in Advanced Robotics), pp. 49-64. doi:10.1007/978-3-540-48113-3_5. http://robots.stanford.edu/isrr-papers/draft/abbott-final.pdf. Retrieved 2026-10-04.
- ↑ 15.0 15.1 15.2 "Louis Rosenberg, PhD". Unanimous AI. https://unanimous.ai/staff-item/louis-rosenberg-phd/. Retrieved 2026-10-04.
- ↑ Louis B. Rosenberg (2021-10-24). "Augmented Reality: Reflections at Thirty Years". Proceedings of the Future Technologies Conference (FTC) 2021, Volume 1 (Lecture Notes in Networks and Systems), pp. 1-11. https://doi.org/10.1007/978-3-030-89906-6_1. Retrieved 2026-10-04.
- ↑ Louis B. Rosenberg, Don Stredney (1996). "A Haptic Interface for Virtual Simulation of Endoscopic Surgery". Studies in Health Technology and Informatics (Medicine Meets Virtual Reality). https://doi.org/10.3233/978-1-60750-873-1-371. Retrieved 2026-10-04.
- ↑ Louis Rosenberg, Scott Brave (1996). "Using force feedback to enhance human performance in graphical user interfaces". CHI '96 Conference Companion, pp. 291-292. https://doi.org/10.1145/257089.257327. Retrieved 2026-10-04.
- ↑ "Immersion Corporation Annual Report (Form 10-K405) for fiscal year 2001". U.S. Securities and Exchange Commission. Immersion Corporation. 2002-03-28. https://www.sec.gov/Archives/edgar/data/1058811/000089161802001523/f79567e10-k405.htm. Retrieved 2026-10-04.
- ↑ 20.0 20.1 "US7577522B2 - Spatially associated personal reminder system and method". Google Patents. https://patents.google.com/patent/US7577522B2/en. Retrieved 2026-10-04.
- ↑ 21.0 21.1 "Cal Poly Professors Partner with Artificial Intelligence Pioneer to Publish Innovative Research". Cal Poly College of Liberal Arts. California Polytechnic State University. 2018. https://web.archive.org/web/20191201013839/https://cla.calpoly.edu/link/fall-2018/artificial-intelligence-research. Retrieved 2026-10-04.
- ↑ Vivek Nair, Wenbo Guo, Justus Mattern, Rui Wang, James F. O'Brien, Louis Rosenberg, Dawn Song (2023). "Unique Identification of 50,000+ Virtual Reality Users from Head & Hand Motion Data". 32nd USENIX Security Symposium. USENIX. https://www.usenix.org/conference/usenixsecurity23/presentation/nair-identification. Retrieved 2026-10-04.
- ↑ Vivek Nair, Wenbo Guo, Rui Wang, James F. O'Brien, Louis Rosenberg, Dawn Song (2024-05). "Berkeley Open Extended Reality Recordings 2023 (BOXRR-23): 4.7 Million Motion Capture Recordings from 105,000 XR Users". IEEE Transactions on Visualization and Computer Graphics, vol. 30, no. 5, pp. 2239-2246. https://doi.org/10.1109/TVCG.2024.3372087. Retrieved 2026-10-04.
- ↑ Vivek Nair, Louis Rosenberg, James F. O'Brien, Dawn Song (2024-01). "Truth in Motion: The Unprecedented Risks and Opportunities of Extended Reality Motion Data". IEEE Security & Privacy, vol. 22, no. 1, pp. 24-32. https://doi.org/10.1109/MSEC.2023.3330392. Retrieved 2026-10-04.
- ↑ Louis Rosenberg (2022-03-25). "Regulation of the Metaverse: A Roadmap". 2022 the 6th International Conference on Virtual and Augmented Reality Simulations (ICVARS), pp. 21-26. https://doi.org/10.1145/3546607.3546611. Retrieved 2026-10-04.
- ↑ "Privacy Lost". Privacy Lost (official film website). https://www.privacylost.org/. Retrieved 2026-10-04.
- ↑ "Our Next Reality". Hachette UK. https://www.hachette.co.uk/titles/alvin-wang-graylin/our-next-reality/9781399812269/. Retrieved 2026-10-04.
- ↑ "Louis Rosenberg". AWE XR Hall of Fame. Augmented World Expo. https://www.awexr.com/hall-of-fame/55-louis-rosenberg. Retrieved 2026-10-04.