Steve Mann
Steve Mann (born June 8, 1962) is a Canadian engineer, inventor, and researcher in wearable computing and computer vision. He is a tenured professor in the Department of Electrical and Computer Engineering at the University of Toronto and is frequently described in academic and press coverage as the "father of wearable computing".[1][2]
Mann is known for building and continuously wearing computerized vision systems for several decades, for the EyeTap (also called the Digital Eye Glass), and for the concept of mediated reality, a framework he proposed in 1994 that treats computational modification of a person's perception of the world as a single category encompassing augmented reality, virtual reality, and the deliberate removal or alteration of real-world content.[3][1] His work on body-worn cameras and displays predates and is widely cited as a precursor to consumer augmented reality glasses such as Google Glass and headsets from Magic Leap.[1] In 2025 he received the IEEE Masaru Ibuka Consumer Technology Award for contributions to wearable computing and high dynamic range imaging.[4]
Early life and education
Mann was born on June 8, 1962, in Hamilton, Ontario, Canada.[5] He began building wearable electronics and computer-vision apparatus while in high school in the 1970s, including a backpack-mounted computer based on the 6502 microprocessor.[5][1] He attended McMaster University in Hamilton, earning a bachelor of science, a bachelor of engineering, and a master of engineering between the mid-1980s and the early 1990s.[5][1]
In 1991 Mann moved to the Massachusetts Institute of Technology, where he was the first member of what became the MIT Media Lab's wearable computing project.[1][5] He completed a PhD in media arts and sciences at the MIT Media Lab in 1997; his doctoral advisor was Rosalind Picard.[5] He joined the University of Toronto as a professor of electrical and computer engineering in 1998 and holds cross-appointments to other faculties at the university.[5][1]
Wearable computing
Mann's central long-term project has been the design of computers worn on the body that mediate vision through a camera and a display positioned in front of the eye. He used the term "WearComp" for the wearable computing systems and "WearCam" for the wearable camera apparatus, and he published a description of the field in the paper "Wearable Computing: A First Step Toward Personal Imaging" in IEEE Computer in February 1997, followed by the article "Wearable Computing" in the same magazine.[6][1] He helped found the International Symposium on Wearable Computers (ISWC) in 1997.[1]
From 1994 to 1996 Mann ran an experiment he called the Wearable Wireless Webcam, transmitting live video from a body-worn camera to a web page on an essentially continuous, around-the-clock basis while also receiving messages on his display from online viewers. This is commonly cited as an early example of lifelogging and continuous personal broadcasting.[5][1]
In 1998 Mann built a wristwatch-based computer with videophone and, by later accounts, app-downloading capability; the device was presented at the IEEE International Solid-State Circuits Conference (ISSCC) in February 2000, where he was introduced as the father of wearable computing.[5][4] The IEEE later credited him with creating an early smartwatch capable of downloading applications for health and fitness use.[4]
Selected timeline
| Year | Event |
|---|---|
| 1970s | Builds backpack-mounted 6502-based wearable computer and early computer-vision apparatus as a high school student[1][5] |
| 1991 | Joins MIT; first member of the Media Lab wearable computing project[1] |
| 1994 | Proposes mediated reality (MIT technical report); begins the Wearable Wireless Webcam experiment[3][5] |
| 1997 | Completes PhD at the MIT Media Lab; publishes wearable computing papers in IEEE Computer; helps found ISWC[5][6] |
| 1998 | Joins the University of Toronto; builds wristwatch videophone computer[5] |
| 2000 | Wristwatch computer presented at IEEE ISSCC; named "father of wearable computing"[4][5] |
| 2013 | Becomes chief scientist of the augmented reality company Meta[7] |
| 2025 | Receives IEEE Masaru Ibuka Consumer Technology Award[4] |
EyeTap and the Digital Eye Glass
The EyeTap, which Mann also calls the Digital Eye Glass, is a head-worn device that makes the eye function as both a camera and a display. An optical system diverts incoming light so that a camera captures the same rays that would otherwise enter the eye, while a display reflects a processed image back into the eye, so that the wearer sees a computationally mediated version of the scene in front of them.[5][1] Because the captured viewpoint is collinear with the eye's own line of sight, the device can overlay graphics, brighten dark areas, dim bright ones, or remove objects from view.[3][5]
Mann has criticized single-eye information displays of the kind used in early consumer smart glasses, arguing that fixing one eye's focus at a set distance while the other eye refocuses on the real world causes eyestrain, a problem he says he encountered in his own earlier prototypes.[2]
Mann introduced mediated reality in a 1994 MIT technical report as a category broader than augmented reality. Where augmented reality typically adds graphics or text on top of an otherwise unmodified view, mediated reality also includes diminishing or altering what the user sees, for example darkening over-bright regions of a scene.[3][5] In a 2018 paper written with Tom Furness and others, Mann placed virtual reality, augmented reality, and mixed reality inside mediated reality, and proposed "multimediated reality" as a further extension that maps signals outside ordinary human perception, such as radio waves or sonar, onto the senses.[3]
Mann coined the term "sousveillance" for the inverse of surveillance: the use of personal, often body-worn, recording devices by individuals to record activity, including recording those in positions of authority, rather than recording being directed downward from institutions onto individuals.[1][5] He has written on the social and ethical dimensions of wearable cameras, and has served in IEEE roles connected to technology and society, including chairing the IEEE International Symposium on Technology and Society held at the University of Toronto in 2013.[2][1]
High dynamic range imaging
Mann is credited with early work on high dynamic range (HDR) imaging, the technique of combining multiple exposures of the same scene to capture a wider range of brightness than a single exposure allows. The IEEE cited his contributions to HDR imaging, noting that the approach is now used in most commercial smartphone cameras and in computer-vision and assistive systems, in its 2025 award to him.[4] His HDR research grew out of his personal imaging and wearable camera work, where adapting a continuously worn camera to widely varying real-world lighting was a practical requirement.[4][6]
Role in VR, AR, and XR
Mann's wearable, eye-worn camera-and-display systems are a documented antecedent of modern augmented reality and virtual reality head-mounted hardware. His EyeTap predates consumer optical see-through products, and his prototypes of the 1980s and 1990s combined a head-mounted display, body-worn cameras, and portable computing of the kind later commercialized in augmented reality glasses such as Google Glass and headsets from Magic Leap.[1] His framing of augmented reality and virtual reality as subsets of mediated reality has been used as a vocabulary for describing the continuum between fully synthetic and partly real displays.[3]
In May 2013 Mann became chief scientist of Meta, an augmented reality startup founded the previous year by Meron Gribetz. Gribetz cited Mann's work on mediated reality and on occlusion (hiding or modifying real-world objects in the view) as reasons for the hire, and the company's first product was a beta augmented reality headset paired with a depth camera for hand-gesture interaction.[7][8] Meta later released the Meta 2 headset, but the company became insolvent in 2019 and is no longer operating.[9]
Mann is also a co-founder and scientific advisor of InteraXon, a Toronto-based neurotechnology company founded in 2007 that makes the Muse brain-sensing headband, an electroencephalography (EEG) device used in meditation and research applications.[1]
2012 Paris incident
On July 1, 2012, Mann reported that he was physically confronted by staff at a McDonald's restaurant on the Champs-Elysees in Paris while wearing his EyeTap, which is attached to his head and not easily removed. According to Mann, employees attempted to pull the device from his head and damaged it, and tore up a letter from his doctor describing the apparatus. McDonald's France disputed his account, saying that its staff had been polite and had not been involved in a physical altercation or damaged any of his possessions. Mann recovered images from the device's memory and described the episode in terms of discrimination against a person whose body is integrated with technology.[10][11]
Awards and recognition
| Year | Recognition |
|---|---|
| 2000 | Introduced as the "father of wearable computing" at IEEE ISSCC[4][5] |
| 2024 | Elevated to IEEE Fellow[5] |
| 2025 | IEEE Masaru Ibuka Consumer Technology Award, for contributions to wearable computing and high dynamic range imaging[4] |
References
- ↑ 1.00 1.01 1.02 1.03 1.04 1.05 1.06 1.07 1.08 1.09 1.10 1.11 1.12 1.13 1.14 1.15 1.16 "Steve Mann: Pioneer of Wearables and Extended Reality". 2024. https://spectrum.ieee.org/engineer-conjured-up-extended-reality.
- ↑ 2.0 2.1 2.2 "Meet Steve Mann, father of wearable computing". https://www.utoronto.ca/news/meet-steve-mann-father-wearable-computing.
- ↑ 3.0 3.1 3.2 3.3 3.4 3.5 "All Reality: Virtual, Augmented, Mixed (X), Mediated (X,Y), and Multimediated Reality". 2018-04-08. https://arxiv.org/abs/1804.08386.
- ↑ 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 "William Stephen George Mann - 2025 IEEE Masaru Ibuka Consumer Technology Award". https://corporate-awards.ieee.org/recipient/william-stephen-george-mann/.
- ↑ 5.00 5.01 5.02 5.03 5.04 5.05 5.06 5.07 5.08 5.09 5.10 5.11 5.12 5.13 5.14 5.15 5.16 5.17 5.18 "Steve Mann (inventor)". https://en.wikipedia.org/wiki/Steve_Mann_(inventor).
- ↑ 6.0 6.1 6.2 "Wearable Computing: A First Step Toward Personal Imaging". 1997-02. http://wearcam.org/ieeecomputer/r2025.htm.
- ↑ 7.0 7.1 "Meta Brings On Steve Mann, Father Of Wearable Computing, As Chief Scientist". 2013-05-21. https://techcrunch.com/2013/05/21/meta-the-worlds-first-entry-level-vr-glasses-brings-on-steve-cyborg-mann-father-of-wearable-computing/.
- ↑ "Startup hires 'cyborg' Mann for Google Glass-killer project". 2013-05-22. https://www.theregister.com/2013/05/22/meta_steve_mann_project/.
- ↑ "Meta (augmented reality company)". https://en.wikipedia.org/wiki/Meta_(augmented_reality_company).
- ↑ "Steve Mann's EyeTap: Was an assault at a Paris McDonald's the first cybernetic hate crime?". 2012-07. https://slate.com/technology/2012/07/steve-mann-s-eyetap-was-an-assault-at-a-paris-mcdonald-s-the-first-cybernetic-hate-crime.html.
- ↑ "Steve Mann, Inventor, Allegedly Attacked At Paris McDonald's For Wearing Digital Eye Glass". 2012-07-17. http://www.huffingtonpost.com/2012/07/17/steve-mann-attacked-paris-mcdonalds-digital-eye-glass-photos_n_1680263.html.