Thomas G. Zimmerman
More actions
Thomas G. Zimmerman (Thomas Guthrie Zimmerman, often called Tom Zimmerman) is an inventor and researcher who built an early instrumented glove and patented an optical flex sensor for measuring finger bending. With Jaron Lanier he co-founded VPL Research, where that work led to the DataGlove, one of the first commercially available wired gloves for virtual reality.[1][2][3] He was the first author of the 1987 CHI + GI paper "A hand gesture interface device", which described the VPL glove system, and the first-named inventor on VPL's 1991 patent for glove-based manipulation of virtual objects.[4][5]
He later studied at the MIT Media Lab, where his 1995 master's thesis described a Personal Area Network (PAN) that sends data through the human body by near-field electrostatic coupling. By 1996 he was a researcher at IBM's Almaden Research Center in San Jose, California; later biographies describe him there as a research staff member and master inventor working on human-computer interaction and environmental sensing.[6][7][8][9]
Early life and education
Zimmerman received a B.S. in Humanities and Engineering from the Massachusetts Institute of Technology in February 1980.[6] The 2017 Mental Floss oral history of the Power Glove reports that as a child he had "air-conducted" orchestras and that in 1976, as an MIT undergraduate, he talked with a friend about finding a new way to make music. He said there that he came up with the idea of a glove on which touching fingers together would play chords, but did not get serious about it until 1979 or 1980.[3] Inverse, citing a 2015 documentary, places the start of the glove work in 1981 in his bedroom in Queens, New York, shortly after he graduated from MIT.[10]
He later returned to MIT as a graduate student in the Program in Media Arts and Sciences. His thesis, supervised by Neil Gershenfeld, was submitted on 26 June 1995, and he received an M.S. in Media Arts and Sciences in September 1995.[6]
Career
Optical flex sensor and Atari
Zimmerman's first glove was a home-built input device for an Atari 400 home computer. He told Mental Floss that he chose the Atari 400 because it had eight analog inputs, that he glued an optical sensor that could pick up finger bends onto an old gardening glove, and that he then wrote a program for finger spelling, in which a letter formed with the hand appeared on screen.[3]
On 29 September 1982 he filed a United States patent application for an "optical flex sensor". The patent gives his address as Flushing, New York; it was granted as US Patent 4,542,291 on 17 September 1985 and assigned to VPL Research of Palo Alto, California.[1] The sensor is a flexible tube with a reflective inner wall, a light source at one end and a photosensitive detector at the other; bending the tube changes how much direct and reflected light reaches the detector, so the detector output tracks the bend. The patent claims embodiments in which a tube is secured near a joint on a glove or a body suit, or attached to an elastic bandage, and a variant with colored wall regions that lets the sensor detect the direction of a bend.[1]
Zimmerman later moved to California and joined the video game company Atari. In his account to Mental Floss, his division manager offered him US$10,000 for the glove, which he declined on a friend's advice.[3]
VPL Research and the DataGlove
In his account, after Atari laid off its staff he told Lanier about the glove, made gloves for Lanier on the side, and joined him once Lanier said he had found some funding.[3] Mental Floss and Inverse date the founding of VPL to 1983, and Lanier told Mental Floss that the company incorporated that year.[3][10] Zimmerman said that once VPL was running he designed an ultrasonic tracking device so the company could tell where the glove was "in five dimensions".[3]
The resulting glove system was presented in "A hand gesture interface device" at the joint CHI and Graphics Interface conference held in Toronto from 5 to 9 April 1987. Zimmerman was first author; his co-authors were Lanier, Chuck Blanchard, Steve Bryson and Young Harvill, all of VPL Research in Redwood City, California.[4][11] The paper describes a glove that supplies real-time gesture, position and orientation data. Analog flex sensors on the glove measure finger bending; hand position and orientation come either from ultrasonic sensing, with five degrees of freedom, or from magnetic flux sensing, with six; and piezoceramic benders give the wearer tactile feedback. Listed applications included driving a real-time 3D hand model that manipulates computer-generated objects, interpreting finger spelling, evaluating hand impairment and acting as an interface to a visual programming language.[4] HistoryofInformation.com notes that the optical flex sensor used in the production DataGlove was a separate invention by Young L. Harvill, who scratched the fiber near each finger joint so that it became locally sensitive to bending.[2]
VPL also patented the overall glove interface. US Patent 4,988,981, "Computer data entry and manipulation apparatus and method", names Zimmerman (then of San Francisco) and Jaron Z. Lanier (of Palo Alto) as inventors and VPL Research of Redwood City as assignee. It was filed on 28 February 1989 as a continuation of an application filed on 17 March 1987, and granted on 29 January 1991. The patent covers a glove with sensors for detecting hand gestures, coupled with a hand position sensor, that generates control signals for manipulating virtual objects, typically through a graphical representation of the operator's hand on a monitor.[5]
Inverse reports that VPL's glove was the cover story of the October 1987 issue of Scientific American.[10] Zimmerman also recalled that Scott Fisher, who had worked with him at Atari, moved to NASA, where head-mounted displays were being developed; he described the glove and the head-mounted display as "peanut butter meeting chocolate".[3]
Power Glove
VPL's glove technology was licensed for the Mattel Power Glove, a low-cost controller for the Nintendo Entertainment System released in 1989; Lanier's own biography lists the Power Glove as a toy licensed to Mattel from VPL.[2][12] Zimmerman told Mental Floss that he believed Abrams/Gentile Entertainment (AGE) approached VPL, while Lanier said he had found AGE; Inverse reports that AGE built a demonstration that connected Zimmerman's glove to an NES running the boxing game Punch-Out before the two companies took the glove to Mattel.[3][10] Comparing the toy with the DataGlove, Zimmerman called it "the difference between a Volkswagen and a Rolls-Royce". He also said it was "a tangible manifestation of VR that was mass-marketed", but that because its gameplay was not satisfying it "did the world of VR a huge disservice".[3]
MIT Media Lab and Personal Area Networks
At the MIT Media Lab, Zimmerman worked in Gershenfeld's Physics and Media Group. His 1995 thesis describes PAN as a wireless system that lets electronic devices on and near the body exchange digital data through near-field electrostatic coupling. A transmitter capacitively couples picoamp currents (for example 50 pA) into the body, the body conducts them to body-mounted receivers, and the surrounding room provides the return path. The thesis states that a low-frequency carrier (for example 330 kHz) is used so that no energy is propagated, minimizing remote eavesdropping and interference between neighboring PANs. The prototype half-duplex modem was estimated to cost less than US$20.[6] The thesis also documents the group's electric-field sensing boards, called "fish", of which about fifty had been produced and distributed to researchers.[6] He published the work as "Personal Area Networks: Near-field intrabody communication" in the IBM Systems Journal in 1996.[13]
According to a 1996 San Jose Mercury News report, Zimmerman had been experimenting with a low-frequency current to create a musical trick for the magician Penn Jillette: seated in a special chair, Jillette had the current flow through his body so that the system could detect where his fingers were as he waved his hands like a conductor, with each change of finger position triggering a different musical note. Zimmerman began working on the PAN concept with Gershenfeld after MIT students asked for help with a "body net", and the two realized that the same principle could move data through the human body.[9]
IBM Research
Zimmerman continued the PAN research after moving to IBM's Almaden Research Center. In October 1996 the Mercury News described his prototype as two palm-sized devices that cost about $20 to make and moved data at roughly the speed of a 2400-baud modem; in demonstrations, two people stood on a transmitter and a receiver and exchanged electronic business cards by shaking hands. IBM would not say when such a product might reach consumers.[9] A CITRIS biography from 2007 credits the electric-field PAN with exchanging business cards by handshake and with preventing airbags from injuring children in a Honda Accord.[14]
His later IBM work moved toward sensing in the natural world. He was lead author of a 2014 MobileHCI paper on remote monitoring of sea turtle nests, with co-authors from the National Park Service and other organizations, and a co-author of a 2022 PLOS ONE study describing TurtleSense, a low-cost accelerometer-based system that remotely detects movement and temperature inside sea turtle nests.[15][16] He has also developed AI-powered microscopes for monitoring plankton, work that TED connects with the Center for Cellular Construction; a 2020 paper with Vito P. Pastore, Sujoy K. Biswas and Bianco describes a lensless video microscope on a Raspberry Pi 3 that detects, tracks and classifies plankton at about 5.1 frames per second.[17] He and the cell engineer Simone Bianco gave the TED talk "The wonderful world of life in a drop of water", posted in March 2018.[8] San Francisco State University listed him as an adjunct professor of biology from 1 March 2021 to 28 February 2024.[18]
Biographies give different patent totals depending on their date: 15 in a 2003 Stanford seminar listing, over 30 in 2007, and more than 40 in the Computer History Museum profile; TED gives more than 60.[19][14][7][8] The 2003 Stanford listing also mentions a deployment of handheld devices for self check-in and boarding at an airport in New Zealand and his work on science television and museum exhibits.[19]
Selected patents and publications
| Year | Work | Type | Notes |
|---|---|---|---|
| 1985 | "Optical flex sensor" (US 4,542,291) | Patent | Filed 29 September 1982; light-guide bend sensor with glove and body suit embodiments[1] |
| 1987 | "A hand gesture interface device" | Conference paper (CHI + GI 1987, Toronto) | With Lanier, Blanchard, Bryson and Harvill; describes the VPL glove system[4] |
| 1991 | "Computer data entry and manipulation apparatus and method" (US 4,988,981) | Patent | With Jaron Lanier; glove plus hand position sensing for manipulating virtual objects[5] |
| 1995 | "Personal Area Networks (PAN): Near-Field Intra-Body Communication" | M.S. thesis, MIT | Supervised by Neil Gershenfeld[6] |
| 1996 | "Personal Area Networks: Near-field intrabody communication" | Journal article (IBM Systems Journal) | Vol. 35, no. 3.4, pp. 609-617[13] |
| 2014 | "Design and field testing of a system for remote monitoring of sea turtle nests" | Conference paper (MobileHCI 2014) | Lead author[15] |
| 2020 | "Embedded System to Detect, Track and Classify Plankton Using a Lensless Video Microscope" | Preprint (arXiv) | With Pastore, Biswas and Bianco[17] |
Legacy
HistoryofInformation.com states that both the DataGlove and the Power Glove were based on Zimmerman's original instrumented glove.[2] Speaker biographies for Stanford's HCI seminar (2003) and CITRIS (2007) say that his Data Glove invention "established the field of Virtual Reality", and his TED speaker page says his Data Glove and PowerGlove inventions "helped establish the field of virtual reality".[19][14][8] Later data gloves for VR combine the same elements his 1987 paper described: finger-bend sensing, hand position tracking and tactile feedback.[4] In the Mental Floss oral history he said that, although the patent had expired, he was happy to have been "involved in the first wave of all that".[3]
See also
References
- ↑ 1.0 1.1 1.2 1.3 "US4542291A - Optical flex sensor". Google Patents. 1985-09-17. https://patents.google.com/patent/US4542291A/en. Retrieved 2026-10-13.
- ↑ 2.0 2.1 2.2 2.3 Jeremy M. Norman. "Zimmerman & Lanier Develop the DataGlove, a Hand Gesture Interface Device". HistoryofInformation.com. https://www.historyofinformation.com/detail.php?id=3626. Retrieved 2026-10-13.
- ↑ 3.00 3.01 3.02 3.03 3.04 3.05 3.06 3.07 3.08 3.09 3.10 Jake Rossen (2017-02-22). "An Oral History of Nintendo's Power Glove". Mental Floss. https://www.mentalfloss.com/article/91939/losing-their-grip-oral-history-nintendos-power-glove. Retrieved 2026-10-13.
- ↑ 4.0 4.1 4.2 4.3 4.4 Thomas Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, Young Harvill (1987). "A hand gesture interface device". Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI + GI 1987), pp. 189-192. Graphics Interface / ACM. https://graphicsinterface.org/?p=4994. Retrieved 2026-10-13.
- ↑ 5.0 5.1 5.2 Thomas G. Zimmerman, Jaron Z. Lanier (1991-01-29). "US Patent 4,988,981: Computer data entry and manipulation apparatus and method". United States Patent and Trademark Office. https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/4988981. Retrieved 2026-10-13.
- ↑ 6.0 6.1 6.2 6.3 6.4 6.5 Thomas Guthrie Zimmerman (1995-09). "Personal Area Networks (PAN): Near-Field Intra-Body Communication". Master's thesis, Program in Media Arts and Sciences, Massachusetts Institute of Technology. https://cba.mit.edu/docs/theses/95.09.zimmerman.pdf. Retrieved 2026-10-13.
- ↑ 7.0 7.1 "Tom Zimmerman". Computer History Museum. https://computerhistory.org/profile/tom-zimmerman/. Retrieved 2026-10-13.
- ↑ 8.0 8.1 8.2 8.3 "Tom Zimmerman - Speaker". TED. https://www.ted.com/speakers/tom_zimmerman. Retrieved 2026-10-13.
- ↑ 9.0 9.1 9.2 Janet Rae-Dupree (1996-10-21). "Can touch this: Gadget uses human body to network electronic business cards, smart devices". San Jose Mercury News (reprinted on the Georgia Tech Future Computing Environments mailing list archive). https://sites.cc.gatech.edu/fce/archives/future/0053.html. Retrieved 2026-10-13.
- ↑ 10.0 10.1 10.2 10.3 Eric Francisco (2020-10-22). "How the "failed" Nintendo Power Glove found an unexpected second life". Inverse. https://www.inverse.com/gaming/nintendo-power-glove-second-life. Retrieved 2026-10-13.
- ↑ Thomas G. Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, Young Harvill. "A hand gesture interface device". ACM Digital Library. ACM. https://doi.org/10.1145/29933.275628. Retrieved 2026-10-13.
- ↑ Jaron Lanier. "Jaron Lanier - Bio". jaronlanier.com. http://www.jaronlanier.com/general.html. Retrieved 2026-10-13.
- ↑ 13.0 13.1 T. G. Zimmerman (1996). "Personal Area Networks: Near-field intrabody communication". IBM Systems Journal, vol. 35, no. 3.4, pp. 609-617. IBM. https://doi.org/10.1147/sj.353.0609. Retrieved 2026-10-13.
- ↑ 14.0 14.1 14.2 "CITRIS IBM Day 2007: Biographies". CITRIS and the Banatao Institute. 2007. https://citris-uc.org/citris-ibm-day-2007-biographies/. Retrieved 2026-10-13.
- ↑ 15.0 15.1 Thomas Zimmerman, Britta Muiznieks, Eric Kaplan, Samuel Wantman, Lou Browning, Eric Frey (2014-09-23). "Design and field testing of a system for remote monitoring of sea turtle nests". Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2014). ACM. https://doi.org/10.1145/2628363.2628432. Retrieved 2026-10-13.
- ↑ Erin B. D. Clabough et al. (2022-10-26). "The secret life of baby turtles: A novel system to predict hatchling emergence, detect infertile nests, and remotely monitor sea turtle nest events". PLOS ONE, vol. 17, no. 10. https://doi.org/10.1371/journal.pone.0275088. Retrieved 2026-10-13.
- ↑ 17.0 17.1 Thomas G. Zimmerman, Vito P. Pastore, Sujoy K. Biswas, Simone Bianco (2020-05-26). "Embedded System to Detect, Track and Classify Plankton Using a Lensless Video Microscope". arXiv. https://arxiv.org/abs/2005.13064. Retrieved 2026-10-13.
- ↑ "Thomas Zimmerman". Department of Biology, San Francisco State University. https://biology.sfsu.edu/thomas-zimmerman. Retrieved 2026-10-13.
- ↑ 19.0 19.1 19.2 "Motivations for Invention". Stanford Seminar on People, Computers, and Design. 2003-11-07. https://hci.stanford.edu/seminar/abstracts/03-04/031107-zimmerman.html. Retrieved 2026-10-13.