Jump to content

Smart glasses

From VR & AR Wiki
See also: Terms and Technical Terms
See also: AR glasses
Google Glass

Smart glasses are wearable computing devices that resemble conventional eyewear but feature integrated electronic components that can provide a variety of functions, most prominently augmented reality (AR) capabilities. Unlike fully immersive virtual reality (VR) headsets, smart glasses typically overlay digital information onto the user's view of the real world.[1] They represent one of the most promising and challenging frontiers in the evolution of mixed reality technologies.

Smart glasses can function as wearable computers: they support wireless connectivity like Bluetooth, Wi-Fi, and GPS, and can run self-contained mobile apps or connect to a smartphone for processing power and data.[2] Some models accept voice input with speech recognition while others provide touch controls via side panels or use gesture recognition systems.

History and development

The conceptual origins of head-worn displays trace back decades. In the 1960s, computer scientist Ivan Sutherland created the first head-mounted display system called "The Sword of Damocles" in 1968.[3] While not specifically designed as eyewear, this pioneering work laid the foundation for future developments.

In the late 1970s, Steve Mann created the "Digital Eye Glass," furthering early wearable computing concepts.[4] The term "augmented reality" itself was coined in 1990 by Boeing researcher Thomas Caudell.[5]

The development of Bluetooth in 1994 and its consumer launch in 1999 were key enabling technologies for future smart glasses.[6] Early 21st-century efforts included Epson's Moverio BT-100 in 2011.

The modern era of smart glasses gained significant public attention with the announcement of Google Glass in April 2012 and the launch of its "Explorer Edition" prototype in 2013.[7] This device brought mainstream attention to the concept of computer-enabled eyewear, though its consumer version was discontinued in 2015 before being reoriented toward enterprise applications after facing challenges with privacy concerns and social acceptance.[8] Sales of all Google Glass versions were ultimately suspended in March 2023.

Throughout the 2010s and early 2020s, numerous companies including Microsoft, Epson, Vuzix, North (acquired by Google), Magic Leap, Apple, Meta (formerly Facebook), and various startups entered the smart glasses market with different approaches and technical solutions.[9]

Technology

Hardware components

Modern smart glasses typically incorporate several key hardware components:

  • Optical displays - Technologies for projecting images to the user's eyes
  • Processing units - Miniaturized computers that run applications and process data
  • Cameras - For computer vision, environmental sensing, and photography/video recording
  • Microphones - For voice commands and audio recording
  • Speakers or bone conduction audio - For sound delivery without blocking environmental audio
  • Sensors - May include accelerometers, gyroscopes, GPS, magnetometers, and light sensors
  • Connectivity - Wi-Fi, Bluetooth, and sometimes cellular capabilities
  • Input methods - Touch panels, buttons, voice recognition, or gesture tracking
  • Battery - Power sources designed for minimal weight and size[10]

Display technologies

Several display technologies are employed in smart glasses:

  • Waveguide displays - Use optical waveguides to direct light from a projector to the user's eye, allowing for a transparent display that overlays digital content onto the real world. This technology is used in devices like the Microsoft HoloLens and Magic Leap.[11]
  • Birdbath optical combiner - Uses curved mirrors to reflect projected images, allowing them to be superimposed on the view of the real world. This approach is used in some Vuzix products.[12]
  • Micro-LED or Micro-OLED displays - Provide high brightness and efficiency in a small form factor, important for daylight visibility. Used in newer smart glasses designs by several manufacturers.[14]
  • LCOS (Liquid Crystal on Silicon) - Reflective displays used in compact AR systems for high-resolution visuals.[15]
  • Holographic optical elements - Create holographic wavelength-selective mirrors that can be embedded in standard eyeglass lenses, potentially enabling thinner and lighter smart glasses.[16]

Input methods

Smart glasses employ various input methods to compensate for the lack of traditional keyboards and touchscreens:

  • Voice commands - Using built-in microphones and speech recognition technology
  • Touch panels on the frame - Allowing for taps, swipes, and gestures
  • Hand gesture recognition - Using cameras to track hand movements in the field of view
  • Eye tracking - Detecting where the user is looking to enable gaze-based interactions
  • Head movements - Using built-in motion sensors to detect deliberate head gestures
  • Companion apps - Smartphone applications that connect to and control the glasses
  • Neural interfaces - Experimental systems detecting subtle facial muscle movements or neural signals[17]

Processors and Operating Systems

Smart glasses typically use specialized processors designed for wearable devices:

  • System-on-chip (SoC) - Optimized for power efficiency and small form factor
  • Specialized processors - Like the Qualcomm Snapdragon XR series designed specifically for extended reality applications[18]
  • Custom silicon - High-end devices like the Apple Vision Pro use custom chips (e.g., Apple M2) for enhanced performance[19]

For operating systems:

  • Many smart glasses run modified versions of Android
  • Some use proprietary operating systems developed specifically for AR applications
  • Others function primarily as displays for connected devices, relying on the host device's processing power

Types of Smart Glasses

Smart glasses can be broadly categorized based on their primary functionality, though many models combine features:

Audio Glasses

Primarily function as headphones, integrating speakers and microphones into standard eyeglass frames for music, calls, and voice assistant access. They typically lack a display.[20] Examples include Amazon Echo Frames and Bose Frames (discontinued).

Camera Glasses

Feature integrated cameras for first-person photo and video capture, often syncing with a smartphone app for sharing, particularly on social media.[21] Examples include Ray-Ban Stories/Ray-Ban Meta and Snap Spectacles.

HUD/Display Glasses (Assisted Reality)

Project simple information like notifications, directions, or messages into the wearer's view, typically as a 2D overlay. They enhance awareness but may not interact deeply with the real world.[22] Sometimes called "Assisted Reality" glasses. Examples include earlier versions of Vuzix glasses or specialized models for cycling.

Augmented/Mixed Reality Glasses

Offer a more immersive experience by overlaying interactive digital content onto the real world, often using sensors and cameras to understand the environment (spatial mapping).[23] These range from enterprise-focused devices like Microsoft HoloLens and Magic Leap to consumer-oriented glasses aiming for virtual screen replacement or AR gaming. "True AR" glasses usually involve spatial awareness and interaction.

Virtual Screen Glasses

Primarily designed to function as a private, large virtual display for connected devices like smartphones, laptops, or game consoles, often used for media consumption or productivity.[24] Examples include XREAL Air/One, Rokid Max, and Viture Pro XR.

Smart Sunglasses

Feature electronically adjustable tint (using liquid crystal technology or electrochromic panels) or incorporate other smart features like audio or cameras into a sunglass form factor.[25] For example, Ampere's Dusk has electrochromic lenses that can change from clear to dark under app control.

Major products and manufacturers

Google Glass

Google Glass was one of the first widely recognized smart glasses products, announced in 2012 and released to "Explorers" in 2013. The original consumer-focused Google Glass featured a small prism display positioned above the right eye, a touchpad on the frame, voice command capability, and a front-facing camera. After facing challenges with privacy concerns and social acceptance, Google pivoted in 2015 to focus on enterprise applications with the Glass Enterprise Edition, followed by Glass Enterprise Edition 2 in 2019.[26][27] Sales of all Google Glass versions were ultimately suspended in March 2023.

Microsoft HoloLens

Microsoft introduced the HoloLens in 2015, with the HoloLens 2 following in 2019. Unlike many other smart glasses, the HoloLens is a self-contained holographic computer with sophisticated spatial mapping capabilities. It features transparent holographic lenses, multiple sensors for environment tracking, and natural gesture recognition. The HoloLens has primarily targeted enterprise, industrial, and medical applications rather than consumer use.[28]

Vuzix

Vuzix has produced several generations of smart glasses, including the M-Series for enterprise and the Blade for both enterprise and consumer applications. Their products typically feature displays that can show information in the user's field of view, cameras, microphones for voice commands, and compatibility with various software platforms. Vuzix has focused heavily on practical workplace applications.[29]

Snap Spectacles

Snap Inc. (formerly Snapchat) released the first generation of Spectacles in 2016, primarily focusing on capturing first-person photos and videos for sharing on the Snapchat platform. Later generations have incorporated more advanced features, with the Spectacles 4 (announced in 2021) featuring true AR capabilities with dual waveguide displays and four built-in microphones.[30]

Ray-Ban Stories and Meta Smart Glasses

In 2021, Meta Platforms (formerly Facebook) partnered with EssilorLuxottica to release Ray-Ban Stories, smart glasses that feature dual cameras for photos and video, open-ear speakers, and microphones. These represent a step toward Meta's vision of augmented reality glasses, though they lack display capabilities for true AR. In 2023, this collaboration continued with the Ray-Ban Meta smart glasses, which added Meta AI capabilities.[31][32]

Apple Vision Pro=

Although not traditional smart glasses, the Apple Vision Pro announced in 2023 represents Apple's first major entry into the head-mounted display market. It is positioned as a "spatial computer" that blends aspects of augmented and virtual reality. Apple has reportedly also been developing true smart glasses with a more conventional form factor.[33]

Smaller manufacturers and specialized products

Numerous other companies have developed smart glasses for various purposes:

  • North (acquired by Google in 2020) created Focals, consumer-oriented smart glasses with a holographic display
  • Epson produces the Moverio line, used for both consumer and enterprise applications
  • TCL introduced the NXTWEAR G and subsequent models as wearable display glasses
  • XREAL (formerly Nreal) offers light mixed reality glasses that connect to smartphones
  • Lenovo developed the ThinkReality A3 smart glasses for enterprise use
  • Oppo introduced Air Glass as a lightweight AR assistant device
  • Rokid produces the Max and AR Lite series for various applications
  • Viture offers the Pro XR for virtual display functionality
  • Amazon makes the Echo Frames, focused on audio and voice assistant features[34][35]

Applications

Consumer applications

Smart glasses for consumers typically focus on several key use cases:

  • Notifications and information access - Displaying messages, alerts, weather updates, and other information without requiring the user to look at a smartphone
  • Navigation - Providing directions and location-based information in the user's field of view
  • Photography and video recording - Capturing first-person perspective content without using hands
  • Social media integration - Sharing experiences directly from the user's perspective
  • Fitness tracking - Displaying workout statistics and performance data in real-time. For instance, fitness-focused smart glasses like Minimis can show live workout metrics and route maps directly in the user's field of vision[36]
  • Translation - Some smart glasses can display real-time translations of text or spoken language
  • Entertainment - Gaming, video viewing, and other entertainment applications[37]

Enterprise and industrial applications

The enterprise sector has seen strong adoption of smart glasses for various applications:

  • Remote assistance - Enabling field workers to receive guidance from remote experts who can see what the worker sees
  • Training - Providing step-by-step instructions and visualization for complex tasks
  • Warehouse operations - Assisting with inventory management, picking, and logistics
  • Manufacturing - Displaying assembly instructions, quality control information, and operational data. Companies like Boeing and General Electric use AR glasses to improve assembly and maintenance efficiency[38]
  • Field service - Giving technicians hands-free access to documentation and technical information
  • Construction & Safety - Highlighting potential hazards, displaying blueprints, and providing safety alerts[39]

Security applications

Smart glasses have been tested and deployed in security and law enforcement contexts:

  • Law enforcement - In China, police in Zhengzhou deployed AR glasses to scan travelers against a facial-recognition database[40]
  • Surveillance - Smart glasses with facial recognition can identify individuals and track movement
  • Access control - Providing security personnel with real-time information about authorized individuals

Medical applications

Smart glasses have found specific applications in healthcare settings:

  • Surgical assistance - Displaying patient vital signs, medical imaging, and procedural guidance during surgery. The HoloLens has been used in orthopedic and neurosurgery[41]
  • Medical training - Providing first-person views of procedures for educational purposes
  • Patient care - Accessing medical records and information while maintaining eye contact with patients
  • Telemedicine - Enabling remote physicians to see what the on-site healthcare provider sees
  • Assistance for the visually impaired - Enhancing vision or providing audio descriptions of the environment
  • Specialized care - Novel applications like using Google Glass to provide hands-free lactation coaching for new mothers[42]

Marketing and Retail

Smart glasses are being used to transform shopping and brand experiences:

  • Interactive Experiences - Creating AR experiences for product demos, virtual showrooms, or interactive displays
  • Personalized Assistance - Providing shoppers with product information, recommendations, and comparisons
  • Virtual Try-On - Allowing customers to visualize how products would look without physical samples
  • Enhanced Event Marketing - Creating immersive brand experiences at trade shows and events[43]

Challenges and limitations

Despite their potential, smart glasses face several significant challenges:

Technical challenges

  • Power consumption - Balancing battery life with processing power, display brightness, and form factor constraints
  • Heat management - Dissipating heat effectively in a device worn on the face
  • Display limitations - Achieving sufficient brightness, contrast, field of view, and resolution while maintaining transparency
  • Miniaturization - Fitting all necessary components into a form factor approaching traditional eyewear
  • Weight distribution - Creating comfortable devices that can be worn for extended periods[44]

Social and ethical challenges

  • Privacy concerns - The presence of cameras and recording capabilities raises significant privacy issues for both users and bystanders. The early Google Glass faced substantial backlash due to its always-on camera, prompting stricter privacy regulations[45]
  • Social acceptance - The conspicuous nature of many smart glasses designs can create social barriers, leading to terms like "Glassholes" for early Google Glass wearers[46]
  • Distraction and safety - Concerns about user attention being diverted from important real-world tasks, especially driving. In 2013, the UK Department for Transport announced that drivers using Google Glass would face the same penalties as drivers texting or using a phone[47]
  • Data security - Protection of the potentially sensitive information captured by smart glasses
  • Digital divide - The cost of smart glasses may limit access to their benefits[48]

Future developments

The smart glasses industry continues to evolve with several key trends:

Form factor improvements

Manufacturers are working toward smart glasses that more closely resemble conventional eyewear in size, weight, and appearance. Advances in miniaturization of components, flexible electronics, and lightweight materials are gradually enabling less conspicuous designs.[49]

Display technology advancements

Emerging display technologies like microLED, advanced waveguides, and holographic optical elements promise improvements in brightness, field of view, power efficiency, and form factor. These developments may eventually enable full-color, high-resolution AR overlays in normal-looking eyewear.[50]

Enhanced sensing and contextual awareness

Future smart glasses will likely incorporate more sophisticated environmental sensing, object recognition, and contextual understanding capabilities. This contextual awareness will enable more intuitive and useful augmented reality experiences that can anticipate user needs.[51]

Integration with other technologies

Smart glasses are increasingly being developed as part of broader ecosystems:

  • Integration with artificial intelligence - Enabling more sophisticated contextual awareness and predictive capabilities. On-device AI, powered by chips like the Qualcomm Snapdragon XR, will enable real-time language translation, object recognition, and personalized experiences[52]
  • Connection with Internet of Things devices - Allowing control and monitoring of smart home and workplace equipment
  • 5G connectivity - Enabling faster data transfer and potential cloud processing of AR content
  • Integration with spatial computing environments - Creating seamless transitions between physical and digital spaces[53]

Market growth

Market projections estimate the global smart glasses market to reach $7.2 billion by 2028, driven by both consumer and enterprise demand.[54] The adoption of smart glasses is expected to accelerate as devices become more powerful, comfortable, and socially acceptable.

Specialized applications

As the technology matures, increasingly specialized applications of smart glasses are emerging in fields such as:

  • Enhanced accessibility - Supporting individuals with various disabilities
  • Education - Creating immersive learning experiences
  • Retail - Transforming shopping with virtual try-on and product information
  • Tourism and cultural heritage - Providing contextual information and historical visualization
  • Sports and athletics - Offering real-time performance data and coaching[55]

See also

References

  1. ↑ Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., & MacIntyre, B. (2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6), 34-47.
  2. ↑ "The Future of Augmented Reality is Here". Materion. https://www.materion.com/en/insights/blog/the-future-of-augmented-reality-is-here/.
  3. ↑ Sutherland, I. E. (1968). A head-mounted three dimensional display. Proceedings of the December 9-11, 1968, Fall Joint Computer Conference, Part I, 757-764.
  4. ↑ Mann, S. (1997). Wearable Computing: A First Step Toward Personal Imaging. Computer, 30(2), 25-32.
  5. ↑ Caudell, T. P., & Mizell, D. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, 659-669.
  6. ↑ "The History of Bluetooth". Bluetooth SIG. https://www.bluetooth.com/about-us/bluetooth-origin/.
  7. ↑ Bilton, N. (2012, February 21). Behind the Google Goggles, Virtual Reality. The New York Times.
  8. ↑ Miller, C. C. (2013, February 20). Google Searches for Style. The New York Times.
  9. ↑ Rauschnabel, P. A., Brem, A., & Ivens, B. S. (2015). Who will buy smart glasses? Empirical results of two pre-market-entry studies on the role of personality in individual awareness and intended adoption of Google Glass wearables. Computers in Human Behavior, 49, 635-647.
  10. ↑ Pedersen, I., & Trueman, D. (2018). Engaging with Environmental Issues as a User of Smart Glasses: A Microcosmic View of the Societal Response to Emerging Technologies. Digital Culture & Society, 4(1), 143-158.
  11. ↑ Kress, B. C., & Starner, T. (2013). A review of head-mounted displays (HMD) technologies and applications for consumer electronics. Proceedings of SPIE, 8720, 87200A.
  12. ↑ Kress, B. C. (2020). Optical Architectures for Augmented-, Virtual-, and Mixed-Reality Headsets. SPIE Press.
  13. ↑ Liao, S. (2018, February 5). Intel made smart glasses that look normal. The Verge.
  14. ↑ Kim, H., & Kwon, S. (2022). Review of micro-LED displays: from technology to applications. Journal of Information Display, 23(1), 1-14.
  15. ↑ Kim, J. (2018). Advances in LCOS Technology for AR Displays. Journal of Display Technology, 14(2), 234-246.
  16. ↑ Lee, S., Jo, Y., Yoo, D., Cho, J., Lee, D., & Lee, B. (2019). Tomographic near-eye displays. Nature Communications, 10, 2497.
  17. ↑ Riva, G. (2019). Virtual reality in the treatment of eating disorders and obesity: State of the art and future challenges. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 13(1).
  18. ↑ "Qualcomm Snapdragon XR: Powering AR/VR". Qualcomm.
  19. ↑ "Apple Vision Pro Technical Specifications". Apple. https://www.apple.com/apple-vision-pro/specs/.
  20. ↑ "The Best Smart Glasses to Augment Your Reality". Wired. https://www.wired.com/gallery/best-smart-glasses/.
  21. ↑ "The Best Smart Glasses to Augment Your Reality". Wired. https://www.wired.com/gallery/best-smart-glasses/.
  22. ↑ "The Best Smart Glasses to Augment Your Reality". Wired. https://www.wired.com/gallery/best-smart-glasses/.
  23. ↑ Chatzopoulos, D., Bermejo, C., Huang, Z., & Hui, P. (2017). Mobile augmented reality survey: From where we are to where we go. IEEE Access, 5, 6917-6950.
  24. ↑ "The Best Smart Glasses to Augment Your Reality". Wired. https://www.wired.com/gallery/best-smart-glasses/.
  25. ↑ Irving, Michael (January 6, 2021). "App-controlled smart sunglasses change tint on demand". New Atlas. https://newatlas.com/wearables/dusk-tint-smart-sunglasses-app-controlled/.
  26. ↑ Miller, C. C. (2013, February 20). Google Searches for Style. The New York Times.
  27. ↑ Google. (2019, May 20). Glass Enterprise Edition 2: faster and more helpful. Google Blog.
  28. ↑ Microsoft. (2019). Microsoft HoloLens 2. Microsoft.
  29. ↑ Vuzix. (2020). Vuzix Blade Upgraded Smart Glasses. Vuzix.
  30. ↑ Snap Inc. (2021, May 20). Introducing the next generation of Spectacles. Snap Inc.
  31. ↑ Meta. (2021, September 9). Introducing Ray-Ban Stories: First-Generation Smart Glasses. Meta.
  32. ↑ "Ray-Ban Meta Smart Glasses". Meta. https://www.ray-ban.com/usa/ray-ban-meta-smart-glasses.
  33. ↑ Apple. (2023, June 5). Apple unveils Apple Vision Pro: Revolutionary spatial computer that seamlessly blends digital content with the physical world. Apple Newsroom.
  34. ↑ Goode, L. (2022, January 4). Smart glasses made Google look dumb. Now Facebook is giving them a go. Wired.
  35. ↑ "Amazon Echo Frames (3rd Gen)". Amazon.
  36. ↑ Thompson, Bronwyn (August 9, 2023). "These smart glasses are out to replace all other fitness trackers". New Atlas. https://newatlas.com/wearables/minimis-smart-glasses/.
  37. ↑ Rauschnabel, P. A. (2018). Virtually enhancing the real world with holograms: An exploration of expected gratifications of using augmented reality smart glasses. Psychology & Marketing, 35(8), 557-572.
  38. ↑ "How Boeing Uses Augmented Reality". Boeing.
  39. ↑ "Smart Glasses in Construction: Applications and Benefits". Construction Business Owner.
  40. ↑ Russell, Jon (February 8, 2018). "Chinese police are using smart glasses to identify potential suspects". TechCrunch. https://techcrunch.com/2018/02/08/chinese-police-are-getting-smart-glasses/.
  41. ↑ Pratt, P. (2018). Augmented Reality in Surgery. Journal of Medical Systems, 42(12), 245.
  42. ↑ Papple, Dawn (April 24, 2014). "Google Glass Connects Breastfeeding Moms With Lactation Help". Inquisitr. http://www.inquisitr.com/1224638/google-glass-connects-breastfeeding-moms-with-lactation-help/.
  43. ↑ Tom Dieck, M. C. (2020). Augmented Reality in Retail. Journal of Retailing and Consumer Services, 55, 102041.
  44. ↑ Makhataeva, Z., & Varol, H. A. (2020). Augmented Reality for Robotics: A Review. Robotics, 9(2), 21.
  45. ↑ Hong, J. (2016). Privacy Issues in Wearable Technology. IEEE Security & Privacy, 14(6), 25-33.
  46. ↑ Eveleth, Rose (December 12, 2018). "Google Glass Wasn't a Failure. It Raised Crucial Concerns". Wired. https://www.wired.com/story/google-glass-reasonable-expectation-of-privacy/.
  47. ↑ Kiss, Jemima (July 31, 2013). "UK set to ban Google Glass for drivers". The Guardian. https://www.theguardian.com/technology/2013/jul/31/google-glass-drivers.
  48. ↑ Hein, D. W. E., Jodoin, J. L., Rauschnabel, P. A., & Ivens, B. S. (2018). Are wearables good or bad for society?: An exploration of societal benefits, risks, and consequences of augmented reality smart glasses. In Mobile Technologies and Augmented Reality in Open Education (pp. 1-13). IGI Global.
  49. ↑ Starner, T. (2015). How wearables worked their way into the mainstream. IEEE Pervasive Computing, 14(3), 10-13.
  50. ↑ Bohn, D. (2020, January 17). The display of the future might be in your contact lens. The Verge.
  51. ↑ Chatzopoulos, D., Bermejo, C., Huang, Z., & Hui, P. (2017). Mobile augmented reality survey: From where we are to where we go. IEEE Access, 5, 6917-6950.
  52. ↑ "Qualcomm Snapdragon XR: Powering AR/VR". Qualcomm.
  53. ↑ Kunze, K., Uema, Y., Shiga, K., Ishimaru, S., Kise, K., & Freitas, D. D. P. (2023). Towards Enhancing Human Capabilities Through Wearable Computing. Computer, 56(6), 70-80.
  54. ↑ "Smart Glasses Market Size & Share Analysis". MarketsandMarkets. 2023-08-01.
  55. ↑ Tom Dieck, M. C., Jung, T. H., & Han, D. I. (2022). Augmented reality smart glasses in tourism: Applications and user experience. Journal of Destination Marketing & Management, 23, 100662.
Retrieved from "https://vrarwiki.com/index.php?title=Smart_glasses&oldid=34806"