Jump to content

Snap OS: Difference between revisions

From VR & AR Wiki
No edit summary
No edit summary
Tag: Reverted
Line 1: Line 1:
{{stub}}
{{see also|Augmented Reality#Platforms}}
==AR Glasses==
==AR Glasses==
'''[[Snap Spectacles]]''' - 2016
'''[[Snap Spectacles]]''' - 2016
Line 12: Line 9:


'''[[Snap Spectacles 5]]''' - 2024
'''[[Snap Spectacles 5]]''' - 2024
{{Platform Infobox
|image=
|Type=Augmented Reality
|Subtype=AR Operating System
|Creator=Snap Inc.
|Developer=Snap Inc.
|Manufacturer=Snap Inc.
|Operating System=Snap OS
|Browser=Built-in web browser with YouTube support
|Devices=Spectacles (5th generation)
|Accessories=USB-C cable, protective glasses cover, carrying pouch, prescription lens insert (optional), smartphone app
|Release Date=September 17, 2024
|Price=$99/month (Developer Program, 1-year commitment)
|Website=https://www.spectacles.com/
}}
{{see also|Augmented Reality#Platforms}}
'''Snap OS''' is a proprietary [[operating system]] designed specifically for [[augmented reality]] (AR) devices, developed by [[Snap Inc.]] The operating system was unveiled on September 17, 2024, at the 6th annual Snap Partner Summit in Santa Monica, California.<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024.</ref><ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." Accessed 2024.</ref> Snap OS powers the fifth generation of [[Spectacles]] AR glasses and represents a decade of research and development in AR technology by Snap Inc.<ref name="snapnewsroom"/>
==Overview==
Snap OS is a purpose-built, groundbreaking operating system designed to enhance how people naturally interact with the world through AR experiences.<ref name="snapnewsroom"/> The system focuses on creating shared experiences and natural interactions, allowing users to navigate through [[hand tracking|hand gestures]] and [[voice commands]].<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024.</ref> Unlike traditional computing interfaces, Snap OS places the main menu in the palm of the user's hand, creating an intuitive navigation system.<ref name="snapnewsroom"/>
According to [[Evan Spiegel]], CEO of Snap Inc., the operating system represents a strategic move to position the company as a leader in AR technology: <ref name="axios">"I think glasses allow us to use computing grounded in the real world, together with our friends, and in a much more natural way."</ref>
==Technical Architecture==
===Snap Spatial Engine===
At the core of Snap OS is the '''Snap Spatial Engine''', which provides [[spatial computing]] capabilities that allow the system to understand the world around users.<ref name="snapnewsroom"/> The engine enables [[Lenses]] (Snap's term for AR applications) to appear realistically in three dimensions with precise environmental mapping.<ref name="developertech"/> The system achieves an industry-leading 13 millisecond [[motion-to-photon latency]], ensuring that AR content integrates naturally into the user's environment with minimal lag.<ref name="snapnewsroom"/><ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024.</ref>
===Hardware Integration===
Snap OS is designed to work with a dual [[system-on-chip]] architecture utilizing two [[Snapdragon]] processors from [[Qualcomm]].<ref name="developertech"/> This infrastructure splits the computational workload across the two processors, enabling more immersive experiences while reducing power consumption.<ref name="snapnewsroom"/> The dual-chip solution works in conjunction with titanium vapor chambers to improve heat dissipation, allowing for up to 45 minutes of continuous standalone runtime.<ref name="developertech"/>
{| class="wikitable"
|+ Technical Specifications
|-
! Feature !! Specification
|-
| Motion-to-photon latency || 13 milliseconds
|-
| Processor || Dual Snapdragon processors
|-
| Battery life || Up to 45 minutes continuous use
|-
| Weight (with Spectacles) || 226 grams
|-
| Field of view || 46 degrees diagonal
|-
| Resolution || 37 pixels per degree
|-
| Display type || Stereo waveguide with automatic tint
|}
==User Interface and Interaction==
===Natural Interaction Methods===
Snap OS employs multiple interaction modalities to create a natural user experience:<ref name="snapnewsroom"/>
* '''Hand tracking''': Four integrated cameras enable seamless hand tracking for gesture-based controls
* '''Voice commands''': On-device speech recognition for text input and system commands
* '''Smartphone integration''': Users can utilize their phone as a custom game controller or 6DoF tracked controller
* '''Palm menu''': The main system menu appears in the user's palm for easy access
===Display Technology===
The operating system drives [[Liquid Crystal on Silicon]] (LCoS) micro-projectors that create vivid, sharp images through advanced [[waveguide]] technology.<ref name="developertech"/> Each waveguide contains billions of nanostructures that guide light into the user's field of view without requiring lengthy calibrations or custom fittings.<ref name="snapnewsroom"/> The display automatically adjusts tinting based on environmental lighting conditions, ensuring visibility in various settings including direct sunlight.<ref name="uploadvr"/>
==Development Platform==
===Lens Studio 5.0===
Snap OS applications, called "Lenses," are developed using '''Lens Studio 5.0''', a completely rebuilt development environment.<ref name="developertech"/> Key features include:
* Support for [[TypeScript]] and [[JavaScript]] programming languages<ref name="developertech"/>
* Improved version control tools for team-based development<ref name="snapnewsroom"/>
* Quick deployment process replacing traditional compilation workflows<ref name="snapnewsroom"/>
* Direct push capability from Lens Studio to Spectacles hardware<ref name="developertech"/>
===Spectacles Interaction Kit===
The '''Spectacles Interaction Kit''' (SIK) provides pre-built interaction systems that allow developers to create intuitive Lenses without building custom interaction frameworks from scratch.<ref name="developertech"/> The kit includes components for:
* Hand gesture recognition
* Spatial UI elements
* Multi-user synchronization
* Environmental understanding
===SnapML and AI Integration===
'''SnapML''' enables developers to integrate custom [[machine learning]] models directly into Lenses for object identification, tracking, and augmentation.<ref name="developertech"/> Additionally, Snap has partnered with [[OpenAI]] to bring cloud-hosted multimodal AI models to the platform, allowing developers to add contextual understanding to AR experiences based on what users see, say, or hear.<ref name="developertech"/><ref name="uploadvr"/>
{| class="wikitable"
|+ Development Tools Comparison
|-
! Feature !! Lens Studio 5.0 !! Previous Versions
|-
| Programming Languages || TypeScript, JavaScript || JavaScript only
|-
| Deployment Method || Direct push || Compilation required
|-
| Version Control || Built-in tools || External tools required
|-
| AI Integration || SnapML + OpenAI models || Limited ML support
|-
| Interaction Framework || Spectacles Interaction Kit || Custom development required
|}
==Features and Capabilities==
===Shared Experiences===
A core principle of Snap OS is enabling shared AR experiences.<ref name="snapnewsroom"/> Multiple users can participate in the same Lens simultaneously, allowing for collaborative gaming, design review, and social interactions.<ref name="spectacles">Spectacles. "Get Closer with Friends." Accessed 2024.</ref> The system includes:
* '''Spectator Mode''': Allows non-Spectacles users to view AR content on their smartphones<ref name="snapnewsroom"/>
* '''Session management''': Developers can set fixed session IDs for controlled multi-user experiences
* '''Connected Lens framework''': Real-time synchronization between multiple devices
===Built-in Applications===
Snap OS includes several pre-installed features:<ref name="spectacles"/>
* '''My AI''': Snap's AI assistant with multimodal capabilities
* '''Web browser''': Supporting standard web content including YouTube
* '''Phone mirroring''': Ability to mirror smartphone screen content
* '''Lens Explorer''': Discovery interface for finding and launching AR experiences
===Privacy and Security===
While specific privacy features were not extensively detailed in available sources, the system includes:<ref name="developertech"/>
* LED indicators that illuminate when cameras are active
* Permission-based access to device capabilities
* Sandboxed application environment for Lenses
==Launch Partners and Applications==
Snap OS launched with several high-profile development partners creating showcase applications:<ref name="developertech"/><ref name="snapnewsroom"/>
{| class="wikitable"
|+ Launch Partner Applications
|-
! Partner !! Application !! Description
|-
| [[LEGO Group]] || BRICKTACULAR || Interactive AR building game controlled by hands and voice
|-
| [[ILM Immersive]] || Star Wars experiences || AR experiences connecting users with the Star Wars universe
|-
| [[Niantic]] || Peridot, Scaniverse || AR pet game and 3D scanning application
|-
| Wabisabi Games || Capture the Flag || Multiplayer AR gaming experience
|}
==Business Model and Availability==
===Developer Program===
Snap OS and Spectacles are available through the '''Spectacles Developer Program''', launched in the United States on September 17, 2024.<ref name="developertech"/> The program operates on a subscription model:
* Monthly cost: $99 USD
* Minimum commitment: 1 year
* Total annual cost: $1,188
* Includes: Spectacles hardware, Snap support, and development tools<ref name="uploadvr"/>
Notably, Snap introduced the platform with "no developer tax," meaning developers retain 100% of revenue from their applications.<ref name="developertech"/>
===Market Strategy===
Snap CEO Evan Spiegel views the operating system as crucial to diversifying the company's business model beyond advertising.<ref name="axios"/> The long-term goal is to become "the most developer-friendly platform in the world," with potential monetization through various models including advertising, subscriptions, and direct Lens purchases.<ref name="axios"/>
==Technical Limitations==
Current limitations of Snap OS include:<ref name="uploadvr"/>
* 45-minute battery life for continuous use
* Limited to developer access (no consumer release as of 2024)
* Production constraints limiting initial availability to approximately 10,000 units
* U.S.-only availability at launch
==Future Development==
===Planned Features===
According to release notes and developer documentation, upcoming features include:
* Enhanced multi-user session management
* Improved hand tracking with reduced jitter
* Extended battery life optimizations
* Expanded international availability
===Industry Impact===
Snap OS represents a significant entry into the AR operating system market, competing with platforms like [[Android XR]] and [[visionOS]].<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." 2024.</ref> Industry analysts note that the focus on natural interactions and shared experiences could establish new standards for AR computing interfaces.
==See Also==
* [[Spectacles]]
* [[Augmented reality]]
* [[Snap Inc.]]
* [[Lens Studio]]
* [[Android XR]]
* [[Apple Vision Pro]]
* [[Meta Quest]]
==References==
<references>
<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024. https://www.axios.com/2024/09/17/snap-operating-system-ar-glasses</ref>
<ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." https://newsroom.snap.com/sps-2024-spectacles-snapos</ref>
<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024. https://www.developer-tech.com/news/snap-os-debuts-with-developer-friendly-spectacles-5-ar-glasses/</ref>
<ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024. https://www.uploadvr.com/snap-spectacles-5-ar/</ref>
<ref name="spectacles">Spectacles. "Get Closer with Friends." https://www.spectacles.com/spectacles-24</ref>
<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." https://www.androidcentral.com/gaming/virtual-reality/smart-glasses-are-a-mess-but-android-xr-should-finally-fix-that</ref>
</references>
==External Links==
* [https://www.spectacles.com/ Official Spectacles website]
* [https://ar.snap.com/ Snap AR Developer Portal]
* [https://lensstudio.snapchat.com/ Lens Studio Download]
* [https://www.snappartnersummit.com/ Snap Partner Summit]
[[Category:Operating systems]]
[[Category:Augmented reality]]
[[Category:Snap Inc.]]
[[Category:2024 software]]
[[Category:Proprietary operating systems]]

Revision as of 17:02, 24 May 2025

AR Glasses

Snap Spectacles - 2016

Snap Spectacles 2 - 2018

Snap Spectacles 3 - 2019

Snap Spectacles 4 - 2021

Snap Spectacles 5 - 2024

Snap OS
Information
Type Augmented Reality
Subtype AR Operating System
Creator Snap Inc.
Developer Snap Inc.
Manufacturer Snap Inc.
Operating System Snap OS
Browser Built-in web browser with YouTube support
Devices Spectacles (5th generation)
Accessories USB-C cable, protective glasses cover, carrying pouch, prescription lens insert (optional), smartphone app
Release Date September 17, 2024
Price $99/month (Developer Program, 1-year commitment)
Website https://www.spectacles.com/
See also: Augmented Reality#Platforms

Snap OS is a proprietary operating system designed specifically for augmented reality (AR) devices, developed by Snap Inc. The operating system was unveiled on September 17, 2024, at the 6th annual Snap Partner Summit in Santa Monica, California.[1][2] Snap OS powers the fifth generation of Spectacles AR glasses and represents a decade of research and development in AR technology by Snap Inc.[2]

Overview

Snap OS is a purpose-built, groundbreaking operating system designed to enhance how people naturally interact with the world through AR experiences.[2] The system focuses on creating shared experiences and natural interactions, allowing users to navigate through hand gestures and voice commands.[3] Unlike traditional computing interfaces, Snap OS places the main menu in the palm of the user's hand, creating an intuitive navigation system.[2]

According to Evan Spiegel, CEO of Snap Inc., the operating system represents a strategic move to position the company as a leader in AR technology: [1]

Technical Architecture

Snap Spatial Engine

At the core of Snap OS is the Snap Spatial Engine, which provides spatial computing capabilities that allow the system to understand the world around users.[2] The engine enables Lenses (Snap's term for AR applications) to appear realistically in three dimensions with precise environmental mapping.[3] The system achieves an industry-leading 13 millisecond motion-to-photon latency, ensuring that AR content integrates naturally into the user's environment with minimal lag.[2][4]

Hardware Integration

Snap OS is designed to work with a dual system-on-chip architecture utilizing two Snapdragon processors from Qualcomm.[3] This infrastructure splits the computational workload across the two processors, enabling more immersive experiences while reducing power consumption.[2] The dual-chip solution works in conjunction with titanium vapor chambers to improve heat dissipation, allowing for up to 45 minutes of continuous standalone runtime.[3]

Technical Specifications
Feature Specification
Motion-to-photon latency 13 milliseconds
Processor Dual Snapdragon processors
Battery life Up to 45 minutes continuous use
Weight (with Spectacles) 226 grams
Field of view 46 degrees diagonal
Resolution 37 pixels per degree
Display type Stereo waveguide with automatic tint

User Interface and Interaction

Natural Interaction Methods

Snap OS employs multiple interaction modalities to create a natural user experience:[2]

  • Hand tracking: Four integrated cameras enable seamless hand tracking for gesture-based controls
  • Voice commands: On-device speech recognition for text input and system commands
  • Smartphone integration: Users can utilize their phone as a custom game controller or 6DoF tracked controller
  • Palm menu: The main system menu appears in the user's palm for easy access

Display Technology

The operating system drives Liquid Crystal on Silicon (LCoS) micro-projectors that create vivid, sharp images through advanced waveguide technology.[3] Each waveguide contains billions of nanostructures that guide light into the user's field of view without requiring lengthy calibrations or custom fittings.[2] The display automatically adjusts tinting based on environmental lighting conditions, ensuring visibility in various settings including direct sunlight.[4]

Development Platform

Lens Studio 5.0

Snap OS applications, called "Lenses," are developed using Lens Studio 5.0, a completely rebuilt development environment.[3] Key features include:

  • Support for TypeScript and JavaScript programming languages[3]
  • Improved version control tools for team-based development[2]
  • Quick deployment process replacing traditional compilation workflows[2]
  • Direct push capability from Lens Studio to Spectacles hardware[3]

Spectacles Interaction Kit

The Spectacles Interaction Kit (SIK) provides pre-built interaction systems that allow developers to create intuitive Lenses without building custom interaction frameworks from scratch.[3] The kit includes components for:

  • Hand gesture recognition
  • Spatial UI elements
  • Multi-user synchronization
  • Environmental understanding

SnapML and AI Integration

SnapML enables developers to integrate custom machine learning models directly into Lenses for object identification, tracking, and augmentation.[3] Additionally, Snap has partnered with OpenAI to bring cloud-hosted multimodal AI models to the platform, allowing developers to add contextual understanding to AR experiences based on what users see, say, or hear.[3][4]

Development Tools Comparison
Feature Lens Studio 5.0 Previous Versions
Programming Languages TypeScript, JavaScript JavaScript only
Deployment Method Direct push Compilation required
Version Control Built-in tools External tools required
AI Integration SnapML + OpenAI models Limited ML support
Interaction Framework Spectacles Interaction Kit Custom development required

Features and Capabilities

Shared Experiences

A core principle of Snap OS is enabling shared AR experiences.[2] Multiple users can participate in the same Lens simultaneously, allowing for collaborative gaming, design review, and social interactions.[5] The system includes:

  • Spectator Mode: Allows non-Spectacles users to view AR content on their smartphones[2]
  • Session management: Developers can set fixed session IDs for controlled multi-user experiences
  • Connected Lens framework: Real-time synchronization between multiple devices

Built-in Applications

Snap OS includes several pre-installed features:[5]

  • My AI: Snap's AI assistant with multimodal capabilities
  • Web browser: Supporting standard web content including YouTube
  • Phone mirroring: Ability to mirror smartphone screen content
  • Lens Explorer: Discovery interface for finding and launching AR experiences

Privacy and Security

While specific privacy features were not extensively detailed in available sources, the system includes:[3]

  • LED indicators that illuminate when cameras are active
  • Permission-based access to device capabilities
  • Sandboxed application environment for Lenses

Launch Partners and Applications

Snap OS launched with several high-profile development partners creating showcase applications:[3][2]

Launch Partner Applications
Partner Application Description
LEGO Group BRICKTACULAR Interactive AR building game controlled by hands and voice
ILM Immersive Star Wars experiences AR experiences connecting users with the Star Wars universe
Niantic Peridot, Scaniverse AR pet game and 3D scanning application
Wabisabi Games Capture the Flag Multiplayer AR gaming experience

Business Model and Availability

Developer Program

Snap OS and Spectacles are available through the Spectacles Developer Program, launched in the United States on September 17, 2024.[3] The program operates on a subscription model:

  • Monthly cost: $99 USD
  • Minimum commitment: 1 year
  • Total annual cost: $1,188
  • Includes: Spectacles hardware, Snap support, and development tools[4]

Notably, Snap introduced the platform with "no developer tax," meaning developers retain 100% of revenue from their applications.[3]

Market Strategy

Snap CEO Evan Spiegel views the operating system as crucial to diversifying the company's business model beyond advertising.[1] The long-term goal is to become "the most developer-friendly platform in the world," with potential monetization through various models including advertising, subscriptions, and direct Lens purchases.[1]

Technical Limitations

Current limitations of Snap OS include:[4]

  • 45-minute battery life for continuous use
  • Limited to developer access (no consumer release as of 2024)
  • Production constraints limiting initial availability to approximately 10,000 units
  • U.S.-only availability at launch

Future Development

Planned Features

According to release notes and developer documentation, upcoming features include:

  • Enhanced multi-user session management
  • Improved hand tracking with reduced jitter
  • Extended battery life optimizations
  • Expanded international availability

Industry Impact

Snap OS represents a significant entry into the AR operating system market, competing with platforms like Android XR and visionOS.[6] Industry analysts note that the focus on natural interactions and shared experiences could establish new standards for AR computing interfaces.

See Also

References

  1. 1.0 1.1 1.2 1.3 Axios. "Snap debuts operating system for AR glasses." September 17, 2024. Cite error: Invalid <ref> tag; name "axios" defined multiple times with different content
  2. 2.00 2.01 2.02 2.03 2.04 2.05 2.06 2.07 2.08 2.09 2.10 2.11 2.12 2.13 Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." Accessed 2024. Cite error: Invalid <ref> tag; name "snapnewsroom" defined multiple times with different content
  3. 3.00 3.01 3.02 3.03 3.04 3.05 3.06 3.07 3.08 3.09 3.10 3.11 3.12 3.13 3.14 Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024. Cite error: Invalid <ref> tag; name "developertech" defined multiple times with different content
  4. 4.0 4.1 4.2 4.3 4.4 UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024. Cite error: Invalid <ref> tag; name "uploadvr" defined multiple times with different content
  5. 5.0 5.1 Spectacles. "Get Closer with Friends." Accessed 2024. Cite error: Invalid <ref> tag; name "spectacles" defined multiple times with different content
  6. Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." 2024. Cite error: Invalid <ref> tag; name "androidcentral" defined multiple times with different content

External Links