Snap OS: Difference between revisions
Xinreality (talk | contribs) No edit summary |
Xinreality (talk | contribs) No edit summary Tag: Reverted |
||
Line 1: | Line 1: | ||
==AR Glasses== | ==AR Glasses== | ||
'''[[Snap Spectacles]]''' - 2016 | '''[[Snap Spectacles]]''' - 2016 | ||
Line 12: | Line 9: | ||
'''[[Snap Spectacles 5]]''' - 2024 | '''[[Snap Spectacles 5]]''' - 2024 | ||
{{Platform Infobox | |||
|image= | |||
|Type=Augmented Reality | |||
|Subtype=AR Operating System | |||
|Creator=Snap Inc. | |||
|Developer=Snap Inc. | |||
|Manufacturer=Snap Inc. | |||
|Operating System=Snap OS | |||
|Browser=Built-in web browser with YouTube support | |||
|Devices=Spectacles (5th generation) | |||
|Accessories=USB-C cable, protective glasses cover, carrying pouch, prescription lens insert (optional), smartphone app | |||
|Release Date=September 17, 2024 | |||
|Price=$99/month (Developer Program, 1-year commitment) | |||
|Website=https://www.spectacles.com/ | |||
}} | |||
{{see also|Augmented Reality#Platforms}} | |||
'''Snap OS''' is a proprietary [[operating system]] designed specifically for [[augmented reality]] (AR) devices, developed by [[Snap Inc.]] The operating system was unveiled on September 17, 2024, at the 6th annual Snap Partner Summit in Santa Monica, California.<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024.</ref><ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." Accessed 2024.</ref> Snap OS powers the fifth generation of [[Spectacles]] AR glasses and represents a decade of research and development in AR technology by Snap Inc.<ref name="snapnewsroom"/> | |||
==Overview== | |||
Snap OS is a purpose-built, groundbreaking operating system designed to enhance how people naturally interact with the world through AR experiences.<ref name="snapnewsroom"/> The system focuses on creating shared experiences and natural interactions, allowing users to navigate through [[hand tracking|hand gestures]] and [[voice commands]].<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024.</ref> Unlike traditional computing interfaces, Snap OS places the main menu in the palm of the user's hand, creating an intuitive navigation system.<ref name="snapnewsroom"/> | |||
According to [[Evan Spiegel]], CEO of Snap Inc., the operating system represents a strategic move to position the company as a leader in AR technology: <ref name="axios">"I think glasses allow us to use computing grounded in the real world, together with our friends, and in a much more natural way."</ref> | |||
==Technical Architecture== | |||
===Snap Spatial Engine=== | |||
At the core of Snap OS is the '''Snap Spatial Engine''', which provides [[spatial computing]] capabilities that allow the system to understand the world around users.<ref name="snapnewsroom"/> The engine enables [[Lenses]] (Snap's term for AR applications) to appear realistically in three dimensions with precise environmental mapping.<ref name="developertech"/> The system achieves an industry-leading 13 millisecond [[motion-to-photon latency]], ensuring that AR content integrates naturally into the user's environment with minimal lag.<ref name="snapnewsroom"/><ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024.</ref> | |||
===Hardware Integration=== | |||
Snap OS is designed to work with a dual [[system-on-chip]] architecture utilizing two [[Snapdragon]] processors from [[Qualcomm]].<ref name="developertech"/> This infrastructure splits the computational workload across the two processors, enabling more immersive experiences while reducing power consumption.<ref name="snapnewsroom"/> The dual-chip solution works in conjunction with titanium vapor chambers to improve heat dissipation, allowing for up to 45 minutes of continuous standalone runtime.<ref name="developertech"/> | |||
{| class="wikitable" | |||
|+ Technical Specifications | |||
|- | |||
! Feature !! Specification | |||
|- | |||
| Motion-to-photon latency || 13 milliseconds | |||
|- | |||
| Processor || Dual Snapdragon processors | |||
|- | |||
| Battery life || Up to 45 minutes continuous use | |||
|- | |||
| Weight (with Spectacles) || 226 grams | |||
|- | |||
| Field of view || 46 degrees diagonal | |||
|- | |||
| Resolution || 37 pixels per degree | |||
|- | |||
| Display type || Stereo waveguide with automatic tint | |||
|} | |||
==User Interface and Interaction== | |||
===Natural Interaction Methods=== | |||
Snap OS employs multiple interaction modalities to create a natural user experience:<ref name="snapnewsroom"/> | |||
* '''Hand tracking''': Four integrated cameras enable seamless hand tracking for gesture-based controls | |||
* '''Voice commands''': On-device speech recognition for text input and system commands | |||
* '''Smartphone integration''': Users can utilize their phone as a custom game controller or 6DoF tracked controller | |||
* '''Palm menu''': The main system menu appears in the user's palm for easy access | |||
===Display Technology=== | |||
The operating system drives [[Liquid Crystal on Silicon]] (LCoS) micro-projectors that create vivid, sharp images through advanced [[waveguide]] technology.<ref name="developertech"/> Each waveguide contains billions of nanostructures that guide light into the user's field of view without requiring lengthy calibrations or custom fittings.<ref name="snapnewsroom"/> The display automatically adjusts tinting based on environmental lighting conditions, ensuring visibility in various settings including direct sunlight.<ref name="uploadvr"/> | |||
==Development Platform== | |||
===Lens Studio 5.0=== | |||
Snap OS applications, called "Lenses," are developed using '''Lens Studio 5.0''', a completely rebuilt development environment.<ref name="developertech"/> Key features include: | |||
* Support for [[TypeScript]] and [[JavaScript]] programming languages<ref name="developertech"/> | |||
* Improved version control tools for team-based development<ref name="snapnewsroom"/> | |||
* Quick deployment process replacing traditional compilation workflows<ref name="snapnewsroom"/> | |||
* Direct push capability from Lens Studio to Spectacles hardware<ref name="developertech"/> | |||
===Spectacles Interaction Kit=== | |||
The '''Spectacles Interaction Kit''' (SIK) provides pre-built interaction systems that allow developers to create intuitive Lenses without building custom interaction frameworks from scratch.<ref name="developertech"/> The kit includes components for: | |||
* Hand gesture recognition | |||
* Spatial UI elements | |||
* Multi-user synchronization | |||
* Environmental understanding | |||
===SnapML and AI Integration=== | |||
'''SnapML''' enables developers to integrate custom [[machine learning]] models directly into Lenses for object identification, tracking, and augmentation.<ref name="developertech"/> Additionally, Snap has partnered with [[OpenAI]] to bring cloud-hosted multimodal AI models to the platform, allowing developers to add contextual understanding to AR experiences based on what users see, say, or hear.<ref name="developertech"/><ref name="uploadvr"/> | |||
{| class="wikitable" | |||
|+ Development Tools Comparison | |||
|- | |||
! Feature !! Lens Studio 5.0 !! Previous Versions | |||
|- | |||
| Programming Languages || TypeScript, JavaScript || JavaScript only | |||
|- | |||
| Deployment Method || Direct push || Compilation required | |||
|- | |||
| Version Control || Built-in tools || External tools required | |||
|- | |||
| AI Integration || SnapML + OpenAI models || Limited ML support | |||
|- | |||
| Interaction Framework || Spectacles Interaction Kit || Custom development required | |||
|} | |||
==Features and Capabilities== | |||
===Shared Experiences=== | |||
A core principle of Snap OS is enabling shared AR experiences.<ref name="snapnewsroom"/> Multiple users can participate in the same Lens simultaneously, allowing for collaborative gaming, design review, and social interactions.<ref name="spectacles">Spectacles. "Get Closer with Friends." Accessed 2024.</ref> The system includes: | |||
* '''Spectator Mode''': Allows non-Spectacles users to view AR content on their smartphones<ref name="snapnewsroom"/> | |||
* '''Session management''': Developers can set fixed session IDs for controlled multi-user experiences | |||
* '''Connected Lens framework''': Real-time synchronization between multiple devices | |||
===Built-in Applications=== | |||
Snap OS includes several pre-installed features:<ref name="spectacles"/> | |||
* '''My AI''': Snap's AI assistant with multimodal capabilities | |||
* '''Web browser''': Supporting standard web content including YouTube | |||
* '''Phone mirroring''': Ability to mirror smartphone screen content | |||
* '''Lens Explorer''': Discovery interface for finding and launching AR experiences | |||
===Privacy and Security=== | |||
While specific privacy features were not extensively detailed in available sources, the system includes:<ref name="developertech"/> | |||
* LED indicators that illuminate when cameras are active | |||
* Permission-based access to device capabilities | |||
* Sandboxed application environment for Lenses | |||
==Launch Partners and Applications== | |||
Snap OS launched with several high-profile development partners creating showcase applications:<ref name="developertech"/><ref name="snapnewsroom"/> | |||
{| class="wikitable" | |||
|+ Launch Partner Applications | |||
|- | |||
! Partner !! Application !! Description | |||
|- | |||
| [[LEGO Group]] || BRICKTACULAR || Interactive AR building game controlled by hands and voice | |||
|- | |||
| [[ILM Immersive]] || Star Wars experiences || AR experiences connecting users with the Star Wars universe | |||
|- | |||
| [[Niantic]] || Peridot, Scaniverse || AR pet game and 3D scanning application | |||
|- | |||
| Wabisabi Games || Capture the Flag || Multiplayer AR gaming experience | |||
|} | |||
==Business Model and Availability== | |||
===Developer Program=== | |||
Snap OS and Spectacles are available through the '''Spectacles Developer Program''', launched in the United States on September 17, 2024.<ref name="developertech"/> The program operates on a subscription model: | |||
* Monthly cost: $99 USD | |||
* Minimum commitment: 1 year | |||
* Total annual cost: $1,188 | |||
* Includes: Spectacles hardware, Snap support, and development tools<ref name="uploadvr"/> | |||
Notably, Snap introduced the platform with "no developer tax," meaning developers retain 100% of revenue from their applications.<ref name="developertech"/> | |||
===Market Strategy=== | |||
Snap CEO Evan Spiegel views the operating system as crucial to diversifying the company's business model beyond advertising.<ref name="axios"/> The long-term goal is to become "the most developer-friendly platform in the world," with potential monetization through various models including advertising, subscriptions, and direct Lens purchases.<ref name="axios"/> | |||
==Technical Limitations== | |||
Current limitations of Snap OS include:<ref name="uploadvr"/> | |||
* 45-minute battery life for continuous use | |||
* Limited to developer access (no consumer release as of 2024) | |||
* Production constraints limiting initial availability to approximately 10,000 units | |||
* U.S.-only availability at launch | |||
==Future Development== | |||
===Planned Features=== | |||
According to release notes and developer documentation, upcoming features include: | |||
* Enhanced multi-user session management | |||
* Improved hand tracking with reduced jitter | |||
* Extended battery life optimizations | |||
* Expanded international availability | |||
===Industry Impact=== | |||
Snap OS represents a significant entry into the AR operating system market, competing with platforms like [[Android XR]] and [[visionOS]].<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." 2024.</ref> Industry analysts note that the focus on natural interactions and shared experiences could establish new standards for AR computing interfaces. | |||
==See Also== | |||
* [[Spectacles]] | |||
* [[Augmented reality]] | |||
* [[Snap Inc.]] | |||
* [[Lens Studio]] | |||
* [[Android XR]] | |||
* [[Apple Vision Pro]] | |||
* [[Meta Quest]] | |||
==References== | |||
<references> | |||
<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024. https://www.axios.com/2024/09/17/snap-operating-system-ar-glasses</ref> | |||
<ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." https://newsroom.snap.com/sps-2024-spectacles-snapos</ref> | |||
<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024. https://www.developer-tech.com/news/snap-os-debuts-with-developer-friendly-spectacles-5-ar-glasses/</ref> | |||
<ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024. https://www.uploadvr.com/snap-spectacles-5-ar/</ref> | |||
<ref name="spectacles">Spectacles. "Get Closer with Friends." https://www.spectacles.com/spectacles-24</ref> | |||
<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." https://www.androidcentral.com/gaming/virtual-reality/smart-glasses-are-a-mess-but-android-xr-should-finally-fix-that</ref> | |||
</references> | |||
==External Links== | |||
* [https://www.spectacles.com/ Official Spectacles website] | |||
* [https://ar.snap.com/ Snap AR Developer Portal] | |||
* [https://lensstudio.snapchat.com/ Lens Studio Download] | |||
* [https://www.snappartnersummit.com/ Snap Partner Summit] | |||
[[Category:Operating systems]] | |||
[[Category:Augmented reality]] | |||
[[Category:Snap Inc.]] | |||
[[Category:2024 software]] | |||
[[Category:Proprietary operating systems]] |
Revision as of 17:02, 24 May 2025
AR Glasses
Snap Spectacles - 2016
Snap Spectacles 2 - 2018
Snap Spectacles 3 - 2019
Snap Spectacles 4 - 2021
Snap Spectacles 5 - 2024
Snap OS | |
---|---|
Information | |
Type | Augmented Reality |
Subtype | AR Operating System |
Creator | Snap Inc. |
Developer | Snap Inc. |
Manufacturer | Snap Inc. |
Operating System | Snap OS |
Browser | Built-in web browser with YouTube support |
Devices | Spectacles (5th generation) |
Accessories | USB-C cable, protective glasses cover, carrying pouch, prescription lens insert (optional), smartphone app |
Release Date | September 17, 2024 |
Price | $99/month (Developer Program, 1-year commitment) |
Website | https://www.spectacles.com/ |
- See also: Augmented Reality#Platforms
Snap OS is a proprietary operating system designed specifically for augmented reality (AR) devices, developed by Snap Inc. The operating system was unveiled on September 17, 2024, at the 6th annual Snap Partner Summit in Santa Monica, California.[1][2] Snap OS powers the fifth generation of Spectacles AR glasses and represents a decade of research and development in AR technology by Snap Inc.[2]
Overview
Snap OS is a purpose-built, groundbreaking operating system designed to enhance how people naturally interact with the world through AR experiences.[2] The system focuses on creating shared experiences and natural interactions, allowing users to navigate through hand gestures and voice commands.[3] Unlike traditional computing interfaces, Snap OS places the main menu in the palm of the user's hand, creating an intuitive navigation system.[2]
According to Evan Spiegel, CEO of Snap Inc., the operating system represents a strategic move to position the company as a leader in AR technology: [1]
Technical Architecture
Snap Spatial Engine
At the core of Snap OS is the Snap Spatial Engine, which provides spatial computing capabilities that allow the system to understand the world around users.[2] The engine enables Lenses (Snap's term for AR applications) to appear realistically in three dimensions with precise environmental mapping.[3] The system achieves an industry-leading 13 millisecond motion-to-photon latency, ensuring that AR content integrates naturally into the user's environment with minimal lag.[2][4]
Hardware Integration
Snap OS is designed to work with a dual system-on-chip architecture utilizing two Snapdragon processors from Qualcomm.[3] This infrastructure splits the computational workload across the two processors, enabling more immersive experiences while reducing power consumption.[2] The dual-chip solution works in conjunction with titanium vapor chambers to improve heat dissipation, allowing for up to 45 minutes of continuous standalone runtime.[3]
Feature | Specification |
---|---|
Motion-to-photon latency | 13 milliseconds |
Processor | Dual Snapdragon processors |
Battery life | Up to 45 minutes continuous use |
Weight (with Spectacles) | 226 grams |
Field of view | 46 degrees diagonal |
Resolution | 37 pixels per degree |
Display type | Stereo waveguide with automatic tint |
User Interface and Interaction
Natural Interaction Methods
Snap OS employs multiple interaction modalities to create a natural user experience:[2]
- Hand tracking: Four integrated cameras enable seamless hand tracking for gesture-based controls
- Voice commands: On-device speech recognition for text input and system commands
- Smartphone integration: Users can utilize their phone as a custom game controller or 6DoF tracked controller
- Palm menu: The main system menu appears in the user's palm for easy access
Display Technology
The operating system drives Liquid Crystal on Silicon (LCoS) micro-projectors that create vivid, sharp images through advanced waveguide technology.[3] Each waveguide contains billions of nanostructures that guide light into the user's field of view without requiring lengthy calibrations or custom fittings.[2] The display automatically adjusts tinting based on environmental lighting conditions, ensuring visibility in various settings including direct sunlight.[4]
Development Platform
Lens Studio 5.0
Snap OS applications, called "Lenses," are developed using Lens Studio 5.0, a completely rebuilt development environment.[3] Key features include:
- Support for TypeScript and JavaScript programming languages[3]
- Improved version control tools for team-based development[2]
- Quick deployment process replacing traditional compilation workflows[2]
- Direct push capability from Lens Studio to Spectacles hardware[3]
Spectacles Interaction Kit
The Spectacles Interaction Kit (SIK) provides pre-built interaction systems that allow developers to create intuitive Lenses without building custom interaction frameworks from scratch.[3] The kit includes components for:
- Hand gesture recognition
- Spatial UI elements
- Multi-user synchronization
- Environmental understanding
SnapML and AI Integration
SnapML enables developers to integrate custom machine learning models directly into Lenses for object identification, tracking, and augmentation.[3] Additionally, Snap has partnered with OpenAI to bring cloud-hosted multimodal AI models to the platform, allowing developers to add contextual understanding to AR experiences based on what users see, say, or hear.[3][4]
Feature | Lens Studio 5.0 | Previous Versions |
---|---|---|
Programming Languages | TypeScript, JavaScript | JavaScript only |
Deployment Method | Direct push | Compilation required |
Version Control | Built-in tools | External tools required |
AI Integration | SnapML + OpenAI models | Limited ML support |
Interaction Framework | Spectacles Interaction Kit | Custom development required |
Features and Capabilities
A core principle of Snap OS is enabling shared AR experiences.[2] Multiple users can participate in the same Lens simultaneously, allowing for collaborative gaming, design review, and social interactions.[5] The system includes:
- Spectator Mode: Allows non-Spectacles users to view AR content on their smartphones[2]
- Session management: Developers can set fixed session IDs for controlled multi-user experiences
- Connected Lens framework: Real-time synchronization between multiple devices
Built-in Applications
Snap OS includes several pre-installed features:[5]
- My AI: Snap's AI assistant with multimodal capabilities
- Web browser: Supporting standard web content including YouTube
- Phone mirroring: Ability to mirror smartphone screen content
- Lens Explorer: Discovery interface for finding and launching AR experiences
Privacy and Security
While specific privacy features were not extensively detailed in available sources, the system includes:[3]
- LED indicators that illuminate when cameras are active
- Permission-based access to device capabilities
- Sandboxed application environment for Lenses
Launch Partners and Applications
Snap OS launched with several high-profile development partners creating showcase applications:[3][2]
Partner | Application | Description |
---|---|---|
LEGO Group | BRICKTACULAR | Interactive AR building game controlled by hands and voice |
ILM Immersive | Star Wars experiences | AR experiences connecting users with the Star Wars universe |
Niantic | Peridot, Scaniverse | AR pet game and 3D scanning application |
Wabisabi Games | Capture the Flag | Multiplayer AR gaming experience |
Business Model and Availability
Developer Program
Snap OS and Spectacles are available through the Spectacles Developer Program, launched in the United States on September 17, 2024.[3] The program operates on a subscription model:
- Monthly cost: $99 USD
- Minimum commitment: 1 year
- Total annual cost: $1,188
- Includes: Spectacles hardware, Snap support, and development tools[4]
Notably, Snap introduced the platform with "no developer tax," meaning developers retain 100% of revenue from their applications.[3]
Market Strategy
Snap CEO Evan Spiegel views the operating system as crucial to diversifying the company's business model beyond advertising.[1] The long-term goal is to become "the most developer-friendly platform in the world," with potential monetization through various models including advertising, subscriptions, and direct Lens purchases.[1]
Technical Limitations
Current limitations of Snap OS include:[4]
- 45-minute battery life for continuous use
- Limited to developer access (no consumer release as of 2024)
- Production constraints limiting initial availability to approximately 10,000 units
- U.S.-only availability at launch
Future Development
Planned Features
According to release notes and developer documentation, upcoming features include:
- Enhanced multi-user session management
- Improved hand tracking with reduced jitter
- Extended battery life optimizations
- Expanded international availability
Industry Impact
Snap OS represents a significant entry into the AR operating system market, competing with platforms like Android XR and visionOS.[6] Industry analysts note that the focus on natural interactions and shared experiences could establish new standards for AR computing interfaces.
See Also
References
- ↑ 1.0 1.1 1.2 1.3 Axios. "Snap debuts operating system for AR glasses." September 17, 2024. Cite error: Invalid
<ref>
tag; name "axios" defined multiple times with different content - ↑ 2.00 2.01 2.02 2.03 2.04 2.05 2.06 2.07 2.08 2.09 2.10 2.11 2.12 2.13 Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." Accessed 2024. Cite error: Invalid
<ref>
tag; name "snapnewsroom" defined multiple times with different content - ↑ 3.00 3.01 3.02 3.03 3.04 3.05 3.06 3.07 3.08 3.09 3.10 3.11 3.12 3.13 3.14 Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024. Cite error: Invalid
<ref>
tag; name "developertech" defined multiple times with different content - ↑ 4.0 4.1 4.2 4.3 4.4 UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024. Cite error: Invalid
<ref>
tag; name "uploadvr" defined multiple times with different content - ↑ 5.0 5.1 Spectacles. "Get Closer with Friends." Accessed 2024. Cite error: Invalid
<ref>
tag; name "spectacles" defined multiple times with different content - ↑ Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." 2024. Cite error: Invalid
<ref>
tag; name "androidcentral" defined multiple times with different content