Snap OS: Difference between revisions - VR & AR Wiki - Virtual Reality & Augmented Reality Wiki

Line 1:

~~{{stub}}~~

~~{{see also|Augmented Reality#Platforms}}~~

==AR Glasses==

'''[[Snap Spectacles]]''' - 2016

Line 12:

Line 9:

'''[[Snap Spectacles 5]]''' - 2024

{{Platform Infobox

|image=

|Type=Augmented Reality

|Subtype=AR Operating System

|Creator=Snap Inc.

|Developer=Snap Inc.

|Manufacturer=Snap Inc.

|Operating System=Snap OS

|Browser=Built-in web browser with YouTube support

|Devices=Spectacles (5th generation)

|Accessories=USB-C cable, protective glasses cover, carrying pouch, prescription lens insert (optional), smartphone app

|Release Date=September 17, 2024

|Price=$99/month (Developer Program, 1-year commitment)

|Website=https://www.spectacles.com/

}}

'''Snap OS''' is a proprietary [[operating system]] designed specifically for [[augmented reality]] (AR) devices, developed by [[Snap Inc.]] The operating system was unveiled on September 17, 2024, at the 6th annual Snap Partner Summit in Santa Monica, California.<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024.</ref><ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." Accessed 2024.</ref> Snap OS powers the fifth generation of [[Spectacles]] AR glasses and represents a decade of research and development in AR technology by Snap Inc.<ref name="snapnewsroom"/>

==Overview==

Snap OS is a purpose-built, groundbreaking operating system designed to enhance how people naturally interact with the world through AR experiences.<ref name="snapnewsroom"/> The system focuses on creating shared experiences and natural interactions, allowing users to navigate through [[hand tracking|hand gestures]] and [[voice commands]].<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024.</ref> Unlike traditional computing interfaces, Snap OS places the main menu in the palm of the user's hand, creating an intuitive navigation system.<ref name="snapnewsroom"/>

According to [[Evan Spiegel]], CEO of Snap Inc., the operating system represents a strategic move to position the company as a leader in AR technology: <ref name="axios">"I think glasses allow us to use computing grounded in the real world, together with our friends, and in a much more natural way."</ref>

==Technical Architecture==

===Snap Spatial Engine===

At the core of Snap OS is the '''Snap Spatial Engine''', which provides [[spatial computing]] capabilities that allow the system to understand the world around users.<ref name="snapnewsroom"/> The engine enables [[Lenses]] (Snap's term for AR applications) to appear realistically in three dimensions with precise environmental mapping.<ref name="developertech"/> The system achieves an industry-leading 13 millisecond [[motion-to-photon latency]], ensuring that AR content integrates naturally into the user's environment with minimal lag.<ref name="snapnewsroom"/><ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024.</ref>

===Hardware Integration===

Snap OS is designed to work with a dual [[system-on-chip]] architecture utilizing two [[Snapdragon]] processors from [[Qualcomm]].<ref name="developertech"/> This infrastructure splits the computational workload across the two processors, enabling more immersive experiences while reducing power consumption.<ref name="snapnewsroom"/> The dual-chip solution works in conjunction with titanium vapor chambers to improve heat dissipation, allowing for up to 45 minutes of continuous standalone runtime.<ref name="developertech"/>

{| class="wikitable"

|+ Technical Specifications

|-

! Feature !! Specification

|-

| Motion-to-photon latency || 13 milliseconds

|-

| Processor || Dual Snapdragon processors

|-

| Battery life || Up to 45 minutes continuous use

|-

| Weight (with Spectacles) || 226 grams

|-

| Field of view || 46 degrees diagonal

|-

| Resolution || 37 pixels per degree

|-

| Display type || Stereo waveguide with automatic tint

|}

==User Interface and Interaction==

===Natural Interaction Methods===

Snap OS employs multiple interaction modalities to create a natural user experience:<ref name="snapnewsroom"/>

* '''Hand tracking''': Four integrated cameras enable seamless hand tracking for gesture-based controls

* '''Voice commands''': On-device speech recognition for text input and system commands

* '''Smartphone integration''': Users can utilize their phone as a custom game controller or 6DoF tracked controller

* '''Palm menu''': The main system menu appears in the user's palm for easy access

===Display Technology===

The operating system drives [[Liquid Crystal on Silicon]] (LCoS) micro-projectors that create vivid, sharp images through advanced [[waveguide]] technology.<ref name="developertech"/> Each waveguide contains billions of nanostructures that guide light into the user's field of view without requiring lengthy calibrations or custom fittings.<ref name="snapnewsroom"/> The display automatically adjusts tinting based on environmental lighting conditions, ensuring visibility in various settings including direct sunlight.<ref name="uploadvr"/>

==Development Platform==

===Lens Studio 5.0===

Snap OS applications, called "Lenses," are developed using '''Lens Studio 5.0''', a completely rebuilt development environment.<ref name="developertech"/> Key features include:

* Support for [[TypeScript]] and [[JavaScript]] programming languages<ref name="developertech"/>

* Improved version control tools for team-based development<ref name="snapnewsroom"/>

* Quick deployment process replacing traditional compilation workflows<ref name="snapnewsroom"/>

* Direct push capability from Lens Studio to Spectacles hardware<ref name="developertech"/>

===Spectacles Interaction Kit===

The '''Spectacles Interaction Kit''' (SIK) provides pre-built interaction systems that allow developers to create intuitive Lenses without building custom interaction frameworks from scratch.<ref name="developertech"/> The kit includes components for:

* Hand gesture recognition

* Spatial UI elements

* Multi-user synchronization

* Environmental understanding

===SnapML and AI Integration===

'''SnapML''' enables developers to integrate custom [[machine learning]] models directly into Lenses for object identification, tracking, and augmentation.<ref name="developertech"/> Additionally, Snap has partnered with [[OpenAI]] to bring cloud-hosted multimodal AI models to the platform, allowing developers to add contextual understanding to AR experiences based on what users see, say, or hear.<ref name="developertech"/><ref name="uploadvr"/>

{| class="wikitable"

|+ Development Tools Comparison

|-

! Feature !! Lens Studio 5.0 !! Previous Versions

|-

| Programming Languages || TypeScript, JavaScript || JavaScript only

|-

| Deployment Method || Direct push || Compilation required

|-

| Version Control || Built-in tools || External tools required

|-

| AI Integration || SnapML + OpenAI models || Limited ML support

|-

| Interaction Framework || Spectacles Interaction Kit || Custom development required

|}

==Features and Capabilities==

===Shared Experiences===

A core principle of Snap OS is enabling shared AR experiences.<ref name="snapnewsroom"/> Multiple users can participate in the same Lens simultaneously, allowing for collaborative gaming, design review, and social interactions.<ref name="spectacles">Spectacles. "Get Closer with Friends." Accessed 2024.</ref> The system includes:

* '''Spectator Mode''': Allows non-Spectacles users to view AR content on their smartphones<ref name="snapnewsroom"/>

* '''Session management''': Developers can set fixed session IDs for controlled multi-user experiences

* '''Connected Lens framework''': Real-time synchronization between multiple devices

===Built-in Applications===

Snap OS includes several pre-installed features:<ref name="spectacles"/>

* '''My AI''': Snap's AI assistant with multimodal capabilities

* '''Web browser''': Supporting standard web content including YouTube

* '''Phone mirroring''': Ability to mirror smartphone screen content

* '''Lens Explorer''': Discovery interface for finding and launching AR experiences

===Privacy and Security===

While specific privacy features were not extensively detailed in available sources, the system includes:<ref name="developertech"/>

* LED indicators that illuminate when cameras are active

* Permission-based access to device capabilities

* Sandboxed application environment for Lenses

==Launch Partners and Applications==

Snap OS launched with several high-profile development partners creating showcase applications:<ref name="developertech"/><ref name="snapnewsroom"/>

{| class="wikitable"

|+ Launch Partner Applications

|-

! Partner !! Application !! Description

|-

| [[LEGO Group]] || BRICKTACULAR || Interactive AR building game controlled by hands and voice

|-

| [[ILM Immersive]] || Star Wars experiences || AR experiences connecting users with the Star Wars universe

|-

| [[Niantic]] || Peridot, Scaniverse || AR pet game and 3D scanning application

|-

| Wabisabi Games || Capture the Flag || Multiplayer AR gaming experience

|}

==Business Model and Availability==

===Developer Program===

Snap OS and Spectacles are available through the '''Spectacles Developer Program''', launched in the United States on September 17, 2024.<ref name="developertech"/> The program operates on a subscription model:

* Monthly cost: $99 USD

* Minimum commitment: 1 year

* Total annual cost: $1,188

* Includes: Spectacles hardware, Snap support, and development tools<ref name="uploadvr"/>

Notably, Snap introduced the platform with "no developer tax," meaning developers retain 100% of revenue from their applications.<ref name="developertech"/>

===Market Strategy===

Snap CEO Evan Spiegel views the operating system as crucial to diversifying the company's business model beyond advertising.<ref name="axios"/> The long-term goal is to become "the most developer-friendly platform in the world," with potential monetization through various models including advertising, subscriptions, and direct Lens purchases.<ref name="axios"/>

==Technical Limitations==

Current limitations of Snap OS include:<ref name="uploadvr"/>

* 45-minute battery life for continuous use

* Limited to developer access (no consumer release as of 2024)

* Production constraints limiting initial availability to approximately 10,000 units

* U.S.-only availability at launch

==Future Development==

===Planned Features===

According to release notes and developer documentation, upcoming features include:

* Enhanced multi-user session management

* Improved hand tracking with reduced jitter

* Extended battery life optimizations

* Expanded international availability

===Industry Impact===

Snap OS represents a significant entry into the AR operating system market, competing with platforms like [[Android XR]] and [[visionOS]].<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." 2024.</ref> Industry analysts note that the focus on natural interactions and shared experiences could establish new standards for AR computing interfaces.

==See Also==

* [[Spectacles]]

* [[Augmented reality]]

* [[Snap Inc.]]

* [[Lens Studio]]

* [[Android XR]]

* [[Apple Vision Pro]]

* [[Meta Quest]]

==References==

<ref name="axios">Axios. "Snap debuts operating system for AR glasses." September 17, 2024. https://www.axios.com/2024/09/17/snap-operating-system-ar-glasses</ref>

<ref name="snapnewsroom">Snap Newsroom. "SPS 2024 | Introducing New Spectacles and Snap OS: The Next Frontier of AR Glasses." https://newsroom.snap.com/sps-2024-spectacles-snapos</ref>

<ref name="developertech">Developer Tech. "Snap OS debuts with developer-friendly Spectacles 5 AR glasses." September 18, 2024. https://www.developer-tech.com/news/snap-os-debuts-with-developer-friendly-spectacles-5-ar-glasses/</ref>

<ref name="uploadvr">UploadVR. "Snap Spectacles Are $100/Month AR Glasses For Developers." September 25, 2024. https://www.uploadvr.com/snap-spectacles-5-ar/</ref>

<ref name="spectacles">Spectacles. "Get Closer with Friends." https://www.spectacles.com/spectacles-24</ref>

<ref name="androidcentral">Android Central. "Android XR will make smart glasses more like smartwatches, and that's exactly what I want." https://www.androidcentral.com/gaming/virtual-reality/smart-glasses-are-a-mess-but-android-xr-should-finally-fix-that</ref>

</references>

==External Links==

* [https://www.spectacles.com/ Official Spectacles website]

* [https://ar.snap.com/ Snap AR Developer Portal]

* [https://lensstudio.snapchat.com/ Lens Studio Download]

* [https://www.snappartnersummit.com/ Snap Partner Summit]

[[Category:Operating systems]]

[[Category:Augmented reality]]

[[Category:Snap Inc.]]

[[Category:2024 software]]

[[Category:Proprietary operating systems]]