Jump to content

SteamVR Desktop Theater Mode

From VR & AR Wiki

SteamVR Desktop Theater Mode is a feature of Valve's SteamVR platform that displays non-VR games and other flat (2D) desktop content on a large virtual screen inside a virtual reality headset. It lets a user launch an ordinary game from their Steam library and play it, using a keyboard and mouse or a gamepad, on a simulated cinema-style screen rather than on a physical monitor. The feature does not convert a game into a true VR experience: the game still renders as a flat image, which SteamVR projects onto a screen within a minimal virtual room.[1][2]

Valve announced the feature in March 2016 as an early beta and demonstrated it publicly at the Game Developers Conference (GDC) 2016.[2][3] The original implementation was delivered as a SteamVR component named Desktop Game Theater. In November 2023 Valve retired that component and replaced it with a reworked feature called the Theater Screen, introduced in the SteamVR 2.1 series of updates.[4][5]

Background

Most early consumer VR headsets, including the HTC Vive and the Oculus Rift, shipped in 2016 with motion-tracked controllers and software written specifically for head-tracked, stereoscopic VR. The large existing catalog of flat PC games was not built for VR: those games assume a fixed 2D display and use input conventions, such as mouse look and camera control during cutscenes, that map poorly to a head-mounted view.[2] Desktop Theater Mode was Valve's approach to letting that catalog be used from inside a headset without modification, by treating the headset as a personal monitor.[1]

Valve described the feature at announcement as a way to play games not made for VR "inside a virtual environment in a sort of virtual home theater with a huge display."[2] The company positioned it as a bridge for the period before a large number of native VR titles existed, and noted that it would support the HTC Vive "and others."[2]

Announcement and 2016 release

Valve issued the announcement around March 12 to 14, 2016, stating that Desktop Theater Mode was in early beta and would be shown for the first time at GDC 2016, which ran March 14 to 18, 2016 in San Francisco.[2][3] Press given hands-on access at the show reported playing flat titles such as Broforce on the virtual screen.[1]

The feature shipped as part of SteamVR and was free, with no separate purchase required.[6] It worked with the HTC Vive and the Oculus Rift; on the Rift, the user first had to enable the "Unknown Sources" setting in the Oculus software so that a non-Oculus-Store application (SteamVR) could run.[6]

How it works

Desktop Theater Mode places the user in a sparse virtual room and renders the game's output on a flat screen positioned in front of them. At a 2016 hands-on, the simulated screen appeared roughly 10 to 12 feet (about 3 to 3.7 meters) wide, viewed from a distance of about 6 feet (about 1.8 meters), with the position adjustable. The room used a deliberately minimal design rather than attempting a photorealistic theater.[1] The mode could be used seated or while standing in a room-scale play space.[2]

The feature draws on some of the same technology Valve used for its Steam In-Home Streaming and Steam Broadcasting features, the latter of which Valve added to Steam in beta in December 2014.[1][7] Valve indicated that games running above 30 frames per second should work without problems.[1] Input is handled with the same devices used for ordinary PC play: a keyboard and mouse or a controller.[1][6]

The Steam Overlay is accessible from within the virtual theater, and the mode can show arbitrary desktop content, not only games. A 2016 demonstration noted that other applications, such as a video streaming service, could be displayed on the virtual screen.[1]

Image quality

A consistent limitation is image clarity. Because the per-eye resolution of 2016-era headsets was far lower than that of a desktop monitor, content shown on the virtual screen looked softer than it would on a physical display, and small on-screen text could be difficult or nearly impossible to read.[6][1] This constraint is inherent to displaying a high-detail 2D image on an early VR panel and is separate from the feature's framerate handling.

Transition to the Theater Screen (2023)

On November 3, 2023, in the SteamVR Beta 2.1.1 update, Valve sunset the original Desktop Game Theater app and introduced a replacement called the Theater Screen.[5][4] The change reached the stable branch as part of the broader SteamVR 2.1 update, released on November 17, 2023.[8] After the change, launching any non-VR application from Steam shows it on the Theater Screen and automatically hides the SteamVR dashboard.[5]

The Theater Screen is an undocked window that behaves like SteamVR's other undockable dashboard panels and can be toggled from a tab at the bottom of the dashboard. Clicking the screen activates a pointer (laser mouse) that exposes controls to turn the screen off, switch on a dark mode, adjust the screen's curvature, and resize and reposition it.[5][4] At launch the reworked feature required opting in to both the Steam Client Beta and the SteamVR Beta.[4] Valve advised exiting any running VR application, including SteamVR Home, before launching a flat game for best results.[5]

The November 2023 release noted known issues, including the screen sometimes showing the entire desktop instead of only the launched application's window, which relaunching usually fixed.[5] Later patches in the 2.1 line, such as SteamVR 2.1.8, addressed reported Theater Screen problems.[9]

Version history

Date SteamVR version Change
March 2016 Beta (initial) Desktop Theater Mode announced as an early beta; demonstrated at GDC 2016.[2][3]
November 3, 2023 Beta 2.1.1 Desktop Game Theater app sunset; new Theater Screen introduced for non-VR applications.[5][4]
November 17, 2023 2.1 Theater Screen change shipped to the stable branch as part of the SteamVR 2.1 update.[8]
Late 2023 2.1.8 Addressed reported Theater Screen issues, including performance problems affecting third-party tools.[9]

Role in VR and AR

Desktop Theater Mode and its Theater Screen successor are part of a category of VR software that turns a headset into a private virtual monitor or cinema. Within the Steam ecosystem the feature is the platform's built-in path for using flat PC content from inside a headset, and it is integrated directly into SteamVR rather than sold as a separate application.[6][4] Because it is built on SteamVR, it runs on the PC headsets SteamVR supports through OpenVR; the 2016 launch worked with the HTC Vive and the Oculus Rift, and later SteamVR hardware such as the Valve Index and Windows Mixed Reality headsets is supported through the same runtime.[2][6]

The same use case is served by separate third-party VR applications on Steam, such as Virtual Desktop and Bigscreen, which also stream a PC desktop or media onto a virtual screen and in some cases add multi-user "watch together" features. Valve's feature differs in being a no-cost component of the runtime itself.

For VR gaming specifically, the feature affects how flat games and VR injection tools interact with SteamVR. Tools that add stereoscopic 3D to flat games, such as the third-party driver vorpX, run flat titles and depend on how SteamVR presents non-VR output; the 2023 switch to an automatic Theater Screen for non-VR launches changed that behavior and prompted discussion among users of such tools, with reports of performance regressions that a later SteamVR 2.1.8 update addressed.[9] The image-quality limit noted above also illustrates a recurring constraint in VR: a headset's panel resolution sets a ceiling on how legibly fine 2D detail, such as small game text, can be reproduced on a virtual screen.[6][1]

References

  1. 1.00 1.01 1.02 1.03 1.04 1.05 1.06 1.07 1.08 1.09 "Hands-on: SteamVR's Desktop Theater Mode plays your 2D games on a giant VR screen". 2016-03-16. https://www.pcworld.com/article/420125/hands-on-steamvrs-desktop-theater-mode-plays-your-2d-games-on-a-giant-vr-screen.html.
  2. 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 "Valve is Bringing the Entire Steam Library into VR with SteamVR Desktop Theater Mode". 2016-03-12. https://www.roadtovr.com/valve-is-bringing-the-entire-steam-library-into-vr-with-steamvr-desktop-theater-mode/.
  3. 3.0 3.1 3.2 "SteamVR will offer a VR experience for traditional games through a virtual display". 2016-03-13. https://www.digitaltrends.com/virtual-reality/steamvr-desktop-mode-announced/.
  4. 4.0 4.1 4.2 4.3 4.4 4.5 "SteamVR Gets New 'Theater Screen' for Playing Flatscreen Games in VR". 2023-11-06. https://roadtovr.com/steamvr-theater-screen-flatscreen-vr-games/.
  5. 5.0 5.1 5.2 5.3 5.4 5.5 5.6 "SteamVR Beta Updated - 2.1.1". Valve Corporation. 2023-11-03. https://store.steampowered.com/news/app/250820/view/3780269076046528419.
  6. 6.0 6.1 6.2 6.3 6.4 6.5 6.6 "How to Play Any Game in VR With SteamVR's Desktop Theater Mode". https://www.howtogeek.com/270017/how-to-play-any-game-in-vr-with-steamvrs-desktop-theater-mode/.
  7. "Valve Takes On Twitch With Steam Broadcasting". 2014-12-02. https://techcrunch.com/2014/12/02/valve-takes-on-twitch-with-steam-broadcasting/.
  8. 8.0 8.1 "Introducing SteamVR 2.1". Valve Corporation. 2023-11-17. https://store.steampowered.com/news/app/250820/view/3814047346171316602.
  9. 9.0 9.1 9.2 "SteamVR now forcing Theatre Mode". https://www.vorpx.com/forums/topic/steamvr-now-forcing-theatre-mode/.