CastAR
More actions
| CastAR | |
|---|---|
| Basic Info | |
| VR/AR | Augmented Reality |
| Type | Optical head-mounted display |
| Subtype | PC-Powered AR |
| Creator | Jeri Ellsworth, Rick Johnson |
| Developer | Technical Illusions (later named castAR) |
| Release Date | November 2014 (early developer prototypes)[1] |
| Price | US$189 Kickstarter starter tier (2013); US$400 development-kit preorder (August 2015)[2][3] |
| Website | Original Kickstarter campaign |
| Requires | PC for the original projected-AR system[2] |
| Display | |
| Display | Two head-mounted micro-projectors[4] |
| Resolution | 1280 x 720 per eye in the January 2014 HD prototype[5] |
| Refresh Rate | 120 Hz per eye (campaign specification)[2] |
| Image | |
| Field of View | 65° horizontal in projected mode (campaign specification)[2] |
| Tracking | |
| Tracking | Six degrees of freedom; camera tracking infrared markers[2] |
| Connectivity | |
| Connectivity | HDMI video and USB tracking in the original PC design[2] |
| Device | |
| Weight | Under 100 g target for the planned final glasses[4] |
| Input | Game controller; proposed Magic Wand and RFID accessories[4] |
castAR was a projected augmented reality system developed by Technical Illusions, the company founded by Jeri Ellsworth and Rick Johnson after they left Valve. Its glasses carried two micro-projectors that sent stereoscopic images onto a retroreflective surface. Light returned toward the glasses, while head tracking changed the rendered perspective as the wearer moved.[4][6]
The project included demonstrated prototypes, early developer hardware and plans for a later consumer system. These were different stages of development: early developer glasses shipped, but the company was still preparing a consumer launch when it shut down in June 2017.[1][7]
Hardware
Glasses
The glasses had two projectors above their lenses and a camera that observed infrared markers near the projection area. In January 2014, Road to VR tried an HD prototype with 1280 x 720 projectors, replacing the lower-resolution projectors used in earlier demonstrations. Moving around the demonstration table changed the view of the virtual scene. The developers told the publication that this prototype had not yet been optimized for latency.[5]
Technical Illusions specified 120 Hz refresh per eye for its planned glasses. Active shutters supplemented the separation provided by retroreflection. The developers designed the frame to fit over prescription glasses, and described a final weight below 100 g as a target.[2][4] The campaign's high-fill-factor claim was intended to reduce the screen door effect; it was a design claim rather than a guarantee that every user would perceive no pixel structure.[2]
In the original PC design, HDMI carried the video signal and USB connected the tracking camera. The campaign described local processing of camera images on the glasses, with tracking results sent to the computer.[2] A contemporary hands-on account described an unobstructed infrared marker plate as necessary for tracking.[8]
AR and VR Clip-on
The proposed AR/VR Clip-On redirected projector light toward the eyes through a near-eye optical path, allowing operation without the external retroreflective sheet. Its intended modes included see-through AR and an opaque virtual reality view. Precise camera tracking would still require infrared markers within view.[4]
The accessory's announced functions should be distinguished from the demonstrated hardware. At CES 2014, Ellsworth told Road to VR that the clip-on prototype worked for only one eye and was not ready to demonstrate. Tom's Hardware also could not test the attachment in its early hands-on coverage.[5][4]
Retro-Reflective Surface
The retroreflective material formed the projection area, for example on a tabletop. It returned most of the incident projector light toward its source, letting several wearers view the same surface with their own perspectives. The system could therefore show different views of one scene, or separate content, to people sharing a table.[5][3] This arrangement required the special surface wherever projected images were to appear; the glasses did not project visible AR content onto arbitrary untreated objects.[4]
Wand Controller
The Magic Wand was proposed as a handheld joystick and tracked 3D input device, with buttons, a trigger and an analog thumb stick. Reviewed reported that the wand was unavailable for its January 2014 demonstration. In August 2015, chief executive David Henkel-Wallace told Road to VR that the wand had been reworked to use the same tracking technology as the glasses.[8][3]
RFID Tracking Grid
The proposed RFID Tracking Grid sat beneath the projection surface. It was intended to identify tagged cards, figurines and other physical game pieces and pass their identities and positions to software. A game could then associate a miniature with a virtual character or display information beside it.[8]
Bases
The campaign offered bases designed to attach beneath existing miniatures. Ordinary RFID bases would identify pieces and provide coarse tracking. RFID Precision bases added a circuit board for two-way communication and more precise tracking; the advertised examples included controlling small motors or lights in a miniature.[8][2] These descriptions belong to the accessory system proposed during development.[2]
Specifications
The following figures describe the original campaign or identified early prototypes. They do not constitute a final consumer specification.
| Part | Documented specification and scope |
|---|---|
| Display | Two micro-projectors, one for each eye.[4] |
| Resolution | 1280 x 720 per eye in the HD prototype demonstrated in January 2014; a combined 2560 x 720 across the two views.[5][2] |
| Refresh rate | 120 Hz per eye, specified in the campaign.[2] |
| Field of view | 65° horizontal for projected mode; 90° horizontal was specified for the proposed clip-on.[2] |
| Tracking | Six degrees of freedom using a camera and infrared markers.[2] |
| Rotational tracking | A gyroscope was planned as a Kickstarter stretch-goal addition, including operation without the infrared marker.[4] |
| Positional tracking | Head-mounted camera observing infrared markers in the environment.[5] |
| Update rate | 120 Hz camera tracking, advertised in the campaign.[2] |
| Latency | 8.3 ms was the advertised tracking response time, rather than a measured end-to-end display-latency result.[2] |
| Connectivity | HDMI for video and USB for the camera in the original PC design.[2] |
| Input | A conventional game controller was demonstrated; the Magic Wand and RFID grid were additional proposed interfaces.[4] |
| Weight | Under 100 g target for the planned final glasses.[4] |
| Retro-Reflective Surface | The Kickstarter starter package included a planned 1 m x 1 m sheet; larger packages specified 1 m x 2 m.[2] |
Setup Tutorial
The original projected-AR arrangement combined a PC, the glasses, a retroreflective projection surface and an infrared marker visible to the tracking camera. The glasses received video over HDMI, while tracking used USB. The marker needed to remain visible as the wearer moved.[2][8] This describes the historical PC setup; later announcements sought a self-contained consumer system.[7]
Apps
Demonstrations focused on games played around a shared surface. In its December 2015 interview with Henkel-Wallace, GamesBeat described virtual marbles, battle chess and a wand-controlled block-stacking demonstration. The company was concentrating on tabletop experiences for the planned consumer product.[9]
Research demonstrations and evaluations
A 2014 report by naval aerospace experimental psychologist Lt. Lee Sciarini described a CastAR prototype evaluation at Naval Air Station Whidbey Island. Naval aviation specialists tried projector glasses and retroreflective material with E/A-18G, E/A-6B and MH-60S aircraft as part of work originating in a Naval Postgraduate School class project. The report compared participants' opinions before and after the experience: ratings of potential training usefulness increased in 12 of 18 task areas. This was a subjective evaluation of a prototype, rather than a demonstration of improved flying skill; the short account did not report participant count or a controlled learning comparison.[10]
Robert A. Sottilare and Joseph J. LaViola's 2015 I/ITSEC paper included CastAR in a feature and usability-heuristic evaluation of ten smart-glasses systems for adaptive land-navigation instruction. The authors considered its resolution useful for map detail, but judged its dependence on retroreflective material impractical for locations without training infrastructure. Their analysis used task requirements and usability criteria, not a reported controlled trial measuring learning with CastAR.[11]
Developer
SDK and Unity integration
The campaign described a free software development kit exposing tracking data, rendering matrices and RFID data. It also proposed Unity integration scripts for the glasses, wand and tagged objects, plus example projects. Other engine integrations and support for existing VR applications were exploratory plans.[2]
History
Valve research and crowdfunding
castAR began in Valve's hardware lab. Ellsworth's experiments in May 2012 led her to investigate projecting images onto retroreflective material. Her large early prototype was nicknamed the "head crab".[6] The campaign's account said that this first apparatus used two cellphone-sized projectors and displayed a static image without tracking. Johnson began helping with software after discussing the project with Ellsworth in August 2012.[2]
After leaving Valve in February 2013, Ellsworth and Johnson obtained permission to take the technology with them and continued through Technical Illusions. They demonstrated castAR at the Bay Area Maker Faire in May 2013.[6]
The Kickstarter campaign ran from October 14 to November 15, 2013. Its 3,863 backers pledged US$1,052,110 against a US$400,000 goal.[12] The US$189 starter tier offered glasses, built-in tracking and a 1 m x 1 m surface, with September 2014 listed as an estimated delivery date.[2]
Early hardware and consumer plans
Early developer prototypes began shipping to Kickstarter backers in November 2014.[1] In August 2015, Henkel-Wallace said about two-thirds of the hand-assembled prototype kits had shipped. At that point he forecast final developer kits for early 2016 and consumer hardware for late 2016 or early 2017. Development-kit preorders started at US$400, with the wand and clip-on priced separately.[3]
On August 19, 2015, the company, now using the name castAR, announced more than US$15 million in Series A funding from Android co-founder Andy Rubin's Playground Global and its seed investors. Its announcement said working prototypes were already going to backers and described commercial availability in 2016 as an anticipated launch.[13]
In December 2015, the company offered reimbursement to backers expecting hardware and a free consumer system when it launched. Henkel-Wallace told GamesBeat that the consumer release was then planned for 2017. The proposal addressed the difference between the developer hardware originally crowdfunded and the software and content expected by consumer backers.[9]
On June 26, 2017, Polygon reported, citing former employees, that castAR had closed its doors and laid off fewer than 70 staff across Palo Alto and Salt Lake City. The report said further funding had not materialized and a small group was trying to sell the technology. The planned self-contained consumer glasses had still been due later that year.[7]
Ellsworth later co-founded Tilt Five, which showed a separate tabletop AR system using retroreflection in 2019.[14]
References
- ↑ 1.0 1.1 1.2 Mariella Moon (2014-11-23). "castAR team ships out first pair of AR glasses, more to follow soon". Engadget. https://www.engadget.com/2014-11-23-castar-shipping.html/. Retrieved 2026-10-15.
- ↑ 2.00 2.01 2.02 2.03 2.04 2.05 2.06 2.07 2.08 2.09 2.10 2.11 2.12 2.13 2.14 2.15 2.16 2.17 2.18 2.19 2.20 2.21 2.22 Technical Illusions. "castAR: the most versatile AR & VR system - Campaign". Kickstarter. https://www.kickstarter.com/projects/technicalillusions/castar-the-most-versatile-ar-and-vr-system/description. Retrieved 2026-10-15.
- ↑ 3.0 3.1 3.2 3.3 Ben Lang (2015-08-20). "CastAR Talks Timelines and Performance Improvements for Dev Kits and Consumer AR Glasses". Road to VR. https://roadtovr.com/castar-talks-timelines-and-performance-improvements-for-dev-kits-and-consumer-ar-glasses/. Retrieved 2026-10-15.
- ↑ 4.00 4.01 4.02 4.03 4.04 4.05 4.06 4.07 4.08 4.09 4.10 4.11 Alex Davies (2014-02-27). "CastAR: The Augmented And Virtual Reality Triple-Threat - How CastAR Works". Tom's Hardware. https://www.tomshardware.com/reviews/castar-augmented-reality%2C3742-3.html. Retrieved 2026-10-15.
- ↑ 5.0 5.1 5.2 5.3 5.4 5.5 Ben Lang (2014-01-08). "CES 2014: First Hands on with CastAR HD Prototype". Road to VR. https://www.roadtovr.com/first-hands-on-with-castar-hd-prototype-ces-2014/. Retrieved 2026-10-15.
- ↑ 6.0 6.1 6.2 Alex Davies (2014-02-27). "CastAR: The Augmented And Virtual Reality Triple-Threat - Projected AR: A Happy Accident?". Tom's Hardware. https://www.tomshardware.com/reviews/castar-augmented-reality%2C3742.html. Retrieved 2026-10-15.
- ↑ 7.0 7.1 7.2 Brian Crecente (2017-06-26). "Former Valve initiative CastAR shuts down". Polygon. https://www.polygon.com/2017/6/26/15877804/castar-shut-down. Retrieved 2026-10-15.
- ↑ 8.0 8.1 8.2 8.3 8.4 Carolyn McDowell (2014-01-14). "Hands On with CastAR". Reviewed. https://www.reviewed.com/health/features/hands-on-with-castar. Retrieved 2026-10-15.
- ↑ 9.0 9.1 Dean Takahashi (2015-12-16). "CastAR will return $1M in Kickstarter money and postpone augmented reality glasses shipments". GamesBeat. https://gamesbeat.com/castar-will-return-1m-in-kickstarter-money-and-postpone-augmented-reality-glasses-shipments/. Retrieved 2026-10-15.
- ↑ Sottilare, Robert A.; LaViola, Joseph J. (2015). "Extending Intelligent Tutoring Beyond the Desktop to the Psychomotor Domain". Proceedings of I/ITSEC 2015: 1-11. Paper 15029. Retrieved 2026-10-15.
- ↑ Technical Illusions. "castAR: the most versatile AR & VR system". Kickstarter. https://www.kickstarter.com/projects/technicalillusions/castar-the-most-versatile-ar-and-vr-system. Retrieved 2026-10-15.
- ↑ castAR (2015-08-19). "castAR Closes $15+ Million Series A Round from Playground Global". PR Newswire. https://www.prnewswire.com/news-releases/castar-closes-15-million-series-a-round-from-playground-global-300130464.html. Retrieved 2026-10-15.
- ↑ Ben Lang (2019-05-17). "Tilt Five Shows AR Tech Aimed at Revolutionizing Tabletop Gaming". Road to VR. https://roadtovr.com/tilt-five-ar-tabletop-gaming-board-games/. Retrieved 2026-10-15.