CleARsight was created by Bobby Barry, Keith Bradley, Peter Lu, Mike Dopsa, and Media Ridha at MIT's Reality Virtually 2019 Hackathon. PreCompiled/Built MPK file is available for download at the bottom of this page.
According to the National Center for Health Statistics, 26 Million Americans Adults experience significant vision loss, creating challenges with Depth Perception, Low-Light scenarios and proprioception. CleARsight for Magic Leap is a Spatial Computing Accessibility application, to improve the daily lives of individuals with Low Vision.
Using Magic Leap’s World Mapping, Haptic Feedback, Spatial Audio, and Holographic Visual Overlay, CleARsight illuminates your environment, outlining object edges with High Contrast colours, and highlighting horizontal planes with a vivid pattern.
Pulling the trigger of the 6DoF Controller, activates the environmental awareness system ‘virtual cane.’ Measuring the distance between the Controller, and the spatial mesh generated by the magic leap’s world reconstruction system, Haptic feedback increases in intensity as obstacles get closer. Like the use of echo-location in nature, this allows the CleARsight wearer to gain a spatial understanding of their immediate environment, without relying exclusively on Vision.
Additionally, a spatial audio file is played from the pointer’s position on the environment mesh. Like an Audible Pedestrian Crossing, this sound allows the CleARsight wearer to hear, in real space, their distance from the obstacle. Operating concurrently, this synchronized combination of haptics, spatial audio and High-Visibility Holographic outlines serve to supplement the CleARsight wearer’s reliance on Visual Navigation.
In the home, and other familiar locations, CleARsight allows the recording of contextual ‘Placed Audio Memos.’ Spatially affixed to their recording location, CleARsight wearers, or their caregivers can drop a message of their choosing, which will automatically playback when approached. Today, CleARsight introduces a novel use of Spatial Computing technology, to amplify the wearer’s senses. Tomorrow, improvements to this technology can be built upon with other digital integrations like Object Recognition, Voice Recognition, and IoT Controls to bolster a robust Sightless User Interface.
Try out CleARsight by side-loading the MPK file. (Guide: https://creator.magicleap.com/learn/guides/sdk-mldb-installing-and-launching-apps)
Download: https://drive.google.com/open?id=1pgvtN3I2sitdTHPHWXIZs0CUBIRTkfXH
// 'Oops There was a problem with the network' Error message can be igored. Download button still works!
Reach out to the creaters of CleARsight if you're interested in further development, practical use of CleARsight or media coverage.
Keith Bradley https://devpost.com/sphericvr http://sphericvr.com/contact
Mike Dopsa https://devpost.com/mcdopsa me@mikedopsa.com
Peter Lu https://devpost.com/PeterLu https://www.lupeter.com/