When I was a software engineer at Daqri, I was on the core app team to develop built-in apps for smart helmet. One of early experiment was to see if we can stream the data from the device to a web interface for analytics purpose in real-time. The sensor data was delievered to AWS IoT then broadcast to a local server.

Analytics Web Interface

The trail represents the trajectory of device movement. The interface allows viewing perspective to change from third-person, first person to god-view. Whenever an image marker is detected, it would populate the "task" associated with individual marker so admin would able to replay / monitor / perform emergency procedure if needed. In order to create fragment effect, it uses THREE.ExplodeModifier to separate faces with unique vertices. The wrecking ball's speed and direction contribute to the force for each face going outward. The floor has friction ratio at 0.95 every frame so that it creates sliding effect on the floor.

Interface Prototype

Besides analytics data, it's equally important how we present the "task" list, especially when dealing with multi-level hierarchy. The question was, how do we let user feel "augmented" with useful information without blocking the view? One idea pops up in my mind immediately was this mechnical appearance. I also took several futuristic interface design / high-tech movies as inspiration for the sci-fi style.

Visual Feedback

Inside of heads-up display, one of the feature that people would love to see is the visual feedback to tell the environment and what was recognized. The "click" effect is a 2D colorful ripple grows outward on 3D environments, it was done completely in shader.

Linux Programming / OpenGL / WebGL