Organize and Share your Electronics the way you want. Sign-Up for a free account now. It takes only 30 seconds!

Control with your smart devices by staring and gesturing

Control with your smart devices by staring and gesturing

As part of a recent Microsoft HoloLens hackathon in San Francisco, Maker Ian Sterling developed a new app that interacts with you smart home via augmented reality. The proof of concept, dubbed “IoTxMR,” allows a user to simply glance at a gadget and control it through gestures.

As you can see in the video below, IoTxMR enables Sterling to connect various Android and Arduino-based devices with the HoloLens to create a customized interdependent network. It also features a mixed reality experience called “virtual zen mode,” complete with calming sounds and light orbs in his surrounding environment.

During a recent interview with Digital Trends, Sterling revealed:

The primary goal of the app is to provide a 3D spatial UI for cross-platform devices — Android Music Player app and Arduino-controlled fan and light — and to interact with them using gaze and gesture control.

The connectivity between Arduino and a mixed reality device is something which holds a huge amount of creative opportunity for developers to create some very exciting applications — be it [Internet of Things], robotics, or other sensor data visualization. Besides this, our app features some fun ways to connect devices. Our demo featured a connection between a music player and a light in order to set a certain mood in your home.

Although just a demo, IoTxMR does highlight the endless possibilities that AR platforms like HoloLens offer in the not-too-distant future.

Read more Here

Pinned onto

Related Pins

ESLOV is the amazing new IoT invention kit from Arduino
ESLOV is the amazing new IoT invention kit from Arduino
Building a sweet plastic MIDI controller
Building a sweet plastic MIDI controller
A DIY interactive book that uses digital gestures
A DIY interactive book that uses digital gestures
HAL 9000 reimagined as a useless machine
HAL 9000 reimagined as a useless machine
An Arduino VU meter for classrooms
An Arduino VU meter for classrooms
Build your own robotic vacuum from scratch
Build your own robotic vacuum from scratch
An animatronic talking takeout container
An animatronic talking takeout container
IDE 1.6.12 released with Sierra support and more
IDE 1.6.12 released with Sierra support and more
PIXIE is an Arduino-based NeoPixel watch
PIXIE is an Arduino-based NeoPixel watch
Capture time-lapses with a steel and aluminum camera slider
Capture time-lapses with a steel and aluminum camera slider
The MR-808 is a robotic drum “synthesizer”
The MR-808 is a robotic drum “synthesizer”
Analyze your world with the WiSci portable spectrometer
Analyze your world with the WiSci portable spectrometer
Capcom CPS2 security programming guide
Capcom CPS2 security programming guide
A community-made, Arduino-powered interactive town map
A community-made, Arduino-powered interactive town map
PyroGraph is a plotter that burns images on paper
PyroGraph is a plotter that burns images on paper
Build your own robotic arm out of cardboard
Build your own robotic arm out of cardboard
Play the guitar on a guitar bag
Play the guitar on a guitar bag
Arduino-powered roller blinds
Arduino-powered roller blinds
Arduino Wiring is the latest addition to Windows 10 IoT Core
Arduino Wiring is the latest addition to Windows 10 IoT Core
An Arduino charging dock with Edison indicator lights
An Arduino charging dock with Edison indicator lights

Top


Shares