Organize and Share your Electronics the way you want. Sign-Up for a free account now. It takes only 30 seconds!

Control with your smart devices by staring and gesturing

Control with your smart devices by staring and gesturing

As part of a recent Microsoft HoloLens hackathon in San Francisco, Maker Ian Sterling developed a new app that interacts with you smart home via augmented reality. The proof of concept, dubbed “IoTxMR,” allows a user to simply glance at a gadget and control it through gestures.

As you can see in the video below, IoTxMR enables Sterling to connect various Android and Arduino-based devices with the HoloLens to create a customized interdependent network. It also features a mixed reality experience called “virtual zen mode,” complete with calming sounds and light orbs in his surrounding environment.

During a recent interview with Digital Trends, Sterling revealed:

The primary goal of the app is to provide a 3D spatial UI for cross-platform devices — Android Music Player app and Arduino-controlled fan and light — and to interact with them using gaze and gesture control.

The connectivity between Arduino and a mixed reality device is something which holds a huge amount of creative opportunity for developers to create some very exciting applications — be it [Internet of Things], robotics, or other sensor data visualization. Besides this, our app features some fun ways to connect devices. Our demo featured a connection between a music player and a light in order to set a certain mood in your home.

Although just a demo, IoTxMR does highlight the endless possibilities that AR platforms like HoloLens offer in the not-too-distant future.

Read more Here







 

More Articles to Read

Wrist thrusters let you fly through the water effortlessly
Wrist thrusters let you fly through the water effortlessly
Adjusting clock with alarm, hygrometer & thermometer on 1.8″ ST7735 display
Adjusting clock with alarm, hygrometer & thermometer on 1.8″ ST7735 display
Adding an “extra sense” with rangefinders
Adding an “extra sense” with rangefinders
This wireless game controller looks like a rug
This wireless game controller looks like a rug
How to run your ESP8266 for years on a battery
How to run your ESP8266 for years on a battery
Making beats on a tiny Arduino DJ controller
Making beats on a tiny Arduino DJ controller
This Arduino machine will judge how sick your ollies are
This Arduino machine will judge how sick your ollies are
Turn an old payphone into a boombox for ’90s hits
Turn an old payphone into a boombox for ’90s hits
QuadBot is a 3D-printable walking robot for everyone
QuadBot is a 3D-printable walking robot for everyone
An Arduino tachometer for your older vehicle
An Arduino tachometer for your older vehicle
Harry Potter fans create a fully-functioning smart wand
Harry Potter fans create a fully-functioning smart wand
A 3D-printed lunar phase clock for your nightstand
A 3D-printed lunar phase clock for your nightstand
Create your own Red Dwarf Talkie Toaster replica
Create your own Red Dwarf Talkie Toaster replica
The Orbitalochka is a solar-powered satellite synth
The Orbitalochka is a solar-powered satellite synth
Building a “laser sky” effect generator with Arduino
Building a “laser sky” effect generator with Arduino
Teslapathic! Hackers build a brain-controlled Tesla
Teslapathic! Hackers build a brain-controlled Tesla
Teen helps friend with a brain injury communicate again
Teen helps friend with a brain injury communicate again
A wakeup light for kids
A wakeup light for kids
This machine sends messages using common chemicals
This machine sends messages using common chemicals
Skintillates: Temporary tattoos with embedded electronics
Skintillates: Temporary tattoos with embedded electronics

Top


Shares