Posture Recognition with Kinect, Azure IoT, ML and WebVR

This post has been republished via RSS; it originally appeared at: Channel 9.

Today's project is from the awesome Microsoft community on hackster.io and while includes complete instructions and parts list, is for the advanced hardware hacking...

Posture Recognition using Kinect, Azure IoT, ML and WebVR

The Idea

With the recent success of depth cameras such as Kinect, gesture and posture recognition has become easier. Using depth sensors, the 3D locations of body-joints can be reliably extracted to used with any machine learning framework, specific gestures or posture can be modelled and inferred. Real world applications in Virtual Reality can be used for Yoga, Ballet training, Golf, anything related to activity recognition and proper postures. I also see application of it in the Architectural, Engineering, Construction and Manufacturing Industry by sending depth sensor data to the cloud to identify correct configurations. It could be used for quality control, anomaly detection and part recognition

This is a proof of concept to detect pose "Y", "M", "C" , "A" and stream the result back to the browser.

....

Posture Recognition Device in Virtual Reality

Capturing the Kinect Skeletal Data, Visualize it in Virtual Reality and send it to Azure IoT for Machine Learning.

If this project made you interested in Kinect, LattePanda board, Johnny-Five, Azure Services, please click "Respect Project" button and follow me. Feel free to contact me, if you have questions.

Kinect

Kinect is an awesome input device for our Internet of Things world. It is a motion sensing input device that has RGB camera, depth sensor, multi-array microphone. I'm currently using it as a motion capture device viewable in Virtual Reality. I bought this adaptor so I can use it on a windows 10 device, Now I can plug it into a USB port.

...

image

...

This is where I believe the strength of Azure services in IoT space. Being able to collect telemetry data, pass to streaming analytics, split the data into outputs.

  • Gathering Training Data to feed your machine learning model
  • With captured telemetry data, use it to call a predictive analytics function and transform the output streaming data.

When I realized this, now I see what Internet of Things is all about. It's not just a building a device, It's adding the Smarts to it. The Predictive Analytics part, it's the real-time data processing and the flexibility of the cloud. Something clicked, MIND-BLOWN.

image

If this project made you interested in Kinect, LattePanda board, Johnny-Five, Azure Services, please click Respect Thumbs Up button and follow me. Feel free to contact me, there's a lot to digest on this one.

Project Information URL: https://microsoft.hackster.io/en-US/RONDAGDAG/posture-recognition-using-kinect-azure-iot-ml-and-webvr-e9c4f7