Skip to main content

Coding for Kinect for Xbox 360

Kinect is an amazing piece of technology. Not only for gaming, it can be used for variety of uses ranging from Healthcare, Security, IT etc. Starting with coding for Kinect seems daunting at first, mainly due to lack of knowledge and starting material.
This article documents my first attempt at coding for Kinect. So basically it’s a beginner level article which introduces us to Kinect. Before you begin, you must ensure that the following pre-requisites have been met.
After you install the Kinect for Windows SDK, plug-in your Kinect to your PC via the USB port and some device drivers should automatically get installed. Finally you should be able to see this screen.

Capture

Now that you have all set up, fire up Visual Studio and create a new WPF project. Add a reference to “Microsoft.Research.Kinect.dll” and “Coding4Fun.Kinect.Wpf.dll”. Next we will create a very basic application which captures Kinect’s RGB Video, Depth Video and try to create a Skeleton out of it. We will basically re-use the code from “Skeletal Viewer” sample that comes with Kinect for Windows SDK.


We will add two images to our XAML window to display the video streams. We will also add a Canvas to display the skeleton that we are tracking. Pretty simple!

<Window x:Class="MyFirstKinectApp.MainWindow"
xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
Title="MainWindow" WindowState="Maximized" Loaded="Window_Loaded">
<Grid>
<Image x:Name="VideoFrameImage"
Height="500" Width="500" HorizontalAlignment="Left"
VerticalAlignment="Top"/>
<Canvas x:Name="SkeletalFrameImage"
Height="500" Width="500" HorizontalAlignment="Right"
VerticalAlignment="Top"/>
<Image x:Name="DepthFrameImage"
Height="500" Width="500" HorizontalAlignment="Left"
VerticalAlignment="Bottom"/>
</Grid>
</Window>

Coding4Fun dll helpfully add few extension methods which makes displaying the video streams a breeze. All we have to do is write:


VideoFrameImage.Source = e.ImageFrame.ToBitmapSource();

Next comes calculating and displaying the skeleton in the Canvas. You can follow the source code to see how it is actually being done.


Finally we end up with the following output:

vlcsnap-2011-10-22-19h33m10s33

That’s it! This is our sample sample application. As you move, the skeleton will mirror your movements. All we have to do now is to detect those movements and have some fun!

Comments

Popular posts from this blog

The IKEA Pilgrimage

"Hez!". If you were in Hyderabad for the opening of first IKEA store in India, you would be forgiven for thinking that it's a religious chant for followers of a religion who are trampling over themselves for getting into their place of worship. Except they were visitors to the new IKEA store.
For the past few days, the news had been carrying multitude of articles related to IKEA opening. The marketing by IKEA team only hyped the situation. Since I was looking to buy a bed, I made the unfortunate decision of going to the IKEA store for a quick in-n-out shopping with my wife on my way to office. The first red flag should have been when we couldn't get parking at 10 am in the morning of a weekday and were asked to park at one of external parking locations. The IKEA folks were kind enough to handout a map of the same.

We were asked to park near ITC Kohenur. From that location, like every well organized pilgrimage, there was a shuttle service to IKEA after every 30 minut…

Book Review - The Girl In Room 105

There are couple of reasons why I pre-ordered Chetan Bhagat's latest - its price is less than a cup of decent coffee making it an impulse purchase and more importantly the book's claim that it is an "unlove story", whatever that means. Bhagat had pioneered the trend of bubblegum IIT college love stories targeted at teens and college-going population which inspired a generation of wannabe writers. But you can chew bubblegum only for so long. After some time you have to spit it out. With this book Bhagat threw away the bubblegum only for it to stick to his shoes.
The story starts the same way as have Bhagat's previous books - in a college and more specifically in an IIT. For initial few chapters you would be forgiven if you think you have picked up one of Bhagat's previous works by mistake. Bhagat is still obsessed with fair skin, women's churidar kurta and how she arranges her hair. The English is still pedestrian which Bhagat justifies as this is how rea…

IoT on Google Cloud Platform

Google wants people to use its Cloud Platform for connecting and managing IoT devices through IoT Core and use other GCP components like BigQuery to analyze data produced by those devices. While these products are fantastic, they also have some real world challenges.
IoT Core provides a managed service for connecting IoT devices. It talks with both HTTP and MQTT protocols and features one-click integration with Cloud PubSub easing most of the infrastructure tasks. However there are some limitations:
You cannot use any random MQTT topic to send/receive messages as you would expect on a custom MQTT bridge. There are special topic formats to send messages and also to receive commands.IoT Core uses Public-Private Key cryptography to secure devices. All IoT devices must first authenticate using the Public Key in a JWT token and then start sending and receiving messages. While these may seem like reasonable restrictions, one has to keep in mind that hardware vendors are still stuck in the 9…