Depth

The demonstration above shows that we are able to combine the information of the depth map with the color video stream. And render in 3D environment.

The OpenGL 3.1 is now included into the project. And it has become an integration of the OpenGL (3D display / calculation), OpenCV ( 2D image processing / marker tracking ), and Kinect API ( camera / depth map driver ).

The color marker tracking function mentioned in the last post is refactored to support arbitrary number of the marker. But the stability of our naive tracker is not ideal. And someone suggested us to look for the "Blob tracker" works done by other people. The idea is similar, but they have more filter and estimation for stabilizing the tracking process. cvblob is the one we currently intend to use, since it is built upon OpenCV we have, and works pretty well in the demonstration.

Right now we have all three dimension information in the space we need to read the operation of the trainee. But the error is still large, we hope that by adapting "Blob tracker", the output would be acceptable.