Summary of Medical Research - Video

I have compiled a video to summarize the work done over summer. I hope it is helpful to everyone.

Presentation under construction

I am making a presentation for the project. I have made the slides; I am currently working on adding voice to the presentation.
For the presentation, please refer to:
https://docs.google.com/presentation/d/1w8bTrBoPRzjik5Nfkr136YjJ8bo2K5W54tyugfEmUmg/edit

Prototype

Ultrasound Guided Needle Placement Training Using Kinect

The prototype is complete!
The rendering module and the tracking module are fully integrated now. The needle visualization is also working. Right now the needle's radius (its actually a cylinder), is rather large. I did this in order to easily get the needle in screen, otherwise it would be very difficult. But this parameter is very easy to change, and can be tuned as per the needs of the ultrasound guided needle placement training.

Challenges:
Many of the challenges that we are facing are mechanical in nature. The probe and needle tracking is working well despite the fact we are not using any fancy setup for tracking them.

What has been found?
At the start of the project we were very anxious about the accuracy of the Kinect for tracking probe and needle. But we can now see that Kinect works very well for this application.

Future Work:
1. Improving accuracy of tracking by using sophisticated marker tracking setup
2. Developing the software in the form of a game so that new surgeons can monitor their own skill level

Long Due Blog Update - Rendering Ultrasound Images based on Kinect Input

Rendering based on Unmodified Kinect Input, discarding normal and up vectors for probe

Rendering Based on Stabilized Kinect Input, discarding Up and Normal Vectors from Kinect

Rendering Based on Stabilized Kinect Input, using Up and Normal Vectors from Kinect

Due to a number of reasons, I could not get a chance to update my blog. This was my progress as of August 3, 2012, just before SIGGRAPH conference.

I had completed integration of rendering module with the Kinect Tracking module.

The first video shows rendering based on data obtained from Kinect without any modifications; as you can see, the output shakes a lot which is not desirable.

To remove the shaking, I followed the simple approach recommended by Dr. Norman Badler, which was to just ignore some of the data given by Kinect. The second video and third video show outputs obtained using this approach. To improve the quality of the output Dr. Badler had suggested using B-Spline to interpolate between frames. I will do it in the future.

The second video discards the Up vector and Normal vector of the slice plane obtained using Kinect, which adds to the stability; but this method will prevent the doctors from being able to orient the probe along oblique directions. So this method cannot be used.

The third video shows the result of the integrated Tracking and Rendering module, without the needle.