Kinect Video Stream Masking
August 29, 2011
Here is some streaming video being masked by the depth image of the kinect.
I use OpenCV's inRangeS to find a range to create a mask from the depth image, then cvCopy to copy it over the video image.
One strange thing I've noticed is the video image is down and to the left of the mask. If you look on the right edge you can see another anomoly which is the boundry of the depth mask. Apparently the depth image is 632 X 480 vs 640 X 480..
Is the shift part of this too?
Inspiration - http://10k3d.com/kinect-learning-to-recognize-objects-using-op
Interesting link - http://www.ruialmeida.org/?p=218
The offset seems to be ~32 pixels as a crow flies - which means I have to adjust the mask 25 pixels left and 25 pixels down...
I'm Wondering :
1. Is this for all Kinects or just mine... I suspect its all because of the way it works & 632 resolution, but I really have not found much info on the subject.
2. How the heck am I going to move the mask over given the set of OpenCV functions?
Looks better !, the alignment falls off as the target gets closer to the edges of the 640x480 screen, but pretty good when centered, which is what I'm gonna work with for object identification.