Using gestures and voice commands to control the robot
September 24, 2013
Couple of months ago we decide to participate in Intel's perceptual computing challenge (http://perceptualchallenge.intel.com). The idea was to extend driver cockpit application to control Veterobot (http://veterobot.org) with gestures and voice recognition. We are using detected thumb position in 3D space. Position along horizontal axis is used as a steering signal and distance to the camera (depth) to control acceleration (forward and backward).
It was a fun exercise but some more tuning is still required to achieve smooth control experience. So it is work in progress.
Edit: somehow, I can not see the attached video in the blog post, so here is the link: http://www.youtube.com/watch?v=5AkzF8kIeC0