Let's Make Robots!

ICU . I See You

guibot's picture
sees people
Cost to build: 
$90
Time to build: 
30 hours

ICU is a sub-project of the SWARS (see what a robot sees) project.

This time I not just wanted to see what a robot sees, but I also wanted to give the robot the ability to understand that there is a person in the room, and stare at the person.

To detect faces I used the OPENCV library for Processing, wich turns out to be very fun to work with and is very sensitive to human faces.. and sometimes it detect faces where there aren’t any.. maybe it is a ghost face detector algorythm!!

I didn’t have time to work with the four motors, I am only working with the two servo motors on the top. Next step will be to apply inverse kinematics and have a better level of interactivity.

Unfortunately I had to pick the computer that was being used in this installation, I will need it in the next weeks, but this bot will be available to the public very soon I promise!!

This is the code I am using if someone wants to look at it, you will need to have the MegaServo library installed for the Arduino sketch, and the OPENCV lib for the Processing sketch.

 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

This stuff is amazing. Good job. I would love to try it sometime. Incidently I just started Processing, here is my first sketch

http://www.openprocessing.org/visuals/?visualID=10494

Calculon320's picture

you could wear a shirt with a face on the back.

guibot's picture

good solution calculon

fritsl's picture

Could you make it detect an arse instead of a face? (So it could follow you)?

GroG's picture

Very emotive.  I see one of your other bots, what is the projection on the wall? The processing code? 
Heh, I was just about to ask what the antennas are until I saw the back picture... nice touch to leave the tie tabs on, gives it a insect like feel.  Design A+ .  Very sexy..

I have been working with OpenCV for a while too - however I have been using the java interface Samuel Audet has wrote @ (http://code.google.com/p/javacv/)  One nice thing is that he has exposed nearly all of the functions of OpenCV.

Calculon320's picture

You connect both the webcam and the 'duino to the computer? So it needs 2 USB ports?

guibot's picture

yes 2 usb ports

flokos's picture

Is the ps cam  conncted to the arduino ?

and if it is connected to the arduino how you do it,i thought arduino couldn't handle a cam.

 

guibot's picture

the cam is connected to the computer, I wouldn't connect a cam to the arduino, it doesn't have CPU power to compute image processing.

Gareth's picture

This is an cool interactive system guibot  - the speed of detection is pretty impressive i must say - (i have to try this out).

Your idea really lends its self into the interactive realm - ie robots drawing attention (showing interest by Eye to Eye contact), you have occasioned me to put my thinking cap on and see what else would be possible.

guibot's picture

The interactive part, human machine relations, exploration of human emotions excites me a lot .. I love to see people waving to robots, smiling, and having emotions based on the robots actions...   I think that robots triggers good fellings in people, and communities like LMR are a proof of that.

I'm happy to know that this triggered you to think in new possibilities, and looking forward to see new cool stuff from you  ;)

Calculon320's picture

Caclulon likes very much. He wants to copy this for his arduino project.

guibot's picture

be my guest  ;)