Communication Robot based on the Image Processing and Voice Recognition

Noriyuki Kawarazakia, Yuuki Kitajima, Kazuya Kojima and Tadashi Yoshidime

Dept. of Robotics and Mechatronics, Kanagawa Institute of Technology, 1030 Shimo-Ogino, Atsugi, Kanagawa 243-0292 Japan.



This paper discussed a communication robot based on the image processing and voice recognition. We developed a communication robot system “HAKUEN” that is composed of a multimedia robot with stereo camera, a wheel type mobile robot and a PC with a microphone. The communication robot approaches and holds out its hand toward the operator according to the voice command. The robot detects the operator's face based on the pixel values of the flesh tint in the colour image. Since the system has to calculate the distance between the robot and the operator rapidly, we use the disparity. The effectiveness of our system is clarified by several experimental results.

Keywords: Communication robot, Handshake action, Voice recognition, Image processing, Disparity.

     Back to TOC