Robot Detecting Voice

1,287

6

4

Introduction: Robot Detecting Voice

Interaction of Robot (Nao) with Multiple speaking person based on fusion of Face detection and Sound source localization.

About the scene: There are 4 person in a normal room with one person initially out of view of scope. Everyone is placed in different configuration and varying distance.

Key steps in detection:
1. Nao first detects the person using face recognition.
2. Then it uses a novel sound source localization technique to detect the person who is speaking
3. Then is rotate its head toward the detected person

Teacher Notes

Teachers! Did you use this instructable in your classroom?
Add a Teacher Note to share how you incorporated it into your lesson.

1 Person Made This Project!

Recommendations

  • Magnets Challenge

    Magnets Challenge
  • Raspberry Pi Contest 2020

    Raspberry Pi Contest 2020
  • Wearables Contest

    Wearables Contest

4 Discussions

0
RobS245
RobS245

10 months ago

Hi there, I really like the concept and would like to know more about it, I'm working on a project with my team where we need a concept of this sort or some sort of sound source detection system implemented in our lamp robot and would appreciate the help!, please get back to me ASAP, thanks ...my email is 20079462@mail.wit.ie

0
techie29
techie29

5 years ago on Introduction

Please watch the video and give me your feedback.

If you like the video, please share it among your friends :)