Lip Reading for Robot Interaction

In our project we implemented algorithm which automatically recognizes facial expressions in real time out of video sample, in order to eventually connect to the robot face "ALGO"

Abstract

In our project we implemented algorithm which automatically recognizes facial expressions in real time out of video sample, in order to eventually connect to the robot face “ALGO” , for him to impersonate facial expressions. The Possible facial expressions are divided for  5 expressions type: “Neutral”, “Happy”, “Angry”, “Surprised” and “Fearful”. During his operation the algorithm recognizes face out of video and classify the expression to one of the 5 types listed above.

Possible applications for our project:

  • Creating interaction between humans and the robotic face based on facial expression
  • Expanding the algorithm which recognizes facial expressions automatically

Results

1

2