Social Robotics in Therapy of Apraxia of Speech

Figure 7

Running example of the speech therapy proposal. The robot leads the user through the exercise, encouraging him to keep participating.

(a) Starting the exercise. The robot shows a “happy” expression while giving instructions to the user through voice. In parallel, the tablet shows the pose that the user should imitate

(b) The robot tells the user to start performing the pose and in parallel captures and analyses the mouth features. The tablet keeps showing the pose that should be imitated

(c) After three valid detections, the robot congratulates the user through voice, gestures, and using the tablet

(d) If the mouth pose detected does not match the desired one, the robot corrects the user using voice and gestures while the tablet shows the target pose