An Expert System for Emotion Recognition from Face Image Sequences

An Expert System for Emotion Recognition from Face Image Sequences

Muharram Mansoorizadeh, Nasrollah M. Charkari, Ehsanollah Kabir

Abstract

This paper presents an expert system for emotion recognition from face image sequences. Such a system can be used for human computer interaction. Input to the system is frontal face image sequences, in which it is assumed that no rigid head motion is present and intensity is uniformly distributed. The system tracks a set of manually marked points of the face and classifies facial feature variations in terms of Action Units. Later, the system classifies detected action units in terms of a subset of basic emotions, i.e. joy, surprise, sadness, inattentiveness, anger, disgust and fear. For each action unit and emotion category, the intensity criteria is defined and used for merging similar action units and emotions. The system recognizes a combination of emotion categories and resolves possible contradictions (e.g. sadness and joy) by eliminating lower intensity emotion. Overall emotion recognition accuracy is about 80%.

Keywords

Emotion Recognition, Expert Systems, Facial Expressions, Video

References