Video Analysis of Human Facial Expressions for Human Computer Interaction using Artificial Intelligence

Abstract

Facial expressions are the most effective way of non-verbal communication. Facial expressions newlinegive clues about the emotional state, pain, alertness, personality, social interaction newlineand physiological signals. Automatic facial expression analysis confronts a series newlineof challenges because the expressions are generally mixed and highly dependent on the newlinesubject. newlineThe major steps of facial expression analysis include face detection, facial feature extraction, newlinenormalization of features (so that they are invariant to pose, illumination and newlinesubject), discriminative mapping of the features and efficient classification. The requirement newlineof real time applications further adds stringent constraints on the efficiency of these newlinetasks. The researchers from the field of computer vision and machine learning are working newlineon automatic facial expression analysis for intelligent environments and multimodal newlinehuman-computer interaction. Facial expression analysis has much research to do because newlineof its potential uses and inherent challenges. The challenges addressed in the proposed newlinework include extraction of facial features, their mapping to high discriminative space, newlineemotion synthesis, handling multiple facial feature descriptors and Action Unit intensity newlinedetection. newlineThe lip features are investigated for prototypic facial expressions analysis to contribute newlineto the argument that facial components instead of holistic facial features can be used for newlinefacial expression analysis. newlineThe feature extraction methods need extraction of facial feature deformation from newlineneutral state caused due to different states of mind. Thin Plate Spline (TPS), which was newlinepreviously adopted for image registration, provides an effective solution for measuring newlinerigid and non-rigid transformation between the source and target image. This property of newlineTPS is explored in the presented work for computing deformation of facial features due newlineto different expressions. The deformations so computed are used for emotion recognition newlineand emotion synthesis. The computation of deformation ...