Facial Emotion Recognition Using CNN and OpenCV: A Review
Keywords:
Emotion Detection Recognition, Convolution Neural Network, Computer Vision, Neural Network, Facial GestureAbstract
Emotion Recognition Using a Facial Feature Recognition is a prominent area of study in the world of Human Computer Interaction (HCI). Humans may express a wide range of emotions and moods through facial movements and body language. In this project, in order to detect the live emotions from the human facial gesture, we will be using an algorithm that allows the computer to automatically detect the facial recognition of human emotions with the help of Convolution Neural Network (CNN) and OpenCV. Finally, emotion detection involves the integration of data from multiple patterns. If computers can comprehend more human emotions, the gap between humans and computers will be reduced. In this research work, we will show how to read a person's frontal facial expression to accurately identify emotions including neutral, happy, sad, surprised, furious, fear, and disgust.
References
Deng L, Liu Y. A joint introduction to natural language processing and to deep learning. Deep learning in natural language processing. 2018:1–22.
Chowdhury GG. Natural language processing. Annu Rev Inf Sci Technol. 2003; 37(1): 51–89.
Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I. The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In2010 ieee computer society conference on computer vision and pattern recognition-workshops 2010 Jun 13 (pp. 94–101). IEEE.
Kalenichenko D, Schroff F, Philbin J, Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2015; 815–823.
Shakhovska N. The approach of Big data processing. XII International Conference on Computer Sciences and Information Technologies (CSIT), Lviv, Ukraine. 2017; 122–125.
Jiro Gyoba, Michael Lyons J, Shigeru Akamatsu, Miyuki Kamachi. Coding Facial Expressions using Gabor Wavelets 3rd IEEE International Conference on Automatic Face and Gesture Recognition. 1998; 200–205.
Shan C, Gong S, McOwan PW. Facial emotion identification based on local binary patterns: a thorough study. Image Vis Comput. 2009; 27(6): 803–816.
Balaji S, Kodagali JA. Computer vision and image analysis based approaches for automatic characterization of fruits-a review. Int J Comput Appl. 2012; 50(6): 6–12.
Carcagnì P, Del Coco M, Leo M, Distante C. Facial expression recognition and histograms of oriented gradients: a comprehensive study. SpringerPlus. 2015 Dec;4(1):1–25.
Zheng WL, Lu BL. Personalizing EEG-Based Affective Models with Transfer Learning In Proceedings of the 25th international joint conference on artificial intelligence. 2016 Jul; 2732–2738.
Zhang Z, Ringeval F, Dong B, Coutinho E, Marchi E, Schüller. Enhanced semi-supervised learning for the recognition of multimodal emotions. The IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2016 Mar; 5185–5189.
Lu X, Li D, Liu Y, Fan Y. using CNN-RNN and C3D hybrid networks to recognize emotions in videos. Proceedings of the 18th ACM International Conference on Multimodal Interaction; Tokyo, Japan. 2016 Nov 12–16; 445–450,
Kim, Yelin & Mower Provost, Emily. (2015). Emotion Recognition During Speech Using Dynamics of Multiple Regions of the Face. ACM Transactions on Multimedia Computing, Communications, and Applications. 12. 1–23. 10.1145/2808204.
Giri S, Singh G, Kumar B, Singh M, Vashisht D, Sharma S, Jain P. Emotion Detection with Facial Feature Recognition Using CNN & OpenCV. In 2022 IEEE 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE). 2022 Apr 28; 230–232.
Guetari R, Chetouani A, Tabia H, Khlifa N. Real time emotion recognition in video stream, using B-CNN and F-CNN. In 2020 IEEE 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP). 2020 Sep 2; 1–6.
Lin S, Yue Y, Zhu X. Emotion recognition using representative geometric feature mask based on CNN. In 2021 IEEE 4th International Conference on Information Systems and Computer Aided Education (ICISCAE). 2021 Sep 24; 257–261.
Basu S, Chakraborty J, Aftabuddin M. Emotion recognition from speech using convolutional neural network with recurrent neural network architecture. In 2017 IEEE 2nd International Conference on Communication and Electronics Systems (ICCES). 2017 Oct 19; 333–336.
Madupu RK, Kothapalli C, Yarra V, Harika S, Basha CZ. Automatic human emotion recognition system using facial expressions with convolution neural network. In 2020 IEEE 4th international conference on electronics, communication and aerospace technology (ICECA). 2020 Nov 5; 1179–1183.
Zadeh MM, Imani M, Majidi B. Fast facial emotion recognition using convolutional neural networks and Gabor filters. In 2019 IEEE 5th Conference on Knowledge Based Engineering and Innovation (KBEI). 2019 Feb 28; 577–581.
Gill R, Singh J. A Deep Learning Approach for Real Time Facial Emotion Recognition. In 2021 IEEE 10th International Conference on System Modeling & Advancement in Research Trends (SMART). 2021 Dec 10; 497–501.
Begaj S, Topal AO, Ali M. Emotion Recognition Based on Facial Expressions Using Convolutional Neural Network (CNN). In 2020 IEEE International Conference on Computing, Networking, Telecommunications & Engineering Sciences Applications (CoNTESA). 2020 Dec 9; 58–63.
Jie C. Speech emotion recognition based on convolutional neural network. In 2021 IEEE International Conference on Networking, Communications and Information Technology (NetCIT). 2021 Dec 26; 106–109.
Kabir MM, Anik TA, Abid MS, Mridha MF, Hamid MA. Facial Expression Recognition Using CNN-LSTM Approach. In 2021 IEEE International Conference on Science & Contemporary Technologies (ICSCT). 2021 Aug 5; 1–6.
Churaev E, Savchenko AV. Multi-user facial emotion recognition in video based on user-dependent neural network adaptation. In 2022 IEEE VIII International Conference on Information Technology and Nanotechnology (ITNT). 2022 May 23; 1–5.
Lee JH, Kim HJ, Cheong YG. A multi-modal approach for emotion recognition of tv drama characters using image and text. In 2020 IEEE International Conference on Big Data and Smart Computing (BigComp). 2020 Feb 19; 420–424.
