Predicting Human Emotions through Time and Frequency Feature Extraction using EEG Emotional Database Analysis
Received: 25 May 2025 | Revised: 30 June 2025 and 18 July 2025 | Accepted: 23 July 2025 | Online: 19 September 2025
Corresponding author: Rashmi Y. Lad
Abstract
Emotion recognition is a technique to identify the emotion of an individual by using facial expressions, behavior, and neuroimaging techniques. Electroencephalography (EEG) is a non-invasive technique mainly used to recognize emotions. To study variations in human emotions, the authors created an EEG dataset, named EEG Emotional Database Analysis (EEDA), by conducting a study with the help of an EEG technician on 10 healthy participants. The participants were asked to watch video clips representing five emotions with a 60-second gap between clips. The emotional responses were collected simultaneously through EEG across five trials, utilizing a 32-channel system. The EEG data were preprocessed to remove artifacts using a band-pass filter and Independent Component Analysis (ICA). Subsequently, signal features were extracted in three domains: time, frequency, and time-frequency. The data were segregated into five classes: Relaxed-Happy-Excitement (RHE), Relaxed-Fear-Sad (RFS), Relaxed-Happy-Fear (RHF), Relaxed-Excitement-Sad (RES), and Relaxed-Happy-Sad (RHS) for training and testing purposes. After feature extraction, feature selection was performed using Principal Component Analysis (PCA), mutual information, Recursive Feature Elimination (RFE), and Least Absolute Shrinkage and Selection Operator (LASSO) regularization to calculate the accuracy with the Bidirectional Long Short-Term Memory (BiLSTM) model. The highest classification accuracies obtained on the EEDA dataset were 84.27% for the RHS class in the time domain, 61.81% for the RES class in the frequency domain, and 84.37% in the time-frequency domain for the RHS and RHF classes.
Keywords:
emotions, EEG, BiLSTM, feature extractionDownloads
References
H. Liu, Y. Zhang, Y. Li, and X. Kong, "Review on Emotion Recognition Based on Electroencephalography," Frontiers in Computational Neuroscience, vol. 15, Oct. 2021, Art. no. 758212.
F. Fürbass, M. A. Kural, G. Gritsch, M. Hartmann, T. Kluge, and S. Beniczky, "An artificial intelligence-based EEG algorithm for detection of epileptiform EEG discharges: Validation against the diagnostic gold standard," Clinical Neurophysiology, vol. 131, no. 6, pp. 1174–1179, June 2020.
M. D. Bengalur and A. K. Saxena, "A Systematic Review on Approaches to Recognize Emotions Using Electroencephalography (EEG) Signals," in Data Engineering and Intelligent Computing: Proceedings of ICICC 2020, Bengaluru, India, 2020, pp. 107–120.
X. Xing, Z. Li, T. Xu, L. Shu, B. Hu, and X. Xu, "SAE+LSTM: A New Framework for Emotion Recognition From Multi-Channel EEG," Frontiers in Neurorobotics, vol. 13, June 2019, Art. no. 37.
W.-L. Zheng, J.-Y. Zhu, and B.-L. Lu, "Identifying Stable Patterns over Time for Emotion Recognition from EEG," IEEE Transactions on Affective Computing, vol. 10, no. 3, pp. 417–429, July 2019.
C. Mühl, B. Allison, A. Nijholt, and G. Chanel, "Affective brain-computer interfaces: Special Issue editorial," Brain-Computer Interfaces, vol. 1, no. 2, pp. 63–65, Apr. 2014.
M. Priyadarshani, P. Kumar, K. Sindhuben Babulal, D. Singh Rajput, and H. Patel, "Human Brain Waves Study Using EEG and Deep Learning for Emotion Recognition," IEEE Access, vol. 12, pp. 101842–101850, 2024.
A. M. Al-Kaysi et al., "Predicting tDCS treatment outcomes of patients with major depressive disorder using automated EEG classification," Journal of Affective Disorders, vol. 208, pp. 597–603, Jan. 2017.
S. Girdher, A. Gupta, S. Jaswal, and V. Naik, "Predicting Human Response in Feature Binding Experiment Using EEG Data," in 2020 International Conference on COMmunication Systems & NETworkS, Bengaluru, India, 2020, pp. 24–28.
C. Niemic, "Studies of Emotion: A Theoretical and Empirical Review of Psychophysiological Studies of Emotion.," Journal of Undergraduate Research, vol. 1, no. 1, pp. 15–18, Oct. 2004.
M. Shabbir Alam, S. Zura A. Jalil, and K. Upreti, "Analyzing recognition of EEG based human attention and emotion using Machine learning," Materials Today: Proceedings, vol. 56, no. 6, pp. 3349–3354, Jan. 2022.
E. H. Houssein, A. Hammad, and A. A. Ali, "Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review," Neural Computing and Applications, vol. 34, no. 15, pp. 12527–12557, Aug. 2022.
V. Padhmashree and A. Bhattacharyya, "Human emotion recognition based on time–frequency analysis of multivariate EEG signal," Knowledge-Based Systems, vol. 238, Feb. 2022, Art. no. 107867.
R. Chaudhary and R. A. Jaswal, "A Review of Emotion Recognition Based on EEG using DEAP Dataset," International Journal of Scientific Research in Science, Engineering and Technology, vol. 8, no. 3, pp. 298–303, June 2021.
T. Colafiglio, P. Sorino, A. Lombardi, D. Lofù, and T. Di, "Predicting Human Emotions using EEG-based Brain computer Interface and Interpretable Machine Learning," in Ital-IA 2023: 3rd National Conference on Artificial Intelligence, Pisa, Italy, 2023.
M. Talele and R. Jain, "A Comparative Analysis of CNNs and ResNet50 for Facial Emotion Recognition," Engineering, Technology & Applied Science Research, vol. 15, no. 2, pp. 20693–20701, Apr. 2025.
N. Ahmadzadeh Nobari Azar, N. Cavus, P. Esmaili, B. Sekeroglu, and S. Aşır, "Detecting emotions through EEG signals based on modified convolutional fuzzy neural network," Scientific Reports, vol. 14, no. 1, May 2024, Art. no. 10371.
V. M. Joshi and R. B. Ghongade, "IDEA: Intellect database for emotion analysis using EEG signal," Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 7, pp. 4433–4447, July 2022.
J. V. M. R. Fernandes, A. R. de Alexandria, J. A. L. Marques, D. F. de Assis, P. C. Motta, and B. R. dos S. Silva, "Emotion Detection from EEG Signals Using Machine Deep Learning Models," Bioengineering, vol. 11, no. 8, Aug. 2024, Art. no. 782.
N. K. Horr, B. Mousavi, K. Han, A. Li, and R. Tang, "Human behavior in free search online shopping scenarios can be predicted from EEG activation using Hjorth parameters," Frontiers in Neuroscience, vol. 17, Nov. 2023, Art. no. 1191213.
B. Wutzl, K. Leibnitz, and M. Murata, "An Analysis of the Correlation between the Asymmetry of Different EEG-Sensor Locations in Diverse Frequency Bands and Short-Term Subjective Well-Being Changes," Brain Sciences, vol. 14, no. 3, Mar. 2024, Art. no. 267.
L.-C. Yu et al., "Building Chinese Affective Resources in Valence-Arousal Dimensions," in Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA, 2016, pp. 540–545.
Downloads
How to Cite
License
Copyright (c) 2025 Rashmi Y. Lad, Shrikant Mapari, Fadi N. Sibai
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
