Hybrid EEG-Based Eye State Classification Using LSTM, Neural Networks, and Multivariate Analysis

Document Type : Research Paper

Authors

1 Ph.D., Department of Computer Engineering, Marwadi University, Rajkot, Gujarat-360003.

2 Department of Computer Engineering, Marwadi University, Rajkot, Gujarat- 360003.

3 Department of Computer Science and Engineering, Madan Mohan Malaviya University of Technology, Gorakhpur, U.P., India- 273010.

10.22059/jitm.2025.102919

Abstract

This paper focuses on a new hybrid machine learning model for classifying eye states from EEG signals by integrating traditional techniques with deep learning methods. Our Hybrid LSTM-KNN architecture employs KNN for classification and uses LSTM networks to extract features temporally. In addition, we perform extensive feature engineering, including statistical Z-test and IQR filtering, dimensionality reduction using PCA, and multivariate analysis to further model the performance. Moreover, an SVM-based unsupervised clustering approach is proposed to partition the EEG feature space, followed by ensemble learning in each cluster to improve accuracy and robustness. Using the EEG Eye State Dataset for the first assessment, the Hybrid LSTM-KNN model recorded an accuracy of 87.2% without PCA. Further improvements through statistical filtering outperformed initial expectations, achieving a 6% rise in performance to 89.1% after outlier removal, 89.1% with Z-test (σ = 3), and 88.3% with IQR (1.5x). After applying PCA along with ensemble learning post clustering, the final model exceeded expectations with an accuracy and F1 score of 96.8%, surpassing Ensemble Cluster-KNN and traditional models based on Ensemble Cluster-KNN, Logistic Regression, SVM, and Random Forest. The outcome demonstrates the robustness and noise-resilience of the model’s performance in practical real-time brain-computer interface and cognitive monitoring systems.

Keywords


Ahmadi, N., Nilashi, M., Minaei-Bidgoli, B., Farooque, M., Samad, S., Aljehane, N. O., & Ahmadi, H. (2022). Eye state identification utilizing EEG signals: A combined method using self-organizing map and deep belief network. Scientific Programming, 2022(1), 4439189.
Albahri, A. S., Al-Qaysi, Z. T., Alzubaidi, L., Alnoor, A., Albahri, O. S., Alamoodi, A. H., & Bakar, A. A. (2023). A systematic review of deep learning technology in the steady-state visually evoked potential-based brain-computer interface applications: Current trends and future trust methodology—International Journal of Telemedicine and Applications.
Alotaiby, T. N., Alshebeili, S. A., Alshawi, T., Ahmad, I., & Abd El-Samie, F. E. (2014). EEG seizure detection and prediction algorithms: A survey. EURASIP Journal on Advances in Signal Processing, 2014(1), 1–21.
Gondesen, F., Marx, M., & Kycler, A.-C. (2019). A shoulder-surfing resistant image-based authentication scheme with a brain-computer interface. 2019 International Conference on Cyberworlds (CW), Kyoto, Japan, 336–343. https://doi.org/10.1109/CW.2019.00061
Hassan, M. M., Hassan, M. R., Huda, S., Uddin, M. Z., Gumaei, A., & Alsanad, A. (2021). A predictive intelligence approach to classify brain–computer interface-based eye state for smart living. Applied Soft Computing, 108, 107453.
Jain, A. and Raja, R. (2023). Automated Novel Heterogeneous Meditation Tradition Classification via Optimized Chi-Squared 1DCNN Method. Journal of Information Technology Management, 15(Special Issue: EIntelligent and Security for Communication, Computing Application (ISCCA-2022)), 1-22. doi: 10.22059/jitm.2023.95223
Jordan, O.-R. (2022). Brain print based on functional connectivity and asymmetry indices of brain regions: A case study of biometric person identification with non-expensive electroencephalogram headsets. Biomedical Engineering, 2022, April 17, 2023. https://doi.org/10.1049/bme2.12097
Kaggle Dataset. (2024). Eye-state classification EEG dataset. Kaggle. https://www.kaggle.com/datasets/robikscube/eye-state-classification-eeg-dataset accessed 24.12.2024.
Khan, A. A., Laghari, A. A., Shaikh, A. A., Dootio, M. A., Estrela, V. V., & Lopes, R. T. (2022). A blockchain security module for brain-computer interface (BCI) with multimedia life cycle framework (MLCF). Neuroscience Informatics, 2(1), 100030.
Kolivand, H. (2019). Brain signals as a new biometric authentication method using a brain-computer interface—Encyclopedia of Computer Graphics and Games.
Kong, W., Wang, L., Xu, S., Babiloni, F., & Chen, H. (2019). EEG fingerprints: Phase synchronization of EEG signals as a biomarker for subject identification. IEEE Access, 7, 121165–121173.
Savaliya, S., Marino, L., Leider, A. M., & Tappert, C. C. (2019). Brain signal authentication for human-computer interaction in virtual reality. 2019 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), New York, NY, USA, 115–120. https://doi.org/10.1109/CSE/EUC.2019.00031
Shuqfa, Z., Lakas, A., & Belkacem, A. N. (2024). Increasing accessibility to a large brain–computer interface dataset: Curation of Physionet EEG motor movement/imagery dataset for decoding and classification. Data in Brief, 54, 110181. https://doi.org/10.1016/j.dib.2023.110181
Singh, M. K. & Kumar, A. (2023). Cucumber Leaf Disease Detection and Classification Using a Deep Convolutional Neural Network. Journal of Information Technology Management, 15(Special Issue: EIntelligent and Security for Communication, Computing Application (ISCCA-2022)), 94–110. doi: 10.22059/jitm.2023.95248
Sun, Y., Lo, F. P. W., & Lo, B. (2019). EEG-based user identification system using 1D-convolutional long short-term memory neural networks. Expert Systems with Applications, 125, 259–267.
Talha, A. Z., Eissa, N. S., & Shapiai, M. I. (2024). Applications of brain-computer interface for motor imagery using deep learning: Review recent trends. Journal of Advanced Research in Applied Sciences and Engineering Technology, 40(2), 96–116.
Vuckovic, A., Gallardo, V. J. F., Jarjees, M., Fraser, M., & Purcell, M. (2018). Prediction of central neuropathic pain in spinal cord injury based on an EEG classifier. Clinical Neurophysiology, 129(8), 1605–1617.
Wang, T., Guan, S. U., Man, K. L., & Ting, T. O. (2014). EEG eye state identification using incremental attribute learning with time-series classification—Mathematical Problems in Engineering, 2014(1), 365101.
Yousefi, F., & Kolivand, H. (2021). A new solution to the brain state permanency for brain-based authentication methods. 2021 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), Riyadh, Saudi Arabia, 69–72. https://doi.org/10.1109/CAIDA51941.2021.9425075
Yousefi, F., & Kolivand, H. (2023). A robust brain pattern for brain-based authentication methods using deep breath. Computers & Security, 103520.
Yousefi, F., Kolivand, H., & Baker, T. (2021). SaS-BCI: A new strategy to predict image memorability and use mental imagery as a brain-based biometric authentication. Neural Computing and Applications, 33, 4283–4297. https://doi.org/10.1007/s00521-020-05247-1
Zhang, S., Sun, L., Mao, X., Hu, C., & Liu, P. (2021). Review on EEG-based authentication technology. Computational Intelligence and Neuroscience, 2021, Article ID 5229576, 20 pages. https://doi.org/10.1155/2021/5229576