Authors : Vishvash C; Vivek Ganga NarayanRao; Monal Digeshwar Bhiwgade; Ritendu Bhattacharyya; Bharani Kumar Depuru

Volume/Issue : Volume 9 - 2024, Issue 8 - August

Google Scholar : https://tinyurl.com/39sc8y47

Scribd : https://tinyurl.com/yuxz6yh6

DOI : https://doi.org/10.38124/ijisrt/IJISRT24AUG721

Abstract : In today's digital learning era, a common yet significant challenge emerges: participants often fall asleep during lecture videos, leading to missed concepts and overwhelming frustration as they struggle to find where they left off. This research delves into a solution designed to enhance comprehension and ease the mental stress associated with these interruptions. Our journey started with data collection from the Internet focusing on Indian and Malaysian contexts we categorized the data into two states active and drowsy, with this dataset in hand we proceeded to a meticulous preprocessing phase, and data augmentation was employed to enhance the diversity of our dataset while image normalization standardized the inputs data balancing was meticulously implemented to provide an unbiased representation of both classes to our model We then set the stage for intense competition among three advanced models: YOLO-V8, DenseNet201, and ResNet152. Each model underwent a preliminary evaluation over 10 epochs, where YOLO-V8 emerged as the frontrunner with a compelling accuracy of 92% on test data. This promising result spurred us to push further, training YOLO-V8 over two extended phases. This paper chronicles the path from identifying a widespread issue to developing a solution that enhances educational comprehension and reduces participant stress. By incorporating the YOLO-V8 model into educational platforms, we introduce an innovative method to detect drowsiness and sustain engagement, ensuring every participant remains engaged in the digital classroom.

Keywords : Drowsiness Detection, Online Learning Engagement, YOLOv8, MobileNetV2, EfficientNetB0, AI in Digital Classrooms, Student Attention Monitoring.

References :

1. Inna Kolyshkina and Simeon, Interpretability of Machine Learning Solutions in Public Healthcare: The CRISP-ML Approach, 2021, Volume 4. https://doi.org/10.3389/fdata.2021.660206
2. B., Mallikarjuna and D., Arunkumar Reddy, Cloud Storage for Data Sharing: Infrastructure as Service (IaaS) in Cloud Environment (February 7, 2018). 2018 IADS International Conference on Computing, Communications & Data Engineering (CCODE) 7-8 February, Available at SSRN: http://dx.doi.org/ 10.2139/ssrn.3169039
3. Zewen Li, Fan Liu, Wenjie Yang, Shouheng Peng, Jun Zhou, A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects, Published in IEEE Transactions on Neural Networks and Learning Systems ( Volume: 33, Issue: 12, December 2022), Publisher: IEEE, DOI: https://doi.org/10.1109/TNNLS.2021.3084827
4. Relan, K. (2019). Deploying Flask Applications. In: Building REST APIs with Flask. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-5022-8_6
5. Mingle Xu, Sook Yoon, Alvaro Fuentes, Dong Sun Park, A Comprehensive Survey of Image Augmentation Techniques for Deep Learning, Pattern Recognition, Volume 137, 2023, 109347, ISSN 0031-3203, https://doi.org/10.1016/j.patcog. 2023.109347
6. Adhinata, F., Rakhmadani, D., Wibowo, M., & Jayadi, A. (2021). A Deep Learning Using DenseNet201 to Detect Masked or Non-masked Face. JUITA: Jurnal Informatika, 9(1), 115 - 121. doi: http://dx.doi.org/10.30595/juita.v9i1.9624
7. Prabhakaran, A.K., Nair, J.J., Sarath, S. (2021). Thermal Facial Expression Recognition Using Modified ResNet152. In: Thampi, S.M., Gelenbe, E., Atiquzzaman, M., Chaudhary, V., Li, KC. (eds) Advances in Computing and Network Communications. Lecture Notes in Electrical Engineering, vol 736. Springer, Singapore. https://doi.org/10.1007/978-981-33-6987-0_32
8. K. Dong, C. Zhou, Y. Ruan, and Y. Li, "MobileNetV2 Model for Image Classification," 2020 2nd International Conference on Information Technology and Computer Application (ITCA), Guangzhou, China, 2020, pp. 476-480, doi: https://doi.org/10.1109/ITCA52113.2020.00106
9. Md. Alamin Talukder, Md. Abu Layek, Mohsin Kazi, Md. Ashraf Uddin, Sunil Aryal, Empowering COVID-19 detection: Optimizing performance through fine-tuned EfficientNet deep learning architecture, Volume 168, 2024, 107789, ISSN 0010-4825, doi: https://doi.org/10.1016/j.compbiomed. 2023.107789
10. Sohan, M., Sai Ram, T., Rami Reddy, C.V. (2024). A Review on YOLOv8 and Its Advancements. In: Jacob, I.J., Piramuthu, S., Falkowski-Gilski, P. (eds) Data Intelligence and Cognitive Informatics. ICDICI 2023. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-99-7962-2_39
11. Shivam Sinha, T.N.Singh, V.K.Singh, A.K.Verma. Epoch Determination for Neural Network by self-organized map (SOM), Comput Geosci 14, 199-206 (2010). https://doi.org/10.1007/s10596-009-9143-0