Attendance Tracking with Perception Detection using Recurrent Neural Network
Keywords:
Online class, (RNN)Recurrent Neural Network, Attendance, body motion, face expression,(LSTM) Long-Short Term MemoryAbstract
The online class environment has become prevalent in education since the Covid-19 pandemic. It offers students and educators the flexibility to access online education from various locations. Despite its challenges, the online class environment has become essential for providing accessible education, especially during the times of disruptions. There are still educators that conduct attendance checking manually so the student’s attendance and attentiveness during online classes is a big challenge for teachers. The researcher developed a system that can detect body motion and face expression in an online class setup. Attendance tracking with perception detection with the use of Recurrent Neural Network is suggested to detect body motion and face expression, capture and then, store the students’ attendance in the system. The system will use real-time detecting the body motion and face expression whether the students is attentive or not are being captured to store the student attendance during online classes. The body motion will detect the body and the facial expression to capture and track when the camera is on. The system incorporates a notification within the system for faculty regarding inattentive students. Also, the system developed as a separate web application that is compatible or complementary with the existing setup of online classes.
Downloads
References
Fiaidhi, J., Qi, L., and Han, Y., (2021) Human Motion Posture Detection Algorithm Using Deep Reinforcement Learning. Mobile Information Systems. Volume 2021, Article ID 4023861, 10 pages. Hindawi. https://doi.org/10.1155/2021/4023861
Chen L., and Li S., (2021). "Human Motion Target Posture Detection Algorithm Using Semi-Supervised Learning in Internet of Things". IEEE Access. vol. 9, pp. 90529-90538, doi: 10.1109/ACCESS.2021.3091430.
Um, Mahanthesha & Mohana, Dr. (2020). Smart Digital Monitoring for Attendance System. Recent Innovations in Chemical Engineering (Formerly Recent Patents on Chemical Engineering). https://www.researchgate.net/publication/346971090_Smart_Digital_Monitoring_for_Attendance_System
Zhang, C., Zhengyu X., and Joohee K., (2021). "Video Object Detection Using Event-Aware Convolutional Lstm and Object Relation Networks" Electronics 10, no. 16: 1918. https://doi.org/10.3390/electronics10161918
Chong, E., Wang, Y., Ruiz, N., and Rehg, J., (2020) Detecting Attended Visual Targets in Video. Computer Vision Foundation. IEEE Xplore. https://github.com/ejcgt/attention-target-detection
Saxena, Shipra. (2021). “What is LSTM? Introduction to Long Short-Term Memory”. Analytics Vidhya. https://www.analyticsvidhya.com/blog/2021/03/introduction-to-long-short-term-memory-lstm/
Xu Y, Zhao L. (2022) Inception-LSTM Human Motion Recognition with Channel Attention Mechanism. Comput Math Methods Med. PMID: 35734775; PMCID: PMC9208947. doi: 10.1155/2022/9173504. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9208947/
Qi, L., and Han, Y., (2021) Human Motion Posture Detection Algorithm Using Deep Reinforcement Learning. Mobile Information Systems. Volume 2021, Article ID 4023861. https://doi.org/10.1155/2021/4023861
Hamilton N, & Weimar W, & Luttgens K(Eds.), (2021). The description of human motion. Kinesiology: Scientific Basis of Human Motion, Twelfth Edition. McGraw Hill. https://accessphysiotherapy.mhmedical.com/content.aspx?bookid=965§ionid=53599851
Ahmed, Syed Hassan and Li, Xue. (2021) “Design and Implementation of Human Motion Recognition Information Processing System Based on LSTM Recurrent Neural Network Algorithm”. Hindawi XML Corpus. Article ID 3669204. https://www.hindawi.com/journals/cin/2021/3669204/
Sun, Gengxin, Shen, Quanping and Ye, Songzhong. (2021) “Research on Human Motion Analysis in Moving Scene Based on Timing Detection and Video Description Algorithm”. Discrete Dynamics in Nature and Society. Hindawi. https://doi.org/10.1155/2021/4320846
Ahmad M., Ahmed I., Khan FA., Qayum F., and Aljuaid H. 2020. Convolutional neural network–based person tracking using overhead views. International Journal of Distributed Sensor Networks. doi:10.1177/1550147720934738
Galvez, Reagan L., Culaba, Alvin B., Dadios, Elmer P., Bandala, Argel A., (2019) “Artificial intelligence: policy paper”. Journal of Computational Innovations and Engineering Applications. DLSU. https://www.dlsu.edu.ph/wp-content/uploads/pdf/research/journals/jciea/vol-4-1/1galvez.pdf
De Goma, De Goma, J.C., Jamias, J.R.V.,Kwong, A.H., and Salvador, J.M.S. (2019) “Real-time facial feature point detection and tracking using rule-based approach and integral projection”. School of Information Technology, Mapua University. International Journal of Innovative Technology and Exploring Engineering. Volume 8, Issue 5s, 2019, Pages 171-175. https://www.scopus.com/record/display.uri?eid=2-s2.0-85063668815&origin=inward&txGid=3863ebaf71209fb284bd11b076c8dc7d
Guillermo, Marielet & Tobias, Rogelio Ruzcko & De Jesus, Luigi Carlo & Billones, Robert Kerwin & Sybingco, Edwin & Dadios, Elmer & Fillone, Alexis. (2020). Detection and Classification of Public Security Threats in the Philippines Using Neural Networks. 320-324. 10.1109/LifeTech48969.2020.1570619075. https://www.researchgate.net/publication/341074351_Detection_and_Classification_of_Public_Security_Threats_in_the_Philippines_Using_Neural_Networks
K. L. Leonida, K. V. Sevilla and C. O. Manlises, "A Motion-Based Tracking System Using the Lucas-Kanade Optical Flow Method," 2022 14th International Conference on Computer and Automation Engineering (ICCAE), Brisbane, Australia, 2022, pp. 86-90, doi: 10.1109/ICCAE55086.2022.9762423.
J. N. Mindoro, N. U. Pilueta, Y. D. Austria, L. Lolong Lacatan and R. M. Dellosa. (2020) "Capturing Students’ Attention Through Visible Behavior: A Prediction Utilizing YOLOv3 Approach”. 11th IEEE Control and System Graduate Research Colloquium (ICSGRC), Shah Alam, Malaysia, 2020, pp. 328-333, doi: 10.1109/ICSGRC49013.2020.9232659.
S. D. Boncolmo, E. V. Calaquian and M. V. C. Caya. (2021) "Gender Identification Using Keras Model Through Detection of Face,". IEEE 13th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM), Manila, Philippines, 2021, pp. 1-6, doi: 10.1109/HNICEM54116.2021.9731814.
Staudemeyer, R.C. and Morris, E.R. (2019) “Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks”. Neural and Evolutionary Computing (cs.NE). arXiv:1909.09586. https://doi.org/10.48550/arXiv.1909.09586
Chen, Suting, and Ning Yang. (2023) "STMP-Net: A Spatiotemporal Prediction Network Integrating Motion Perception" Sensors 23, no. 11: 5133. https://doi.org/10.3390/s23115133
Qawasmeh, Y., Qutishat, D., and Obeidallah, R. (2022) “ An overview of Attendance and Participation in Online Class During the Covid Pandemic: A Case Study”. International Journal of Interactive Mobile Technologies (iJIM) DOI:10.3991/ijim.v16i04.27103
Aguilar, M. V., & Torres, G. (2021). Making Sense of Online Classes during Quarantine due to the COVID-19 Pandemic: Students’ Perceptions from a Philippine University. Asia Social Issues, 14(4), Article 248066 (15 pages). Retrieved July 16, 2023 from https://so06.tci-thaijo.org/index.php/asi/article/view/248066
Barrot, J., Llenares, I. I., & Del Rosario, L. S. (2021). Students’ online learning challenges during the pandemic and how they cope with them: The case of the Philippines. Education and Information Technologies, 26(6), 7321–7338. Retrieved July 16, 2023 from https://doi.org/10.1007/s10639-021-10589-x
Kalita, D., (2022). A brief overview of Recurrent Nueral Networks (RNN). Analytics Vidhya, Published March 11, 2022. https://www.analyticsvidhya.com/blog/2022/03/a-brief-overview-of-recurrent-neural-networks-rnn/
Chugh, A., (2023). Deep Learning| Introduction to Long Short-Term Memory. GeeksforGeeks. Published May 31, 2023. https://www.geeksforgeeks.org/deep-learning-introduction-to-long-short-term-memory
Roy S., Nagrale P. (2022) “Encoding the Photoreceptors of the Human Eye”. Cureus. 10;14(10): e30125. PMID: 36381896; PMCID: PMC9644661. doi: 10.7759/cureus.30125
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
