Every year, many deaths occur due to various strains of viral diseases, especially during the Arbaeen procession, numerous crowds in blessed places, and the beginning of the academic year of schools and universities in the country. The spread of compliance with health protocols was considered the best solution to stop this disease, and each individual's commitment to these protocols played a crucial role. Since manually monitoring compliance with health protocols is time-consuming, laborious, and error-prone, using an intelligent monitoring system to check people's mask coverage and identify symptomatic people regardless of quarantine regulations is strongly required in public environments. This article proposes an automatic hardware/software system based on artificial intelligence to identify people's mask cover and measure body temperature, which performs face recognition, mask cover detection and body temperature measurement, respectively, using the Viola Jones algorithm, convolutional neural network and temperature sensor. The Viola Jones converts a gray-level image to face area detected of the image. CNN model that optimized through transfer learning for classifying images is the ResNet type. If a person has not used a mask or the person’s body temperature is higher than 37.5 degrees, the system will issue a warning. The proposed model was obtained accuracies of 99% and 98% for the training and validation sets at Epoch 18. In the field evaluation, this system was able to achieve 96% accuracy in face recognition and 100% accuracy in mask cover detection. This smart system can be used to monitor compliance with health protocols in public centers.
Highlights
The study discussed viral disease prevention during crowded events and school terms through smart health protocols.
This article suggests using hardware/software system based on artificial intelligence to monitor mask compliance and body temperature, reducing manual monitoring errors.
The system uses the Viola-Jones algorithm for face detection, a ResNet-based CNN for mask detection, and a temperature sensor.
The best accuracies for training and validation dataset, are 99% and 98% at Epoch 18 respectively, also 96% for face recognition and 100% for mask detection in real dataset.
Fauci, A. S., Lane, H. C., & Redfield, R. R. (2020). Covid-19—navigating the uncharted. New England Journal of Medicine, 382(13), 1268-1269.
Yang, L., Liu, S., Liu, J., Zhang, Z., Wan, X., Huang, B., & Zhang, Y. (2020). COVID-19: immunopathogenesis and Immunotherapeutics. Signal transduction and targeted therapy, 5(1), 128.
Velavan, T. P., & Meyer, C. G. (2020). The COVID‐19 epidemic. Tropical medicine & international health, 25(3), 278.
Khanna, R. C., Cicinelli, M. V., Gilbert, S. S., Honavar, S. G., & Murthy, G. V. (2020). COVID-19 pandemic: Lessons learned and future directions. Indian journal of ophthalmology, 68(5), 703-710.
Shatnawi, M., Alhanaee, K., Alhammadi, M., & Almenhali, N. (2023). Advancements in Machine Learning-Based Face Mask Detection: A Review of Methods and Challenges. International Journal of Electrical and Electronics Research, 11(3), 844-850.
Zhang, H., Tang, J., Wu, P., Li, H., & Zeng, N. (2023). A novel attention-based enhancement framework for face mask detection in complicated scenarios. Signal Processing: Image Communication, 116, 116985.
Liu, Y., & Qu, Y. (2024). Construction of a smart face recognition model for university libraries based on FaceNet-MMAR algorithm. Plos one, 19(1), e0296656.
Singh, N., & Tripathi, P. (2024). An efficient model for detecting real-time facemask based on different Classification Algorithms. Multimedia Tools and Applications, 83(18), 55175-55198.
Hosny, K. M., Ibrahim, N. A., Mohamed, E. R., & Hamza, H. M. (2024). Artificial intelligence-based masked face detection: A survey. Intelligent Systems with Applications, 22, 200391.
Wani, “Face mask detection and alarming system using machine learning,” IJAEM, vol.5, no.1, pp.914-919, 2024.
Ak, Ö. B., Kuruöz, E., & Ak, A. (2024). Determining the Reliability of Personal Masks with Convolutional Neural Networks. Afet ve Risk Dergisi, 7(1), 71-85.
Chavda, A., Dsouza, J., Badgujar, S., & Damani, A. (2021, April). Multi-stage CNN architecture for face mask detection. In 2021 6th International Conference for Convergence in Technology (i2ct) (pp. 1-8). IEEE.
Loey, M., Manogaran, G., Taha, M. H. N., & Khalifa, N. E. M. (2021). A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic. Measurement, 167, 108288.
Chen, Y., Hu, M., Hua, C., Zhai, G., Zhang, J., Li, Q., & Yang, S. X. (2021). Face mask assistant: Detection of face mask service stage based on mobile phone. IEEE Sensors Journal, 21(9), 11084-11093.
Al-Nabulsi, J., Turab, N., Owida, H. A., Al-Naami, B., De Fazio, R., & Visconti, P. (2023). Iot solutions and ai-based frameworks for masked-face and face recognition to fight the COVID-19 pandemic. Sensors, 23(16), 7193.
Rusia, M. K., & Singh, D. K. (2024). An improved deep transfer learning approach to identify the human face mask in real-time considering the COVID-19 pandemic. Multimedia Tools and Applications, 83(7), 21695-21743.
Wu, P., Li, H., Zeng, N., & Li, F. (2022). FMD-Yolo: An efficient face mask detection method for COVID-19 prevention and control in public. Image and vision computing, 117, 104341.
Mostafa, S. A., Ravi, S., Zebari, N. A., Mohammed, M. A., Nedoma, J., ... & Ding, W. (2024). A YOLO-based deep learning model for Real-Time face mask detection via drone surveillance in public spaces. Information Sciences, 120865.
Zhang, L., Peng, J., Liu, W., Yuan, H., Tan, S., Wang, L., & Yi, F. (2023). A semantic fusion based approach for express bill detection in complex scenes. Image and Vision Computing, 135, 104708.
Viola, P., & Jones, M. (2001, December). Rapid object detection using a boosted cascade of simple features. In Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001 (Vol. 1, pp. I-I). Ieee.
Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press.
O’Mahony, N., Campbell, S., Carvalho, A., Harapanahalli, S., Hernandez, G. V., Krpalkova, L., & Walsh, J. (2020). Deep learning vs. traditional computer vision. In Advances in Computer Vision: Proceedings of the 2019 Computer Vision Conference (CVC), Volume 1 1 (pp. 128-144). Springer International Publishing.
Tabian, I., Fu, H., & Sharif Khodaei, Z. (2019). A convolutional neural network for impact detection and characterization of complex composite structures. Sensors, 19(22), 4933.
O'Shea, K. (2015). An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458.
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., … & Iyengar, S. S. (2018). A survey on deep learning: Algorithms, techniques, and applications. ACM computing surveys (CSUR), 51(5), 1-36.
Albawi, S., Mohammed, T. A., & Al-Zawi, S. (2017). Understanding of a convolutional neural network. 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey, 1–6.
Yin, X., & Liu, X. (2017). Multi-task convolutional neural network for pose-invariant face recognition. IEEE Transactions on Image Processing, 27(2), 964-975.
Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 815-823).
Li, X., Lai, S., & Qian, X. (2021). Dbcface: Towards pure convolutional neural network face detection. IEEE Transactions on Circuits and Systems for Video Technology, 32(4), 1792-1804.
Rezaeian,M Reza. (2024). Intelligent Control and Monitoring of Infectious Viral Diseases Based on Deep Learning. Sustainable Energy and Artificial Intelligence, 1(2), 127-135. doi: 10.61186/seai.2409-1004
MLA
Rezaeian,M Reza. "Intelligent Control and Monitoring of Infectious Viral Diseases Based on Deep Learning", Sustainable Energy and Artificial Intelligence, 1, 2, 2024, 127-135. doi: 10.61186/seai.2409-1004
HARVARD
Rezaeian M Reza. (2024). 'Intelligent Control and Monitoring of Infectious Viral Diseases Based on Deep Learning', Sustainable Energy and Artificial Intelligence, 1(2), pp. 127-135. doi: 10.61186/seai.2409-1004
CHICAGO
M Reza Rezaeian, "Intelligent Control and Monitoring of Infectious Viral Diseases Based on Deep Learning," Sustainable Energy and Artificial Intelligence, 1 2 (2024): 127-135, doi: 10.61186/seai.2409-1004
VANCOUVER
Rezaeian M Reza. Intelligent Control and Monitoring of Infectious Viral Diseases Based on Deep Learning. SEAI. 2024;1(2):127-135. doi: 10.61186/seai.2409-1004