Real-Time Occluded Face Identification Using Deep Learning
Abstract
One of the most difficult aspects of face identification is face occlusion. Face occlusion is when anything is placed over the face, for example, a mask. Masks occlude multiple important facial features, like the chin, lips, nose, and facial edges. Face identification becomes challenging when important facial features are occluded. Using one of the deep learning algorithms, YOLOv5, this work tries to identify the face of someone whose face is occluded by a mask in real-time. A special program is being created to test the effectiveness of the YOLOv5 algorithm. 14 people's data were registered, and each person had 150 images used for training, validation, and testing. The images used are regular faces and mask-occluded faces. Nine distinct configurations of epoch and batch sizes were used to train the model. Then, during the testing phase, the best-performing configuration was chosen. Images and real-time input were used for testing. The highest possible accuracy of image identification is 100%, whereas the maximum accuracy of real-time identification is 64%. It was found during the testing that the brightness of the room has an influence on the performance of YOLOv5. Identifying individuals becomes more challenging when there are significant changes in brightness.
Keywords
Full Text:
PDFReferences
F. Syuhada, I. G. P. Suta Wijaya, and F. Bimantoro, “Pengenalan Wajah Untuk Sistem Kehadiran Menggunakan Metode Eigenface dan Euclidean Distance,” Journal of Computer Science and Informatics Engineering (J-Cosine), vol. 2, no. 1, Sep. 2018, doi: 10.29303/jcosine.v2i1.74.
L. Novamizanti, N. V. de Lima, and E. Susatio, “Sistem Pengenalan Wajah 3D Menggunakan ICP dan SVM,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 6, no. 6, p. 601, Dec. 2019, doi: 10.25126/jtiik.2019661609.
R. A. Pratama, S. Achmadi, and K. Auliasari, “PENERAPAN METODE CONVOLUTIONAL NEURAL NETWORK PADA APLIKASI DETEKSI WAJAH PENGUNJUNG PERPUSTAKAAN,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 6, no. 1, pp. 253–258, Mar. 2022, doi: 10.36040/jati.v6i1.4517.
R. P. H. Sejati and R. Mardhiyyah, “Deteksi Wajah Berbasis Facial Landmark Menggunakan OpenCV Dan Dlib,” Jurnal Teknologi Informasi, vol. 5, no. 2, pp. 144–148, Dec. 2021, doi: 10.36294/jurti.v5i2.2220.
B. Xu et al., “CattleFaceNet: A cattle face identification approach based on RetinaFace and ArcFace loss,” Comput Electron Agric, vol. 193, p. 106675, Feb. 2022, doi: 10.1016/j.compag.2021.106675.
A. Kumar, A. Kaur, and M. Kumar, “Face detection techniques: a review,” Artif Intell Rev, vol. 52, no. 2, pp. 927–948, Aug. 2019, doi: 10.1007/s10462-018-9650-2.
S. Anwarul and S. Dahiya, “A comprehensive review on face recognition methods and factors affecting facial recognition accuracy,” in Proceedings of ICRIC 2019: Recent Innovations in Computing, 2020, pp. 495–514.
O. B. Sezer, M. U. Gudelek, and A. M. Ozbayoglu, “Financial time series forecasting with deep learning : A systematic literature review: 2005–2019,” Appl Soft Comput, vol. 90, p. 106181, May 2020, doi: 10.1016/j.asoc.2020.106181.
A. Anwar and A. Raychowdhury, “Masked Face Recognition for Secure Authentication,” Aug. 2020.
N. Hidayat, S. Wahyudi, and A. A. Diaz, “PENGENALAN INDIVIDU MELALUI IDENTIFIKASI WAJAH MENGGUNAKAN METODE YOU ONLY LOOK ONCE (YOLOv5),” in UNEJ e-Proceeding, 2022, pp. 85–98.
N. Kwak and D. Kim, “Study On Masked Face Detection And Recognition using transfer learning,” International Journal of Advanced Culture Technology, vol. 10, no. 1, pp. 294–301, 2022.
B. Mandal, A. Okeukwu, and Y. Theis, “Masked Face Recognition using ResNet-50,” Apr. 2021.
S. Malakar, W. Chiracharit, K. Chamnongthai, and T. Charoenpong, “Masked Face Recognition Using Principal component analysis and Deep learning,” in 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), May 2021, pp. 785–788. doi: 10.1109/ECTI-CON51831.2021.9454857.
M. S. Al-Tamimi and F. A. Mohammed Ali, “Face mask detection based on algorithm YOLOv5s,” International Journal of Nonlinear Analysis and Applications, 2022.
Mardiana, M. A. Muhammad, and Y. Mulyani, “Library Attendance System using YOLOv5 Faces Recognition,” in 2021 International Conference on Converging Technology in Electrical and Information Engineering (ICCTEIE), Oct. 2021, pp. 68–72. doi: 10.1109/ICCTEIE54047.2021.9650628.
J. Liu and D. Li, “Research on Moving Object Detection of Animated Characters,” Procedia Comput Sci, vol. 208, pp. 271–276, 2022, doi: 10.1016/j.procs.2022.10.039.
Z. Chen et al., “Plant Disease Recognition Model Based on Improved YOLOv5,” Agronomy, vol. 12, no. 2, p. 365, Jan. 2022, doi: 10.3390/agronomy12020365.
C. Jiang et al., “Object detection from UAV thermal infrared images and videos using YOLO models,” International Journal of Applied Earth Observation and Geoinformation, vol. 112, p. 102912, Aug. 2022, doi: 10.1016/j.jag.2022.102912.
F. Jubayer et al., “Detection of mold on the food surface using YOLOv5,” Curr Res Food Sci, vol. 4, pp. 724–728, 2021, doi: 10.1016/j.crfs.2021.10.003.
Y. Li, J. Wang, H. Wu, Y. Yu, H. Sun, and H. Zhang, “Detection of powdery mildew on strawberry leaves based on DAC-YOLOv4 model,” Comput Electron Agric, vol. 202, p. 107418, Nov. 2022, doi: 10.1016/j.compag.2022.107418.
G. Jocher, “Yolov5 documentation,” Ultralytics, 2020.
R. Xu, H. Lin, K. Lu, L. Cao, and Y. Liu, “A Forest Fire Detection System Based on Ensemble Learning,” Forests, vol. 12, no. 2, p. 217, Feb. 2021, doi: 10.3390/f12020217.
M. N. Baay, A. N. Irfansyah, and M. Attamimi, “Sistem Otomatis Pendeteksi Wajah Bermasker Menggunakan Deep Learning,” Jurnal Teknik ITS, vol. 10, no. 1, Aug. 2021, doi: 10.12962/j23373539.v10i1.59790.
F. M. Qotrunnada and P. H. Utomo, “Metode Convolutional Neural Network untuk Klasifikasi Wajah Bermasker,” in PRISMA, Prosiding Seminar Nasional Matematika, 2022, pp. 799–807.
Roboflow, “Give your software the sense of sight,” https://roboflow.com/ , 2016.
DOI: https://doi.org/10.15408/jti.v16i1.31211 Abstract - 0 PDF - 0
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Anggina Primanita, Muhammad Fachrurrozi, Rafly Pakomgan, Abdiansah Abdiansah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
3rd Floor, Dept. of Informatics, Faculty of Science and Technology, UIN Syarif Hidayatullah Jakarta
Jl. Ir. H. Juanda No.95, Cempaka Putih, Ciputat Timur.
Kota Tangerang Selatan, Banten 15412
Tlp/Fax: +62 21 74019 25/ +62 749 3315
Handphone: +62 8128947537
E-mail: jurnal-ti@apps.uinjkt.ac.id
Jurnal Teknik Informatika by Prodi Teknik Informatika Universitas Islam Negeri Syarif Hidayatullah Jakarta is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://journal.uinjkt.ac.id/index.php/ti.
JTI Visitor Counter: View JTI Stats