ABSTRACT
Nowadays, a home security system plays an important role in every single home. Previously almost all the doors could be locked or unlocked by using traditional methods, such as keys, security cards, passwords, and patterns. However, other incidents that have taken place that lead to a matter of concern such as the loss of key, identity fraud have become a significant problem in conventional systems. Also had difficult to believe conventional security measures that lead to serious issues. To get better of these issues smart doors lock/unlock system using face recognition on deep learning approach is introduced with the internet of things to enhance the security capabilities. In this work, we designed a face recognition based automatic door lock/unlock system using raspberry pi that can connect to a smart home system. The raspberry pi is performing the main role play as a controller for smart door lock and unlock. The camera module is used for taking pictures and compared with database images to authenticate the images. Face detection was performed using the Haar-Cascade classifier while convolutional neural network (VGG-16) and linear binary pattern histogram (LBPH) are used for face recognition purposes. On the basis of verification only the matching faces that leads to the unlocking the door, otherwise, the door remained locked, and send a notification email with the detected face to the owner. The proposed method improve the security system and eliminates the key-based system.

Keywords: Face Detection, Face Recognition, VGG-16, LBPH, Raspberry Pi 4 Model B+.

REFERENCES

[1] R. Nareshkumar, A. Kamat, and D. Shinde, "Smart door security control system using Raspberry Pi," International Journal of Innovations & Advancement in Computer Science (IJIACS), vol. 6, pp. 499-503, 2017.
[2] A. Najmurrokhman, K. Kusnandar, A. B. Krama, E. C. Djamal, and R. Rahim, "Development of a secured room access system based on face recognition using Raspberry Pi and Android based smartphone," in MATEC Web of Conferences, 2018, vol. 197: EDP Sciences, p. 11008.
[3] A. B. Perdana and A. Prahara, "Face Recognition Using Light-Convolutional Neural Networks Based On Modified Vgg16 Model," in 2019 International Conference of Computer Science and Information Technology (ICoSNIKOM), 2019: IEEE, pp. 1-4.
[4] M. K. Dabhi and B. K. Pancholi, "Face detection system based on viola-jones algorithm," International Journal of Science and Research (IJSR), vol. 5, no. 4, pp. 62-64, 2016.
[5] M. Agarwal, H. Agrawal, N. Jain, and M. Kumar, "Face recognition using principle component analysis, eigenface and neural network," in 2010 International conference on signal acquisition and processing, 2010: IEEE, pp. 310-314.
[6] S. Liu and M. Silverman, "A practical guide to biometric security technology," IT Professional, vol. 3, no. 1, pp. 27-32, 2001.
[7] S. Kar, S. Hiremath, D. G. Joshi, V. K. Chadda, and A. Bajpai, "A multi-algorithmic face recognition system," in 2006 International Conference on Advanced Computing and Communications, 2006: IEEE, pp. 321-326.
[8] W. Xueguang and D. Xiaowei, "Study on algorithm of access control system based on face recognition," in 2009 ISECS International Colloquium on Computing, Communication, Control, and Management, 2009, vol. 3: IEEE, pp. 336-338.
[9] P. Viola and M. J. Jones, "Robust real-time face detection," International journal of computer vision, vol. 57, no. 2, pp. 137-154, 2004.
[10] S. Nath, P. Banerjee, R. N. Biswas, S. K. Mitra, and M. K. Naskar, "Arduino based door unlocking system with real time control," in 2016 2nd International conference on contemporary computing and informatics (IC3I), 2016: IEEE, pp. 358-362.
[11] S. Shavi, "Secured room access module," in 2017 International Conference On Smart Technologies For Smart Nation (SmartTechCon), 2017: IEEE, pp. 1134-1138.
[12] G. Senthilkumar, K. Gopalakrishnan, and V. S. Kumar, "Embedded image capturing system using raspberry pi system," International Journal of Emerging Trends & Technology in Computer Science, vol. 3, no. 2, pp. 213-215, 2014.
[13] I. M. Sayem and M. S. Chowdhury, "Integrating face recognition security system with the internet of things," in 2018 International Conference on Machine Learning and Data Engineering (iCMLDE), 2018: IEEE, pp. 14-18.
[14] C. Vongchumyen et al., "Door lock system via web application," in 2017 International Electrical Engineering Congress (iEECON), 2017: IEEE, pp. 1-4.
[15] S. Jogdand and M. Karanjkar, "Implementation of Automated Door Accessing System with Face Design and Recognition," International Journal of Science and Research (IJSR), vol. 4, no. 10, 2015.
[16] N. Stekas and D. Van Den Heuvel, "Face recognition using local binary patterns histograms (LBPH) on an FPGA-based system on chip (SoC)," in 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2016: IEEE, pp. 300-304.
[17] H. H. Lwin, A. S. Khaing, and H. M. Tun, "Automatic door access system using face recognition," Int. J. Sci. Technol. Res, vol. 4, no. 6, pp. 294-299, 2015.
[18] Y. Taigman, M. Yang, M. A. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 1701-1708.
[19] J. O. Helvig, "Implementing the Viola-Jones face detection algorithm," Diss. Technical University of Denmark, DTU, DK-2800 Kgs. Lyngby, Denmark, 2008.
[20] A. P. Mrudula, Kruthika Dinesh, Reethika P, "SMART DOOR UNLOCKING SYSTEM," International Research Journal of Engineering and Technology (IRJET), vol. 07, no. 05, May 2020.
[21] C.-H. Hung, Y.-W. Bai, and J.-H. Ren, "Design and implementation of a door lock control based on a near field communication of a smartphone," in 2015 IEEE International Conference on Consumer Electronics-Taiwan, 2015: IEEE, pp. 45-46.
[22] N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 2005, vol. 1: Ieee, pp. 886-893.
[23] M. A. Khan, M. K. Shaikh, S. A. bin Mazhar, and K. Mehboob, "Comparative analysis for a real time face recognition system using raspberry Pi," in 2017 IEEE 4th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA), 2017: IEEE, pp. 1-4.
[24] A. Uçar, Y. Demir, and C. Güzeliş, "Object recognition and detection with deep learning for autonomous driving applications," Simulation, vol. 93, no. 9, pp. 759-769, 2017.
[25] G. B. Huang, M. Mattar, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database forstudying face recognition in unconstrained environments," in Workshop on faces in'Real-Life'Images: detection, alignment, and recognition, 2008.
[26] V. Kushwaha, M. Singh, R. Singh, M. Vatsa, N. Ratha, and R. Chellappa, "Disguised faces in the wild," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 1-9.