網路的崛起，產生了各種新穎的服務，數位金融這項方便的服務也隨之而來，透過網路轉帳繳款已經不是空談，但資訊安全仍然是一大問題，各種加密措施為了保護使用者資訊紛紛被設計出來，為了提升帳戶安全度，各家銀行也增加使用者帳號密碼的限制，雖然多少有效，但同時也增加了使用者的不便。因此生物辨識技術便開始發達，透過生物特徵與認證系統結合，從每個人的生理特徵尋找微小的差異處，是生物辨識的精神，但能做到如此細緻功能的技術同時也需要高端的硬體，立體臉部辨識的紅外線攝影機、指紋辨識個掃描器或是虹膜辨識的高畫質相機，無一不是成本高昂。本論文致力於將只需要單顆彩色相機鏡頭的平面臉部辨識與使用者認證系統結合，設計出與使用者互動的方式排除影像及影片偽造行為，在手機上同時達到安全又有效率之功能。

The rise of the Internet has produced a variety of innovative services. The convenient service of Fintech has followed. It is no longer a dream about payment or transferring through Internet, but information security is still a big problem. Various encryption measure shave been designed to protect user information. In order to improve account security, banks have also increased the restrictions on user account passwords. Although it is effective, it also increases user inconvenience. Therefore, biometrics identification has begun to develop. The spirit of biometric identification is combining biometrics and authentication systems to find small differences from each person’s physiological characteristics. However, technologies that can achieve such meticulous functions also require high-end hardware. Infrared cameras with stereo face recognition, fingerprint recognition scanners or high-resolution cameras with iris recognition are all costly. This paper is dedicated to combining the flat face recognition that requires only a single color camera with the user authentication system, and designing a way of interacting with the user to eliminate image and film spoofing, and achieve safe and efficient functions on the mobile phone at the same time.

[1]G. Aguilar, G. Sanchez, K. Toscano, M. Salinas, M. Nakano, and H. Perez.Finger print recognition. InSecondInternational Conference on Internet Monitoring and Protection (ICIMP 2007), pages 32–32, 2007.
[2]A. Anjos, M. M. Chakka, and S. Marcel. Motion-based counter-measures tophoto attacks in face recognition.IET biometrics, 3(3):147–158, 2013.
[3]A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic. Robust discriminative response map fitting with constrained local models. InProceedings of theIEEE conference on computer vision and pattern recognition, pages 3444–3451, 2013.
[4]W. Bao, H. Li, N. Li, and W. Jiang. A liveness detection method for face recognition based on optical flow field. In2009 International Conference onImage Analysis and Signal Processing, pages 233–236. IEEE, 2009.
[5]Z. Boulkenafet, J. Komulainen, and A. Hadid. Face spoofing detection us-ing colour texture analysis.IEEE Transactions on Information Forensics andSecurity, 11(8):1818–1830, 2016.
[6]J. Brooke et al. Susa quick and dirty usability scale.Usability evaluation in industry, 189(194):4–7, 1996.
[7]Á. A. Cabrera, F. Hohman, J. Lin, and D. H. Chau. Interactive classification for deep learning interpretation.arXiv preprint arXiv:1806.05660, 2018.
[8]P. P. Chan, W. Liu, D. Chen, D. S. Yeung, F. Zhang, X. Wang, and C.C.Hsu. Face liveness detection using a flash against 2d spoofing attack.IEEETransactions on Information Forensics and Security, 13(2):521–534, 2017.
[9]Y. Chen, J. Sun, X. Jin, T. Li, R. Zhang, and Y. Zhang. Your face your heart:Secure mobile face authentication with photoplethysmograms. InIEEE IN-48 FOCOM 2017-IEEE Conference on Computer Communications, pages 1–9.IEEE, 2017.
[10]G. Chetty and M. Wagner. Multi-level liveness verification for face-voice biometric authentication. In2006 Biometrics Symposium: Special Session onResearch at the Biometric Consortium Conference, pages 1–6. IEEE, 2006.
[11]T. Choudhury, B. Clarkson, T. Jebara, and A. Pentland. Multimodal person recognition using unconstrained audio and video. InProceedings, International Conference on Audio-and Video-Based Person Authentication, pages176–181. Citeseer, 1999.
[12]T.F.Cootes,G.J.Edwards,andC.J.Taylor. Active appearance models. IEEETransactions on Pattern Analysis & Machine Intelligence, (6):681–685, 2001.
[13]L.J.Cronbach. Coefficient alpha and the internal structure of tests. psychometrika, 16(3):297–334, 1951.
[14]J.Deng,Y.Zhou,andS.Zafeiriou. Marginal loss for deep face recognition. InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pages 60–68, 2017.
[15]S. K. Dey, A. Hossain, and M. M. Rahman. Implementation of a web application to predict diabetes disease: An approach using machine learning algorithm. In2018 21st International Conference of Computer and InformationTechnology (ICCIT), pages 1–5. IEEE, 2018.
[16]T. I. Dhamecha, A. Nigam, R. Singh, and M. Vatsa. Disguise detection and face recognition in visible and thermal spectrums. In2013 International Conference on Biometrics (ICB), pages 1–8. IEEE, 2013.
[17]L. Flom and A. Safir. Iris recognition system, 1987. US Patent 4,641,349.
[18]J. Galbally, S. Marcel, and J. Fierrez. Image quality assessment for fake bio-metric detection: Application to iris, fingerprint, and face recognition. IEEE transactions on image processing, 23(2):710–724, 2013.49
[19]M. Hasnat, J. Bohné, J. Milgram, S. Gentric, L. Chen, et al. von mises-fisher mixture model-based deep learning: Application to face verification. arXivpreprint arXiv:1706.04264, 2017.
[20]K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
[21]J. Hu, L. Peng, and L. Zheng. Xface: a face recognition system for android mobile phones. In 2015 IEEE 3rd International Conference on Cyber-PhysicalSystems, Networks, and Applications, pages 13–18. IEEE, 2015.
[22]G. B. Huang, M. Mattar, H. Lee, and E. Learned-Miller. Learning to align from scratch. InNIPS, 2012.
[23]J. Huang, V. Rathod, C. Sun, M. Zhu, A. Korattikara, A. Fathi, I. Fischer,Z. Wojna, Y. Song, S. Guadarrama, et al. Speed/accuracy trade-offs for modern convolutional object detectors. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 7310–7311, 2017.
[24]H.-K. Jee, S.-U. Jung, and J.-H. Yoo. Liveness detection for embedded face recognition system. International Journal of Biological and Medical Sciences,1(4):235–238, 2006.
[25]J. Johnson. Benchmarks for popular cnn models. https://github.com/jcjohn-son/cnn-benchmarks, 2017.
[26]L. Juranek, J. Stastny, V. Skorpil, and L. Junek. Acceleration of server-side image processing by client-side pre-processing in web application environment. In2019 42nd International Conference on Telecommunications andSignal Processing (TSP), pages 127–130. IEEE, 2019.
[27]V. Kazemi and J. Sullivan. One millisecond face alignment with an ensemble of regression trees. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 1867–1874, 2014.50
[28]M. Khamis, F. Alt, and A. Bulling. The past, present, and future of gaze-enabled handheld mobile devices: Survey and lessons learned. In Proceedings of the 20th International Conference on Human-Computer Interaction withMobile Devices and Services, page 38. ACM, 2018.
[29]S. Kim, Y. Ban, and S. Lee. Face liveness detection using a light field camera.Sensors, 14(12):22471–22499, 2014.
[30]W. Kim, S. Suh, and J.-J. Han. Face liveness detection from a single image via diffusion speed model.IEEE transactions on Image processing, 24(8):2456–2465, 2015.
[31]. King. Tensorflow.js. https://www.tensorflow.org/js, 2017.
[32]D. King. Dlib-high-quality-face-recognition-with-deep. http://blog.dlib.net/2017/02/high-quality-face-recognition-with-deep.html, 2017.
[33]K.Kollreider, H.Fronthaler, andJ.Bigun. Evaluating liveness by face images and the structure tensor. In4th IEEE Workshop on Automatic IdentificationAdvanced Technologies Location, Buffalo, NY, USA, OCT 17-18, 2005, pages75–80. IEEE Press, 2005.
[34]A. Lagorio, M. Tistarelli, M. Cadoni, C. Fookes, and S. Sridharan. Liveness detection based on 3d face shape analysis. In2013 International Workshop onBiometrics and Forensics (IWBF), pages 1–4. IEEE, 2013.
[35]J.Li, Y.Wang, T.Tan, andA.K.Jain. Live face detection based on the analysis of fourier spectra. InBiometric Technology for Human Identification, volume5404, pages 296–303. International Society for Optics and Photonics, 2004.
[36]J.-W.Li. Eye blink detection based on multiple gabor response waves. In2008International Conference on Machine Learning and Cybernetics, volume 5, pages 2852–2856. IEEE, 2008.
[37]J. Liu, Y. Deng, T. Bai, Z. Wei, and C. Huang. Targeting ultimate accuracy: Face recognition via deep embedding. arXiv preprint arXiv:1506.07310,2015.
[38]Y. Liu, H. Li, and X. Wang. Rethinking feature discrimination and polymerization for large-scale recognition.arXiv preprint arXiv:1710.00870, 2017.
[39]N. Marangunić and A. Granić. Technology acceptance model: a literature review from 1986 to 2013. Universal Access in the Information Society,14(1):81–95, 2015.
[40]V.Mühler. face-api.js—javascript api for face recognition in the browser with tensorflow.js. https://github.com/justadudewhohacks/face-api.js, 2018.
[41]A. Naitsat and Y. Y. Zeevi. Face anti-spoofing based on projective invariants.In 2018 IEEE International Conference on the Science of Electrical Engineer-ing in Israel (ICSEE), pages 1–5. IEEE, 2018.
[42]T. Ojala, M. Pietikäinen, and T. Mäenpää. Multi resolution grayscale and rotation invariant texture classification with local binary patterns.IEEE Trans-actions on Pattern Analysis & Machine Intelligence, (7):971–987, 2002.
[43]G. Pan, L. Sun, Z. Wu, and S. Lao. Eye blink-based anti-spoofing in face recognition from a generic web camera. In2007 IEEE 11th International Conference on Computer Vision, pages 1–8. IEEE, 2007.
[44]K. Patel, H. Han, and A. K. Jain. Secure face unlock: Spoof detection on smart phones.IEEE transactions on information forensics and security,11(10):2268–2283, 2016.
[45]D.RamananandX.Zhu. Face detection, pose estimation, and landmark localization in the wild. InProceedings of the 2012 IEEE Conference on ComputerVision and Pattern Recognition (CVPR), pages 2879–2886. Citeseer, 2012.
[46]R. Ranjan, C. D. Castillo, and R. Chellappa. L2-constrained softmax loss for discriminative face verification.arXiv preprint arXiv:1703.09507, 2017.
[47]J. Redmon and A. Farhadi. Yolo9000: better, faster, stronger. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages7263–7271, 2017.
[48]S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 fps via regressing local binary features. InProceedings of the IEEE Conference on ComputerVision and Pattern Recognition, pages 1685–1692, 2014.
[49]S. Ribaric, A. Ariyaeeinia, and N. Pavesic. De-identification for privacy protection in multimedia content: A survey.Signal Processing: Image Communication, 47:131–151, 2016.
[50]A. Roy, N. Memon, and A. Ross. Masterprint: Exploring the vulnerability of partial fingerprint-based authentication systems.IEEE Transactions on Information Forensics and Security, 12(9):2013–2025, 2017.
[51]C.Sagonas, E.Antonakos, G.Tzimiropoulos, S.Zafeiriou, and M.Pantic. 300faces in-the-wild challenge: Database and results.Image and vision computing, 47:3–18, 2016.
[52]C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 397–403, 2013.
[53]C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. A semi-automatic methodology for facial landmark annotation. InProceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 896–903, 2013.
[54]A. F. Sequeira, J. Murari, and J. S. Cardoso. Iris liveness detection methods in mobile applications. In2014 International Conference on Computer VisionTheory and Applications (VISAPP), volume 3, pages 22–33. IEEE, 2014.
[55]D. Shang, X. Zhang, and X. Xu. Face and lip-reading authentication system based on android smart phones. In2018ChineseAutomationCongress(CAC),pages 4178–4182. IEEE.
[56]M. Smiatacz. Liveness measurements using optical flow for biometric person authentication. Metrology and Measurement Systems, 19(2):257–268, 2012.
[57]M. Wang and W. Deng. Deep face recognition: A survey.arXiv preprint arXiv:1804.06655, 2018.
[58]D. Wen, H. Han, and A. K. Jain. Face spoof detection with image distortion analysis. IEEE Transactions on Information Forensics and Security, 10(4):746–761, 2015.
[59]Y.WuandQ. Ji. Facial landmark detection: A literature survey. InternationalJournal of Computer Vision, 127(2):115–142, 2019.
[60]X. Ying, X. Li, and M. C. Chuah. Liveface: A multi-task cnn for fast face-authentication. In2018 17th IEEE International Conference on MachineLearning and Applications (ICMLA), pages 955–960. IEEE, 2018.
[61]H.Yu,T.-T.Ng,andQ.Sun. Recaptured photo detection using specularity distribution. In2008 15th IEEE International Conference on Image Processing, pages 3140–3143. IEEE, 2008.
[62]J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine auto-encoder net-works (cfan) for real-time face alignment. InEuropean conference on com-puter vision, pages 1–16. Springer, 2014.
[63]Y.Zhang,R.K.Dubey,G.Hua,andV.L.Thing. Face spoofing video detection using spatio-temporal statistical binary pattern. InTENCON 2018-2018 IEEERegion 10 Conference, pages 0309–0314. IEEE, 2018.
[64]Z. Zhang, P. Luo, C. C. Loy, and X. Tang. Facial landmark detection by deep multi-task learning. InEuropean conference on computer vision, pages 94–108. Springer, 2014.
[65]S. Zhu, C. Li, C. Change Loy, and X. Tang. Face alignment by coarse-to-fine shape searching. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 4998–5006, 2015.
[66]X. Zhu, Z. Lei, X. Liu, H. Shi, and S. Li. Face alignment across large poses:a 3d solution (2015).arXiv preprint arXiv:1511.07212.