| 研究生: |
林家珍 Lin, Jia-Jhen |
|---|---|
| 論文名稱: |
基於偽曝光類HDR圖像融合方法的金屬反光表面3D掃描技術 A Novel 3D Scanning Technique for Reflective Metal Surface Based on HDR-like Image From Pseudo Exposure Image Fusion Method |
| 指導教授: |
劉建聖
Liu, Chien-Sheng |
| 學位類別: |
碩士 Master |
| 系所名稱: |
工學院 - 機械工程學系 Department of Mechanical Engineering |
| 論文出版年: | 2022 |
| 畢業學年度: | 110 |
| 語文別: | 中文 |
| 論文頁數: | 104 |
| 中文關鍵詞: | 結構光 、三維掃描 、金屬反光重建 、偽曝光 、圖像融合 |
| 外文關鍵詞: | Structured light, 3D scanning, Metal reflection, Pseudo-exposure, Image fusion |
| 相關次數: | 點閱:117 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近年來,低成本、高效益的三維掃描器,結合視覺測量的逆向工程已經廣泛的應用在眾多的領域,如在生物醫學:牙齒、牙模重建、人體體型的量測;工業檢測:工件之粗糙度量測、質量控制和逆向工程、逆向工程…等,皆大量運用了三維掃描機來達成三維重建以及分析。其中結構光掃描系統對於高反射率材質進行重建時,會因為表面產生的反射光,導致相機拍攝該區域時產生飽和,造成資訊遺失或錯誤,最終影響重建精度。
因此本研究的目的是透過文獻的研究與比較,提出一套能針對金屬材質的物體進行三維重建,並解決反光問題的系統。本研究將利用偽曝光的影像融合方式,透過參考圖關係的計算來產生偽曝光圖像,再透過影像融合的方式來達到高動態圖像的效果,希望透過此系統,在使用結構光掃描金屬物件上的精度與效率有所提升。並透過全因子實驗設計,找到最佳的實驗參數,根據實驗結果,本研究提出的方法可以有效的解決金屬反光掃描的問題,達到預期的精度,透過偽曝光的方式,可以減少拍攝的照片,有效的提升掃描效率。
In recent years, 3D scanners have been widely used in many fields, such as biomedicine, industrial inspection, quality control and reverse engineering etc. They all use 3D scanners to achieve 3D reconstruction and analysis. Among them, when using structured light to scan a metal workpiece, the reflected light generated by the surface will cause the camera's sensor to be saturated during the shooting process. It will lead to the information loss or error, and ultimately affect the reconstruction accuracy.
In this thesis, by reviewing and comparing the literature, we propose a system that can solve reflection problems and reconstruct metallic objects. We will calculate the relationship of the reference image, and generate a pseudo-exposed image through the relationship, and then use the method of image fusion to achieve the effect of high dynamic image. It is hoped that through this system, metal objects can be scanned with structured light, improving precision and efficiency. According to the experimental results, the method proposed in this thesis can effectively solve the problem of metal reflection scanning and achieve the expected accuracy. Through pseudo exposure, the number of photos can be reduced and the scanning efficiency can be effectively improved.
[1] 3D Scanner-Global Market Outlook (2016-2022) from:https://www.orbisresearch.com/reports/index/3d-scanner-global-market-outlook-2016-2022
[2] G. Mansour, “A developed algorithm for simulation of blades to reduce the measurement points and time on coordinate measuring machine (CMM),” Measurement (2014), 54 51 –57.
[3] A. Weckenmann, G. Peggs and J. Hoffmann, "Probing systems for dimensional micro- and nano-metrology", Meas. Sci. Technol., vol. 17, no. 3, (2006): 504-509
[4] Wu, Ke, et al. "An exposure fusion-based structured light approach for the 3D measurement of a specular surface." IEEE Sensors Journal 21.5 (2020): 6314-6324.
[5] Gupta, Shantanu Sen, Shifat Hossain, and Ki-Doo Kim. "HDR-like image from pseudo-exposure image fusion: A genetic algorithm approach." IEEE Transactions on Consumer Electronics 67.2 (2021): 119-128.
[6] Gorthi, Sai Siva, and Pramod Rastogi. "Fringe projection techniques: whither we are?." Optics and lasers in engineering 48.ARTICLE (2010): 133-140.
[7] 張毓紋. "三維結構光量測方法與應用之回顧." 科儀新知 226 (2021): 7-23.
[8] Scharstein, Daniel, and Richard Szeliski. "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms." International journal of computer vision 47.1 (2002): 7-42.
[9] Blake, Randolph, and Hugh Wilson. "Binocular vision." Vision research 51.7 (2011): 754-770.
[10] Howard, Ian P., and Brian J. Rogers. Binocular vision and stereopsis. Oxford University Press, USA, (1995).
[11] Sun, Xiyan, et al. "Distance measurement system based on binocular stereo vision." IOP Conference Series: Earth and Environmental Science. Vol. 252. No. 5. IOP Publishing, (2019).
[12] Zhang, Song. "High-speed 3D shape measurement with structured light methods: A review." Optics and Lasers in Engineering 106 (2018): 119-131.
[13] Moring, Ilkka, et al. "Acquisition of three-dimensional image data by a scanning laser range finder." Optical engineering 28.8 (1989): 897-902.
[14] Lange, Robert, et al. "Time-of-flight range imaging with a custom solid state image sensor." Laser Metrology and Inspection. Vol. 3823. International Society for Optics and Photonics, (1999).
[15] Hussmann, Stephan, Thorsten Ringbeck, and Bianca Hagebeuker. "A performance review of 3D TOF vision systems in comparison to stereo vision systems." Stereo vision 372 (2008).
[16] Wehr, Aloysius, and Uwe Lohr. "Airborne laser scanning—an introduction and overview." ISPRS Journal of photogrammetry and remote sensing 54.2-3 (1999): 68-82.
[17] Axelsson, Peter. "Processing of laser scanner data—algorithms and applications." ISPRS Journal of Photogrammetry and Remote Sensing 54.2-3 (1999): 138-147.
[18] Elmqvist, M., et al. "Terrain modelling and analysis using laser scanner data." International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences 34.3/W4 (2001): 219-226.
[19] Stafne, M. A., Larry D. Mitchell, and Robert L. West. "Positional calibration of galvanometric scanners used in laser Doppler vibrometers." Measurement 28.1 (2000): 47-59.
[20] Isa, Mohammed A., and Ismail Lazoglu. "Design and analysis of a 3D laser scanner." Measurement 111 (2017): 122-133.
[21] Kusnoto, Budi, and Carla A. Evans. "Reliability of a 3D surface laser scanner for orthodontic applications." American Journal of Orthodontics and Dentofacial Orthopedics 122.4 (2002): 342-348.
[22] Pages, Jordi, and Joaquim Salvi. "Coded light projection techniques for 3D reconstruction." J3eA 4 (2005): 001.
[23] Salvi, Joaquim, Jordi Pages, and Joan Batlle. "Pattern codification strategies in structured light systems." Pattern recognition 37.4 (2004): 827-849.
[24] 劉治中,周錫珉. "結構光三維成像及其編碼技術." 科儀新知 219 (2019): 25-37.
[25] Tajima, Johji, and Masato Iwakawa. "3-D data acquisition by rainbow range finder." [1990] Proceedings. 10th International Conference on Pattern Recognition. Vol. 1. IEEE, 1990.
[26] Cheng, Fang-Hsuan, Chien-Te Lu, and Yea-Shuan Huang. "3D object scanning system by coded structured light." 2010 Third International Symposium on Electronic Commerce and Security (ISECS 2010). IEEE Computer Society, 2010.
[27] Klein, Andreas. "Linear feedback shift registers." Stream Ciphers. Springer, London, 2013. 17-58.
[28] Zhang, Li, Brian Curless, and Steven M. Seitz. "Rapid shape acquisition using color structured light and multi-pass dynamic programming." Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission. IEEE, (2002).
[29] Posdamer, Jeffrey L., and Martin D. Altschuler. "Surface measurement by space-encoded projected beam systems." Computer graphics and image processing 18.1 (1982): 1-17.
[30] Gühring, Jens. "Dense 3D surface acquisition by structured light using off-the-shelf components." Videometrics and Optical Methods for 3D Shape Measurement. Vol. 4309. SPIE, (2000).
[31] Durdle, Nelson G., Jaishankar Thayyoor, and V. J. Raso. "An improved structured light technique for surface reconstruction of the human trunk." Conference Proceedings. IEEE Canadian Conference on Electrical and Computer Engineering (Cat. No. 98TH8341). Vol. 2. IEEE, 1998.
[32] V. Srinivasan, H. C. Liu, and M. Halioua, "Automated phase-measuring profilometry of 3-D diffuse objects," Appl. Opt. 23, 3105-3108 (1984)
[33] Feng S., Chen Q., Zuo C., Li R., Shen G. and Feng F. "Automatic identification and removal of outliers for highspeed fringe projection profilometry. " Opt. Eng. 52, 013605 (2013)
[34] Huang L. and Asundi A. K. "Phase invalidity identification framework with the temporal phase unwrapping method. " Meas. Sci. Technol. 22, 035304 (2011)
[35] Lu J., Mo R., Sun H., Chang Z. and Zhao X. " Invalid phase values removal method for absolute phase recovery. " Appl. Opt. 55, 387–394 (2016)
[36] Wang H., Kemao Q. and Soon S. H. "Valid point detection in fringe projection profilometry. "Opt. Express 23, (2015): 7535–7549
[37] Song, Zhan, et al. "A high dynamic range structured light means for the 3D measurement of specular surface." Optics and Lasers in Engineering 95 (2017): 8-16.
[38] D. Palousek, M. Omasta, D. Koutny, J. Bednar, T. Koutecky and F. Dokoupil, "Effect of matte coating on 3D optical measurement accuracy", Opt. Mater., vol. 40, pp. 1-9, Feb. 2015.
[39] Nayar, Shree K., Katsushi Ikeuchi, and Takeo Kanade. "Surface reflection: physical and geometrical perspectives." (1991): 611-634.
[40] Ri, Shien, Motoharu Fujigaki, and Yoshiharu Morimoto. "Intensity range extension method for three-dimensional shape measurement in phase-measuring profilometry using a digital micromirror device camera." Applied optics 47.29 (2008): 5400-5407.
[41] Chen, Tongbo, et al. "Polarization and phase-shifting for 3D scanning of translucent objects." 2007 IEEE conference on computer vision and pattern recognition. IEEE, 2007.
[42] Rowe, M. P., et al. "Polarization-difference imaging: a biologically inspired technique for observation through scattering media." Optics letters 20.6 (1995): 608-610.
[43] Schechner, Yoav Y., and Nir Karpel. "Recovery of underwater visibility and structure by polarization analysis." IEEE Journal of oceanic engineering 30.3 (2005): 570-587.
[44] Wolff, Lawrence B. "Polarization camera for computer vision with a beam splitter." JOSA A 11.11 (1994): 2935-2945.
[45] Zhu, Zhenmin, et al. "Camera calibration method based on optimal polarization angle." Optics and Lasers in Engineering 112 (2019): 128-135.
[46] Salahieh, Basel, et al. "Multi-polarization fringe projection imaging for high dynamic range objects." Optics express 22.8 (2014): 10064-10071.
[47] Cai, Zewei, et al. "Structured light field 3D imaging." Optics express 24.18 (2016): 20324-20334.
[48] Liu, Gui-hua, Xian-Yong Liu, and Quan-Yuan Feng. "3D shape measurement of objects with high dynamic range of surface reflectivity." Applied optics 50.23 (2011): 4557-4565.
[49] Kowarschik, Richard M., et al. "Adaptive optical 3-D-measurement with structured light." Optical engineering 39.1 (2000): 150-158.
[50] Feng, Shijie, et al. "Fast three-dimensional measurements for dynamic scenes with shiny surfaces." Optics Communications 382 (2017): 18-27.
[51] Waddington, Christopher, and Jonathan Kofman. "Saturation avoidance by adaptive fringe projection in phase-shifting 3D surface-shape measurement." 2010 international symposium on optomechatronic technologies. IEEE, 2010.
[52] Waddington, Christopher, and Jonathan Kofman. "Camera-independent saturation avoidance in measuring high-reflectivity-variation surfaces using pixel-wise composed images from projected patterns of different maximum gray level." Optics Communications 333 (2014): 32-37.
[53] Zhang, Liang, et al. "High dynamic range 3D shape measurement based on the intensity response function of a camera." Applied Optics 57.6 (2018): 1378-1386.
[54] Li, Dong, and Jonathan Kofman. "Adaptive fringe-pattern projection for image saturation avoidance in 3D surface-shape measurement." Optics express 22.8 (2014): 9887-9901.
[55] Chen, Chao, et al. "Adaptive projection intensity adjustment for avoiding saturation in three-dimensional shape measurement." Optics Communications 410 (2018): 694-702.
[56] Lin, Hui, et al. "Adaptive digital fringe projection technique for high dynamic range three-dimensional shape measurement." Optics express 24.7 (2016): 7703-7718.
[57] Lin, Hui, et al. "Three-dimensional shape measurement technique for shiny surfaces by adaptive pixel-wise projection intensity adjustment." Optics and Lasers in Engineering 91 (2017): 206-215.
[58] Chen, Songlin, et al. "Analysis and reduction of phase errors caused by nonuniform surface reflectivity in a phase-shifting measurement system." Optical Engineering 56.3 (2017): 033102.
[59] Zhang, Song. "Rapid and automatic optimal exposure control for digital fringe projection technique." Optics and Lasers in Engineering 128 (2020): 106029.
[60] Babaie, Gelareh, Mehrdad Abolbashari, and Faramarz Farahi. "Dynamics range enhancement in digital fringe projection technique." Precision Engineering 39 (2015): 243-251.
[61] Sheng Hong, Jing Xu, and Song Zhang. "Dynamic projection theory for fringe projection profilometry." Applied optics 56.30 (2017): 8452-8460.
[62] Zhang Song, and Shing-Tung Yau. "High dynamic range scanning technique." Optical Engineering 48.3 (2009): 033604.
[63] Ekstrand Laura, and Song Zhang. "Autoexposure for three-dimensional shape measurement using a digital-light-processing projector." Optical Engineering 50.12 (2011): 123603.
[64] Zhong, Kai, et al. "Enhanced phase measurement profilometry for industrial 3D inspection automation." The International Journal of Advanced Manufacturing Technology 76.9 (2015)
[65] Feng, Shijie, et al. "General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique." Optics and Lasers in Engineering 59 (2014): 56-71.
[66] Zhang, Bin, Yuanxin Ouyang, and Shuo Zhang. "High dynamic range saturation intelligence avoidance for three-dimensional shape measurement." 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing. IEEE, 2015
[67] Rao, Li, and Feipeng Da. "High dynamic range 3D shape determination based on automatic exposure selection." Journal of Visual Communication and Image Representation 50 (2018): 217-226.
[68] Madden, Brian C. "Extended intensity range imaging." Technical Reports (CIS) (1993): 248.
[69] Debevec, Paul E., and Jitendra Malik. "Recovering high dynamic range radiance maps from photographs." ACM SIGGRAPH 2008 classes. 2008. 1-10.
[70] Jiang, Chufan, Tyler Bell, and Song Zhang. "High dynamic range real-time 3D shape measurement." Optics express 24.7 (2016): 7337-7346.
[71] R. Y. Tsai, “A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses,” IEEE J. Rob. Autom. 3, 323-344 (1987).
[72] Z. Zhang, “A Flexible New Technique for Camera Calibration,” IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330-1334 (2000).
[73] Yin, Yongkai, et al. "High dynamic range imaging for fringe projection profilometry with single-shot raw data of the color camera." Optics and Lasers in Engineering 89 (2017): 138-144.
[74] Chen, Yanming, Yuming He, and Eryi Hu. "Phase deviation analysis and phase retrieval for partial intensity saturation in phase-shifting projected fringe profilometry." Optics communications 281.11 (2008): 3087-3090.
[75] Hu, Eryi, Yuming He, and Yanming Chen. "Study on a novel phase-recovering algorithm for partial intensity saturation in digital projection grating phase-shifting profilometry." Optik 121.1 (2010): 23-28.
[76] Qi, Zhaoshuai, et al. "Error of image saturation in the structured-light method." Applied Optics 57.1 (2018): A181-A188.
[77] Lin, Hui, and Zhuqin Han. "Automatic optimal projected light intensity control for digital fringe projection technique." Optics Communications 484 (2021): 126574.
[78] Page, G. F. "MULTIPLE VIEW GEOMETRY IN COMPUTER VISION, by Richard Hartley and Andrew Zisserman, CUP, Cambridge, UK, 2003, vi+ 560 pp., ISBN 0-521-54051-8.(Paperback£ 44.95)." Robotica 23.2 (2005): 271-271.
[79] Faugeras, Olivier, and Quang-Tuan Luong. The geometry of multiple images: the laws that govern the formation of multiple images of a scene and some of their applications. MIT press, 2001.
[80] MathWorks, "What Is Camera Calibration?." , from https://ww2.mathworks.cn/help/vision/ug/camera-calibration.html
[81] Gray, Frank. "Pulse code communication. US Patent 2632058." (1953).
[82] Lanman, Douglas, and Gabriel Taubin. "Build your own 3D scanner: 3D photography for beginners." ACM siggraph 2009 courses. 2009. 1-94.
[83] Mertens, Tom, Jan Kautz, and Frank Van Reeth. "Exposure fusion: A simple and practical alternative to high dynamic range photography." Computer graphics forum. Vol. 28. No. 1. Oxford, UK: Blackwell Publishing Ltd, 2009.
[84] Burt, Peter J., and Edward H. Adelson. "A multiresolution spline with application to image mosaics." ACM Transactions on Graphics (TOG) 2.4 (1983): 217-236.
校內:2027-08-25公開