成功大學博碩士論文系統

簡易檢索 / 詳目顯示

回結果列表

研究生：	蘇玫甄 Su, Mei-Chen
論文名稱：	手機即時室內定位系統基於單張影像後方交會和行人航位推算 Real Time Indoor Positioning Based on Image Resection and PDR
指導教授：	江凱偉 Chiang, Kai-Wei
學位類別：	碩士 Master
系所名稱：	工學院 - 測量及空間資訊學系 Department of Geomatics
論文出版年：	2020
畢業學年度：	108
語文別：	英文
論文頁數：	96
中文關鍵詞：	手機即時室內定位、影像定位、影像辨識、影像匹配、後方交會、行人航位推算
外文關鍵詞：	Real Time Indoor Positioning on Smartphone, VisionBased Positioning, Image Recognition, Image Matching, Resection, Pedestrian Dead Reckoning
相關次數：	點閱：157 下載：18
分享至:	分享至facebook 分享至twitter

查詢本校圖書館目錄查詢臺灣博碩士論文知識加值系統勘誤回報

隨著手機導航與定位普及於日常生活中，適地性服務(Location Based Service, LBS)因此變成熱門議題，目前於室外環境下可利用全球衛星定位系統(Global Navigation Satellite System, GNSS)結合慣性導航系統(Inertial Navigation System, INS)和一些地圖約制的演算法來達成獲得位置資訊的目標。然而室內因遮蔽問題無法接收到衛星訊號，為了使LBS在室內環境下也能延續作用，故各項室內定位技術開始發展起來。其中基於視覺辨識的定位，因不需要基礎建設且精度可達到期望的水準，較具備競爭力。隨著科技進步，每台智慧型手機都配備相機功能，手機的計算能力、圖像處理能力都能克服視覺辨識處理時間過長的問題，在影像定位的前提下，此方法可以在較少的時間定位出準確的位置。
因此本研究設計了一個應用程式，利用設置方框在自然景物周圍的方式來大幅減少影像處理時間，可在離線階段利用已事先進行過相機率定的手機，結合開放式資料庫OpenCV中的Canny邊際萃取、輪廓偵測等演算法，使手機可以快速尋找到框的位置，並與資料庫進行ORB影像匹配，提取出在資料庫中框內自然地物的區域坐標，並利用單張影像後方交會的原理來進行室內定位，此方法可以在不利用硬體設備的情況下有效的進行即時影像室內定位，且誤差也不隨時間累積，其可達公分等級的精度。並將此技術搭配行人航位推算 (Pedestrian Dead Reckoning, PDR)，計算出連續的使用者位置資訊並減低整體的運算負荷，展示於室內地圖上，透過影像定位來校正行人航位推算隨時間累積的誤差，結合兩技術的優點，達成快速精準的室內定位技術。該演算法可以在離線狀態有效地於資料庫中匹配物件，並達到公分級的定位精度，為一種低成本、高處理速度和高精準度的室內定位技術。

An astonishing growth of smartphone usage and real time navigation popularity have been witnessed in recent years. Hence, Location Based Service (LBS) has become increasingly important for a rising number of applications in different field. In outdoor environments, the Global Navigation Satellite System (GNSS) can be exploited in conjunction with Inertial Navigation Systems (INS) and some algorithms of map constraint to achieve the goal for obtaining the precise position information. However, in indoor environments, satellite signal cannot be received due to the shadowing problem, so that indoor positioning technique should seek out other technologies to get location information. Consequently, various indoor positioning technologies began to develop and lots of service are provided nowadays. Particularly, vision-based technology has main advantages including the infrastructure is not necessary and the accuracy has reached appreciable levels. If the time burden of image processing can be improved, vision-based has a good prospect since the growth of computational capabilities, image processing, and the popularity of smartphone built-in camera.
Therefore, the research designs an application on mobile phone, not only attaches markers on object to decrease processing time, but also does camera calibration to improve the accuracy in advance. In addition, the research develops an algorithm assisted by Canny and contour detection algorithm of OpenCV library to find markers effectively. In offline stage, the application has constructed a database of control points in object coordinate system and the coefficient of Interior Orientation Parameters (IOPs). Under these circumstances, user just takes one photo then the application can detect those markers and doing ORB matching with RANSAC to retrieve those attributes according objects from database. The application can successfully match objects from database and through space resection to achieve indoor positioning in centimeter-level. Next, vision-based positioning combines with Pedestrian Dead Reckoning (PDR) to calculate continuous user’s position and reduce the overall computational burden, then display user trajectory on the indoor map. Furthermore, vision-based positioning can calibrate the error which increases over time and produced by PDR and take their respective advantages to achieve rapid and accurate indoor positioning technology. Overall, the indoor positioning technology which is proposed by the research is a low cost, high processing speed and high accuracy real time method.

Content
摘要 ........................................................................................................................................... I
Abstract .................................................................................................................................. III
致謝 .......................................................................................................................................... V
Content ................................................................................................................................... VI
List of Tables......................................................................................................................... IX
List of Figures ......................................................................................................................... X
Chapter 1 Introduction................................................................................................ 1
1 Motivation and Problem Statement ............................................................................... 1
2 Objectives and Contributions....................................................................................... 3
3 Thesis Outline................................................................................................................... 4
Chapter 2 Background................................................................................................. 6
1 Background to Radio Frequency (RF) based indoor navigation on smartphone..... 6
1.1 Wireless Local Area Networks (WLAN) based positioning................................... 7
1.2 Bluetooth Low Energy (BLE) based positioning...................................................... 9
1.3 Summary ...................................................................................................................... 10
2 Background to Vision-based Indoor Positioning ....................................................... 11
3 Background to Inertial Navigation (self-contained sensor)...................................... 13
4 Background to Magnetic Field Magnitude (MFM) based Indoor Positioning....... 14
Chapter 3 Vision-based Indoor Positioning Assisted with PDR....................... 16
1 Coordinate System......................................................................................................... 16
1.1 Object Coordinate System ......................................................................................... 17
1.2 Camera Coordinate System ....................................................................................... 19
1.3 Digital Image Coordinate System............................................................................. 20
1.4 Sensor Coordinate System......................................................................................... 22
2 Application System Architecture ................................................................................. 23
3 Database Introduction.................................................................................................... 25
3.1 SQLite........................................................................................................................... 26
3.2 Database Design.......................................................................................................... 27
4 Camera Calibration ........................................................................................................ 29
5 Space Resection.............................................................................................................. 31
6 Precision Indexes............................................................................................................ 34
7 Pedestrian Dead Reckoning Algorithm....................................................................... 36
Chapter 4 Image Processing ..................................................................................... 40
1 Marker-based and Feature-based Positioning............................................................. 40
2 The Flow Chart of Image Processing .......................................................................... 41
3 OpenCV Introduction .................................................................................................... 42
4 Grayscale ......................................................................................................................... 43
5 Gaussian Blur.................................................................................................................. 45
6 Canny Edge Detection ................................................................................................... 47
7 Find Contour ................................................................................................................... 49
8 Image Matching.............................................................................................................. 53
8.1 SIFT .............................................................................................................................. 54
8.2 SURF ............................................................................................................................ 54
8.3 ORB .............................................................................................................................. 55
9 Image Retrieval............................................................................................................... 56
10 Lens Distortion Calibration ........................................................................................ 58
11 Positioning Algorithm ................................................................................................. 61
Chapter 5 Results and Analysis................................................................................ 62
1 The Interface of Application System on Mobile Phone............................................ 62
2 Experiment Place............................................................................................................ 63
3 Camera Calibration Result and Lens Distortion ........................................................ 65
4 Database Interface .......................................................................................................... 68
5 Vision-based Indoor Positioning Result...................................................................... 69
5.1 Image Processing and Matching Result ................................................................... 71
5.2 Space Resection Accuracy Evaluation..................................................................... 74
6 PDR Trajectory Result...................................................................................................... 76
Chapter 6 Conclusions and Recommendations.................................................... 86
1 Conclusions..................................................................................................................... 86
2 Thesis Contributions ...................................................................................................... 87
3 Recommendations .......................................................................................................... 88
Reference ............................................................................................................................... 90
                                    

Ahn, J., Heo, J., Lim, S., Kim, W., A study on the application of patient location data for ubiquitous healthcare system based on LBS, 2008 10th International Conference on Advanced Communication Technology. IEEE, pp. 2140-2143. 2008.
Al-Ammar, M.A., Alhadhrami, S., Al-Salman, A., Alarifi, A., Al-Khalifa, H.S., Alnafessah, A., Alsaleh, M., Comparative survey of indoor positioning technologies, techniques, and algorithms, 2014 International Conference on Cyberworlds. IEEE, pp. 245-252. 2014.
Amani, N., Dehghanian, V., Nielsen, J., User-induced antenna variation and its impact on the performance of RSS-based indoor positioning, 2016 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). IEEE, pp. 1-5. 2016.
Aoki, H., Schiele, B., Pentland, A., Realtime personal positioning system for a wearable computer, Digest of Papers. Third International Symposium on Wearable Computers. IEEE, pp. 37-43. 1999.
Ban, R., Kaji, K., Hiroi, K., Kawaguchi, N., Indoor positioning method integrating pedestrian Dead Reckoning with magnetic field and WiFi fingerprints, 2015 Eighth international conference on mobile computing and ubiquitous networking (ICMU). IEEE, pp. 167-172. 2015.
Blankenbach, J., Norrdine, A., Position estimation using artificial generated magnetic fields, 2010 International Conference on Indoor Positioning and Indoor Navigation. IEEE, pp. 1-5. 2010.
Bradski, G., Kaehler, A., Learning OpenCV: Computer vision with the OpenCV library. " O'Reilly Media, Inc.". 2008.
Bradski, G., Kaehler, A., Pisarevsky, V., Learning-Based Computer Vision with Intel's Open Source Computer Vision Library. Intel technology journal 9. 2005.
Brajdic, A., Harle, R., Walk detection and step counting on unconstrained smartphones, Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, pp. 225-234. 2013.
Davidson, P., Piché, R., A survey of selected indoor positioning methods for smartphones. IEEE Communications Surveys & Tutorials 19, 1347-1370. 2016.
Ding, L., Goshtasby, A., On the Canny edge detector. Pattern Recognition 34, 721-725. 2001.
Easa, S.M., Space resection in photogrammetry using collinearity condition without linearisation. Survey Review 42, 40-49. 2010.
El-Rabbany, A., Lymer, D., Datums, Coordinate Systems and GPS.
Elloumi, W., Latoui, A., Canals, R., Chetouani, A., Treuillet, S., Indoor pedestrian localization with a smartphone: A comparison of inertial and vision-based methods. IEEE Sensors Journal 16, 5376-5388. 2016.
Graham, R.L., Yao, F.F., Finding the convex hull of a simple polygon. Journal of Algorithms 4, 324-331. 1983.
Group, I.W., Wireless LAN medium access control (MAC) and physical layer (PHY) specifications, amendment 6: Enhancements for high efficiency WLAN. IEEE P802. 11ax D 2, 2. 2018.
Guo, Q., Deng, W.H., Bebek, O., Cavusoglu, M.C., Mastrangelo, C.H., Young, D.J., Personal inertial navigation system assisted by MEMS ground reaction sensor array and interface ASIC for GPS-denied environment. IEEE Journal of Solid-State Circuits 53, 3039-3049. 2018.
Han, J., Haihong, E., Le, G., Du, J., Survey on NoSQL database, 2011 6th international conference on pervasive computing and applications. IEEE, pp. 363-366. 2011.
Harle, R., A survey of indoor inertial positioning systems for pedestrians. IEEE Communications Surveys & Tutorials 15, 1281-1293. 2013.
Heikkila, J., Silven, O., A four-step camera calibration procedure with implicit image correction, Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE, pp. 1106-1112. 1997.
Honkavirta, V., Perala, T., Ali-Loytty, S., Piché, R., A comparative survey of WLAN location fingerprinting methods, 2009 6th workshop on positioning, navigation and communication. IEEE, pp. 243-251. 2009.
Jahn, J., Batzer, U., Seitz, J., Patino-Studencka, L., Boronat, J.G., Comparison and evaluation of acceleration based step length estimators for handheld devices, 2010 International Conference on Indoor Positioning and Indoor Navigation. IEEE, pp. 1-6. 2010.
Karami, E., Prasad, S., Shehata, M., Image matching using SIFT, SURF, BRIEF and ORB: performance comparison for distorted images. arXiv preprint arXiv:1710.02726. 2017.
Kawaji, H., Hatada, K., Yamasaki, T., Aizawa, K., An image-based indoor positioning for digital museum applications, 2010 16th International Conference on Virtual Systems and Multimedia. IEEE, pp. 105-111. 2010.
Khalajmehrabadi, A., Gatsis, N., Akopian, D., Modern WLAN fingerprinting indoor positioning methods and deployment challenges. IEEE Communications Surveys & Tutorials 19, 1974-2002. 2017.
Kim, G., Petriu, E.M., Fiducial marker indoor localization with artificial neural network, 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. IEEE, pp. 961-966. 2010.
Kim, J., Jun, H., Vision-based location positioning using augmented reality for indoor navigation. IEEE Transactions on Consumer Electronics 54, 954-962. 2008.
Kim, S.-E., Kim, Y., Yoon, J., Kim, E.S., Indoor positioning system using geomagnetic anomalies for smartphones, 2012 International conference on indoor positioning and indoor navigation (IPIN). IEEE, pp. 1-5. 2012.
Kutty, S.B., Saaidin, S., Yunus, P.N.A.M., Hassan, S.A., Evaluation of canny and sobel operator for logo edge detection, 2014 International Symposium on Technology Management and Emerging Technologies. IEEE, pp. 153-156. 2014.
Li, B., Gallagher, T., Dempster, A.G., Rizos, C., How feasible is the use of magnetic field alone for indoor positioning?, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN). IEEE, pp. 1-9. 2012.
Li, C.H., Chuang, K.W., Liao, J.K., Chu, C.H., Tsai, G.J., U.S. Patent Application. 2015.
Liang, J.Z., Corso, N., Turner, E., Zakhor, A., Image based localization in indoor environments, 2013 Fourth International Conference on Computing for Geospatial Research and Application. IEEE, pp. 70-75. 2013.
Liu, H., Darabi, H., Banerjee, P., Liu, J., Survey of wireless indoor positioning techniques and systems. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 37, 1067-1080. 2007.
Liu, S., Jiang, Y., Striegel, A., Face-to-face proximity estimationusing bluetooth on smartphones. IEEE Transactions on Mobile Computing 13, 811-823. 2013.
Mao, G., Fidan, B., Anderson, B.D., Wireless sensor network localization techniques. Computer networks 51, 2529-2553. 2007.
Marengoni, M., Stringhini, D., High level computer vision using opencv, 2011 24th SIBGRAPI Conference on Graphics, Patterns, and Images Tutorials. IEEE, pp. 11-24. 2011.
Mautz, R., Tilch, S., Survey of optical indoor positioning systems, 2011 international conference on indoor positioning and indoor navigation. IEEE, pp. 1-7. 2011.
Nurminen, H., Dashti, M., Piché, R., A survey on wireless transmitter localization using signal strength measurements. Wireless Communications and Mobile Computing 2017. 2017.
Paek, J., Ko, J., Shin, H., A measurement study of BLE iBeacon and geometric adjustment scheme for indoor location-based mobile applications. Mobile Information Systems 2016. 2016.
Powar, J., Gao, C., Harle, R., Assessing the impact of multi-channel BLE beacons on fingerprint-based positioning, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN). IEEE, pp. 1-8. 2017.
Röbesaat, J., Zhang, P., Abdelaal, M., Theel, O., An improved BLE indoor localization with Kalman-based fusion: An experimental study. Sensors 17, 951. 2017.
Rublee, E., Rabaud, V., Konolige, K., Bradski, G., ORB: An efficient alternative to SIFT or SURF, 2011 International conference on computer vision. Ieee, pp. 2564-2571. 2011.
Sadoun, B., Al-Bayari, O., LBS and GIS technology combination and applications, 2007 IEEE/ACS International Conference on Computer Systems and Applications. IEEE, pp. 578-583. 2007.
Saravanan, C., Color image to grayscale image conversion, 2010 Second International Conference on Computer Engineering and Applications. IEEE, pp. 196-199. 2010.
Seco, F., Jiménez, A.R., Prieto, C., Roa, J., Koutsou, K., A survey of mathematical methods for indoor localization, 2009 IEEE International Symposium on Intelligent Signal Processing. IEEE, pp. 9-14. 2009.
Shao, W., Zhao, F., Wang, C., Luo, H., Muhammad Zahid, T., Wang, Q., Li, D., Location fingerprint extraction for magnetic field magnitude based indoor positioning. Journal of Sensors 2016. 2016.
Sharp, I., Yu, K., Guo, Y.J., GDOP analysis for positioning system design. IEEE Transactions on Vehicular Technology 58, 3371-3382. 2009.
Storms, W., Shockley, J., Raquet, J., Magnetic field navigation in an indoor environment, 2010 Ubiquitous Positioning Indoor Navigation and Location Based Service. IEEE, pp. 1-10. 2010.
Suzuki, S., Topological structural analysis of digitized binary images by border following. Computer vision, graphics, and image processing 30, 32-46. 1985.
Tae-Hyun, H., In-Hak, J., Seong-Ik, C., Detection of traffic lights for vision-based car navigation system, Pacific-Rim Symposium on Image and Video Technology. Springer, pp. 682-691. 2006.
Thompson, M.M., Eller, R.C., Radlinski, W.A., Speert, J.L., Manual of photogrammetry. American Society of Photogrammetry Falls Church, Va. 1966.
Wang, E., Yan, W., iNavigation: an image based indoor navigation system. Multimedia tools and applications 73, 1597-1615. 2014.
Wolf, P.R., Dewitt, B.A., Elements of photogrammetry: with applications in GIS. McGraw-Hill New York. 2000.
Xiao, C., Yang, D., Chen, Z., Tan, G., 3-D BLE indoor localization based on denoising autoencoder. IEEE Access 5, 12751-12760. 2017.
Xu, J., He, H., Qin, F., Chang, L., A novel autonomous initial alignment method for strapdown inertial navigation system. IEEE Transactions on Instrumentation and Measurement 66, 2274-2282. 2017.
Zhao, X., Xiao, Z., Markham, A., Trigoni, N., Ren, Y., Does BTLE measure up against WiFi? A comparison of indoor location performance, European Wireless 2014; 20th European Wireless Conference. VDE, pp. 1-6. 2014.

校內：2021-07-31公開
校外：2021-07-31公開

簡易檢索 / 詳目顯示

相關論文