| 研究生: |
白宇傑 Pai, Yu-Chieh |
|---|---|
| 論文名稱: |
智慧型眼鏡軟體發展平台之建立 Building a Smart Glasses Software Development Platform |
| 指導教授: |
陳 敬
Chen, Jing |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
| 論文出版年: | 2017 |
| 畢業學年度: | 105 |
| 語文別: | 中文 |
| 論文頁數: | 110 |
| 中文關鍵詞: | 智慧型眼鏡 、開發平台 、即時影音串流 、應用軟體啟動器 |
| 外文關鍵詞: | Smart Glasses, development platform, live streaming, application launcher |
| 相關次數: | 點閱:151 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近年來,技術的演進見證了移動式和穿戴式裝置的進步速度不斷的加快,智慧型眼鏡的誕生使得新興應用如雨後春筍般冒出。不過由於智慧型眼鏡人機互動介面與傳統智慧型手機相異;以及各式應用還不明確情況下,導致廠商對於軟體支援部份仍無法投注大量心力,使得智慧型眼鏡應用程式開發者只能依賴傳統Android開發環境進行開發,徒增開發成本及負擔。
本論文設計之智慧型眼鏡軟體發展平台,提供開發環境讓智慧型眼鏡應用開發者使用,可增進應用程式開發之便利性。此發展平台由四個部份所組成:(1)使用基礎Eclipse平台作為開發引擎,並透過Eclipse處理應用程式專案;(2)提供即時影音串流及離線式語音辨識開發套件,預先完成應用開發基礎工作,開發者可直接使用;(3)加入開發套件使用輔助文件工具及應用程式視覺化介面設計開發工具,使得開發者進行智慧型眼鏡應用開發能更加順手;(4)配合橫向螢幕顯示重新設計智慧型眼鏡應用軟體啟動器,並加入語音控制功能讓眼鏡使用者無需動手即能操作。
本論文實作以Eclipse平台為基礎,將其擴充為智慧型眼鏡軟體發展平台。實作內容包含:(1)整合即時影音串流套件,並實作影音編碼方法;(2)新增離線式語音辨識函式;(3)實作智慧型眼鏡應用軟體啟動器,增進眼鏡操作體驗;(4)實作開發套件使用輔助文件工具,供開發者查詢函式使用方式;(5)修改並整合DroidDraw Android佈局介面設計工具,使其支援智慧型眼鏡螢幕顯示佈局設計。
本論文之主要貢獻為:設計一智慧型眼鏡軟體發展平台,其開發平台以Eclipse平台為基礎,加入了開發套件及開發工具,使得開發者能不需要重新熟悉開發環境下進行智慧型眼鏡應用開發。此外,配合眼鏡特殊的人機介面,重新設計智慧型眼鏡應用軟體啟動器,使得眼鏡使用者操作起來更加順手。
The birth of smart glasses makes the emerging application of wearable devices spring up like mushrooms. However, because of the uncertainty in application trend and the difference in human-computer interaction between smart glasses and popular smart phones, not only consumers hesitate but also manufactures do not invest much effort in software support. Therefore, developers of smart glasses applications can only rely on traditional Android application development tools and suffer from work load and cost.
This study builds a smart glasses software development platform to provide application developers a development environment which may enhance the convenience as well as productivity in building smart glasses applications. There are four parts in the design of this platform: (1) the Eclipse platform which, in addition to processing the application project, serves as the engine of development and the primary interface between the platform and developers; (2) SDK (Software Development Kit) which includes not only the SDKs commonly required to develop Android applications, but also SDKs pertinent to implementing desirable functionality of smart glasses applications, such as streaming and voice recognition; (3) development aids which serve as tools to help developers, such as design aid for application display layout; (4) an application launcher specific to smart glasses, which is a user interface suitable for operating smart glasses. With the capability of Eclipse, components can be integrated or removed as needed. Therefore, this platform features not only expandability but also flexibility.
The implementation of this platform is based on the original application development platform for Android system, which consists of Eclipse platform and Android SDK. This study extends the SDK by integrating, as components, an SDK for live streaming and an SDK for voice recognition. The part of development aids is achieved by porting Android display layout design tool, namely DroidDraw, and, in addition, implementing an Eclipse plug-in module for consulting API usage. The former supports the display resolutions of smart glasses. The application launcher is implemented as a user-space application which supports horizontal screen display and voice-operating capability.
The main contribution of this study is the development of a platform which is suitable for developing application software of smart glasses. This platform is based on Eclipse and existing Android system so that developers can avoid the burden of learning curve in adapting to a new development platform. It supports common features and basic requirements of smart glasses applications, such as horizontal display and voice control, with flexibility by integrating suitable SDK. It provides convenience by adding helpful and handy tools. In addition this platform is targeted at developing user space applications, the impact of system level dependency and hardware variety would not cause much effort or difficulty.
[1] Adapter, http://hi.baidu.com/laoyang1018/blog/item/b34b241f3c7b44d6a78669b1.html, accessed on 2016-10-24.
[2] Advanced Audio Coding, https://en.wikipedia.org/wiki/Advanced_Audio_Coding, accessed on 2016-11-25.
[3] Android, https://en.wikipedia.org/wiki/Android_(operating_system), accessed on 2016-09-24.
[4] Android application package, https://en.wikipedia.org/wiki/Android_application_package, accessed on 2016-09-24.
[5] Android Debug Bridge, https://developer.android.com/studio/command-line/adb.html, accessed on 2016-12-01.
[6] Android intent, https://developer.android.com/reference/android/content/Intent.html, accessed on 2016-10-26.
[7] Apache License, http://www.apache.org/licenses/LICENSE-2.0, accessed on 2016-09-24.
[8] App Components, https://developer.android.com/guide/components/index.html, accessed on 2016-09-24.
[9] Application programming interface, https://en.wikipedia.org/wiki/Application_programming_interface, accessed on 2016-09-24.
[10] CMU Sphinx, http://cmusphinx.sourceforge.net/, accessed on 2016-09-25.
[11] Concurrent Versions System, https://en.wikipedia.org/wiki/Concurrent_Versions_System, accessed on 2016-11-28.
[12] Dalvik https://en.wikipedia.org/wiki/Dalvik_(software), accessed on 2016-09-24.
[13] DroidDraw, https://github.com/sosiouxme/DroidDraw, accessed on 2016-10-26.
[14] Eclipse-PDE, http://www.eclipse.org/pde/, accessed on 2016-10-25.
[15] Eclipse Platform Technical Overview, http://www.eclipse.org/articles/Whitepaper-Platform-3.1/eclipse-platform-whitepaper.html, accessed on 2016-09-25.
[16] Epson Moverio BT-200 – provati in anteprima, http://www.webnews.it/2014/03/27/epson-moverio-bt-200-provati-in-anteprima/, accessed on 2016-09-24.
[17] Gesture recognition, https://en.wikipedia.org/wiki/Gesture_recognition, accessed on 2016-09-24.
[18] Glass Development Kit, https://developers.google.com/glass/develop/gdk/, accessed on 2016-09-25.
[19] Google Glass, https://en.wikipedia.org/wiki/Google_Glass, accessed on 2016-09-24.
[20] Google Glass : User Interface., https://developers.google.com/glass/design/ui, accessed on 2016-09-24.
[21] Google Glass embraced at Beth Israel Deaconess, https://www.bostonglobe.com/business/2014/04/08/beth-israel-use-google-glass-throughout-emergency-room/WhIXcVzkpn7MOCAhKuRJZL/story.html, accessed on 2016-09-24.
[22] Google Glass Enables Surgeons To Consult Remotely, http://www.informationweek.com/healthcare/mobile-and-wireless/google-glass-enables-surgeons-to-consult-remotely/d/d-id/1112837?, accessed on 2016-09-25.
[23] Google Glass makes doctors better surgeons, Stanford study shows, http://venturebeat.com/2014/09/16/docs-performed-surgery-better-wearing-google-glass-stanford-study-shows/, accessed on 2016-09-25.
[24] Google Glass Mirror API, https://developers.google.com/glass/develop/mirror/, accessed on 2016-10-13.
[25] Google Glass User Interface, https://developers.google.com/glass/design/ui, accessed on 2016-09-24.
[26] The Google Now weather card shows relevant information automatically., https://developers.google.com/glass/images/google-now-weather.png, accessed on 2016-09-24.
[27] H.264/MPEG-4 AVC, https://en.wikipedia.org/wiki/H.264/MPEG-4_AVC, accessed on 2016-09-25.
[28] HTTP Live Streaming, https://en.wikipedia.org/wiki/HTTP_Live_Streaming, accessed on 2016-09-25.
[29] Immersions, https://developers.google.com/glass/develop/gdk/immersions, accessed on 2016-09-25.
[30] Integrated development environment, https://en.wikipedia.org/wiki/Integrated_development_environment, accessed on 2016-09-23.
[31] IntelliJ IDEA, https://en.wikipedia.org/wiki/IntelliJ_IDEA, accessed on 2016-09-26.
[32] Intermediate representation, https://en.wikipedia.org/wiki/Intermediate_representation, accessed on 2016-11-25.
[33] IP Networks, http://citeseer.nj.nefc.com/schulzrinne00ip.html, accessed on 2016-10-15.
[34] Joint Video Team, http://www.itu.int/ITU-T/2005-2008/com16/jvt/, accessed on 2016-09-26.
[35] KitKat for Glass, https://support.google.com/glass/answer/4578099?hl=en, accessed on 2016-09-24.
[36] List of free and open-source software packages, https://en.wikipedia.org/wiki/List_of_free_and_open-source_software_packages, accessed on 2016-11-25.
[37] Lossy compression, https://en.wikipedia.org/wiki/Lossy_compression, accessed on 2016-11-14.
[38] MediaRecorder.AudioEncoder, https://developer.android.com/reference/android/media/MediaRecorder.AudioEncoder.html, accessed on 2016-11-27.
[39] MediaRecorder.OutputFormat, https://developer.android.com/reference/android/media/MediaRecorder.OutputFormat.html, accessed on 2016-11-27.
[40] MediaRecorder.VideoEncoder, https://developer.android.com/reference/android/media/MediaRecorder.VideoEncoder.html, accessed on 2016-11-28.
[41] Mercedes-Benz imagines seamless door-to-door directions with Google Glass, https://www.engadget.com/2013/07/29/mercedes-benz-google-glass/, accessed on 2016-09-25.
[42] OpenGL, https://en.wikipedia.org/wiki/OpenGL, accessed on 2016-09-24.
[43] OpenMAX, https://zh.wikipedia.org/wiki/OpenMAX, accessed on 2016-11-28.
[44] Overview of CMUSphinx toolkit, http://cmusphinx.sourceforge.net/wiki/tutorialoverview, accessed on 2016-11-27.
[45] Plug-in, https://en.wikipedia.org/wiki/Plug-in_(computing), accessed on 2016-09-23.
[46] Real Time Streaming Protocol (RTSP), https://tools.ietf.org/html/rfc2326, accessed on 2016-09-25.
[47] Real Time Streaming Protocol (RTSP), https://www.ietf.org/rfc/rfc2326.txt, accessed on 2016-10-11.
[48] RTP: A Transport Protocol for Real-Time Applications, https://tools.ietf.org/html/rfc3550, accessed on 2016-09-25.
[49] SDP: Session Description Protocol, https://tools.ietf.org/html/rfc4566, accessed on 2016-09-25.
[50] SiME Smart Glasses, http://cht.chipsip.com/computing/index.php?mode=data&id=126, accessed on 2016-09-24.
[51] Smart Glasses Comparison, http://www.chipsip.com/archive/SiME%20Smart%20Glasses_2015Jan(1).pdf, accessed on 2016-09-25.
[52] Speech recognition, https://en.wikipedia.org/wiki/Speech_recognition, accessed on 2016-09-26.
[53] SQLite, https://en.wikipedia.org/wiki/SQLite, accessed on 2016-09-24.
[54] Streaming media, https://en.wikipedia.org/wiki/Streaming_media, accessed on 2016-09-25.
[55] Surface, https://developer.android.com/reference/android/view/Surface.html, accessed on 2016-09-24.
[56] Thad Starner Home - College of Computing - Georgia Tech, http://www.cc.gatech.edu/fac/Thad.Starner/, accessed on 2016-12-11.
[57] ThumbnailUtils, https://developer.android.com/reference/android/media/ThumbnailUtils.html, accessed on 2016-10-24.
[58] Timeline, https://developers.google.com/glass/v1/reference/timeline, accessed on 2016-09-24.
[59] Tuning speech recognition accuracy, http://cmusphinx.sourceforge.net/wiki/tutorialtuning, accessed on 2016-12-16.
[60] x264, https://en.wikipedia.org/wiki/X264, accessed on 2017-1-2.
[61] X (company), https://en.wikipedia.org/wiki/X_(company), accessed on 2016-09-24.
[62] YUV, https://en.wikipedia.org/wiki/YUV, accessed on 2016-11-29.
[63] 在消費挫敗 在醫療市場重生的智慧眼鏡, http://www.digitimes.com.tw/tw/dt/n/shwnws.asp?CnlID=13&packageid=9602&id=0000433816_NJ372VBJ2SZHYY5C2CJLL&cat=50&ct=1, accessed on 2016-10-13.
[64] 有損壓縮演算法, http://www.techbang.com/posts/21959-you-should-know-digital-audio-file-audio-format-the-storage-disc-case-parade, accessed on 2016-12-16.
[65] 智慧型眼鏡一戴 20 年:專訪 Google Glass 技術負責人 Thad Starner, http://www.inside.com.tw/2014/02/07/google-glass-thad-starner-interview, accessed on 2016-09-24.
[66] 智慧眼鏡比較, http://cht.chipsip.com/archive/SiME%20Smart%20Glasses_2015Jan_Chinese.pdf, accessed on 2016-10-13.
校內:立即公開