簡易檢索 / 詳目顯示

研究生: 白宇傑
Pai, Yu-Chieh
論文名稱: 智慧型眼鏡軟體發展平台之建立
Building a Smart Glasses Software Development Platform
指導教授: 陳 敬
Chen, Jing
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電腦與通信工程研究所
Institute of Computer & Communication Engineering
論文出版年: 2017
畢業學年度: 105
語文別: 中文
論文頁數: 110
中文關鍵詞: 智慧型眼鏡開發平台即時影音串流應用軟體啟動器
外文關鍵詞: Smart Glasses, development platform, live streaming, application launcher
相關次數: 點閱:151下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近年來,技術的演進見證了移動式和穿戴式裝置的進步速度不斷的加快,智慧型眼鏡的誕生使得新興應用如雨後春筍般冒出。不過由於智慧型眼鏡人機互動介面與傳統智慧型手機相異;以及各式應用還不明確情況下,導致廠商對於軟體支援部份仍無法投注大量心力,使得智慧型眼鏡應用程式開發者只能依賴傳統Android開發環境進行開發,徒增開發成本及負擔。
    本論文設計之智慧型眼鏡軟體發展平台,提供開發環境讓智慧型眼鏡應用開發者使用,可增進應用程式開發之便利性。此發展平台由四個部份所組成:(1)使用基礎Eclipse平台作為開發引擎,並透過Eclipse處理應用程式專案;(2)提供即時影音串流及離線式語音辨識開發套件,預先完成應用開發基礎工作,開發者可直接使用;(3)加入開發套件使用輔助文件工具及應用程式視覺化介面設計開發工具,使得開發者進行智慧型眼鏡應用開發能更加順手;(4)配合橫向螢幕顯示重新設計智慧型眼鏡應用軟體啟動器,並加入語音控制功能讓眼鏡使用者無需動手即能操作。
    本論文實作以Eclipse平台為基礎,將其擴充為智慧型眼鏡軟體發展平台。實作內容包含:(1)整合即時影音串流套件,並實作影音編碼方法;(2)新增離線式語音辨識函式;(3)實作智慧型眼鏡應用軟體啟動器,增進眼鏡操作體驗;(4)實作開發套件使用輔助文件工具,供開發者查詢函式使用方式;(5)修改並整合DroidDraw Android佈局介面設計工具,使其支援智慧型眼鏡螢幕顯示佈局設計。
    本論文之主要貢獻為:設計一智慧型眼鏡軟體發展平台,其開發平台以Eclipse平台為基礎,加入了開發套件及開發工具,使得開發者能不需要重新熟悉開發環境下進行智慧型眼鏡應用開發。此外,配合眼鏡特殊的人機介面,重新設計智慧型眼鏡應用軟體啟動器,使得眼鏡使用者操作起來更加順手。

    The birth of smart glasses makes the emerging application of wearable devices spring up like mushrooms. However, because of the uncertainty in application trend and the difference in human-computer interaction between smart glasses and popular smart phones, not only consumers hesitate but also manufactures do not invest much effort in software support. Therefore, developers of smart glasses applications can only rely on traditional Android application development tools and suffer from work load and cost.
    This study builds a smart glasses software development platform to provide application developers a development environment which may enhance the convenience as well as productivity in building smart glasses applications. There are four parts in the design of this platform: (1) the Eclipse platform which, in addition to processing the application project, serves as the engine of development and the primary interface between the platform and developers; (2) SDK (Software Development Kit) which includes not only the SDKs commonly required to develop Android applications, but also SDKs pertinent to implementing desirable functionality of smart glasses applications, such as streaming and voice recognition; (3) development aids which serve as tools to help developers, such as design aid for application display layout; (4) an application launcher specific to smart glasses, which is a user interface suitable for operating smart glasses. With the capability of Eclipse, components can be integrated or removed as needed. Therefore, this platform features not only expandability but also flexibility.
    The implementation of this platform is based on the original application development platform for Android system, which consists of Eclipse platform and Android SDK. This study extends the SDK by integrating, as components, an SDK for live streaming and an SDK for voice recognition. The part of development aids is achieved by porting Android display layout design tool, namely DroidDraw, and, in addition, implementing an Eclipse plug-in module for consulting API usage. The former supports the display resolutions of smart glasses. The application launcher is implemented as a user-space application which supports horizontal screen display and voice-operating capability.
    The main contribution of this study is the development of a platform which is suitable for developing application software of smart glasses. This platform is based on Eclipse and existing Android system so that developers can avoid the burden of learning curve in adapting to a new development platform. It supports common features and basic requirements of smart glasses applications, such as horizontal display and voice control, with flexibility by integrating suitable SDK. It provides convenience by adding helpful and handy tools. In addition this platform is targeted at developing user space applications, the impact of system level dependency and hardware variety would not cause much effort or difficulty.

    第1章 緒 論 1 1.1 研究背景 1 1.2 研究動機 4 1.3 研究方法 7 1.4 章節規劃 7 第2章 相關研究 8 2.1 智慧型眼鏡(Smart glasses) 8 2.1.1 智慧型眼鏡發展 8 2.1.2 Google Glass簡介 9 2.1.3 EPSON Moverio BT-200簡介 10 2.1.4 SiME Smart Glass簡介 11 2.2 Android及開發平台相關研究 12 2.2.1 Android 系統架構 13 2.2.2 Android SDK 15 2.2.3 Google Glass 系統 17 2.2.4 Glass Development Kit 20 2.2.5 Eclipse開發平台 22 2.2.6 討論 24 2.3 影音串流及編碼原理 24 2.3.1 影音串流簡介 24 2.3.2 影音串流通訊協定 25 2.3.3 視訊編碼 29 2.3.4 音訊編碼 30 2.4 語音辨識系統 31 2.5 討論 33 第3章 架構設計 35 3.1 概述 35 3.2 平台架構 37 3.3 即時影音串流開發套件 39 3.3.1 音訊處理模組 40 3.3.2 視訊處理模組 41 3.3.3 影音儲存模組 42 3.3.4 網路通訊模組 43 3.3.5 即時傳輸封裝模組 45 3.3.6 即時影音串流流程 47 3.4 離線式語音辨識套件 49 3.5 智慧型眼鏡應用軟體啟動器 51 3.6 智慧眼鏡軟體發展平台工具 53 3.6.1 開發套件使用輔助文件工具 54 3.6.2 應用程式視覺化界面設計工具 55 第4章 平台實作 57 4.1 實作環境 57 4.2 即時影音串流套件實作 59 4.2.1 音訊及視訊串流模組實作 61 4.2.2 Android SDK版本號及編碼緩衝區大小判斷 67 4.2.3 影音儲存模組實作 68 4.2.4 即時影音串流套件封裝 69 4.3 離線式語音辨識子系統實作 70 4.4 智慧型眼鏡應用軟體啟動器實作 71 4.4.1 佈局設計 71 4.4.2 橫向列表方法實作 72 4.4.3 智慧型眼鏡應用軟體啟動器函式之建立 74 4.4.4 智慧型眼鏡應用軟體啟動器設定 74 4.5 開發套件使用輔助文件工具實作 75 4.6 應用程式視覺化介面設計工具實作 78 第5章 系統測試 81 5.1 系統測試環境 81 5.2 功能測試 83 5.3 效能測試 91 5.4 應用程式開發範例 94 第6章 結論與展望 104 6.1 結論 104 6.2 未來展望 105 參考文獻 106

    [1] Adapter, http://hi.baidu.com/laoyang1018/blog/item/b34b241f3c7b44d6a78669b1.html, accessed on 2016-10-24.
    [2] Advanced Audio Coding, https://en.wikipedia.org/wiki/Advanced_Audio_Coding, accessed on 2016-11-25.
    [3] Android, https://en.wikipedia.org/wiki/Android_(operating_system), accessed on 2016-09-24.
    [4] Android application package, https://en.wikipedia.org/wiki/Android_application_package, accessed on 2016-09-24.
    [5] Android Debug Bridge, https://developer.android.com/studio/command-line/adb.html, accessed on 2016-12-01.
    [6] Android intent, https://developer.android.com/reference/android/content/Intent.html, accessed on 2016-10-26.
    [7] Apache License, http://www.apache.org/licenses/LICENSE-2.0, accessed on 2016-09-24.
    [8] App Components, https://developer.android.com/guide/components/index.html, accessed on 2016-09-24.
    [9] Application programming interface, https://en.wikipedia.org/wiki/Application_programming_interface, accessed on 2016-09-24.
    [10] CMU Sphinx, http://cmusphinx.sourceforge.net/, accessed on 2016-09-25.
    [11] Concurrent Versions System, https://en.wikipedia.org/wiki/Concurrent_Versions_System, accessed on 2016-11-28.
    [12] Dalvik https://en.wikipedia.org/wiki/Dalvik_(software), accessed on 2016-09-24.
    [13] DroidDraw, https://github.com/sosiouxme/DroidDraw, accessed on 2016-10-26.
    [14] Eclipse-PDE, http://www.eclipse.org/pde/, accessed on 2016-10-25.
    [15] Eclipse Platform Technical Overview, http://www.eclipse.org/articles/Whitepaper-Platform-3.1/eclipse-platform-whitepaper.html, accessed on 2016-09-25.
    [16] Epson Moverio BT-200 – provati in anteprima, http://www.webnews.it/2014/03/27/epson-moverio-bt-200-provati-in-anteprima/, accessed on 2016-09-24.
    [17] Gesture recognition, https://en.wikipedia.org/wiki/Gesture_recognition, accessed on 2016-09-24.
    [18] Glass Development Kit, https://developers.google.com/glass/develop/gdk/, accessed on 2016-09-25.
    [19] Google Glass, https://en.wikipedia.org/wiki/Google_Glass, accessed on 2016-09-24.
    [20] Google Glass : User Interface., https://developers.google.com/glass/design/ui, accessed on 2016-09-24.
    [21] Google Glass embraced at Beth Israel Deaconess, https://www.bostonglobe.com/business/2014/04/08/beth-israel-use-google-glass-throughout-emergency-room/WhIXcVzkpn7MOCAhKuRJZL/story.html, accessed on 2016-09-24.
    [22] Google Glass Enables Surgeons To Consult Remotely, http://www.informationweek.com/healthcare/mobile-and-wireless/google-glass-enables-surgeons-to-consult-remotely/d/d-id/1112837?, accessed on 2016-09-25.
    [23] Google Glass makes doctors better surgeons, Stanford study shows, http://venturebeat.com/2014/09/16/docs-performed-surgery-better-wearing-google-glass-stanford-study-shows/, accessed on 2016-09-25.
    [24] Google Glass Mirror API, https://developers.google.com/glass/develop/mirror/, accessed on 2016-10-13.
    [25] Google Glass User Interface, https://developers.google.com/glass/design/ui, accessed on 2016-09-24.
    [26] The Google Now weather card shows relevant information automatically., https://developers.google.com/glass/images/google-now-weather.png, accessed on 2016-09-24.
    [27] H.264/MPEG-4 AVC, https://en.wikipedia.org/wiki/H.264/MPEG-4_AVC, accessed on 2016-09-25.
    [28] HTTP Live Streaming, https://en.wikipedia.org/wiki/HTTP_Live_Streaming, accessed on 2016-09-25.
    [29] Immersions, https://developers.google.com/glass/develop/gdk/immersions, accessed on 2016-09-25.
    [30] Integrated development environment, https://en.wikipedia.org/wiki/Integrated_development_environment, accessed on 2016-09-23.
    [31] IntelliJ IDEA, https://en.wikipedia.org/wiki/IntelliJ_IDEA, accessed on 2016-09-26.

    [32] Intermediate representation, https://en.wikipedia.org/wiki/Intermediate_representation, accessed on 2016-11-25.
    [33] IP Networks, http://citeseer.nj.nefc.com/schulzrinne00ip.html, accessed on 2016-10-15.
    [34] Joint Video Team, http://www.itu.int/ITU-T/2005-2008/com16/jvt/, accessed on 2016-09-26.
    [35] KitKat for Glass, https://support.google.com/glass/answer/4578099?hl=en, accessed on 2016-09-24.
    [36] List of free and open-source software packages, https://en.wikipedia.org/wiki/List_of_free_and_open-source_software_packages, accessed on 2016-11-25.
    [37] Lossy compression, https://en.wikipedia.org/wiki/Lossy_compression, accessed on 2016-11-14.
    [38] MediaRecorder.AudioEncoder, https://developer.android.com/reference/android/media/MediaRecorder.AudioEncoder.html, accessed on 2016-11-27.
    [39] MediaRecorder.OutputFormat, https://developer.android.com/reference/android/media/MediaRecorder.OutputFormat.html, accessed on 2016-11-27.
    [40] MediaRecorder.VideoEncoder, https://developer.android.com/reference/android/media/MediaRecorder.VideoEncoder.html, accessed on 2016-11-28.
    [41] Mercedes-Benz imagines seamless door-to-door directions with Google Glass, https://www.engadget.com/2013/07/29/mercedes-benz-google-glass/, accessed on 2016-09-25.
    [42] OpenGL, https://en.wikipedia.org/wiki/OpenGL, accessed on 2016-09-24.
    [43] OpenMAX, https://zh.wikipedia.org/wiki/OpenMAX, accessed on 2016-11-28.
    [44] Overview of CMUSphinx toolkit, http://cmusphinx.sourceforge.net/wiki/tutorialoverview, accessed on 2016-11-27.
    [45] Plug-in, https://en.wikipedia.org/wiki/Plug-in_(computing), accessed on 2016-09-23.
    [46] Real Time Streaming Protocol (RTSP), https://tools.ietf.org/html/rfc2326, accessed on 2016-09-25.
    [47] Real Time Streaming Protocol (RTSP), https://www.ietf.org/rfc/rfc2326.txt, accessed on 2016-10-11.
    [48] RTP: A Transport Protocol for Real-Time Applications, https://tools.ietf.org/html/rfc3550, accessed on 2016-09-25.
    [49] SDP: Session Description Protocol, https://tools.ietf.org/html/rfc4566, accessed on 2016-09-25.
    [50] SiME Smart Glasses, http://cht.chipsip.com/computing/index.php?mode=data&id=126, accessed on 2016-09-24.
    [51] Smart Glasses Comparison, http://www.chipsip.com/archive/SiME%20Smart%20Glasses_2015Jan(1).pdf, accessed on 2016-09-25.
    [52] Speech recognition, https://en.wikipedia.org/wiki/Speech_recognition, accessed on 2016-09-26.
    [53] SQLite, https://en.wikipedia.org/wiki/SQLite, accessed on 2016-09-24.
    [54] Streaming media, https://en.wikipedia.org/wiki/Streaming_media, accessed on 2016-09-25.
    [55] Surface, https://developer.android.com/reference/android/view/Surface.html, accessed on 2016-09-24.
    [56] Thad Starner Home - College of Computing - Georgia Tech, http://www.cc.gatech.edu/fac/Thad.Starner/, accessed on 2016-12-11.
    [57] ThumbnailUtils, https://developer.android.com/reference/android/media/ThumbnailUtils.html, accessed on 2016-10-24.
    [58] Timeline, https://developers.google.com/glass/v1/reference/timeline, accessed on 2016-09-24.
    [59] Tuning speech recognition accuracy, http://cmusphinx.sourceforge.net/wiki/tutorialtuning, accessed on 2016-12-16.
    [60] x264, https://en.wikipedia.org/wiki/X264, accessed on 2017-1-2.
    [61] X (company), https://en.wikipedia.org/wiki/X_(company), accessed on 2016-09-24.
    [62] YUV, https://en.wikipedia.org/wiki/YUV, accessed on 2016-11-29.
    [63] 在消費挫敗 在醫療市場重生的智慧眼鏡, http://www.digitimes.com.tw/tw/dt/n/shwnws.asp?CnlID=13&packageid=9602&id=0000433816_NJ372VBJ2SZHYY5C2CJLL&cat=50&ct=1, accessed on 2016-10-13.
    [64] 有損壓縮演算法, http://www.techbang.com/posts/21959-you-should-know-digital-audio-file-audio-format-the-storage-disc-case-parade, accessed on 2016-12-16.
    [65] 智慧型眼鏡一戴 20 年:專訪 Google Glass 技術負責人 Thad Starner, http://www.inside.com.tw/2014/02/07/google-glass-thad-starner-interview, accessed on 2016-09-24.

    [66] 智慧眼鏡比較, http://cht.chipsip.com/archive/SiME%20Smart%20Glasses_2015Jan_Chinese.pdf, accessed on 2016-10-13.

    無法下載圖示 校內:立即公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE