簡易檢索 / 詳目顯示

研究生: 吳冠璋
Wu, Guan-Zhang
論文名稱: 適用於嵌入式系統之多游標視窗系統
A Multiple-Cursor Windowing System for Embedded System
指導教授: 楊中平
Young, Chung-Ping
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2009
畢業學年度: 97
語文別: 英文
論文頁數: 88
中文關鍵詞: 多重觸控多游標視窗系統圖形介面嵌入式系統
外文關鍵詞: multi-touch, multiple-cursor, windowing system, graphical user interfaces, embedded system
相關次數: 點閱:94下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 多重觸控是近年來新發展起來的輸入裝置,在2006-2008年間,各種多重觸控的技術頻繁的被提出,也有一些產品出現在市面上。不過大部分的產品提供的多是一套函式庫,讓想應用這產品的開發人員自行使用,這使得開發人員必須想辦法讓應用程式支援裝置函式庫,這些修改應用程式的工作是耗時且沒有意義的,希望能有一個解決方案解決此問題。
    本論文提出一個方法,透過視窗系統支援來解決這個問題,使得應用程式不用被修改就可以擁有多重觸控支援。多重觸控裝置上的多個點將被對應到多個游標上,每個游標都有自己獨立的訊息通道,都可以送訊息給應用程式。我們選擇DirectFB作為視窗系統,用GTK+作為圖形介面,用Wii Remote作為多重觸控輸入裝置。在DirectFB上發展一個新的視窗管理模組來實現多個獨立游標。我們將著重於對舊的應用程式支援,而不是發展新的訊息機制讓應用程式能支援多重觸控。並提出一些策略來更新畫面,設定一些參數來評估效能。

    Multi-touch devices are new input devices grown up in recent years. In 2006-2008, many solutions were proposed to achieve multi-touch. Some manufacturers produce various multi-touch devices, but most of them provide only libraries for developers to use. It means that developers had to rewrite all applications to fit to those libraries. Those reworking for applications are time-consuming and meaningless. It might be good if there exists a solution to prevent reworking.
    This thesis proposes a way to solve this problem at windowing system level so that applications won't be changed. Multiple points on device are mapped to multiple cursors, each cursor has ability to send events to application independently. We select DirectFB as windowing system, GTK+ as graphical user interfaces toolkit, and Wii Remote as multi-touch input device. We develop a new window manager for DirectFB to support multiple cursors. We focus on supporting legacy applications, without creating new event to support multi-touch. We also propose several strategies on updating screen, and set several parameters to evaluate performance.

    摘要 iii Abstract iv 致謝 v List of Figures viii List of Tables x Chapter 1. Introduction 1 1.1 Overview 2 1.2. Motivation 4 1.3. Applications 6 1.4. Organization of This Thesis 8 Chapter 2. Related Work 9 2.1. Multi-touch Supported Hardware 9 2.1.1. Sensor Matrix Multi-touch 9 2.1.2 Image Recognition Multi-touch 12 2.2. Multi-touch Supported Software 19 Chapter 3. Background Technology 23 3.1. DirectFB 23 3.1.1. Surface Core 29 3.1.2. Graphics Core (GFX) 30 3.1.3. Input Core 39 3.1.4. Window Manager Core 41 3.2. GTK+ 49 3.3. Wii Remote 50 Chapter 4. Implementation 53 4.1. Problems in Original Window Manager Module 53 4.2. Our Solutions 55 4.3. Wii Remote Driver 58 4.4. Window Manager Module 59 4.4.1. Multiple Cursors 59 4.4.2. Window Decoration 60 4.4.3. Better Region-Splitting and Region-Repainting Solutions 62 4.4.3.1. Splitting Threshold 64 4.4.3.2. Merging Threshold 65 4.4.3.3. Ignoring Threshold 66 4.4.3.4. Cover Threshold 66 4.4.3.5. No-Splitting Threshold 68 Chapter 5. Evaluation 69 5.1. Environment Setup 69 5.2. Experiment Results 73 5.2.1. Region-splitting Solutions 74 5.2.1.1. Splitting Threshold 74 5.2.1.2. Merging Threshold 77 5.2.1.3. Ignoring Threshold 79 5.2.2. Region-repainting Solutions 79 5.2.2.1. Cover Threshold 79 5.2.2.2. No-Splitting Threshold 81 5.3. Functional Test 81 Chapter 6. Conclusions 83 Future Works 83 Reference 84

    [1]SK Lee, William Buxton K. C. Smith, "A multi-touch three dimensional touch-sensitive tablet", ACM SIGCHI Bulletin, vol. 16, Issue 4, pp. 21– 25, April 1985.
    [2]Human Commun. Technol. Lab., British Columbia Univ., Vancouver, BC, Canada, "FlowField and beyond: applying pressure-sensitive multi-point touchpad interaction", International Conference on Multimedia and Expo, vol. 1, pp. 49–52, July 2003 .
    [3]Paul Dietz, Darren Leigh, "DiamondTouch: A Multi-User Touch Technology", Proceedings of the 14th annual ACM symposium on User interface software and technology, pp. 219–226, November 2001.
    [4]Jefferson Y. Han, "Low-cost multi-touch sensing through frustrated total internal reflection", Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 115–118, October 2005.
    [5]K. C. Dohse, Thomas Dohse, Jeremiah D. Still, Derrick J. Parkhurst, "Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking", Proceedings of the First International Conference on Advances in Computer-Human Interaction, pp. 297–302, November 2008.
    [6]De Maria, E.A.A. Gho, E. Maidana, C.E. Rodriguez, C.A. Szklanny, F.I. Tantignone, H.R. Dept. de Ing. e Investig. Tecnol., Univ. Nac. de La Matanza, Buenos Aires, "Real Time FPGA based Thresholding Segmentation in a Multi Touch System", 2008 4th Southern Conference on Programmable Logic, pp. 237–240, March 2008.
    [7]R. Gonzalez- R. Woods, "Digital Image Processing", 3rd edition, Prentice Hall, August 2007.
    [8]Izadi, S. Agarwal, A. Criminisi, A. Winn, J. Blake, A. Fitzgibbon, A. Microsoft Res. Cambridge, "C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces", Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 3–10, October 2007.
    [9]Sears, Andrew and Shneiderman, Ben, "High Precision Touchscreens: Design Strategies and Comparisons with a Mouse", International Journal of Man-Machine Studies, 1991
    [10]Hrvoje Benko, Andrew D. Wilson, Patrick Baudisch, "Precise selection techniques for multi-touch screens", ACM Special Interest Group on Computer-Human Interaction, pp. 1263–1272, 2006.
    [11]Alan Esenther, Kathy Ryall, "Fluid DTMouse: Better Mouse Support for Touch-Based Interactions", Proceedings of the working conference on Advanced visual interfaces, pp. 112–115, 2006
    [12]Jason Stewart, Benjamin B. Bederson, Allison Druin, "Single display groupware: a model for co-present collaboration", Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pp. 286–293, 1999.
    [13]Bederson B.B., Hollan J.D., Perlin K., Meyer J., Bacon D., Furnas G., "Pad++: A Zoomable Graphical Sketchpad For Exploring Alternate Interface Physics", Journal of Visual Languages & Computing, vol. 7, No. 1, pp. 3–32, March 1996.
    [14]Garth B.D. Shoemaker, Kori M. Inkpen, "MIDDesktop: An Application Framework for Single Display Groupware Investigations", Burnaby, BC, Canda.
    [15]Hourcade, Juan Pablo, Bederson, Benjamin B., "Architecture and Implementation of a Java Package for Multiple Input Devices (MID)", University of Maryland, Human Computer Interaction Laboratory.
    [16]Peter Hutterer, Bruce H. Thomas, "Groupware support in the windowing system", Proceedings of the eight Australasian conference on User interface vol. 64, pp. 39–46, 2007.
    [17]Mike Wu, Ravin Balakrishnan, "Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays", Proceedings of the 16th annual ACM symposium on User interface software and technology, pp. 193–202, 2003.
    [18]D. H. Mott, M. H. Lee and H. R. Nicholls, "An Experimental Very High Resolution Tactile Sensor Array," Proceedings of 4th International Conference on Robot Vision and Sensory Control, pp. 241–250, 1984.
    [19]Wayne Westerman, John G. Elias, Alan Hedge, "Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction", Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, pp. 632–636, October 2001.
    [20]Y. Ohta, Takeo Kanade, T. Sakai, "Color information for region segmentation.", Computer Graphics and Image Processing, vol. 13, No. 3, pp. 222–241, 1980.
    [21]Michael J. Swain, Dana H. Ballard, "Color Indexing.", International Journal of Computer Vision, vol. 7, No. 1, pp. 11–32, 1991.
    [22]Jie Yang, Alex Waibel, "A real-time face tracker.", Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision, Sarasota, Florida, pp. 142–147, 1996.
    [23]Jie Yang, Alex Waibel, "Tracking human faces in real-time.", CS department, CMU, Technical Report. CMU-CS-95-210, 1995.
    [24]Johnson, R., Fryberger, D., "Touch Actuable Data Input Panel Assembly.", U.S. Patent 3,673,327., June 1972.
    [25]White, W., "Method for Optical Comparison of Skin Friction-Ridge", U.S. Patent 3,200,701., August 1965.
    [26]Kasday, L., "Touch Position Sensitive Surface.", U.S. Patent 4,484,179., November 1984.
    [27]"EPIA M Datasheet", VIA Technologies, Inc.
    [28]Microsoft Surface. [Online]. Available: http://www.microsoft.com/surface/
    [29]X Window System. [Online]. Available: http://www.x.org/wiki/
    [30]MPX : The Multi-Pointer X Server. [Online]. Available: http://wearables.unisa.edu.au/mpx/
    [31]Windows 7. [Online]. Available: http://www.microsoft.com/windows/windows-7/
    [32]Windows Touch Development Document. [Online]. Available:
    http://msdn.microsoft.com/en-us/library/dd562197(VS.85).aspx
    [33]DirectFB Homepage. [Online]. Available: http://www.directfb.org/
    [34]Qt Software - Code Less. Create More. Deploy Everywhere. [Online]. Available: http://trolltech.com
    [35]MiniGUI -- A cross-operating-system graphics user interface support system for embedded devices. [Online]. Available: http://www.minigui.org
    [36]Datasheet: Qt Cross-Platform Application Framework. [Online]. Available: http://trolltech.com/products/appdev/platform/files/pdf/qt-cross-platform-application-framework-datasheet
    [37]Datasheet for MiniGUI V3.0.X. [Online]. Available:
    http://www.minigui.com/fileadmin/download/minigui-datasheet-3.0e.pdf
    [38]CELF Audio Video Graphics Specification v2.0. [Online]. Available: http://tree.celinuxforum.org/CelfPubWiki/AudioVideoGraphicsSpec_V2
    [39]Nintendo Wiiの概要:コントローラ. [Online]. Available: http://www.nintendo.co.jp/n10/e3_2006/wii/controller.html
    [40]GTK+. [Online]. Available: http://www.gtk.org/
    [41]CWiid. [Online]. Available: http://abstrakraft.org/cwiid/
    [42]BlueZ. [Online]. Available: http://www.bluez.org/
    [43]Bluetooth. [Online]. Available: http://www.bluetooth.com
    [44]D-Bus (Desktop Bus). [Online]. Available: http://www.freedesktop.org/wiki/Software/dbus
    [45]Behrouz A. Forouzan, "TCP/IP Protocol Suite Third Edition", McGraw-Hill, 2006.
    [46]Johnny Chung Lee's Wii Project. [Online]. Available: http://johnnylee.net/projects/wii/
    [47]BitBlit. [Online]. Available: http://en.wikipedia.org/wiki/Bit_blit

    下載圖示 校內:2010-09-09公開
    校外:2010-09-09公開
    QR CODE