隨著科技的發展，越來越多強調多媒體服務與人機介面(human machine interface)的新產品問世，其中有著吸引人的外觀、豐富的功能、以及低價位特質的商品尤其受到市場的歡迎。本論文主要的研究，是希望能夠以影像辨識(image recognition)的技術來實現一個互動式的彩繪系統。為了使系統的成本降低而且穩固，我們以一般攝影機結合液晶顯示器來建構硬體系統，利用定位網格與圖形辨識技術，使得繪畫系統能夠執行各式各樣的繪畫功能，例如：擷取材質、自動定位、功能選擇、貼上小動畫等。本建構的彩繪系統經幼齡學童之實際操作以確認整體的可行性以及運作是否流暢。實驗的結果顯示，影像自動定位辨識技術成功地結合攝影機、液晶螢幕以實現高度接受度之互動式彩繪系統。我們深信本研究將對其它許多互動式多媒體教育與娛樂系統的應用有很大的助益。

More and more inventions in uses of multimedia services and human machine interface (HMI) have been greatly created recently. Due to appealing appearances, versatile functionalities, and low prices, some of them are popular through mass productions. In this thesis, the main goal is to realize an interactive painting system, which is primarily based on image recognition. In order to achieve a steady and low cost system, the proposed system is integrated by a general camera and a liquid crystal display (LCD) monitor in hardware. By using the designed positioning pattern and recognition technique, we accomplished various advanced painting functions, such as capturing texture, auto-positioning, icon selection, and posting a small video, etc. The proposed painting system was practiced by kindergartners. Experimental result shows that image-based auto-positioning brush (IA-Brush), which integrates with a video camera, LCD monitor, and pattern recognition technique, can achieve a highly-acceptable interactive painting system. We believe that the proposed system will exhibit great contributions to many other applications in interactive multimedia education and entertainment systems.

[1] R. Lind, R. Schumacher, R. Reger, R. Olney, H. Yen, and M. Laur, “The network vehicle—a glimpse into the future of mobile multi-media,” IEEE Aerospace and Electronic Systems Magazine, volume 14, issue 9, pp. 29-32, Sep. 1999.
[2] P. Cesar, J. Vierinen, and P. Vuorimaa, “Open graphical framework for interactive TV,” Proceedings of the IEEE Fifth International Symposium on Multimedia Software Engineering, pp.189-203, August 2006.
[3] G. C. de Silva, T. yamasaki, and K. Aizawa, “An interactive multimedia diary for the home,” IEEE Computer, volume 40, issue 5, pp. 52-59, May 2007.
[4] M. Macedonia, “iPhones target the tech elite,” IEEE Computer Magazine, volume 40, issue 6, pp. 94-95, June 2007.
[5] B. B. Bederson, A. J. Quinn, and A. Druin, “Designing the Reading Experience for Scanned Multi-lingual Picture Books on Mobile Phones,” In Proceedings of the 9th ACM/IEEE-CS Joint Conference on Digital Libraries, 15-19 June, 2009, (in press).
[6] S. S. Mohammad, “Login to internet websites by next generation game console,” International Conference in Central Asia on nternet, 2006 2nd IEEE/IFIP, pp. 1-4, 2006.
[7] X. Y. Yang and G. Chen, “Human-computer interaction design in product design,” Education Technology and Computer Science, volume 2, pp. 437-439, 7-8 March, 2009.
[8] M. Hua and H. Qiu, “The prototyping in interaction design,” IEEE Computer-Aided Industrial Design and Conceptual Design, pp.468-471, 22-25 Nov., 2008.
[9] I. Cheng, A. Basu, and R. Goebel, “Interactive multimedia for adaptive online education,” IEEE Multimedia, volume 16, issue 1, pp. 16-25, Jan.-March 2009.
[10] I. Schifter, “ToddlePuff: an interactive tangible and spatial interface,” IEEE Digital Games and Intelligent Toys Based Education, p.177-179, 17-19 Nov., 2008.
[11] J. B. Labrune and W. Mackay, “SketchCam: creative photography for children,” Proceedings of the 6th international conference on Interaction design and children, pp.153-156, 6-8 June, 2007.
[12] J. S. Yeh, T. Y.. Lien, and M. Ouhyoung, “On the effects of haptic display in brush and ink simulation for Chinese painting and calligraphy,” Proceedings of the IEEE 10th Pacific Conference on Computer Graphics and Applications, pp. 439-441, Oct. 2002.
[13] W. Baxter, J. Wendt, and M. C. Lin, “A viscous paint model for interactive applications,” Computer Animation and Virtual Worlds, Volume. 15, issue. 3-4, pp. 433-441, July 2004.
[14] W. Baxter, J. Wendt, and M. C. Lin, “IMPaSTo: a realistic, interactive model for paint,” Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering, pp.45-56, 07-09 June, 2004.
[15] R. P. Pargas, “Seeing clearly through ink in computer science courses,” First International Workshop on Pen-Based Learning Technologies (PLT 2007), pp.1-6, 4-5 May, 2007.
[16] H. J. Lee, H. Kim, G. Gupta, and A. Mazalek, “WiiArts: creating collaborative art experience with WiiRemote interaction,” Proceedings of the 2nd international conference on Tangible and embedded interaction, pp.33-36, 18-20 February, 2008.
[17] J. Kim, J. Park, H. K. Kim, and C. Lee, “HCI (Human Computer Interaction) using multi-touch tabletop display,” IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp. 391-394, Aug. 2007.
[18] J. D. Smith, T. C. N. Graham, D. Holman, and J. Borchers, “Low-cost Malleable Surfaces with multi-touch pressure sensitivity,” IEEE Computer, volume 40, issue 5, pp. 205-208, 10-12 Oct, 2007.
[19] D. Iwai and K. Sato, “Heat sensation in image creation with thermal vision,” Proceeding of the ACM SIGCHI Int'l Conference on Advances in Computer Entertainment Technology, pp. 213-216, Jun. 2005.
[20] Microsoft Surface, http://www.microsoft.com/surface/
[21] A. Agarwal, S. Izadi, M. Chandraker, and A. Blake, “High precision multi-touch sensing on Surfaces using overhead cameras,” Horizontal Interactive Human-Computer Systems, p.197-200, 10-12 Oct., 2007.
[22] P. Vandoren, T. V. Laerhoven, L. Claesen, etc., “Dip - IT: digital infrared painting on an interactive table,” Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems, pp. 2901-2906, 5-10 April, 2008.
[23] R. Grasset, J. D. Gascuel, and D. Schmalstieg, “Interactive mediated reality,” Proceedings of the Australasian User Interface Conference (AUIC), pp. 21-29, 31 Jan - 3 Feb, 2005.
[24] K. Ryokai, S. Marti, and H. Ishii, “I/O Brush: beyond static collages,” in Extended Abstracts of Conference on Human Factors in Computing Systems (CHI'07), ACM Press, pp. 1995-2000, Apr. 2007.
[25] K. Ryokai, S. Marti, and H. Ishii, “Designing the world as your palette,” in Proceedings of Conference on Human Factors in Computing Systems (CHI '05), ACM Press, pp. 1037-1049, Apr. 2005.
[26] J. Gu, J. Zhou, C. Yang, “Fingerprint recognition by combining global structure and local cues,” IEEE Transactions on Image Processing, volume 15, issue 7, pp. 1952-1964, July 2006.
[27] X. Liu, C. Lin, “Information Management System of Grocery Production Processing Based on a Bar Code Identification Technology,” IEEE International Workshop on Anti-counterfeiting, Security, Identification, pp. 164-168, 16-18 April, 2007.
[28] Y. Q. Yang, J. Bai, R. L. Tian, N. Liu, “A vehicle license plate recognition system based on fixed color collocation,” Proceedings of 2005 International Conference on Machine Learning and Cybernetics, volume 9, pp. 5394-5397, 18-21 Aug., 2005.
[29] D. Kim, J. Sung, “A Real-Time Face Tracking using the Stereo Active Appearance Model,” IEEE Transactions on Image Processing, pp. 2833-2836, 8-11 Oct. 2006.
[30] J. R. Ding, J. Y. Chen, F. C. Yang, and J. F. Yang, “Image-based Auto-positioning Brush for LCD displays,” 33rd IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 2177-2180, March 31- April 4 2008.
[31] L. E. Cheng, J.Y. Chen, and J. F. Yang, “An interactive painting system by using enhanced auto-positioning and pattern matching techniques," 9th Pacific-Rim Conference on Multimedia (PCM), pp. 109-118, Dec. 2008.
[32] W. Tao, H. Jin, and Y. Zhang, “Color Image Segmentation Based on Mean Shift and Normalized Cuts," IEEE Systems, Man, and Cybernetics, Part B, volume 37, issue 5,pp. 1382-1389, Oct. 2007.
[33] J. S. Yu, M. C. Jhuang, K. C. Yang, and J. H. Wang, “Multi-object segmentation using probabilistic labeling,” IEEE International Conference on Systems, Man, and Cybernetics (SMC 2008), pp.1026-1030, 12-15 Oct, 2008.