隨著互動式人機介面的技術逐漸進步，人們與電腦進行溝通的方式也漸漸多樣化。然而，一般在進行互動遊戲時，畫面的呈現都是以電腦建構的虛擬環境為主，無法讓人們有比較真實的感覺。因此，在本論文中，我們提出一套將真實人物重建於虛擬空間中的方法，並且將畫面立體化，使得人們可以真實感受到虛擬物體的互動。
本套真實人物重建的方法流程中包含：影像切割、特徵點擷取、區塊匹配、視差估測、及影像重建之步驟。我們將透過這些方法得知人物在空間中的深度關係，並且利用深度資訊，得知人物與虛擬物件的相互關係及將人物重建於虛擬空間中。根據實驗結果可以看出，依照估測出的深度圖，可以將人物重建於虛擬空間中正確的位置。

After availability of interactive human computer interface (HCI), the communication between human and computer become more and more diverse. However, the display scene is based on the virtual environment mainly controlled by the user, who is playing interactive games, and it can not make surrounding people feel the virtual reality. In order to enhance the interaction of gaming experience and the existence of virtual objects, a procedure to reconstruct 3D real body in virtual space and exhibit in stereoscopic display is proposed in this thesis.
The proposed procedure includes image segmentation, feature point extraction, block matching, parallax estimation, and image reconstruction. We design a process to get the depth of people in real environment, and utilize the depth information to determine the relationship between people and virtual object and reconstruct people in virtual space. Experimental results show that the proposed system can reconstruct the 3D image based on the estimated depth map at the right position in virtual space.

[1] M. Mohring, C. Lessing, and O. Bimber, “Video see-through AR on consumer cell-phones,” in Proceedings of the IEEE International Symposium on Mixed and Augmented, pp. 252-253, Nov 2004.

[2] R. T. Azuma, “A survey of augmented reality,” In Presence: Teleoperators and Virtual Environments 6, 4, pp. 355-385, Aug 1997.

[3] EyeToy, http://www.EyeToy.com

[4] Vivid Group, http://www.thevividgrp.com/

[5] T. Kakuta, L. B. Vinh, R. Kawakami, T. Oishi, “Detection of moving objects and cast shadows using a spherical vision camera for outdoor mixed reality,” in Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 219-222, Oct 2008.

[6] H. Kim, S. J. Yang and K. Sohn, “3D reconstruction of stereo images for interaction between real and virtual worlds,” in Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 169-176, Oct 2003.

[7] M. Accame, F. G. B. De Natale, and D. D. Giusto, “Hierarchical block matching for disparity estimation in stereo sequences,” in International Conference on Image Processing, Vol. II, pp. 374-377, Oct 1995.

[8] E. Izquierdo, “Stereo matching for enhanced telepresence in 3D-video communications,” IEEE Transactions on Circuits System Video Technology, Vol. 7, pp. 629-643, Aug 1997.

[9] T. Kanade and M. Okutomi, “A stereo matching algorithm with an adaptive windows: theory and experiment,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 9, pp. 920-932, Sep 1994.

[10] B. Deng, Y. Gao, L. Wu, B. Yang and Y. Wei, “Accurate feature point matching based on affine iterative model,” in Proceedings of the IEEE Information and Communication Technologies, Vol. 2, pp. 2969-2973, 2006.

[11] W.K. Pratt. “Digital image processing,” Second Edition, John Wiley and Sons, 1991.

[12] C. Harris and M. Stephens, “A combined corner and edge detector,” in Proc. of 4th ALVEY vision conference, pp. 147-151, 1988.
[13] Golias, N.A. and Dutton, R.W., “Delaunay triangulation and 3D adaptive mesh generation,” Finite Elements in Analysis and Design, Vol. 25, pp. 331-341, Apr 1997.

[14] J. Shi and C. Tomasi, “Good features to track,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, Jun 1994.

[15] J. Zhou and J. Shi, “A robust algorithm for feature point matching,” Computer & Graphics, pp. 429-436, Jun 2002.

[16] L. Zhang and W. J. Tam, “Stereoscopic image generation based on depth images for 3D TV”, IEEE Transactions on Broadcasting, Vol. 51, No. 2, pp. 191-199, Jun 2005.

[17] http://www.uart.org.tw/pscl/3d-stereo/3D-Doc-3.htm

[18] 彭國倫, “3D 繪圖程式設計使用：Direct3D 10/9與OpenGL 2.0,” 碁峰資訊股份有限公司, 2008.