簡易檢索 / 詳目顯示

研究生: 嚴崇仁
Yan, Chung-Ren
論文名稱: 非擬真風格化材質分析與合成演算法
Texture Synthesis for Stylized Rendering
指導教授: 李同益
Lee, Tong-Yee
學位類別: 博士
Doctor
系所名稱: 電機資訊學院 - 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2009
畢業學年度: 97
語文別: 英文
論文頁數: 82
中文關鍵詞: 材質合成風格化繪圖醫學容積模型視覺化
外文關鍵詞: Stylization rendering, Anatomic visualization, Non-frontal-parallel Textures., Texture Synthesis
相關次數: 點閱:83下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近十年來,更多的學者投入了材質貼圖的研究領域,如何節省儲存材質貼圖的空間且保留材質的細緻度,一直是個持續不斷的研究方向。材質合成演算法是解決這個問題一個很好的方案,我們可以藉由材質合成演算法將小尺寸的材質合成符合我們所需要的任意大小尺寸與輪廓的材質,且可以保留原始材質的結狗性與解析度。本篇論文首先提出一個嶄新的材質合成演算法,利用影像特徵的分析使得材質合成演算法更為自動化並能產生品質較佳的合成材質,此外我們加入了平行視點空間轉換與變形的觀念,讓一般材質合成演算法所無法處理的非平行視點的材質影像能夠合成較佳的結果。其次,我們考慮不同材質間相依性的問題,並結合非擬真電腦繪圖方法,將醫學容積模型作不同風格的非擬真視覺化表現。最後,對於畫作筆觸風格轉移的問題,我們提出一套自動擷取畫作中重要筆觸的流程,並改善我們的材質合成演算法,合成出在空間與色調上均保持連續性的三維貼圖,並將二維影像的筆觸貼圖轉移到三維模型上。

    In this thesis, we propose a new patch-based texture synthesis method. The core of the proposed method consists of two main components: 1) a feature-weighted similarity measurement to search for the best match and 2) a dynamically prioritized-based pixel re-synthesis to reduce discontinuity at the boundary of adjacent patches. Examples and experimental comparisons with other previous methods are demonstrated to verify the usefulness of our proposed method. In addition, we enhance the proposed method with a view warping technique to better synthesize non-frontal-parallel textures (NFPTs) that can not be synthesized well by traditional texture synthesis methods.
    Next, A non-photorealistic rendering (NPR) technique can help medical practitioners visualize anatomic models and illustrate them with different stylizations. This technique provides potentially useful rendering alternatives to conventional volume or surface rendering in medical visualization. Improved performance allows interactive visualization of anatomic models and adding stroke texture synthesis can enrich medical object illustrations.
    Finally, we introduce a novel technique to generate painterly art maps (PAM) for 3D non-photorealistic rendering. Our technique can automatically transfer brush stroke textures and color changes to 3D models from samples of a painted image. Therefore, the generation of stylized images or animation in the style of a given artwork can be achieved. This new approach works particularly well for a rich variety of brush strokes ranging from simple 1D and 2D line-art strokes to very complicated ones with significant variations in stroke characteristics. During the rendering or animation process, the coherence of brush stroke textures and color changes over 3D surfaces can be well maintained.

    中文摘要 I Abstract II Acknowledgements IV Contents V List of Tables VII List of Figures VIII Chapter 1. Introduction 1 1.1 Motive 1 1.2 Contribution 4 1.3 Organization 5 Chapter 2. Related Works 7 2.1 Texture Synthesis 7 2.2 Stylized rendering 9 Chapter 3. Texture Synthesis with Prioritized Pixel Re-synthesis 13 3.1 Overview 13 3.2 Texture Synthesis 14 3.2.1 Searching the Best Patch 15 3.2.2 Reducing Discontinuity in Overlapping Regions 17 3.3 Results 22 3.3.1 Synthesis results of Frontal-parallel Textures 22 3.3.2 Handling Non-frontal-parallel Textures (NFPT) 27 Chapter 4. Stylized Rendering for Anatomic Visualization 31 4.1 Overview 31 4.2 Data Preprocessing 32 4.2.1 Smoothing and Relaxation 32 4.2.2 Directions and Curvature 33 4.3 NPR QSplat Point-Sampled Hierarchy 35 4.4 Stroke Drawing with Stylization 36 4.4.1 Rendering with Strokes 37 4.4.2 Example-Based Stroke Synthesis 38 4.5 Results 41 Chapter 5. Stylized Rendering Using Samples of a Painted 46 5.1 Overview 46 5.2 System Overview 49 5.3 Painterly Art Map Construction 50 5.3.1 Painting image segmentation using scribbles 50 5.3.2 Coherence Search Space 51 5.3.3 Key Map Generation Using Multi-resolution Synthesis 53 5.3.4 In-between Maps Synthesis 57 5.4 Apply PAM to Stylized NPR Rendering 58 5.5 Results 59 5.5.1 Generating line art PAM 60 5.5.2 Stylization of different paintings 61 5.5.3 Rendering Performance 66 5.5.4 Comparison and Application 66 Chapter 6. Conclusions 72 References 75 Vita 81

    1. M. Ashikhmin, “Synthesizing natural textures,” ACM Symposium on Interactive 3D Graphics, pp. 217-226, 2001.
    2. T. Beier, and S. Neely, “Feature-based image metamorphosis,” Proceedings of SIGGRAPH 92. In Computer Graphics, pp. 35-42, 1992.
    3. Z. Bar-Joseph, R. El-Yaniv, D. Lischinski, and M. Werman, “Texture mixing and texture movie synthesis using statistical learning,” IEEE Trans. Visualization and Computer Graphics, vol. 7, no. 2, pp. 120–135, 2001.
    4. S. Bruckner and M. E. GrLoller, “Style transfer functions for illustrative volume rendering,” Computer Graphics Forum, vol. 26, pp. 715–724, 2007.
    5. D. Cornish, A. Rowan, and D. Luebke, “View-dependent particles for interactive non-photorealistic rendering,” Proc. Graphics Interface, pp. 151–158, 2001.
    6. M. F. Cohen, J. Shade, S. Hiller, and O. Deussen, “Wang tiles for image and texture generation,” ACM Transactions on Graphics, vol. 22, no. 3, pp. 287– 294, Jul. 2003.
    7. M.-T. Chi and T.-Y. Lee, “Stylized and Abstract Painterly Rendering System Using a Multi-scale Segmented Sphere Hierarchy,” IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 1, pp. 61–72, 2006.
    8. Y. Deng, B. S. Manjunath, and H. Shin, “Color image segmentation,” Proc. Computer Vision and Pattern Recognition (CVPR), pp. 2446–2451, 1999.
    9. O. Deussen and T. Strothotte, “Computer-generated pen-and-ink illustration of trees,” Proceedings of SIGGRAPH, pp. 13–18, 2000.
    10. F. Dong, G. J. Clapworthy, H. Lin, and M. A. Krokos, “Nonphotorealistic Rendering of Medical Volume Data,” IEEE Computer Graphics & Applications, vol. 23, no. 4, pp. 44–52, 2003.
    11. A. A. Efros and T. K. Leung, “Texture synthesis by non-parametric sampling,” Intl. Conf. Computer Vision, pp. 1033-1038, 1999.
    12. A. A. Efros and W. T. Freeman, “Image quilting for texture synthesis and transfer,” Proceedings of SIGGRAPH, pp. 341–346, 2001.
    13. H. Fang and J. C. Hart, “Textureshop: texture synthesis as a photograph editing tool,” ACM Transactions on Graphics, 23(3):354–359, 2004.
    14. A. Gooch, B. Gooch, P. Shirley, and E. Cohen, “A Non-Photorealistic Lighting Model for Automatic Technical Illustration,” Proceedings of SIGGRAPH, ACM Press, pp. 447–452, 1998.
    15. B. Gooch and A. Gooch, “Non-Photorealistic Rendering,” AK Peters, 2001.
    16. D. J. Heeger and J. R. Bergen, “Pyramid-based texture analysis/ synthesis,” Proceedings of SIGGRAPH, pp. 229–238, 1995.
    17. A. Hertzmann and D. Zorin, “Illustrating smooth surfaces,” Proceedings of SIGGRAPH, pp. 517–526, 2000.
    18. A. Hertzmann, C. Jacobs, N. Oliver, B. Curless, and D. Salesin, “Image analogies,” Proceedings of SIGGRAPH, pp. 327-340, 2001.
    19. A. Hertzmann, “A survey of stroke-based rendering,” IEEE Computeru. 3187 Graphics and Applications, vol. 23, no. 4, pp. 70–81, 2003.
    20. R. D. Kalnins, L. Markosian, B. J. Meier, M. A. Kowalski, J. C. Lee, P. L. Davidson, M. Webb, J. F. Hughes, and A. Finkelstein, “Wysiwyg npr: Drawing strokes directly on 3d models,” ACM Transactions on Graphics, vol. 21, no. 3, pp. 755–762, Jul. 2002.
    21. C. D. Kulla, J. D. Tucek, R. J. Bailey, and C. M. Grimm, “Using texture synthesis for non-photorealistic shading from paint samples,” Proc. Pacific Conf. Computer Graphics and Applications, pp. 477–481, 2003.
    22. V. Kwatra, A. Schödl, I. Essa, G. Turk and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” ACM Transactions on Graphics (SIGGRAPH 2003), Vol. 22, No. 3, pp. 277-286, July 2003.
    23. V. Kwatra, I. Essa, A. Bobick, and N. Kwatra, “Texture optimization for example-based synthesis,” ACM Transactions on Graphics (SIGGRAPH 2005), Vol. 24, No.3, pp. 795-802, July 2005.
    24. L. Liang, C. Liu, Y. Xu, B. Guo, and H.-Y Shum, “Real-time texture synthesis using patch-based sampling,” ACM Transactions on Graphics, Vol. 20, No. 3, pp. 127-150, 2001.
    25. A. Lu, C. J. Morris, D. S. Ebert, P. Rheingans, and C. Hansen, “Non-Photorealistic Volume Rendering Using Stippling Techniques,” Proc. IEEE Visualization 2002, IEEE CS Press, pp. 211–218, 2002.
    26. E. B. Lum, A. Stompel, and K.-L. Ma, “Using motion to illustrate static 3d shape- kinetic visualization,” IEEE Trans. Visualization and Computer Graphics, vol. 9, no. 2, pp. 115–126, 2003.
    27. P.-H. Lin and T.-Y Lee, “Camera- Sampling Field and Its Applications,” IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 3, pp. 241–251, 2004.
    28. Y. Liu, W.-C. Lin, and J. HaysG, “Near Regular Texture Analysis and Manipulation,” ACM Transactions on Graphics (SIGGRAPH 2004), Vol. 23, No. 3, pp. 368-376, 2004.
    29. S. Lefebvre and H. Hoppe, “Parallel controllable texture synthesis,” ACM Transactions on Graphics (SIGGRAPH 2005), Vol. 24, No.3, pp. 777-786, July 2005.
    30. T.-Y. Lee and C.-R. Yan, “Feature-Based Texture Synthesis,” Proc. Int’l Conf. Computational Science and its Applications (ICCSA 05), LNCS 3482, Springer-Verlag, pp. 1043–1049, 2005.
    31. T.-Y. Lee, C.-R. Yan, and M.-T. Chi, “Stylized rendering for anatomic visualization,” Computing in Science and Engg., vol. 9, no. 1, pp. 13–19, 2007.
    32. T.-Y. Lee, C.-H. Lin, S.-W. Yen and H.-J. Chen, “A natural pen-and-paper like sketching interface for modeling and animation,” Proc. Int’l Conf. Computer Animation and Social Agents(CASA), pp. 87–92, 2007.
    33. B. J. Meier, “Painterly rendering for animation,” Proceedings of SIGGRAPH, pp. 477–484, 1996.
    34. W. Matusik, M. Zwicker, and F. Durand, “Texture design using a simplicial complex of morphable textures,” ACM Transactions on Graphics, vol. 24, no. 3, pp. 787–794, Aug. 2005.
    35. J. D. Northrup and L. Markosian, “Artistic silhouettes: a hybrid approach,” Proc. Symp. Non-photorealistic animation and rendering, pp. 31–37, 2000.
    36. A. Nealen and M. Alexa, “Hybrid Texture Synthesis,” Proceedings of Eurographics Symposium on Rendering, pp. 97-105, 2003.
    37. Y. Ohtake, A. Belyaev, M. Alexa, G. Turk, and H.-P Seidel, “Multi-Level Partition of Unity Implicits,” ACM Transactions on Graphics, vol. 22, no. 3, pp. 463–470, 2003.
    38. H. Pfister, M. Zwicker, J. van Baar, and M. Gross, “Surfels: Surface elements as rendering primitives,” Proceedings of SIGGRAPH, pp. 335–342, 2000.
    39. E. Praun, H. Hoppe, M. Webb, and A. Finkelstein, “Real-Time Hatching,” Proceedings of SIGGRAPH, ACM Press, pp. 581–586, 2001.
    40. M. Pauly, R. Keiser, and M. Gross, “Multi-Scale Feature Extraction on Point-Sampled Models,” Proceedings of EUROGRAPHICS 2003, Blackwell, pp. 281–289, 2003.
    41. D. Pavić, V. Schönefeld, and L. Kobbelt, “Interactive Image Completion with Perspective Correction,” The Visual Computer, Vol. 22, No. 9, pp. 671-681, 2006.
    42. S. Rusinkiewicz and M. Levoy, “QSplat: A Multiresolution Point Rendering System for Large Meshes,” Proceedings of SIGGRAPH, ACM Press, pp. 343–352, 2000.
    43. E. Reinhard, M. Ashikhmin, B. Gooch, and P. S. Shirley, “Color transfer between images,” IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34–41, Sep./Oct. 2001.
    44. S. Seitz, and C. Dyer, “View Morphing,” Proceedings of SIGGRAPH, pp. 21-30, 1996.
    45. P.-P. J. Sloan, W. Martin, A. Gooch, and B. Gooch, “The lit sphere: a model for capturing npr shading from art,” Proc. Graphics Interface, pp. 143–150, 2001.
    46. T. Strothotte and S. Schlechtweg, “Non-Photorealistic Computer Graphics Modeling, Rendering and Animation,” Morgan Kaufmann, 2002.
    47. L.-Y. Wei and M. Levoy, “Fast texture synthesis using tree-structured vector quantization,” Proceedings of SIGGRAPH, pp. 479-488, 2000.
    48. M. Webb, E. Praun, A. Finkelstein, and H. Hoppe, “Fine tone control in hardware hatching,” Proc. Symp. Non-photorealistic animation and rendering, pp. 53–58, 2002.
    49. Q. Wu and Y. Yu, “Feature Matching and Deformation for Texture Synthesis,” ACM Transactions on Graphics (SIGGRAPH 2004), Vol. 23, No. 3, pp. 362-365, 2004.
    50. Y. Xu, B. Guo, And H.-Y Shum, “Chaos mosaic: Fast and memory efficient texture synthesis,” Microsoft Res. Tech. Rep. MSR-TR-2000-32, April, 2000.
    51. H. Xu, N. Gossett, and B. Chen, “Pointworks: Abstraction and rendering of sparsely scanned outdoor environments,” Proc. Eurographics Symp. Rendering, pp. 45–52, 2004.
    52. X. Yuan and B. Chen, “Illustrating Surfaces in Volume,” Proc. VisSym 04: Joint IEEE/EG Symp. Visualization, pp. 9–16, 2004.
    53. J. Zhang, K. Zhou, L. Velho, B. Guo, and H.-Y. Shum, “Synthesis of progressively variant textures on arbitrary surfaces,” ACM Transactions on Graphics, vol. 22, no. 3, pp. 295–302, Jul. 2003.
    54. S. Zelinka and M. Garland, “Interactive texture synthesis on surfaces using jump maps,” Proc. Eurographics Symp. Rendering, pp. 90–96, 2003.
    55. S. Zelinka and M. Garland, “Jump map-based interactive texture synthesis,” ACM Transactions on Graphics, Vol. 23, No. 4, pp. 930-962, 2004.

    下載圖示 校內:2011-08-31公開
    校外:2011-08-31公開
    QR CODE