簡易檢索 / 詳目顯示

研究生: 吳宏文
Wu, Hung-Wen
論文名稱: 非均勻有理化基底雲形類神經網路之研究與應用
Study on Non-Uniform Rational B-Splines Neural Networks and their Applications
指導教授: 鄭銘揚
Cheng, Ming-Yang
學位類別: 博士
Doctor
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2010
畢業學年度: 99
語文別: 英文
論文頁數: 123
中文關鍵詞: 非均勻有理化基底雲形類神經網路數位影像處理行波超音波馬達速度控制
外文關鍵詞: Non-uniform B-splines (NURBS), neural network, digital image process, traveling wave ultrasonic motor (TWUSM), speed control
相關次數: 點閱:104下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本論文之主旨在於針對非均勻有理化基底雲形類神經網路及其應用作深入探究。首先,基於非均勻有理化基底雲形曲線之概念,提出一嶄新的非均勻有理化基底雲形曲線類神經網路。由於行波超音波馬達特性複雜且其電壓對速度特性可用曲線表示,故將所提出之非均勻有理化基底雲形曲線類神經網路應用在行波超音波馬達之前饋補償器與回授控制器的設計問題上。其次,依據非均勻有理化基底雲形曲面之觀念,我們更進一步推演出一全新的非均勻有理化基底雲形曲面類神經網路。由於數位影像可用曲面方式描述之,故將所提出之非均勻有理化基底雲形曲面類神經網路應用於處理影像修補與影像壓縮問題上。在本論文所探討的非均勻有理化基底雲形曲線與曲面類神經網路中,其主要之架構乃以前饋式網路為其主體。與其他常見之類神經網路相較,其最大差異處在於第一層隱藏層中的活化函數是以基底函數取代常用的雙彎曲函數。同時,本論文採用倒傳遞演算法來完成非均勻有理化基底雲形曲線與非均勻有理化基底雲形曲面類神經網路中合宜控制點與權重值之學習。此外,本論文亦針對非均勻有理化基底雲形曲線與非均勻有理化基底雲形曲面類神經網路的相關參數值與節點值之選取方式以及應用流程作詳盡之描述與探討。最後,本論文提出數個範例並佐以模擬數據與實驗結果驗證所提方法之可行性與有效性。

    An in-depth study on the Non-Uniform B-splines (NURBS) neural networks and their applications is conducted in this dissertation. Firstly, based on the concept of the NURBS curve, the NURBS Curve Neural Network (NURBSCNN) is proposed. Since the characteristic curve that describes the relationship between the input voltage and the output speed for the traveling wave ultrasonic motor (TWUSM) is highly complex and nonlinear, the proposed NURBSCNN is applied to implement the feedforward compensator and speed controller for the TWUSM. Secondly, exploiting the idea of NURBS surface, the NURBS Surface Neural Network (NURBSSNN) is proposed. Since a digital image can be represented by a NURBS surface, the proposed NURBSSNN is employed to cope with the image compression and image restoration problems in this dissertation. Both the proposed NURBSCNN and NURBSSNN belong to the category of feedforward neural networks. Compared with other commonly used neural networks, the most significant difference is that the activation functions of the first hidden layers in the proposed neural networks are blending functions rather than the commonly used sigmoid functions. The back-propagation algorithm is exploited to learn appropriate values of the control points and weights in the proposed NURBSCNN and NURBSSNN. Moreover, the selection methods for the values of the corresponding parameter and knot vector in the NURBSCNN and NURBSSNN, as well as their application flowcharts, are elaborated upon and discussed in detail. The feasibility and effectiveness of the proposed approaches are demonstrated by several illustrative examples in this dissertation.

    Abstract (Chinese) i Abstract (English) ii Acknowledgment iv Contents v List of Tables viii List of Figures ix Symbols and Abbreviations xiv Chapter 1 Introduction 1 1.1 Motivation 2 1.2 Literature review 4 1.2.1 The application of NURBS on the control of TWUSM 4 1.2.2 The application of NURBS on image compression and restoration 6 1.3 Dissertation contributions 9 1.4 Dissertation organization 10 Chapter 2 Background of B-Splines Curves and Surfaces 11 2.1 Introduction 11 2.2 B-spline curves 12 2.3 Degree of a B-spline curve 14 2.4 Control points 15 2.5 Parameterization and knot vectors 16 2.5.1 Parameterization 16 2.5.2 Knot vectors 21 2.6 B-spline basis functions 25 2.7 B-spline surfaces 31 2.8 Rational B-spline curves and surfaces 32 2.9 Summary 35 Chapter 3 NURBS Curve Neural Networks and NURBS Surface Neural Networks 36 3.1 Introduction 36 3.2 The proposed NURBSCNN 38 3.2.1 Derivation of NURBSCNN 38 3.2.2 Learning rules for updating the control points and weights of NURBSCNN 40 3.3 The proposed NURBSSNN 42 3.3.1 Derivation of NURBSSNN 42 3.3.2 Learning rules for control points and weights of NURBSSNN 44 3.4 Summary 46 Chapter 4 Design of Feedforward Compensator and Speed Controller for TWUSM Using NURBSCNN 47 4.1 Introduction 47 4.2 Feedforward compensator design for TWUSM using NURBSCNN 49 4.2.1 Parameterization for feedforward compensator 52 4.2.2 Determination of knot vectors for feedforward compensator 53 4.3 Speed feedback controller design for TWUSM using NURBSCNN 56 4.3.1 Parameterization for speed feedback controller 57 4.3.2 Determination of knot vectors for speed feedback controller 58 4.4 Speed control architecture for TWUSM 61 4.5 Simulation and experimental results 63 4.5.1 Simulation results of feedforward compensator 63 4.5.2 Experimental results of speed control 65 4.6 Summary 97 Chapter 5 Application of NURBS Surface Neural Networks to Digital Image Processing 98 5.1 Introduction 98 5.2 NURBS surface representation of a digital image 100 5.3 Image compression using NURBSSNN 102 5.3.1 Parameterization and knot vectors determination for image compression 103 5.3.2 Selection of compression ratio 104 5.4 Corrupted image restoration using NURBSSNNs 106 5.4.1 Parameterization for image restoration 107 5.4.2 Determination of knot vectors for image restoration 108 5.5 Experimental results 109 5.5.1 Experimental results of image compression 109 5.5.2 Experimental results of corrupted image restoration 111 5.6 Summary 112 Chapter 6 Conclusions 114 6.1 Conclusions 114 6.2 Further work 115 References 117 Publication List 122 Vita 123

    [1] S. A. Coons, “Surfaces for Computer-Aided Design of Space Forms,” Technical Report MAC-TR-41, Cambridge, MA: MIT. 1967.
    [2] L. Piegl and W. Tiller, “Curve and Surface Constructions Using Rational B-Splines,” Computer-Aided Design, vol. 19, no. 9, pp. 485-498, 1987.
    [3] C. D. Boor, A Practical Guide to Splines. New York: Springer Verlag, 1978.
    [4] L. Piegl, “On NURBS: A Survey,” IEEE Computer Graphics and Application, vol. 11, no. 1, pp. 55-71, 1991.
    [5] M. Y. Cheng, H. Y. Huang, and A. W. Y Su, “A NURBS-Based Error Concealment Technique for Corrupted Images from Packet Loss,” in Proceedings of the 2002 IEEE International Conference on Image Processing, 2002, vol. 2, pp. 705-708.
    [6] W. Tiller, “Rational B-Splines for Curve and Surface Representation,” IEEE Computer Graphics and Application, pp. 61-69, 1983.
    [7] G. Bal and E. Bekiroglu, “Servo Speed Control of Travelling-Wave Ultrasonic Motor Using Digital Signal Processor,” Sensors and Actuators A: Physical, vol. 109, no. 3, pp. 212-219, 2004.
    [8] K. T. Chau, S. W. Chung, and C. C. Chan, “Neuro-Fuzzy Speed Tracking Control of Traveling-Wave Ultrasonic Motor Drives Using Direct Pulsewidth Modulation,” IEEE Transactions on Industry Applications, vol. 39, no. 4, pp. 1061-1069, 2003.
    [9] H. Mojallali, R. Amini, I. Z. Roozbeh, and A. A. Jalali, “Systematic Experimental Based Modeling of a Rotary Piezoelectric Ultrasonic Motor,” ISA Transactions, vol. 46, no. 1, pp. 31-40, 2007.
    [10] S. A. Al-Sabbah, E. Mendes, and Y. Bernard, “Derivation of Simplified Hybrid Model and Speed Control for Traveling Wave Ultrasonic Motor,” International Journal of Applied Electromagnetics and Mechanics, vol. 19, no. 1-4, pp. 581-585, 2004.
    [11] T. C. Chen, C. H. Yu, C. J. Chen, and M. C. Tsai, “Neuro-Fuzzy Speed Control of Traveling-Wave Type Ultrasonic Motor Drive Using Frequency and Phase Modulation,” ISA Transactions, vol. 47, no. 3, pp. 325-338, 2008.
    [12] T. Senjyu, H. Miyazato, S. Yokoda, and K. Uezato, “Speed Control of Ultrasonic Motors Using Neural Network,” IEEE Transactions on Power Electronics, vol. 13, no. 3, pp. 381-387, 1998.
    [13] M. Unser, A. Aldroubi, and M. Eden, “B-spline signal processing. II. Efficiency design and applications,” IEEE Transactions on Signal Processing, vol. 41, no. 2, pp. 834-848, 1993.
    [14] E. Bekiroglu and G. Bal, “Experimental Investigation of Input-Output Characteristics of a Travelling-Wave Ultrasonic Motor,” Journal of Electroceramics, vol. 20, no. 3-4, pp. 287-292, 2008.
    [15] S. W. Chung and K. T. Chau, “Servo Speed Control of Travelling-Wave Ultrasonic Motors Using Pulse Width Modulation,” Electric Power Components and Systems, vol. 29, no. 8, pp. 707-722, 2001.
    [16] Y. Izuno, R. Takeda, and M. Nakaoka, “New Fuzzy Reasoning-Based High-Performance Speed/Position Servo Control Schemes Incorporating Ultrasonic Motor,” IEEE Transactions on Industry Applications, vol. 28, no. 3, pp. 613-618, 1992.
    [17] A. V. Dam, “PHIGS+, Functional Description Revision 3.0,” Computer Graphics, vol. 22, no. 3, pp. 125-220, 1988.
    [18] M. L. Fang, D. F. Chen, and B. Y. Zhu, “Model Reconstruction of Existing Products Using Neural Networks for Reverse Engineering,” in Proceedings of the 1997 IEEE international conference on intelligent processing systems, 1997, pp. 396-400.
    [19] M. Y. Cheng, M. C. Tsai, and J. C. Kuo, “Real-Time NURBS Command Generators for CNC Servo Controllers,” International Journal of Machine Tools and Manufacture, vol. 42, no. 7, pp. 801-813, 2002.
    [20] M. Y. Cheng and Y. H. Wang, “Velocity Field Construction for Contour Following Tasks Represented in NURBS Form,” IEEE Transactions on Automatic Control, vol. 54, no. 10, pp. 2405-2410, 2009.
    [21] F. Iannelli and A. Uncini, “Learning of Physical-like Sound Synthesis Models by Adaptive Spline Recurrent Neural Networks,” IEE Electronics Letters, vol. 38, no. 14, pp. 724-725, 2002.
    [22] K. F. C. Yiu, S. Wang, K. L. Teo, and A. C. Tsoi, “Nonlinear System Modeling via Knot-Optimizing B-Spline Networks,” IEEE Transactions on Neural Network, vol. 12, no. 5, pp. 1013-1022, 2001.
    [23] S. Guarnieri and F. Piazza, “Multilayer Feedforward Networks with Adaptive Spline Activation Function,” IEEE Transactions on Neural Network, vol. 10, no. 3, pp. 672-683 , 1999.
    [24] Z. Y. Lin, D. S. Reay, B. W. Williams, and X. N. He, “Online Modeling for Switched Reluctance Motor Using B-Spline Neural Networks,” IEEE Transactions on Industrial Electronics, vol. 54, no. 6, pp. 3317-3322, 2007.
    [25] Z. Y. Lin, D. S. Reay, B. W. Williams, and X. N. He, “Torque Ripple Reduction in Switched Reluctance Motor Drives Using B-Spline Neural Networks,” IEEE Transactions on Industry Applications, vol. 42, no. 6, pp. 1445-1453, 2006.
    [26] T. Y. Lan, C. Y. Lo, M. Y. Wang, and Y. A. Yu, “Multi-Quality Prediction Model of CNC Turning Using Back-Propagation Network,” Information Technology Journal, vol. 7, no. 6, pp. 911-917, 2008.
    [27] I. Mutlu, “Artificial Neural Networks Modeling of Non-Asbestos Brake Lining Performance Boric Acid in Brake Pad,” Information Technology Journal, vol. 8, pp. 398-402, 2009.
    [28] C. W. Chan, K. C. Cheung, H. Jin, and H. Y. Zhang, “B-Spline Recurrent Neural Network and Its Application to Modeling of Nonlinear Dynamic Systems,” in Proceedings of the 1998 American Control Conference, 1998, pp. 78-82.
    [29] H. Jin, C. W. Chan, H. Y. Zhang, and W. K. Yeung, “Fault Detection of Redundant Systems Based on B-Spline Neural Network,” in Proceedings of the 2000 American Control Conference, 2000, pp. 1215-1219.
    [30] J. Y. Wang and F. S. Cohen, “3D Object Recognition and Shape Estimation from Image Contours Using B-Splines, Unwarping Techniques, and Neural Network,” in Proceedings of the 1991 IEEE International Joint Conference on Neural Networks, 1991, vol. 3, pp. 2318-2324.
    [31] J. Mao, Y. Wang, and W. Sun, “Remote Sensing Images Classification Using Fuzzy B-Spline Function Neural Network,” in Proceedings of the 2002 IEEE 4th World Congress on Intelligent Control and Automation, 2002, vol. 3, pp. 2159-2163.
    [32] M. Solazzi, F. Piazza, and A. Uncini, “Nonlinear Blind Source Separation by Spline Neural Networks,” in Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2001, vol. 5, pp. 2781-2784.
    [33] P. Campolucci, Capperelli F., Guarnieri S., Piazza F., and Uncini A., “Neural Networks with Adaptive Spline Activation Function”, in Proceedings of the 1996 IEEE 8th Mediterranean Electrotechnical Conference, 1996, vol. 3, pp. 1442-1445.
    [34] A. Z. Averbuch and V. A. Zheludev, “A New Family of Spline-Based Biorthogonal Wavelet Transforms and Their Application to Image Compression,” IEEE Transactions on Image Processing, vol. 13, no. 7, pp. 993-1007, 2004.
    [35] T. Watanabe, “Image Coding Making Use of B-Spline Surfaces,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 2, pp. 409-413, 1997.
    [36] H. Sun and W. Kwok, “Concealment of Damaged Block Transform Coded Images Using Projections onto Convex Sets,” IEEE. Transactions on Image Processing, vol. 4, no. 4, pp. 470-477, 1995.
    [37] L. Ma and K. Khorasani, “Application of Adaptive Constructive Neural Networks to Image Compression,” IEEE Transactions on Neural Networks, vol. 13, no. 5, pp. 1112-1126, 2002.
    [38] S. W. Perry and L. Guan, “Weight Assignment for Adaptive Image Restoration by Neural Networks,” IEEE Transactions on Neural Networks, vol. 11, no. 1, pp. 156-170, 2000.
    [39] J. Luo, C. W. Chen, K. J. Parker, and T. S. Huang, “Artifact Reduction in Low Bit Rate DCT-based Image Compression,” IEEE Transactions on Image Processing, vol. 5, no. 9, pp. 1363-1368, 1996.
    [40] L. F. Shang, Z. Yi, and L. P. Ji, “Binary Image Thinning Using Autowaves Generated by PCNN,” Neural Processing Letters, vol. 25, no. 1, pp. 49-62, 2007.
    [41] M. J. Seow and V. K. Asari, “Color Characterization and Balancing by a Nonlinear Line Attractor Network for Image Enhancement,” Neural Processing Letters, vol. 22, no. 3, pp. 291-309, 2005.
    [42] S. Ridella, S. Rovetta, and R. Zunino, “IAVQ-Interval- Arithmetic Vector Quantization for Image Compression,” IEEE Transactions on Circuits and Systems, vol. 47, no. 12, pp. 1378-1390, 2000.
    [43] Y. G. Wu and S. C. Tai, “Low Bit Rate Subband DCT Image Compression,” IEEE Transactions on Consumer Electronics, vol. 43, no. 2, pp. 134-140, 1997.
    [44] Y. Sun, “Hopfield Neural Network Based Algorithms for Image Restoration and Reconstruction. I. Algorithms and Simulations,” IEEE Transactions on Signal Processing, vol. 48, no. 7, pp. 2105-2118, 2000.
    [45] Y. Wang and Q. Zhu, “Signal Loss Recovery in DCT Based Image and Video Codec,” in SPIE Proceeding of Signal Communication and Image Processing, 1991, pp. 667-678.
    [46] E. T. Y. Lee, “Choosing Nodes in Parametric Curve Interpolation,” Computer-Aided Design, vol. 21, no. 6, pp. 363-370, 1989.
    [47] M. Y. Cheng, H. W. Wu, and A. W. Y. Su, “On Non-Uniform Rational B-Splines Surface Neural Networks,” Neural Processing Letters, vol. 28, no. 1, pp. 1-15, 2008.
    [48] D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, “Parallel Distributed Processing: Explorations in the Microstructure of Cognition,” Cambridge: MIT Press, vol. 1, 1987.
    [49] H. W. Wu and M. Y. Cheng, “Design of Feedforward Compensator for the Travelling Wave Ultrasonic Motor Based on Non-Uniform Rational B-Splines Curve Neural Network,” Information Technology Journal, vol. 9, no. 8, pp. 1671-1676, 2010.
    [50] R. H. Brown, S. C. Schneider, and M. G. Mulligan, “Analysis of Algorithms for Velocity Estimation from Discrete Position versus Time Data,” IEEE Transactions on Industrial Electronics, vol. 39, no. 1, pp. 11-19, 1992.
    [51] Shinsei Corporation, Japan. Manual for USR-60 and Driver D6060 (2005) [Online]. Available: http://www.shinsei-motor.com/English/welcome.html.
    [52] Industrial Technology Research Institute, Taiwan. PC-based Motion Control Card with EPCIO-4000. (2010) [Online]. Available: http://www.epcio.com.tw/motioncard.html.
    [53] J. B. Ziegler and N. B. Nichols, “Optimum Settings for Automatic Controllers,” Transactions of the ASME, vol. 64, pp. 759-768, 1942.
    [54] P. Cominos and N. Munro, “PID Controllers: Recent Tuning Methods and Design to Specification,” in Proceedings of the 2002 IEE Control Theory and Applications, 2002, vol. 149, no. 1, pp. 46-53.
    [55] C. Gonzalez and R. E. Woods, Digital Image Processing. 3rd edition, Taipei: Pearson Education, 2008.
    [56] J. Canny, “A Computational Approach to Edge Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986.
    [57] J. W. Park and S. U. Lee, “Recovery of Corrupted Image Data Based on the NURBS Interpolation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 7, pp. 1003-1008, 1999.
    [58] H. Y., Huang, “On Corrupted Image Restoration and Image Compression Using NURBS,” Master Degree Thesis, Dayeh University, Taiwan, 2000.

    下載圖示 校內:2012-01-24公開
    校外:2013-01-24公開
    QR CODE