| 研究生: |
吳宏文 Wu, Hung-Wen |
|---|---|
| 論文名稱: |
非均勻有理化基底雲形類神經網路之研究與應用 Study on Non-Uniform Rational B-Splines Neural Networks and their Applications |
| 指導教授: |
鄭銘揚
Cheng, Ming-Yang |
| 學位類別: |
博士 Doctor |
| 系所名稱: |
電機資訊學院 - 電機工程學系 Department of Electrical Engineering |
| 論文出版年: | 2010 |
| 畢業學年度: | 99 |
| 語文別: | 英文 |
| 論文頁數: | 123 |
| 中文關鍵詞: | 非均勻有理化基底雲形 、類神經網路 、數位影像處理 、行波超音波馬達 、速度控制 |
| 外文關鍵詞: | Non-uniform B-splines (NURBS), neural network, digital image process, traveling wave ultrasonic motor (TWUSM), speed control |
| 相關次數: | 點閱:104 下載:3 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文之主旨在於針對非均勻有理化基底雲形類神經網路及其應用作深入探究。首先,基於非均勻有理化基底雲形曲線之概念,提出一嶄新的非均勻有理化基底雲形曲線類神經網路。由於行波超音波馬達特性複雜且其電壓對速度特性可用曲線表示,故將所提出之非均勻有理化基底雲形曲線類神經網路應用在行波超音波馬達之前饋補償器與回授控制器的設計問題上。其次,依據非均勻有理化基底雲形曲面之觀念,我們更進一步推演出一全新的非均勻有理化基底雲形曲面類神經網路。由於數位影像可用曲面方式描述之,故將所提出之非均勻有理化基底雲形曲面類神經網路應用於處理影像修補與影像壓縮問題上。在本論文所探討的非均勻有理化基底雲形曲線與曲面類神經網路中,其主要之架構乃以前饋式網路為其主體。與其他常見之類神經網路相較,其最大差異處在於第一層隱藏層中的活化函數是以基底函數取代常用的雙彎曲函數。同時,本論文採用倒傳遞演算法來完成非均勻有理化基底雲形曲線與非均勻有理化基底雲形曲面類神經網路中合宜控制點與權重值之學習。此外,本論文亦針對非均勻有理化基底雲形曲線與非均勻有理化基底雲形曲面類神經網路的相關參數值與節點值之選取方式以及應用流程作詳盡之描述與探討。最後,本論文提出數個範例並佐以模擬數據與實驗結果驗證所提方法之可行性與有效性。
An in-depth study on the Non-Uniform B-splines (NURBS) neural networks and their applications is conducted in this dissertation. Firstly, based on the concept of the NURBS curve, the NURBS Curve Neural Network (NURBSCNN) is proposed. Since the characteristic curve that describes the relationship between the input voltage and the output speed for the traveling wave ultrasonic motor (TWUSM) is highly complex and nonlinear, the proposed NURBSCNN is applied to implement the feedforward compensator and speed controller for the TWUSM. Secondly, exploiting the idea of NURBS surface, the NURBS Surface Neural Network (NURBSSNN) is proposed. Since a digital image can be represented by a NURBS surface, the proposed NURBSSNN is employed to cope with the image compression and image restoration problems in this dissertation. Both the proposed NURBSCNN and NURBSSNN belong to the category of feedforward neural networks. Compared with other commonly used neural networks, the most significant difference is that the activation functions of the first hidden layers in the proposed neural networks are blending functions rather than the commonly used sigmoid functions. The back-propagation algorithm is exploited to learn appropriate values of the control points and weights in the proposed NURBSCNN and NURBSSNN. Moreover, the selection methods for the values of the corresponding parameter and knot vector in the NURBSCNN and NURBSSNN, as well as their application flowcharts, are elaborated upon and discussed in detail. The feasibility and effectiveness of the proposed approaches are demonstrated by several illustrative examples in this dissertation.
[1] S. A. Coons, “Surfaces for Computer-Aided Design of Space Forms,” Technical Report MAC-TR-41, Cambridge, MA: MIT. 1967.
[2] L. Piegl and W. Tiller, “Curve and Surface Constructions Using Rational B-Splines,” Computer-Aided Design, vol. 19, no. 9, pp. 485-498, 1987.
[3] C. D. Boor, A Practical Guide to Splines. New York: Springer Verlag, 1978.
[4] L. Piegl, “On NURBS: A Survey,” IEEE Computer Graphics and Application, vol. 11, no. 1, pp. 55-71, 1991.
[5] M. Y. Cheng, H. Y. Huang, and A. W. Y Su, “A NURBS-Based Error Concealment Technique for Corrupted Images from Packet Loss,” in Proceedings of the 2002 IEEE International Conference on Image Processing, 2002, vol. 2, pp. 705-708.
[6] W. Tiller, “Rational B-Splines for Curve and Surface Representation,” IEEE Computer Graphics and Application, pp. 61-69, 1983.
[7] G. Bal and E. Bekiroglu, “Servo Speed Control of Travelling-Wave Ultrasonic Motor Using Digital Signal Processor,” Sensors and Actuators A: Physical, vol. 109, no. 3, pp. 212-219, 2004.
[8] K. T. Chau, S. W. Chung, and C. C. Chan, “Neuro-Fuzzy Speed Tracking Control of Traveling-Wave Ultrasonic Motor Drives Using Direct Pulsewidth Modulation,” IEEE Transactions on Industry Applications, vol. 39, no. 4, pp. 1061-1069, 2003.
[9] H. Mojallali, R. Amini, I. Z. Roozbeh, and A. A. Jalali, “Systematic Experimental Based Modeling of a Rotary Piezoelectric Ultrasonic Motor,” ISA Transactions, vol. 46, no. 1, pp. 31-40, 2007.
[10] S. A. Al-Sabbah, E. Mendes, and Y. Bernard, “Derivation of Simplified Hybrid Model and Speed Control for Traveling Wave Ultrasonic Motor,” International Journal of Applied Electromagnetics and Mechanics, vol. 19, no. 1-4, pp. 581-585, 2004.
[11] T. C. Chen, C. H. Yu, C. J. Chen, and M. C. Tsai, “Neuro-Fuzzy Speed Control of Traveling-Wave Type Ultrasonic Motor Drive Using Frequency and Phase Modulation,” ISA Transactions, vol. 47, no. 3, pp. 325-338, 2008.
[12] T. Senjyu, H. Miyazato, S. Yokoda, and K. Uezato, “Speed Control of Ultrasonic Motors Using Neural Network,” IEEE Transactions on Power Electronics, vol. 13, no. 3, pp. 381-387, 1998.
[13] M. Unser, A. Aldroubi, and M. Eden, “B-spline signal processing. II. Efficiency design and applications,” IEEE Transactions on Signal Processing, vol. 41, no. 2, pp. 834-848, 1993.
[14] E. Bekiroglu and G. Bal, “Experimental Investigation of Input-Output Characteristics of a Travelling-Wave Ultrasonic Motor,” Journal of Electroceramics, vol. 20, no. 3-4, pp. 287-292, 2008.
[15] S. W. Chung and K. T. Chau, “Servo Speed Control of Travelling-Wave Ultrasonic Motors Using Pulse Width Modulation,” Electric Power Components and Systems, vol. 29, no. 8, pp. 707-722, 2001.
[16] Y. Izuno, R. Takeda, and M. Nakaoka, “New Fuzzy Reasoning-Based High-Performance Speed/Position Servo Control Schemes Incorporating Ultrasonic Motor,” IEEE Transactions on Industry Applications, vol. 28, no. 3, pp. 613-618, 1992.
[17] A. V. Dam, “PHIGS+, Functional Description Revision 3.0,” Computer Graphics, vol. 22, no. 3, pp. 125-220, 1988.
[18] M. L. Fang, D. F. Chen, and B. Y. Zhu, “Model Reconstruction of Existing Products Using Neural Networks for Reverse Engineering,” in Proceedings of the 1997 IEEE international conference on intelligent processing systems, 1997, pp. 396-400.
[19] M. Y. Cheng, M. C. Tsai, and J. C. Kuo, “Real-Time NURBS Command Generators for CNC Servo Controllers,” International Journal of Machine Tools and Manufacture, vol. 42, no. 7, pp. 801-813, 2002.
[20] M. Y. Cheng and Y. H. Wang, “Velocity Field Construction for Contour Following Tasks Represented in NURBS Form,” IEEE Transactions on Automatic Control, vol. 54, no. 10, pp. 2405-2410, 2009.
[21] F. Iannelli and A. Uncini, “Learning of Physical-like Sound Synthesis Models by Adaptive Spline Recurrent Neural Networks,” IEE Electronics Letters, vol. 38, no. 14, pp. 724-725, 2002.
[22] K. F. C. Yiu, S. Wang, K. L. Teo, and A. C. Tsoi, “Nonlinear System Modeling via Knot-Optimizing B-Spline Networks,” IEEE Transactions on Neural Network, vol. 12, no. 5, pp. 1013-1022, 2001.
[23] S. Guarnieri and F. Piazza, “Multilayer Feedforward Networks with Adaptive Spline Activation Function,” IEEE Transactions on Neural Network, vol. 10, no. 3, pp. 672-683 , 1999.
[24] Z. Y. Lin, D. S. Reay, B. W. Williams, and X. N. He, “Online Modeling for Switched Reluctance Motor Using B-Spline Neural Networks,” IEEE Transactions on Industrial Electronics, vol. 54, no. 6, pp. 3317-3322, 2007.
[25] Z. Y. Lin, D. S. Reay, B. W. Williams, and X. N. He, “Torque Ripple Reduction in Switched Reluctance Motor Drives Using B-Spline Neural Networks,” IEEE Transactions on Industry Applications, vol. 42, no. 6, pp. 1445-1453, 2006.
[26] T. Y. Lan, C. Y. Lo, M. Y. Wang, and Y. A. Yu, “Multi-Quality Prediction Model of CNC Turning Using Back-Propagation Network,” Information Technology Journal, vol. 7, no. 6, pp. 911-917, 2008.
[27] I. Mutlu, “Artificial Neural Networks Modeling of Non-Asbestos Brake Lining Performance Boric Acid in Brake Pad,” Information Technology Journal, vol. 8, pp. 398-402, 2009.
[28] C. W. Chan, K. C. Cheung, H. Jin, and H. Y. Zhang, “B-Spline Recurrent Neural Network and Its Application to Modeling of Nonlinear Dynamic Systems,” in Proceedings of the 1998 American Control Conference, 1998, pp. 78-82.
[29] H. Jin, C. W. Chan, H. Y. Zhang, and W. K. Yeung, “Fault Detection of Redundant Systems Based on B-Spline Neural Network,” in Proceedings of the 2000 American Control Conference, 2000, pp. 1215-1219.
[30] J. Y. Wang and F. S. Cohen, “3D Object Recognition and Shape Estimation from Image Contours Using B-Splines, Unwarping Techniques, and Neural Network,” in Proceedings of the 1991 IEEE International Joint Conference on Neural Networks, 1991, vol. 3, pp. 2318-2324.
[31] J. Mao, Y. Wang, and W. Sun, “Remote Sensing Images Classification Using Fuzzy B-Spline Function Neural Network,” in Proceedings of the 2002 IEEE 4th World Congress on Intelligent Control and Automation, 2002, vol. 3, pp. 2159-2163.
[32] M. Solazzi, F. Piazza, and A. Uncini, “Nonlinear Blind Source Separation by Spline Neural Networks,” in Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2001, vol. 5, pp. 2781-2784.
[33] P. Campolucci, Capperelli F., Guarnieri S., Piazza F., and Uncini A., “Neural Networks with Adaptive Spline Activation Function”, in Proceedings of the 1996 IEEE 8th Mediterranean Electrotechnical Conference, 1996, vol. 3, pp. 1442-1445.
[34] A. Z. Averbuch and V. A. Zheludev, “A New Family of Spline-Based Biorthogonal Wavelet Transforms and Their Application to Image Compression,” IEEE Transactions on Image Processing, vol. 13, no. 7, pp. 993-1007, 2004.
[35] T. Watanabe, “Image Coding Making Use of B-Spline Surfaces,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 2, pp. 409-413, 1997.
[36] H. Sun and W. Kwok, “Concealment of Damaged Block Transform Coded Images Using Projections onto Convex Sets,” IEEE. Transactions on Image Processing, vol. 4, no. 4, pp. 470-477, 1995.
[37] L. Ma and K. Khorasani, “Application of Adaptive Constructive Neural Networks to Image Compression,” IEEE Transactions on Neural Networks, vol. 13, no. 5, pp. 1112-1126, 2002.
[38] S. W. Perry and L. Guan, “Weight Assignment for Adaptive Image Restoration by Neural Networks,” IEEE Transactions on Neural Networks, vol. 11, no. 1, pp. 156-170, 2000.
[39] J. Luo, C. W. Chen, K. J. Parker, and T. S. Huang, “Artifact Reduction in Low Bit Rate DCT-based Image Compression,” IEEE Transactions on Image Processing, vol. 5, no. 9, pp. 1363-1368, 1996.
[40] L. F. Shang, Z. Yi, and L. P. Ji, “Binary Image Thinning Using Autowaves Generated by PCNN,” Neural Processing Letters, vol. 25, no. 1, pp. 49-62, 2007.
[41] M. J. Seow and V. K. Asari, “Color Characterization and Balancing by a Nonlinear Line Attractor Network for Image Enhancement,” Neural Processing Letters, vol. 22, no. 3, pp. 291-309, 2005.
[42] S. Ridella, S. Rovetta, and R. Zunino, “IAVQ-Interval- Arithmetic Vector Quantization for Image Compression,” IEEE Transactions on Circuits and Systems, vol. 47, no. 12, pp. 1378-1390, 2000.
[43] Y. G. Wu and S. C. Tai, “Low Bit Rate Subband DCT Image Compression,” IEEE Transactions on Consumer Electronics, vol. 43, no. 2, pp. 134-140, 1997.
[44] Y. Sun, “Hopfield Neural Network Based Algorithms for Image Restoration and Reconstruction. I. Algorithms and Simulations,” IEEE Transactions on Signal Processing, vol. 48, no. 7, pp. 2105-2118, 2000.
[45] Y. Wang and Q. Zhu, “Signal Loss Recovery in DCT Based Image and Video Codec,” in SPIE Proceeding of Signal Communication and Image Processing, 1991, pp. 667-678.
[46] E. T. Y. Lee, “Choosing Nodes in Parametric Curve Interpolation,” Computer-Aided Design, vol. 21, no. 6, pp. 363-370, 1989.
[47] M. Y. Cheng, H. W. Wu, and A. W. Y. Su, “On Non-Uniform Rational B-Splines Surface Neural Networks,” Neural Processing Letters, vol. 28, no. 1, pp. 1-15, 2008.
[48] D. E. Rumelhart, J. L. McClelland, and the PDP Research Group, “Parallel Distributed Processing: Explorations in the Microstructure of Cognition,” Cambridge: MIT Press, vol. 1, 1987.
[49] H. W. Wu and M. Y. Cheng, “Design of Feedforward Compensator for the Travelling Wave Ultrasonic Motor Based on Non-Uniform Rational B-Splines Curve Neural Network,” Information Technology Journal, vol. 9, no. 8, pp. 1671-1676, 2010.
[50] R. H. Brown, S. C. Schneider, and M. G. Mulligan, “Analysis of Algorithms for Velocity Estimation from Discrete Position versus Time Data,” IEEE Transactions on Industrial Electronics, vol. 39, no. 1, pp. 11-19, 1992.
[51] Shinsei Corporation, Japan. Manual for USR-60 and Driver D6060 (2005) [Online]. Available: http://www.shinsei-motor.com/English/welcome.html.
[52] Industrial Technology Research Institute, Taiwan. PC-based Motion Control Card with EPCIO-4000. (2010) [Online]. Available: http://www.epcio.com.tw/motioncard.html.
[53] J. B. Ziegler and N. B. Nichols, “Optimum Settings for Automatic Controllers,” Transactions of the ASME, vol. 64, pp. 759-768, 1942.
[54] P. Cominos and N. Munro, “PID Controllers: Recent Tuning Methods and Design to Specification,” in Proceedings of the 2002 IEE Control Theory and Applications, 2002, vol. 149, no. 1, pp. 46-53.
[55] C. Gonzalez and R. E. Woods, Digital Image Processing. 3rd edition, Taipei: Pearson Education, 2008.
[56] J. Canny, “A Computational Approach to Edge Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986.
[57] J. W. Park and S. U. Lee, “Recovery of Corrupted Image Data Based on the NURBS Interpolation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 7, pp. 1003-1008, 1999.
[58] H. Y., Huang, “On Corrupted Image Restoration and Image Compression Using NURBS,” Master Degree Thesis, Dayeh University, Taiwan, 2000.