簡易檢索 / 詳目顯示

研究生: 許秋明
Hsu, Eagle
論文名稱: 網際網路即時影像及語音傳輸系統之研究與設計
The Design and Analysis of Real-Time Video and Audio Transmission System in Internet
指導教授: 周哲民
Jou, Jer-Min
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系碩士在職專班
Department of Electrical Engineering (on the job class)
論文出版年: 2005
畢業學年度: 93
語文別: 中文
論文頁數: 136
中文關鍵詞: 即時傳輸語音編碼訊息匯流排網路影像電話混音網際網路數位語音
外文關鍵詞: RTCP, Mbus, TCL, DCOM, Timestamp, IPC, VIC, VOIP, VOD, RTP, MBone, CORBA, Socket, UDP, OSI, RAT
相關次數: 點閱:101下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  •   隨著網際網路基礎建設的發展,寬頻網路不但改變了人類的生活行為,也為網路多媒體的形式重新定義,寬頻網路使得多媒體在網際網路上的應用成為實用的技術,例如 Videoconference , VOD(Video On Demand)等,其中應用最廣泛也最成功的技術之一就是網路影像語音方面的應用,我們統稱為VoIP(Voice over Internet Protocol),正快速地改變傳統的電話語音通訊方式。

      為了快速地了解網路傳送影像語音封包的技術,並且在未來能夠發展出網路影像電話,因此我們將藉由研究開放原始碼的語音會議軟體與視訊會議軟體,來達到此目的,且成功地整合了兩套軟體。

      在本篇論文中我們研究了網際網路即時傳輸協定RTP/RTCP、訊息溝通匯流排 MBus(Message Bus),以及語音、影像封包在網路上的遺失及修補機制,更進一步地藉由研究語音、影像的軟體架構與程式執行流程,實做出網路影像電話,並且對語音、影像的各個功能區塊作執行時間的分析,及網際網路封包的傳送過程中,所發生的封包遺失及傳送封包數量作時間的分析。

      Recently, growing the foundation of internet-based, wide band network changing the behavior of human being, and redefine the style of network multimedia, wide band network enable the apply of multimedia over internet become practical technology, for example : Videoconference, VOD(Video On Demand) etc. , among these application, the technology of widely use and successfully apply is the video and audio over the internet , we call all these is VoIP(Voice Over Internet Protocol), now is rapidly change the voice communication manner by traditional phone .
      
      In order to understand rapidly the technology of delivering real-time video and audio data packet through the network, and develop the video telephone in the future, in order to achieve the goal of video phone, we study and analyze the open source of audio conferencing software and video conference, then integrated the audio and video software successfully.

      In this thesis we study the Real-time Transport Protocol (RTP) and the Real-time Control Protocol (RTCP) for transmitting real-time packets, and the Message Bus(MBus), and the packet loss, repair mechanism of internet multimedia. we present the architecture and the execution flow of the video and audio, finally, we present the execution time of each function block making up video phone, and the number of packet loss in the internet.

    摘要 Abstract 第一章 緒論 ......................................................... 1 1.1 研究背景與動機 ..................................... .............1 1.2 研究目的 ........................................... .............1 1.3 論文架構 ........................................... .............2 第二章 網際網路即時傳輸 ................................. ............4 2.1 Multimedia Streaming on the Internet .............................4 2.1.1串流媒體(Streaming Media ) ....................... ..............5 2.1.2串流媒體(Streaming Media)的播放方式 .............. ..............5 2.1.3 Multimedia Transmission Component ................ .............6 2.2 Network Protocols ................................................7 2.2.1 OSI參考模式(Reference Model) .................................7 2.2.2 OSI 7 Layers ................................................8 2.2.3 UDP .........................................................12 2.3 Multicast backbone ..............................................12 2.4 RTP/RTCP ........................................................15 2.4.1專有名詞的定義 ...............................................15 2.4.2 RTP標頭的欄位定義 ...........................................17 2.4.3 RTCP控制協定 ................................................19 2.4.4 RTCP封包的種類與格式 ........................................20 2.4.5 傳送端回報封包(SR).........................................22 第三章 語音傳輸系統 .................................... ............36 3.1 Software Architecture ...........................................36 3.1.1 Initial block ...............................................46 3.1.2 Mbus Control block ..........................................50 3.1.3 Tcl block ...................................................52 3.1.4 Mbus UI block ...............................................57 3.1.5 Mbus Media Engine block .....................................60 3.1.6 RTP/RTCP block ..............................................62 3.1.7 Audio in block ..............................................65 3.1.8 Audio out block .............................................66 3.1.9 Transmit block ..............................................67 3.1.10 Receive block ..............................................68 3.2 Message Bus .....................................................69 3.2.1 Mbus 的功能 .................................................70 3.2.2 Mbus 與網路的關係 ...........................................71 3.2.3 Mbus 訊息傳送與接收之函式 ...................................72 3.2.4 Mbus rendezvous 訊息命令與其意義 ............................72 3.2.5 Mbus Rendezvous 之實例 ......................................73 3.2.6 Mbus_send流程圖 .............................................73 3.2.7 Mbus 心跳訊息(HeartBeat)傳送函式流程圖 ......................74 3.2.8 Mbus_recv 訊息接收函式流程圖 ................................75 3.2.9 CORBA AND DCOM ..............................................76 3.3 Synchronization and concurrency scheme in runtime ...............79 3.3.1 Communication Paradigms .....................................79 3.3.2 IPC (Inter Process Control) .................................79 3.3.3 Socket ......................................................81 3.3.4 TCL Synchronization With Widows .............................81 3.4 G.711 Packetization ................................. ...........82 3.4.1 數位語音處理流程 ............................... ............82 3.4.2 數位語音簡介 ................................... ............83 3.4.3 G.711 的介紹 ................................... ............85 3.4.4 Audio Packetization ............................ ............86 3.5 Packet Loss Protection ........................... ..............88 3.5.1 分散聲音區塊 ................................... ............88 3.5.2 正向錯誤修正(Forward Error Correction) ......... ............88 3.5.3 聲音訊號分層 ................................... ............90 3.5.4 重複編碼(Redundancy) ............................ ...........90 3.6 Audio Mixing & Playout ............................... ..........91 3.6.1 混音 (Mixing) ................................... ...........91 3.6.2 Mixing function ................................. ...........92 3.6.3 Mixing Buffer ................................... ...........92 3.6.4 Audio Playout ................................... ...........93 第四章 Video與Audio整合 ............................... .............95 4.1 Video overview .................................... .............95 4.2 Media Timestamp ..................................... ...........97 4.2.1 Audio Timestamp ................................. ...........97 4.2.2 Media Timestamp ................................. ...........98 4.2.3 Media Timestamp Synchronization ................. ...........99 4.3 Playout Buffer ..................................... ...........101 4.3.1 Playout Buffer資料結構 ........................ ..............101 4.3.2 基本的操作函式 ................................ ............103 4.3.3 Playout Time Calculation ...................... ............106 4.4 Lip Synchronization ............................................112 4.4.1 Media Synchronization ......................................112 4.4.2 Sender Behavior ............................................113 4.4.3 Receiver Behavior ..........................................114 4.4.4 Nckuee Audio/Vieo Synchronization ..........................115 4.5 User Interface Integration .......................... ..........117 4.5.1 Tcl Script file ................................ ...........117 4.5.2 整合完成之畫面 ................................ ............119 第五章 實驗與分析結果 .................................. ...........120 5.1 系統開發使用之軟硬體工具及程式語言 .............................120 5.2 功能區塊時間分析................................................120 5.2.1 測試環境介紹 ...............................................120 5.2.2 語音傳輸的時間分析 .........................................120 5.2.3 影像傳輸的時間分析 .........................................121 5.3 網路封包傳送與接收的個數之統計結果..............................122 5.3.1 測試環境一 .................................................123 5.3.2 測試環境二 .................................................126 5.3.3 兩個測試環境之結果比較 .....................................128 5.4 程序所需之系統記憶體 ...........................................130 第六章 結論與未來發展 ..............................................132 參考文獻 ...........................................................134

    [1] Andrew S. Tanenbaum, Computer Networks (Third Edition), Prentice-Hall 1996.
    [2] Audio Conferencing Application http://www-nrg.ee.lbl.gov/vat/
    [3] CCITT G.711 Pulse Code Modulation(PCM) http://ckp.made-it.com/pcm.html
    [4] Colin Perkins, Orion Hodson, and Vicky Hardman. A Survey of Packet Loss Recovery Techniques for Streaming Audio. IEEE Network, 12(5), September/October 1998.
    [5] Common Object Request Broker Architecture (CORBA) http://www.corba.org/standards.htm
    [6] Distributed Component Object Model (DCOM) http://msdn.microsoft.com/library/default.asp?url=/library/en-us/dndcom/html/msdn_dcomarch.asp
    [7] H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson. RTP: A Transport Protocol for Real-Time Applications. Request for comments (Proposed Standard) RFC 1889, Internet Engineering Task Force, January 1996.
    [8] H. Schulzrinne. RTP Profile for Audio and Video Conferences with Minimal Control. Request for comments (Proposed Standard) RFC 1890, Internet Engineering Task Force, January 1996.
    [9] International Organization for Standardization http://www.iso.org/iso/en/ISOOnline.frontpage
    [10] John K. Ousterhout. Tcl and the Tk Toolkit. Addison-Wesley Publishing Company. 1994.
    [11] J. Ott, C. Perkins, and D. Kutscher. A Message Bus for Local Coordination. RFC 3259, Internet Engineering Task Force, April 2002.
    [12] Larry L. Peterson and Bruce S. Davie. COMPUTER NETWORKS: A Systems Approach 2nd, Morgan Kaufmann, 340-350, 2000.
    [13] McCanne, S., and Jacobson, V., "vic: A Flexible Framework Framework for Packet Video " ACM Multimedia '95. http://www-mice.cs.ucl.ac.uk/multimedia/software/vic/
    [14] Ramachandran Ramjee, Jim Kurose, Don Towsley, and Henning Schulzrinne. Adaptive playout mechanisms for packetized audio applications in wide-area networks. In Conference on Computer Communications (IEEE Infocom), Toronto, Canada, June 1994.
    [15] Reverse Path Forwarding (RPF) http://www.juniper.net/techpubs/software/erx/erx50x/swconfig-routing-vol1/html/ip-multicast-config7.html
    [16] S. Deering. Host extensions for IP multicasting. Request for comments (Proposed Standard) RFC 1112, Internet Engineering Task Force, August 1989.
    [17] Stefan Brunner , and Akhlaq A. Ali "Voice Over IP 101 Understanding VoIP Networks" http://www.Juniper.net VoIP-Def.pdf Aug 2004
    [18] Stephen Casner and Stephen Deering. First IETF Internet audiocast. ACM Computer Communication Review, 22(3):92-97, July 1992.
    [19] T. Turletti and C. Huitema, “RTP payload format for H.261 video streams,” Request for Comments (Proposed Standard) RFC 2032, Internet Engineering Task Force, Oct. 1996.
    [20] Tcl/Tk : A Developer's Guideby Clif Flynt. Publisher: Morgan Kaufmann. Publish date: 05 May, 2003.
    [21] University College London, Computer Science Department, User Guide for VIC v2.8, Version 1 (DRAFT), 29 September 1998, http://www-mice.cs.ucl.ac.uk/multimedia/software/documentation/vic-userguide.zip, vic-userguide.doc.
    [22] Vicky Hardman, Angela Sasse, and Isidor Kouvelas. Successful Multi-party Audio Communication over the Internet. In Communications of the ACM, 41(5),May 1998.
    [23] Vicky Hardman, Martina Angela Sasse, Mark Handley, and Anna Watson. Reliable Audio for Use over the Internet. In Proceedings of INET95, 1995.
    [24] Vicky Hardman, Peter Kirstein, Martina Angela Sasse, Orion Hodson, Isidor Kouvelas, and Colin Perkins. Robust Audio Tool (RAT). User Guide, Availablefromwww-mice.cs.ucl.ac.uk/multimedia/software/documentation/rat4-ug-v4-0011.pdf, October 1994.
    [25] Windows 95 程式設計指南. 原著: Jeffrey Richter & Jonathan Locke 譯者李書良 出版商:碁峰,
    [26] 朱孝國, 語音合成Speech Synthesize Note, 朱孝國的筆記本http://www.cyut.edu.tw/~s9154610/
    [27] 邱庭鈺, 即時語音會議之強健性語音工具的分析與研究, 國立成功大學電機工程學系, 碩士論文, 2004.

    下載圖示 校內:2006-07-29公開
    校外:2006-07-29公開
    QR CODE