簡易檢索 / 詳目顯示

研究生: 鍾煒康
Chung, Wei-Kang
論文名稱: CDPFS: 在資料網路中心的BCube拓樸下改進負載平衡之流動態配置的平行演算法
CDPFS: A Centralized Dynamic Parallel Flow Scheduling Algorithm to Improve Load Balancing on BCube Topology for Data Center Network
指導教授: 謝孫源
Hsieh, Sun-Yuan
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2016
畢業學年度: 104
語文別: 英文
論文頁數: 55
中文關鍵詞: 資料網路中心以伺服器為主之網路中心軟體定義網路
外文關鍵詞: Data Center Network, Server-Centric Network, Software-Defi ned Network.
相關次數: 點閱:79下載:2
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近幾年來,隨著雲端運算的普及且有越來越流行的趨勢,像是大數據的雲端運算應用程式需要一個更大的網路頻寬且強而有力的大型資料網路中心。而為了因應這些需求,現在有越來越多的學者提出不同的大型資料網路中心拓樸來解決這些問題。在其中BCube是一個著名的遞迴式定義結構的拓樸,它有著良好的拓樸特性,像是對伺服器彼此間提供了多條短距離的平行路徑,或是針對在伺服器和交換器的容錯上允許某些鏈結斷掉時,不會大幅降低整體的頻寬效能。在原作者提出的分散式路由BSR演算法,由每個來源伺服器去計算和決定它傳送資料給目的伺服器的路徑,這種演算法實作簡單且快速,不過在彼此伺服器相互傳送資料而不去考慮彼此選擇的路徑,在最差的狀況下,它們可能有很高的機率在使用相同的路徑而發生碰撞,導致浪費了將近百分之五十原本BCube拓樸每條鏈結能提供的頻寬。因此在這篇論文,為了去改善傳遞資料時在BCube上大量的碰撞和充分利用到每條鏈結的頻寬,我們在BCube拓樸上增加了一個全域的集中管理伺服器和設計一個在這台伺服器上執行的集中式動態流配置的平行演算法: CDPFS 和CDPFSMP 分別針對伺服器彼此間的單一路徑和多條路徑來分配資料流。我們提出的演算法主要是透過在BCube上蒐集到的每個網路流的可用路徑,並同時計算較不壅塞的可用路徑來優先分配給每個網路流。在模擬實驗的結果顯示,我們提出的集中式演算法可以充分利用BCube良好的拓樸特性和提升整體效能對每個網路流在BCube上的負載平衡。

    In recent years, with the growing popularity of cloud computing, big-data applications increase demands for large and powerful data center networks (DCNs). There are more and more newly proposed network topologies for DCNs. BCube is a well-known recursively defined network structure which has good properties providing multiple low-diameter paths and good fault-tolerance for data center networks. Its distributed routing algorithm BSR which is fast and easy to build multiple parallel path set. But in the worst case, it may occur many flow collisions and waste 50\% capacity of each link in BCube. In this paper, in order to fully use those redundant links and improve load balancing in BCube, we add the central master computer to BCube topology and design a centralized dynamic parallel flow scheduling algorithm: CDPFS and CDPFSMP for single-path and multi-paths. We mainly focus on finding the least congestion path for each flow with global network status information and allocate those paths to each flow in parallel. The simulation result shows that our proposed algorithms which take advantage of BCube structure and give a good performance for load balancing.

    1 Introduction 1 2 Related Work 5 2.1 The BCube Structure and BSR Algorithm . . . . . . . . . . . . . . . . . . 5 2.2 Flow Scheduling Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 2.3 Flow Scheduling techniques in Data Center Networks(DCN) . . . . . . . . 9 2.4 Software De ned Network . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.5 Parallel Computing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3 The Proposed Algorithm 12 3.1 The SP and NSP Categories . . . . . . . . . . . . . . . . . . . . . . . . . . 12 3.2 The Path Set and Graph of SP . . . . . . . . . . . . . . . . . . . . . . . . 13 3.3 The First, Intermediate and Last Forwarders . . . . . . . . . . . . . . . . . 16 3.4 The Path Set and Graph of NSP and AltSP . . . . . . . . . . . . . . . . . 16 3.5 The Centralized Dynamic Parallel Flow Scheduling Algorithm with Single- Path . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 3.6 The Centralized Dynamic Parallel Flow Scheduling Algorithm with Multi- Path . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 4 Simulation on Mininet 39 4.1 Simulation Environment and Architecture . . . . . . . . . . . . . . . . . . 39 4.2 Dynamic Flow Scheduling . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 4.3 Simulation Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 5 Conclusion 52

    [1] A. Greenberg, et al., VL2: A scalable and
    exible data center network, ACM SIG-
    COMM, Aug. (2009)
    [2] B. R. Heap, Permutations by interchanges, Comput. J. , 6 , pp. 293294. (1963)
    [3] B. Douglass and A. Oruc, On self-routing in clos connection networks, IEEE Trans.
    Comput., vol. 41, no. 1, pp. 121124. (1993)
    [4] B. Heller, S. Seetharaman, P. Mahadevan, Y. Yiakoumis, P. Sharma, S. Banerjee,
    and N. McKeown. Elastictree: Saving energy in data center networks. April 2010.
    [5] C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, DCell: A scalable and fault-
    tolerant network structure for data centers, ACM SIGCOMM Computer Communi-
    cation Review, vol. 38, no. 4, pp. 7586. (2008)
    [6] C. Guo, H. Wu, K. Tan, L. Shiy, Y. Zhang, and S. Lu. Bcube: A high performance,
    server-centric network architecture for modular data centers. In SIGCOMM. (2009)
    [7] C. Raiciu, S. Barre, C. Pluntke, A. Greenhalgh, D. Wischik, and M. Handley. Im-
    proving Datacenter Performance and Robustness with Multipath TCP. In ACM SIG-
    COMM. (2011)
    [8] D. Li, et al., FiConn: Using backup port for server interconnection in data centers,
    Proc. IEEE INFOCOM. (2009)
    [9] D. Kreutz et al., Software-De ned Networking: A Comprehensive Survey,
    arxiv.org/pdf/1406.0440. (2014)
    [10] Eitan Zahavi, Isaac Keslassy, and Avinoam Kolodny, Distributed adaptive routing
    convergence to non-blocking dcn routing assignments, journal on selected areas in
    communications, vol. 32, no. 1, 0733-8716/14, IEEE. (2014)
    [11] F. Chang et. al. Bigtable: A Distributed Storage System for Structured Data. In
    OSDI06. (2006)
    [12] G. Wang, D. G. Andersen, M. Kaminsky, M. Kozuch, T. S. E. Ng, K. Papagiannaki,
    M. Glick, and L. Mummert. Your data center is a router: The case for recon gurable
    optical circuit switched paths. In Proc. ACM Hotnets-VIII, New York City, NY.
    USA., Oct. (2009)
    [13] G. Wang, D. Andersen, M. Kaminsky, K. Papagiannaki, T. Ng, M. Kozuch, and M.
    Ryan, c-through: Part-time optics in data centers, in ACM SIGCOMM Computer
    Communication Review, vol. 40, no. 4. ACM, pp. 327338. (2010)
    [14] H. Wu, G. Lu, D. Li, C. Guo, and Y. Zhang. MDCube: a high performance network
    structure for modular data center interconnection. In ACM CoNEXT. (2009)
    [15] H. Farhady, H. Lee, and A. Nakao, Software-de ned networking: A survey, Elsevier
    Computer Networks, vol.81, pp.79-95. (2015)
    [16] J. Dean, S. Ghemawat. MapReduce: Simpli ed Data Processing on Large Clus-
    ters, Sixth Symposium on Operating System Design and Implementation (OSDI04).
    (2004)
    [17] Ke BY, Tien PL, Hsiao YL, Parallel prioritized
    ow scheduling for software de ned
    data center network. In: 2013 IEEE 14th International Conference on High Perfor-
    mance Switching and Routing (HPSR), pp 217218. (2013)
    [18] M. Al-Fares, A. Loukissas and A. Vahdat, A scalable, commodity data center network
    architecture, ACM SIGCOMM08. (2008)
    [19] M. Al-Fares, S. Radhakrishnan, B. Raghavan, W. College, N. Huang, and A. Vahdat.
    Hedera: Dynamic
    ow scheduling for data center networks. In Proceedings of NSDI
    2010, San Jose, CA, USA, April. (2010)
    [20] M. Chen, S. Mao, and Y. Liu, Big Data: A Survey, Springer Mobile Networks and
    Applications Journal, vol. 19, no. 2, pp. 171209 ,Apr. (2014)
    [21] Mininet, An Instant Virtual Network on your Laptop, Accessed: Sept. 2014 [Online]
    Available: http://mininet.org. (2014)
    [22] N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford,
    S. Shenker, and J. Turner. OpenFlow: enabling innovation in campus networks.
    SIGCOMM CCR, 38(2):6974. (2008)
    [23] N. Farrington, G. Porter, S. Radhakrishnan, H. Bazzaz, V. Subramanya, Y. Fainman,
    G. Papen, and A. Vahdat, Helios: a hybrid electrical/optical switch architecture for
    modular data centers, in ACM SIGCOMM Computer Communication Review, vol.
    40, no. 4. ACM, pp.339350. (2010)
    [24] POX. Pox open
    ow controller, [Online] Available:
    http://www.noxrepo.org/pox/about-pox. (2014)
    [25] Python Software Foundation, Python language reference, version 2.7, Accessed: Sept.
    2014. [Online] Available: http://www.python.org. (2014)
    [26] R. Mysore, et al., PortLand: A scalable fault-tolerant layer 2 data center network
    fabric, ACM SIGCOMM, Aug. (2009)
    [27] Ryu, [Online] Available: http://osrg.github.com/ryu/. (2014)
    [28] S. Ghemawat, H. Gobioff, and S. Leung. The Google File System. In ACM SOSP03.
    (2003)
    [29] sFlow-RT, [Online] Available: httpt//www.inmon.com (2014)
    [30] W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical
    Recipes in C (Cambridge University Press, Cambridge. (1992)

    下載圖示 校內:2019-01-01公開
    校外:2019-01-01公開
    QR CODE