| 研究生: |
鍾煒康 Chung, Wei-Kang |
|---|---|
| 論文名稱: |
CDPFS: 在資料網路中心的BCube拓樸下改進負載平衡之流動態配置的平行演算法 CDPFS: A Centralized Dynamic Parallel Flow Scheduling Algorithm to Improve Load Balancing on BCube Topology for Data Center Network |
| 指導教授: |
謝孫源
Hsieh, Sun-Yuan |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 資訊工程學系 Department of Computer Science and Information Engineering |
| 論文出版年: | 2016 |
| 畢業學年度: | 104 |
| 語文別: | 英文 |
| 論文頁數: | 55 |
| 中文關鍵詞: | 資料網路中心 、以伺服器為主之網路中心 、軟體定義網路 |
| 外文關鍵詞: | Data Center Network, Server-Centric Network, Software-Defined Network. |
| 相關次數: | 點閱:79 下載:2 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近幾年來,隨著雲端運算的普及且有越來越流行的趨勢,像是大數據的雲端運算應用程式需要一個更大的網路頻寬且強而有力的大型資料網路中心。而為了因應這些需求,現在有越來越多的學者提出不同的大型資料網路中心拓樸來解決這些問題。在其中BCube是一個著名的遞迴式定義結構的拓樸,它有著良好的拓樸特性,像是對伺服器彼此間提供了多條短距離的平行路徑,或是針對在伺服器和交換器的容錯上允許某些鏈結斷掉時,不會大幅降低整體的頻寬效能。在原作者提出的分散式路由BSR演算法,由每個來源伺服器去計算和決定它傳送資料給目的伺服器的路徑,這種演算法實作簡單且快速,不過在彼此伺服器相互傳送資料而不去考慮彼此選擇的路徑,在最差的狀況下,它們可能有很高的機率在使用相同的路徑而發生碰撞,導致浪費了將近百分之五十原本BCube拓樸每條鏈結能提供的頻寬。因此在這篇論文,為了去改善傳遞資料時在BCube上大量的碰撞和充分利用到每條鏈結的頻寬,我們在BCube拓樸上增加了一個全域的集中管理伺服器和設計一個在這台伺服器上執行的集中式動態流配置的平行演算法: CDPFS 和CDPFSMP 分別針對伺服器彼此間的單一路徑和多條路徑來分配資料流。我們提出的演算法主要是透過在BCube上蒐集到的每個網路流的可用路徑,並同時計算較不壅塞的可用路徑來優先分配給每個網路流。在模擬實驗的結果顯示,我們提出的集中式演算法可以充分利用BCube良好的拓樸特性和提升整體效能對每個網路流在BCube上的負載平衡。
In recent years, with the growing popularity of cloud computing, big-data applications increase demands for large and powerful data center networks (DCNs). There are more and more newly proposed network topologies for DCNs. BCube is a well-known recursively defined network structure which has good properties providing multiple low-diameter paths and good fault-tolerance for data center networks. Its distributed routing algorithm BSR which is fast and easy to build multiple parallel path set. But in the worst case, it may occur many flow collisions and waste 50\% capacity of each link in BCube. In this paper, in order to fully use those redundant links and improve load balancing in BCube, we add the central master computer to BCube topology and design a centralized dynamic parallel flow scheduling algorithm: CDPFS and CDPFSMP for single-path and multi-paths. We mainly focus on finding the least congestion path for each flow with global network status information and allocate those paths to each flow in parallel. The simulation result shows that our proposed algorithms which take advantage of BCube structure and give a good performance for load balancing.
[1] A. Greenberg, et al., VL2: A scalable and
exible data center network, ACM SIG-
COMM, Aug. (2009)
[2] B. R. Heap, Permutations by interchanges, Comput. J. , 6 , pp. 293294. (1963)
[3] B. Douglass and A. Oruc, On self-routing in clos connection networks, IEEE Trans.
Comput., vol. 41, no. 1, pp. 121124. (1993)
[4] B. Heller, S. Seetharaman, P. Mahadevan, Y. Yiakoumis, P. Sharma, S. Banerjee,
and N. McKeown. Elastictree: Saving energy in data center networks. April 2010.
[5] C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, DCell: A scalable and fault-
tolerant network structure for data centers, ACM SIGCOMM Computer Communi-
cation Review, vol. 38, no. 4, pp. 7586. (2008)
[6] C. Guo, H. Wu, K. Tan, L. Shiy, Y. Zhang, and S. Lu. Bcube: A high performance,
server-centric network architecture for modular data centers. In SIGCOMM. (2009)
[7] C. Raiciu, S. Barre, C. Pluntke, A. Greenhalgh, D. Wischik, and M. Handley. Im-
proving Datacenter Performance and Robustness with Multipath TCP. In ACM SIG-
COMM. (2011)
[8] D. Li, et al., FiConn: Using backup port for server interconnection in data centers,
Proc. IEEE INFOCOM. (2009)
[9] D. Kreutz et al., Software-De ned Networking: A Comprehensive Survey,
arxiv.org/pdf/1406.0440. (2014)
[10] Eitan Zahavi, Isaac Keslassy, and Avinoam Kolodny, Distributed adaptive routing
convergence to non-blocking dcn routing assignments, journal on selected areas in
communications, vol. 32, no. 1, 0733-8716/14, IEEE. (2014)
[11] F. Chang et. al. Bigtable: A Distributed Storage System for Structured Data. In
OSDI06. (2006)
[12] G. Wang, D. G. Andersen, M. Kaminsky, M. Kozuch, T. S. E. Ng, K. Papagiannaki,
M. Glick, and L. Mummert. Your data center is a router: The case for recon gurable
optical circuit switched paths. In Proc. ACM Hotnets-VIII, New York City, NY.
USA., Oct. (2009)
[13] G. Wang, D. Andersen, M. Kaminsky, K. Papagiannaki, T. Ng, M. Kozuch, and M.
Ryan, c-through: Part-time optics in data centers, in ACM SIGCOMM Computer
Communication Review, vol. 40, no. 4. ACM, pp. 327338. (2010)
[14] H. Wu, G. Lu, D. Li, C. Guo, and Y. Zhang. MDCube: a high performance network
structure for modular data center interconnection. In ACM CoNEXT. (2009)
[15] H. Farhady, H. Lee, and A. Nakao, Software-de ned networking: A survey, Elsevier
Computer Networks, vol.81, pp.79-95. (2015)
[16] J. Dean, S. Ghemawat. MapReduce: Simpli ed Data Processing on Large Clus-
ters, Sixth Symposium on Operating System Design and Implementation (OSDI04).
(2004)
[17] Ke BY, Tien PL, Hsiao YL, Parallel prioritized
ow scheduling for software de ned
data center network. In: 2013 IEEE 14th International Conference on High Perfor-
mance Switching and Routing (HPSR), pp 217218. (2013)
[18] M. Al-Fares, A. Loukissas and A. Vahdat, A scalable, commodity data center network
architecture, ACM SIGCOMM08. (2008)
[19] M. Al-Fares, S. Radhakrishnan, B. Raghavan, W. College, N. Huang, and A. Vahdat.
Hedera: Dynamic
ow scheduling for data center networks. In Proceedings of NSDI
2010, San Jose, CA, USA, April. (2010)
[20] M. Chen, S. Mao, and Y. Liu, Big Data: A Survey, Springer Mobile Networks and
Applications Journal, vol. 19, no. 2, pp. 171209 ,Apr. (2014)
[21] Mininet, An Instant Virtual Network on your Laptop, Accessed: Sept. 2014 [Online]
Available: http://mininet.org. (2014)
[22] N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford,
S. Shenker, and J. Turner. OpenFlow: enabling innovation in campus networks.
SIGCOMM CCR, 38(2):6974. (2008)
[23] N. Farrington, G. Porter, S. Radhakrishnan, H. Bazzaz, V. Subramanya, Y. Fainman,
G. Papen, and A. Vahdat, Helios: a hybrid electrical/optical switch architecture for
modular data centers, in ACM SIGCOMM Computer Communication Review, vol.
40, no. 4. ACM, pp.339350. (2010)
[24] POX. Pox open
ow controller, [Online] Available:
http://www.noxrepo.org/pox/about-pox. (2014)
[25] Python Software Foundation, Python language reference, version 2.7, Accessed: Sept.
2014. [Online] Available: http://www.python.org. (2014)
[26] R. Mysore, et al., PortLand: A scalable fault-tolerant layer 2 data center network
fabric, ACM SIGCOMM, Aug. (2009)
[27] Ryu, [Online] Available: http://osrg.github.com/ryu/. (2014)
[28] S. Ghemawat, H. Gobioff, and S. Leung. The Google File System. In ACM SOSP03.
(2003)
[29] sFlow-RT, [Online] Available: httpt//www.inmon.com (2014)
[30] W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical
Recipes in C (Cambridge University Press, Cambridge. (1992)