簡易檢索 / 詳目顯示

研究生: 黃光弘
Huang, Guang-Hung
論文名稱: 以查詢為導向之物件檔案系統設計與實作
A Design and Implementation of the Query-based Object File System
指導教授: 斯國峰
Ssu, Kuo-Feng
蔡尚榮
Tsai, Shang-Rong
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電腦與通信工程研究所
Institute of Computer & Communication Engineering
論文出版年: 2006
畢業學年度: 94
語文別: 中文
論文頁數: 81
中文關鍵詞: 物件儲存系統檔案系統
外文關鍵詞: Object Storage, File System
相關次數: 點閱:90下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本文研究如何設計與實作一個以搜尋為基礎之物件檔案系統。物件儲存系統是目前逐漸受到網路儲存工業所重視的技術,與以SAN和NAS為基礎的檔案系統相比較,物件檔案系統可以提供更高的系統擴充性與資料共享能力。除了使用物件儲存的概念外,此檔案系統可以使用關鍵字搜尋檔案,對於現今越來越大的儲存空間,這是一項重要且需要的功能。
    實作的原型展現出物件儲存系統與以搜尋為基礎之檔案系統所帶來的好處,提供有效率與彈性的物件分類與命名方式,使得使用者可以藉由組織category結構以方便的瀏覽與搜尋物件。

    This thesis presents the design and implementation of a query-based object file system. The object-based file systems have gained the serious attention in the network storage industry. The technology potentially offers better system scalability and data sharing capacity in comparison to traditional SAN-based orNAS-based solutions. In addition to the object-based concept, the file system provides keyword-based file searching capability which considered to be very important and desired features for nowadays huge volume storage systems.
    The prototype system can express the advantages of both the object-based storage system and the query-based file systems. The prototype system also express the power and flexibility in the aspect of object set grouping and naming scheme. The schemeprovides users to construct category structures for theconvenience in object browsing and searching.

    摘要 i Abstract iii 誌謝 v 圖目錄 xi 表目錄 xv 第 1 章 緒論 1 1.1研究背景 1 1.2 研究動機 1 1.2.1 儲存系統面臨的問題 1 1.2.2 檔案搜尋的問題 2 1.2.3 彈性的名稱空間 3 1.3 研究目標 3 1.4 章節簡介 3 第 2 章 背景知識 5 2.1目前儲存系統概況 5 2.1.1 目前常見之儲存系統架構 5 2.1.2 各儲存系統面臨的問題 7 2.1.3 儲存系統相關議題 8 2.2 物件儲存系統 9 2.2.1物件儲存模型 9 2.2.2 物件儲存系統與傳統儲存系統之比較 11 2.2.3 物件儲存系統之現況 11 2.3 物件儲存系統相關標準 12 2.3.1 iSCSI 12 2.3.1.1 SCSI簡介 12 2.3.1.2 iSCSI 13 2.3.1.3 iSCSI Layer 14 2.3.1.4 Session and TCP Connection 14 2.3.1.5 Session Management 15 2.3.1.6 Address and Naming Conventions 16 2.3.1.7 Error Handling 17 2.3.1.8 Security 18 2.3.1.9 iSCSI優勢 18 2.3.2 T10 SCSI Object-Based Storage Device Commands 19 2.3.2.1 T10 OSD系統模型 19 2.3.2.2 T10 OSD物件模型 19 2.3.2.3 T10 OSD Commands 22 2.4 搜尋為導向之資料管理方式 24 第 3 章 相關研究 27 3.1 Lustre 系統 27 3.1.1 Lustre 介紹 27 3.1.2 MDS子系統 28 3.2 Intel iSCSI/OSD系統 29 3.2.1 Intel iSCSI/OSD介紹 29 3.2.2 Intel OSD子系統 30 3.2.3 Intel iSCSI/OSD 與 Lustre 之比較 31 第 4 章 系統設計 32 4.1 系統規劃與設計目標 32 4.1.1 系統架構考量 32 4.1.2 Client檔案系統考量 33 4-2 Label Based Object File System 設計 34 4.2.1 系統元件設計 34 4.2.1.1 Generic Object 34 4.2.1.2 Label 36 4.2.1.3 Collection 39 4.2.1.4 Category 43 4.2.1.5 Virtual Partition 45 4.2.2 Access Control 47 4.2.3 LBOFS API 48 4.2.3.1 Account 相關 48 4.2.3.2 Category相關 48 4.2.3.3 Collection相關 49 4.2.2.4 General Object 相關 49 4.2.2.5 Label相關 50 4.3 Client設計 50 4.3.1 Client 架構 50 4.3.2 Client Cache 51 4.4 MDS設計 53 4.4.1 MDS 架構 53 4.4.2 Security Model 54 4.5 Metadata Service Protocol 設計 55 4.5.1 訊息格式 55 4.5.2 MDS Function 56 第 5 章 系統實作 59 5.1 Client實作 59 5.1.1 Client實作架構 59 5.1.2 Client Cache 60 5.2 MDS實作 64 5.2.1 MDS實作架構 64 5.2.2 Metadata Storage Pool 64 5.2.3 Data Structure 65 5-3 運作流程 67 第 6 章 結論與未來工作 78 6-1 結論 78 6-2 未來工作 78 參考文獻 80

    [1] G.A. Gibson, D.F. Nagle, K. Amiri, J. Butler, F.W. Chang, H. Gobioff, C. Hardin, E. Riedel, D. Rochberg and J. Zelenka, "A Cost-effective High-bandwidth Storage Architecture," In Proceedings of the 8th Conference on Architechtural Support for Programming Languages and Operating Systems, pp.92-102, October 1998.
    [2] G.A. Gibson, D.F. Nagle, K. Amiri, F. W. Chang, H. Gobioff, E. Riedel, D. Rochberg and J. Zelenka. "Filesystems for Network-Attached Secure Disks," Technical Report CMU-CS-97-118, July 1997.
    [3] R. Burns. "Data Management in a Distributed File System for Storage Area Networks," PhD Thesis, Department of Computer Science, University of California, Santa Cruz, March 2000.
    [4] Cluster File Systems Inc. Lustre http://www.lustre.org
    [5] Panasas http://www.panasas.com
    [6] Intel OSD/iSCSI Reference Implementation http://sourceforge.net/projects/intel-iscsi
    [7] T10 Technical Committee http://t10.org/
    [8] Storage Networking Industry Association http://www.snia.org/
    [9] IBM Object Storage Device Simulator for Linux
    http://www.alphaworks.ibm.com/tech/osdsim
    [10] J. Satran, "iSCSI (Internet Small Computer System Interface)," IETF Standard, January 2003.
    [11] SCSI Object-Based Storage Device Command, http://www.t10.org/ftp/t10/drafts/osd/osd-r10.pdf
    [12] SQLite http://sqlite.org
    [13] D.K. Gifford, P. Jouvelot, M.A. Sheldon and J. O'Toole, "Semantic File Systems," In Proceedings of 13th ACM Symposium on Operating Systems Principles, pp.16-25, October 1991.
    [14] Y. Padioleau, B. Sigonneau and O. Ridoux, "LISFS: A Logical Information System as a File System," In Proceeding of the 28th International Conference on Software Engineering, pp.803-806, May 2006.
    [15] M. Mesnier, G.R. Ganger and E. Riedel, "Object-based Storage," IEEE Communications Magazine, vol.41, no.8, pp.84-90, August 2003.
    [16] Y. Lu , D.H.C. Du and T. Ruwart, "QoS Provisioning Framework for an OSD - Based Storage System," In Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies, pp.28–35, April 2005.
    [17] S.A. Brandt, D.D.E. Long, E.L. Miller and L. Xue, "Efficient Metadata Management in Large Distributed File Systems," In Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, pp.290-298, April 2003.
    [18] F. Wang, S.A. Brandt, E.L. Miller and D.D.E. Long. "OBFS: A File System for Object-based Storage Devices," In Proceedings of the 21st IEEE / 12th NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 283–300, April 2004.
    [19] O. Rodeh and A. Teperman. "zFS:A Scalable Distributed File System Using Object Disks," In Proceedings of the 20th IEEE / 11th NASA Goddard Conference on Mass Storage Systems and Technologies, pp.207-218, April 2003.
    [20] E.K. Lee and C.A. Thekkath. "Petal: Distributed Virtual Disks," In Proceedings of the 7th International Conference on Architectural Support for Programming Languages and Operating Systems, pp.84-92, September 1996.
    [21] 黃建州, 蔡尚榮, "The Design and Implementation of the Metadata Service in an Object-based File System," Master Thesis, Institute of Computer and Communication, NCKU, June 2006.
    [22] 蔡旻均, 蔡尚榮, "The Design of Object Storage Device," Master Thesis, Institute of Computer and Communication, NCKU, June 2006.

    下載圖示 校內:2008-08-11公開
    校外:2010-08-11公開
    QR CODE