簡易檢索 / 詳目顯示

研究生: 葉光仁
Yeh, Guang-Rew
論文名稱: 利用資料語意監控即時資料串流
Exploiting data Semantics in monitoring real-time Data streams
指導教授: 徐立群
Shu, LihChyun
學位類別: 碩士
Master
系所名稱: 管理學院 - 會計學系
Department of Accountancy
論文出版年: 2007
畢業學年度: 95
語文別: 英文
論文頁數: 40
中文關鍵詞: 及時系統排程方法SOSA(m k) 模型資料串流管理系統
外文關鍵詞: (m k) model, SOSA, real-time scheduling, data stream management system
相關次數: 點閱:82下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在及時資料串流監視應用程式中,許多連續查詢能夠產生有效的產出以觸發相對應的動作。但受制於無止盡的串流資料和有限的資源處理能力下,從不同來源的串流資料往往無法滿足應用程式要求的服務品質。及時資料串流監視應用程式有必要採用合適的排程技術去保留資源以便處理更有價值的資料,在本篇論文中,利用探偵串流資料語義和應用(m,k)模型,我們提出一套名為安全負荷卸載方法(SOSA),並以SOSA 為基礎提出一個創新的(m,k)排程演算法名為SOSA-DBP。我們透過機率模型分析和實證結果去驗證該演算法的效果並比較目前已存在的演算法。

    In Real-time data stream monitoring applications, many continuous queries registered in the system should generate valid output to trigger corresponding actions. Due to unbounded amount of stream and limited processing resources, some of the data stream processing tasks originated from different sources do not always satisfy QoS requirement of application.
    It is necessary that real-time monitor stream applications save resources to service valuable tasks from other streams by using adequate scheduling techniques. To relief system burden, many load shedding methods have been proposed. The lack of traditional load shedding methods only random drop
    incoming tuples excess system overloaded. In this thesis, we propose a Safe load Shedding Approach (SOSA) by exploiting the data semantic of sensor streams and application of the (m, k) deadline model. A novel (m, k)
    scheduling algorithm called SOSA-DBP will be introduced based on the philosophy of SOSA. We present probabilistic analysis and experimental that characterizes the effectiveness of our approach compared with the existing algorithms.

    1. Introduction and Background................................................................. 1 1.1 Introduction......................................................................................... 1 1.2 Motivation........................................................................................... 3 1.3 Background......................................................................................... 5 1.3.1 Data Stream Model ...................................................................... 5 1.3.2 Real-time Scheduling................................................................... 6 2. Related Work ............................................................................................ 9 3. System Model and Basic idea................................................................. 12 3.1 System model.................................................................................... 12 3.2 Basic idea.......................................................................................... 14 4. Best-effort Semantics Based on (m,k) scheduling algorithms ............ 20 4.1 Assigning priority during unstable state........................................... 20 4.2 Assigning priority policy .................................................................. 22 5. Experiment evaluations.......................................................................... 25 5.1 Analysis of Dynamic Failure Rate.................................................... 25 5.2 Experiment Setup.............................................................................. 27 5.3 Experimental Results ........................................................................ 28 5.3.1 Homogeneous workload .......................................................... 29 5.3.2 Heterogeneous workload ......................................................... 32 5.3.3 Impact of delta values.............................................................. 34 5.3.4 Impact of number of streams ................................................... 36 6. Conclusion and future work .................................................................. 38

    [WPSS06] Y.Wei, V. Prasad, S. H. Son, and J. A. Stankovic
    Prediction-Based QoS Management for Real-Time Data
    Streams. IEEE real-timesystem, 2006.
    [BBDMT04] B.Babcock, S.Babu, M.Datar, R.Motwani, and
    D.Thomas. Operator scheduling in data stream systems.
    The VLDB Journal, Dec, 2004.
    [CCCC+02] D.Carney, U.Cetintemel, M.Cherniack, C. Convey, S.
    Lee, G.Seidman, M.Stonebraker, N.Tatbul, and S.Zdonik.
    Monitoring Streams: A New Class of Data Management
    Applications. In proceedings of the 28th International
    Conference on Very Large Data Bases (VLDB'02), Hong
    Kong, China, 2002.
    [CCRZ+03] D.Carney, U.Cetintermel, A.Rasin, S.Zdonik,
    M.Cherniack, and M.Stonebraker. Operator scheduling
    in a data stream manager. In VLDB, 2003.
    [OJW03] C.Olston, J.Jiang, J.Widom. Adaptive Filters for
    Continuous Queries over Distributed Data Streams. To
    appear in Proc. ACM Int.Conf. on Management of Data.
    June 2003.
    [GO03] L.Golab and M.Ozsu. Issues in data stream management.
    SIGMOD Record, 2003
    [GAE06] TM Ghanem, WG Aref, AK Elmagarmid. Exploiting
    Predicate-window Semantics over Data streams.
    SIGMOD Record,2006
    [TCZCS03] N.Tatbul, U.Cetintemel, S.Zdonik, M.Chemiack,
    M.Stonebraker. Load Shedding in a Data Stream
    Manager. VLDB,2003
    [TZ06] N.Tatbul, S.Zdonik. Window-Aware Load Shedding for
    aggregation Queries Over Data Stream. VLDB,2006
    [TLPY06] Y.-C. Tu, S. Liu, S. Prabhakar, and B. Yao. Load
    Shedding in stream Databases: A control-Based
    Approach Proceedings of the 32nd international
    conference VLDB,2006
    [SLSL05] S. Schmidt, T. Legler, D. Schaller, andW. Lehner.
    “Real-time scheduling for data stream management
    systems.” In Proc. of the 17th Euromicro Conference on
    Real-Time Systems, 2005.
    [HR95] M.Hamdaoui and P.Ramanathan. A Dynamic Priority
    Assignment Technique for Streams with (m, k)-Firm
    Deadlines.” IEEE .Trans Computers, Dec 1995.
    [HR99] M.Hamdaoui and P.Ramanathan. Overload management
    in real-time control applications using (m, k)-firm
    guarantee. IEEE Transactions on Parallel and Distributed
    Systems, 10(6): 549-559, June 1999

    下載圖示 校內:立即公開
    校外:2007-07-18公開
    QR CODE