onr:"swepub:oai:DiVA.org:uu-6024"
Search: onr:"swepub:oai:DiVA.org:uu-6024" > Scalable Scientific...
- 1 of 1
- Previous record
- Next record
- To hitlist
Scalable Scientific Stream Query Processing
-
- Ivanova, Milena, 1967- (author)
- Uppsala universitet,Avdelningen för datalogi,Datalogi
-
- Risch, Tore, Professor (thesis advisor)
- Uppsala universitet,Avdelningen för datalogi
-
- Rundensteiner, Elke A., Professor (opponent)
- Computer Science Department, Worcester Polytechnic Institute, Worcester, MA
- (creator_code:org_t)
- ISBN 9155463517
- Uppsala : Acta Universitatis Upsaliensis, 2005
- English 137 s.
- Series: Uppsala Dissertations from the Faculty of Science and Technology, 1104-2516 ; 66
- Doctoral thesis (other academic/artistic)
Abstract
Subject headings
Close
- Scientific applications require processing of high-volume on-line streams of numerical data from instruments and simulations. In order to extract information and detect interesting patterns in these streams scientists need to perform on-line analyses including advanced and often expensive numerical computations. We present an extensible data stream management system, GSDM (Grid Stream Data Manager) that supports scalable and flexible continuous queries (CQs) on such streams. Application dependent streams and query functions are defined through an object-relational model. Distributed execution plans for continuous queries are specified as high-level data flow distribution templates. A built-in template library provides several common distribution patterns from which complex distribution patterns are constructed. Using a generic template we define two customizable partitioning strategies for scalable parallel execution of expensive stream queries: window split and window distribute. Window split provides parallel execution of expensive query functions by reducing the size of stream data units using application dependent functions as parameters. By contrast, window distribute provides customized distribution of entire data units without reducing their size. We evaluate these strategies for a typical high volume scientific stream application and show that window split is favorable when expensive queries are executed on limited resources, while window distribution is better otherwise. Profile-based optimization automatically generates optimized plans for a class of expensive query functions. We further investigate requirements for GSDM in Grid environments. GSDM is a fully functional system for parallel processing of continuous stream queries. GSDM includes components such as a continuous query engine based on a data-driven data flow paradigm, a compiler of CQ specifications into distributed execution plans, stream interfaces and communication primitives. Our experiments with real scientific streams on a shared-nothing architecture show the importance of both efficient processing and communication for efficient and scalable distributed stream processing.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Keyword
- data stream management systems
- parallel stream processing
- scientific stream query processing
- user-defined stream partitioning
- Computer science
- Datalogi
- Data- och systemvetenskap
- Computer Systems Sciences
Publication and Content Type
- vet (subject category)
- dok (subject category)
Find in a library
- Scalable Scientific Stream Query Processing (Search the publication in LIBRIS)
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Ivanova, Milena, ...
- Risch, Tore, Pro ...
- Rundensteiner, E ...
- About the subject
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Computer Science ...
- Parts in the series
- Uppsala Disserta ...
- By the university
- Uppsala University
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
