| 101. |
- Östberg, Per-Olov, 1973-
(author)
-
Architectures, design methodologies, and service composition techniques for Grid job and resource management
- 2009
-
Licentiate thesis (other academic/artistic)abstract
- The field of Grid computing has in recent years emerged and been established as an enabling technology for a range of computational eScience applications. The use of Grid technology allows researchers and industry experts to address problems too large to efficiently study using conventional computing technology, and enables new applications and collaboration models. Grid computing has today not only introduced new technologies, but also influenced new ways to utilize existing technologies.This work addresses technical aspects of the current methodology of Grid com- puting; to leverage highly functional, interconnected, and potentially under-utilized high-end systems to create virtual systems capable of processing problems too large to address using individual (supercomputing) systems. In particular, this thesis studies the job and resource management problem inherent to Grid environments, and aims to contribute to development of more mature job and resource management systems and software development processes. A number of aspects related to Grid job and resource management are here addressed, including software architectures for Grid job management, design methodologies for Grid software development, service composition (and refactorization) techniques for Service-Oriented Grid Architectures, Grid infrastructure and application integration issues, and middleware-independent and transparent techniques to leverage Grid resource capabilities.The software development model used in this work has been derived from the notion of an ecosystem of Grid components. In this model, a virtual ecosystem is defined by the set of available Grid infrastructure and application components, and ecosystem niches are defined by areas of component functionality. In the Grid ecosys- tem, applications are constructed through selection and composition of components, and individual components subject to evolution through meritocratic natural selection. Central to the idea of the Grid ecosystem is that mechanisms that promote traits beneficial to survival in the ecosystem, e.g., scalability, integrability, robustness, also influence Grid application and infrastructure adaptability and longevity. As Grid computing has evolved into a highly interdisciplinary field, current Grid applications are very diverse and utilize computational methodologies from a number of fields. Due to this, and the scale of the problems studied, Grid applications typically place great performance requirements on Grid infrastructures, making Grid infrastructure design and integration challenging tasks. In this work, a model of building on, and abstracting, Grid middlewares has been developed and is outlined in the papers. In addition to the contributions of this thesis, a number of software artefacts, e.g., the Grid Job Management Framework (GJMF), have resulted from this work.
|
|
| 102. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
Creo : reduced complexity service development
- 2014
-
In: Proceedings of CLOSER 2014 - 4th International Conference on Cloud Computing and Services Science. - : SciTePress. - 9789897580192 ; , s. 230-241
-
Conference paper (peer-reviewed)abstract
- In this work we address service-oriented software development in distributed computing environments, and investigate an approach to software development and integration based on code generation. The approach is illustrated in a toolkit for multi-language software generation built on three building blocks; a service description language, a serialization and transport protocol, and a set of code generation techniques. The approach is intended for use in the eScience domain and aims to reduce the complexity of development and integration of distributed software systems through a low-knowledge-requirements model for construction of network-accessible services. The toolkit is presented along with a discussion of use cases and a performance evaluation quantifying the performance of the toolkit against selected alternative techniques for code generation and service communication. In tests of communication overhead and response time, toolkit performance is found to be comparable to or improve upon the evaluated techniques.
|
|
| 103. |
- Östberg, Per-Olov, et al.
(author)
-
Decentralized Prioritization-Based Management Systems for Distributed Computing
- 2013
-
In: 2013 IEEE 9th international conference on e-science (e-science). - : IEEE Computer Society. - 9780769550831 ; , s. 228-237
-
Conference paper (peer-reviewed)abstract
- Fairshare scheduling is an established technique to provide user-level differentiation in management of capacity consumption in high-performance and grid computing scheduler systems. In this paper we extend on a state-of-the-art approach to decentralized grid fairshare and propose a generalized model for construction of decentralized prioritization-based management systems. The approach is based on (re) formulation of control problems as prioritization problems, and a proposed framework for computationally efficient decentralized priority calculation. The model is presented along with a discussion of application of decentralized management systems in distributed computing environments that outlines selected use cases and illustrates key trade-off behaviors of the proposed model.
|
|
| 104. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
Decentralized scalable fairshare scheduling
- 2013
-
In: Future Generation Computer Systems. - : Elsevier. - 0167-739X .- 1872-7115. ; 29:1, s. 130-143
-
Journal article (peer-reviewed)abstract
- This work addresses Grid fairshare allocation policy enforcement and presents Aequus, a decentralized system for Grid-wide fairshare job prioritization. The main idea of fairshare scheduling is to prioritize users with regard to predefined resource allocation quotas. The presented system builds on three contributions: a flexible tree-based policy model that allows delegation of policy definition, a job prioritization algorithm based on local enforcement of distributed fairshare policies, and a decentralized architecture for non-intrusive integration with existing scheduling systems. The system supports organization of users in virtual organizations and divides usage policies into local and global policy components that are defined by resource owners and virtual organizations. The architecture realization is presented in detail along with an evaluation of the system behavior in an emulated environment. In the evaluation, convergence noise types (mechanisms counteracting policy allocation convergence) are characterized and quantified, and the system is demonstrated to meet scheduling objectives and perform scalably under realistic operating conditions.
|
|
| 105. |
- Östberg, Per-Olov, et al.
(author)
-
Domain Models and Data Modeling as Drivers for Data Management : The ASSISTANT Data Fabric Approach
- 2022
-
In: 10th IFAC Conference on Manufacturing Modelling, Management and Control MIM 2022. - : Elsevier. ; , s. 19-24
-
Conference paper (peer-reviewed)abstract
- To develop AI-based models capable of governing or providing decision support to complex manufacturing environments, abstractions and mechanisms for unified management of data storage and processing capabilities are needed. Specifically, as such models tend to include and rely on detailed representations of systems, components, and tools with complex interactions, mechanisms for simplifying, integrating, and scaling management capabilities in the presence of complex data requirements (e.g., high volume, velocity, and diversity of data) are of particular interest. A data fabric is a system that provides a unified architecture for management and provisioning of data. In this work we present the background, design requirements, and high-level outline of the ASSISTANT data fabric - a flexible data management tool designed for use in adaptive manufacturing contexts. The paper outlines the implementation of the system with specific focus on the use of domain models and the data modeling approach used, as well as provides a generic use case structure reusable in many industrial contexts.
|
|
| 106. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
GJMF - a composable service-oriented Grid job management framework
- 2013
-
In: Future Generation Computer Systems. - : Elsevier BV. - 0167-739X .- 1872-7115. ; 29:1, s. 144-157
-
Journal article (peer-reviewed)abstract
- We investigate best practices for Grid software design and development, and propose a composable, loosely coupled Service-Oriented Architecture for Grid job management. The architecture focuses on providing a transparent Grid access model for concurrent use of multiple Grid middlewares and aims to decouple Grid applications from Grid middlewares and infrastructure. The notion of an ecosystem of Grid infrastructure components is extended, and Grid job management software design is discussed in this context. Non- intrusive integration models and abstraction of Grid middleware function- ality through hierarchical aggregation of autonomous Grid job management services are emphasized, and service composition techniques facilitating this process are explored. A proof-of-concept implementation of the architecture is presented along with a discussion of architecture implementation details and trade-offs introduced by the service composition techniques used.
|
|
| 107. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
Heuristics and Algorithms for Data Center Optimization
- 2015
-
In: Proceedings of the 7th Multidisciplinary International Conference on Scheduling : Theory and Applications (MISTA 2015). ; , s. 921-927
-
Conference paper (other academic/artistic)
|
|
| 108. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
Impact of service overhead on service-oriented Grid architectures
- 2011
-
Conference paper (peer-reviewed)abstract
- Grid computing applications and infrastructures build heavily on Service-Oriented Computing development methodology and are often realized as Service-Oriented Ar- chitectures. Current Service-Oriented Architecture methodology renders service components as Web Services, and suffers per- formance limitations from Web Service overhead. The Grid Job Management Framework (GJMF) is a flexible Grid in- frastructure and application support component realized as a loosely coupled network of Web Services that offers a range of abstractive and platform independent interfaces for middleware- agnostic Grid job submission, monitoring, and control. In this paper we a present a performance evaluation aimed to characterize the impact of service overhead on Grid Service- Oriented Architectures and evaluate the efficiency of the GJMF architecture and optimization mechanisms designed to mediate impact of Web Service overhead on architecture performance.
|
|
| 109. |
- Östberg, Per-Olov, 1973-, et al.
(author)
-
Increasing flexibility and abstracting complexity in service-based Grid and cloud software
- 2011
-
In: Proceedings of the 1st International Conference on Cloud Computing and Services Science. - : SciTePress. - 9789898425522 ; , s. 240-249
-
Conference paper (peer-reviewed)abstract
- This work addresses service-based software development in Grid and Cloud computing environments, and proposes a methodology for Service-Oriented Architecture design. The approach consists of an architecture design methodology focused on facilitating system flexibility, a service model emphasizing component modularity and customization, and a development tool designed to abstract service development complexity. The approach is intended for use in computational eScience environments and is designed to increase flexibility in system design, development, and deployment, and reduce complexity in system development and administration. To illustrate the approach we present case studies from two recent Grid infrastructure software development projects, and evaluate impact of the development approach and the toolset on the projects.
|
|
| 110. |
- Östberg, Per-Olov, et al.
(author)
-
Mediation of service overhead in service-oriented grid architectures
- 2011
-
In: 2011 IEEE/ACM 12th International Conference on Grid Computing. - : IEEE. - 9780769545721 - 9781457719042 ; , s. 9-18
-
Conference paper (peer-reviewed)abstract
- Grid computing applications and infrastructures build heavily on Service-Oriented Computing development methodology and are often realized as Service-Oriented Architectures. The Grid Job Management Framework (GJMF) is a flexible Grid infrastructure and application support tool that offers a range of abstractive and platform independent interfaces for middleware-agnostic Grid job submission, monitoring, and control. In this paper we use the GJMF as a test bed for characterization of Grid Service-Oriented Architecture overhead, and evaluate the efficiency of a set of design patterns for overhead mediation mechanisms featured in the framework.
|
|
