| 1. |
- Cameron, David, et al.
(författare)
-
Adaptive data management in the ARC Grid middleware
- 2011
-
Ingår i: Journal of Physics, Conference Series. - : IOP Publishing. - 1742-6588 .- 1742-6596. ; 331:062006
-
Tidskriftsartikel (refereegranskat)abstract
- The Advanced Resource Connector (ARC) Grid middleware was designed almost 10 years ago, and has proven to be an attractive distributed computing solution and successful in adapting to new data management and storage technologies. However, with an ever-increasing user base and scale of resources to manage, along with the introduction of more advanced data transfer protocols, some limitations in the current architecture have become apparent. The simple first-in first-out approach to data transfer leads to bottlenecks in the system, as does the built-in assumption that all data is immediately available from remote data storage. We present an entirely new data management architecture for ARC which aims to alleviate these problems, by introducing a three-layer structure. The top layer accepts incoming requests for data transfer and directs them to the middle layer, which schedules individual transfers and negotiates with various intermediate catalog and storage systems until the physical file is ready to be transferred. The lower layer performs all operations which use large amounts of bandwidth, i.e. the physical data transfer. Using such a layered structure allows more efficient use of the available bandwidth as well as enabling late-binding of jobs to data transfer slots based on a priority system. Here we describe in full detail the design and implementation of the new system.
|
|
| 2. |
- Eerola, Paula, et al.
(författare)
-
Atlas Data-Challenge 1 on NorduGrid
- 2003
-
Ingår i: Proceedings of CHEP 2003.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- The first LHC application ever to be executed in a computational Grid environment is the so-called ATLAS Data-Challenge 1, more specifically, the part assigned to the Scandinavian members of the ATLAS Collaboration. Taking advantage of the NorduGrid testb
|
|
| 3. |
- Eerola, Paula, et al.
(författare)
-
Building a Production Grid in Scandinavia
- 2003
-
Ingår i: IEEE Internet Computing. - : IEEE. ; 7:4, s. 27-35
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- The aim of the NorduGrid project is to build and operate a production grid infrastructure in Scandinavia and Finland. By developing innovative middleware solutions, it enables a 24/7 production-level test bed. Through a common access layer, NorduGrid conn
|
|
| 4. |
- Eerola, Paula, et al.
(författare)
-
Roadmap for the ARC Grid Middleware
- 2007
-
Ingår i: Lecture Notes in Computer Science. - Berlin, Heidelberg : Springer Berlin Heidelberg. - 9783540757542 ; 4699/2007, s. 471-479
-
Konferensbidrag (refereegranskat)abstract
- The Advanced Resource Connector (ARC) or the NorduGrid middleware is an open source software solution enabling production quality computational and data Grids, with special emphasis on scalability, stability, reliability and performance. Since its first release in May 2002, the middleware is deployed and being used in production environments. This paper aims to present the future development directions and plans of the ARC middleware in terms of outlining the software development roadmap.
|
|
| 5. |
|
|
| 6. |
- Eerola, Paula, et al.
(författare)
-
The NorduGrid architecture and tools
- 2003
-
Ingår i: Proceedings of CHEP 2003.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- The NorduGrid project designed a Grid architecture with the primary goal to meet the requirements of production tasks of the LHC experiments. While it is meant to be a rather generic Grid system, it puts emphasis on batch processing suitable for problems
|
|
| 7. |
- Eerola, Paula, et al.
(författare)
-
The NorduGrid production Grid infrastructure, status and plans
- 2003
-
Ingår i: Proc. Fourth International Workshop on Grid Computing. ; , s. 158-165
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- NorduGrid offers reliable Grid services for academic users over an increasing set of computing & storage resources spanning through the Nordic countries Denmark, Finland, Norway and Sweden. A small group of scientists has already been using the NorduGrid
|
|
| 8. |
- Ekelöf, Tord, et al.
(författare)
-
LCG and ARC middleware interoperability
- 2006
-
Konferensbidrag (refereegranskat)abstract
- LCG and ARC are two of the major production-ready Grid middleware solutions being used by hundreds of HEP researchers every day. Even though the middlewares are based on same technology, there are substantial architectural and implementational divergencies. An ordinary user faces difficulties trying to cross the boundaries of the two systems: ARC clients so far have not been capable accessing LCG resources and vice versa. After presenting the similarities and differences of the LCG and ARC middlewares, we will focus on the strategies implementing interoperable layers over the two middlewares. The most important areas are the job submission and management and information system components. The basic requirement for the interoperability layer implementation is capability of transparent cross Grid job submission both from ARC and LCG.
|
|
| 9. |
- Ellert, Mattias, et al.
(författare)
-
The NorduGrid project: using Globus toolkit for building GRID infrastructure
- 2003
-
Ingår i: Nuclear Instruments & Methods in Physics Research. Section A: Accelerators, Spectrometers, Detectors, and Associated Equipment. - 0167-5087. ; 502:2-3, s. 407-410
-
Tidskriftsartikel (refereegranskat)abstract
- The NorduGrid is the pioneering Grid project in Scandinavia. The purpose of the project is to create a Grid computing infrastructure in Nordic countries. The cornerstone of the infrastructure adopted at NorduGrid is the Globus toolkit developed at Argonne National Laboratory and University of Southern California. It is, however, missing several important high-level services. With the need to provide working production system, NorduGrid has developed its own solution for the most essential parts. An early prototype implementation of the proposed architecture is being tested and further developed. Aiming at simple but yet functional system capable of handling common computational problems encountered in the Nordic scientific communities, we were choosing simple, but still functional solutions with the necessary parts implemented first. (C) 2003 Elsevier Science B.V. All rights reserved.
|
|
| 10. |
- Ellert, Mattias, et al.
(författare)
-
The NorduGrid project: Using Globus toolkit for building Grid infrastructure
- 2003
-
Ingår i: Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. - : Elsevier Science B.V.. ; 502:2-3, s. 407-410
-
Tidskriftsartikel (refereegranskat)abstract
- The NorduGrid is the pioneering Grid project in Scandinavia. The purpose of the project is to create a Grid computing infrastructure in Nordic countries. The cornerstone of the infrastructure adopted at NorduGrid is the Globus toolkit developed at Argonne
|
|
