Sökning: onr:"swepub:oai:DiVA.org:mdh-60081" >
Methodological Prin...
Methodological Principles for Reproducible Performance Evaluation in Cloud Computing
-
- Papadopoulos, Alessandro, Professor (författare)
- Mälardalens universitet,Inbyggda system
-
- Versluis, L. (författare)
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands
-
- Bauer, A. (författare)
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands
-
visa fler...
-
- Herbst, N. (författare)
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands
-
- Kistowski, J. V. (författare)
- Escuela Superior Politecnica Del Litoral, Guayaquil, Ecuador
-
- Ali-Eldin, Ahmed (författare)
- Umeå universitet,Institutionen för datavetenskap,Umeå University, Umeå, Sweden
-
- Abad, C. L. (författare)
- Escuela Superior Politecnica Del Litoral, Guayaquil, Ecuador
-
- Amaral, J. N. (författare)
- University of Alberta, Edmonton, AB, Canada
-
- Tuma, P. (författare)
- Charles University, Prague, Czech Republic
-
- Iosup, A. (författare)
- Vrije Universiteit Amsterdam, Amsterdam, Netherlands
-
visa färre...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers Inc. 2021
- 2021
- Engelska.
-
Ingår i: IEEE Transactions on Software Engineering. - : Institute of Electrical and Electronics Engineers Inc.. - 0098-5589 .- 1939-3520. ; 47:8, s. 1528-1543
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- The rapid adoption and the diversification of cloud computing technology exacerbate the importance of a sound experimental methodology for this domain. This work investigates how to measure and report performance in the cloud, and how well the cloud research community is already doing it. We propose a set of eight important methodological principles that combine best-practices from nearby fields with concepts applicable only to clouds, and with new ideas about the time-accuracy trade-off. We show how these principles are applicable using a practical use-case experiment. To this end, we analyze the ability of the newly released SPEC Cloud IaaS benchmark to follow the principles, and showcase real-world experimental studies in common cloud environments that meet the principles. Last, we report on a systematic literature review including top conferences and journals in the field, from 2012 to 2017, analyzing if the practice of reporting cloud performance measurements follows the proposed eight principles. Worryingly, this systematic survey and the subsequent two-round human reviews, reveal that few of the published studies follow the eight experimental principles. We conclude that, although these important principles are simple and basic, the cloud community is yet to adopt them broadly to deliver sound measurement of cloud environments.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Datorsystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Computer Systems (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
Nyckelord
- Experimental evaluation
- experimentation
- observation study
- Architectural acoustics
- Cloud computing
- Economic and social effects
- Engineering research
- Software engineering
- Software testing
- Benchmark testing
- Computer performance
- Performance evaluation
- Systematics
- Benchmarking
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas
- Av författaren/redakt...
-
Papadopoulos, Al ...
-
Versluis, L.
-
Bauer, A.
-
Herbst, N.
-
Kistowski, J. V.
-
Ali-Eldin, Ahmed
-
visa fler...
-
Abad, C. L.
-
Amaral, J. N.
-
Tuma, P.
-
Iosup, A.
-
visa färre...
- Om ämnet
-
- NATURVETENSKAP
-
NATURVETENSKAP
-
och Data och informa ...
-
- TEKNIK OCH TEKNOLOGIER
-
TEKNIK OCH TEKNO ...
-
och Elektroteknik oc ...
-
och Datorsystem
-
- NATURVETENSKAP
-
NATURVETENSKAP
-
och Data och informa ...
-
och Datavetenskap
- Artiklar i publikationen
-
IEEE Transaction ...
- Av lärosätet
-
Mälardalens universitet
-
Umeå universitet