A Cloud Benchmark Suite Combining Micro and Applications Benchmarks

Scheuner, Joel,1991Chalmers tekniska högskola,Chalmers University of Technology (författare)

Micro and application performance benchmarks are commonly used to guide cloud service selection. However, they are often considered in isolation in a hardly reproducible setup with a flawed execution strategy. This paper presents a new execution methodology that combines micro and application benchmarks into a benchmark suite called RMIT Combined, integrates this suite into an automated cloud benchmarking environment, and implements a repeatable execution strategy. Additionally, a newly crafted Web serving benchmark called WPBench with three different load scenarios is contributed. A case study in the Amazon EC2 cloud demonstrates that choosing a cost-efficient instance type can deliver up to 40% better performance with 40% lower costs at the same time for the Web serving benchmark WPBench. Contrary to prior research, our findings reveal that network performance does not vary relevantly anymore. Our results also show that choosing a modern type of virtualization can improve disk utilization up to 10% for I/O-heavy workloads.

Leitner, Philipp,1982Chalmers tekniska högskola,Chalmers University of Technology(Swepub:cth)phileitn (författare)
Chalmers tekniska högskola (creator_code:org_t)

Ingår i:ACM/SPEC International Conference on Performance Engineering CompanionNew York, NY, USA : ACM, s. 161-1669781450356299

Om ämnet

NATURVETENSKAP: NATURVETENSKAP; och Data och informa ...; och Programvarutekni ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.