Improving Cloud Storage Network Bandwidth Utilization of Scientific Applications

Markidis, Stefano (författare): KTH,Beräkningsvetenskap och beräkningsteknik (CST)

(creator_code:org_t)

Association for Computing Machinery (ACM), 2023
2023
Engelska.
Ingår i: Proceedings of the 7th Asia-Pacific Workshop on Networking, APNET 2023. - : Association for Computing Machinery (ACM). ; , s. 172-173

Relaterad länk:: https://urn.kb.se/re...; visa fler...; https://doi.org/10.1...; visa färre...

Abstract Ämnesord

Stäng

Cloud providers began to provide managed services to attract scientific applications, which have been traditionally executed on supercomputers. One example is AWS FSx for Lustre, a fully managed parallel file system (PFS) released in 2018. However, due to the nature of scientific applications, the frontend storage network bandwidth is left completely idle for the majority of its lifetime. Furthermore, the pricing model does not match the scalability requirement. We propose iFast, a novel host-side caching mechanism for scientific applications that improves storage bandwidth utilization and end-to-end application performance: by overlapping compute and data writeback through inexpensive local storage. iFast supports the Massage Passing Interface (MPI) library that is widely used by scientific applications and is implemented as a preloaded library. It requires no change to applications, the MPI library, or support from cloud operators. We demonstrate how iFast can accelerate the end-to-end time of a representative scientific application Neko, by 13-40%.

Av författaren/redakt...: Chien, Steven W. ...; Sato, Kento; Podobas, Artur; Jansson, Niclas, ...; Markidis, Stefan ...; Honda, Michio

Om ämnet

TEKNIK OCH TEKNOLOGIER: TEKNIK OCH TEKNO ...; och Elektroteknik oc ...; och Datorsystem

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.