Identifying the potential of Near Data Processing for Apache Spark

ISBN for proceedings: 9781450353359QC 20171124QC 20210518
While cluster computing frameworks are continuously evolving to provide real-time data analysis capabilities, Apache Spark has managed to be at the forefront of big data analytics for being a unified framework for both, batch and stream data processing. There is also a renewed interest in Near Data Processing (NDP) due to technological advancement in the last decade. However, it is not known if NDP architectures can improve the performance of big data processing frameworks such as Apache Spark. In this paper, we build the case of NDP architecture comprising programmable logic based hybrid 2D integrated processing-in-memory and instorage processing for Apache Spark, by extensive profiling of Apache Spark based workloads on Ivy Bridge Server.

TEKNIK OCH TEKNOLOGIER Elektroteknik och elektronik hsv//swe
ENGINEERING AND TECHNOLOGY Electrical Engineering, Electronic Engineering, Information Engineering hsv//eng
Processing-in-memory
In-storage Processing
Apache Spark
Informations- och kommunikationsteknik
Information and Communication Technology

Ohara, MoriyoshiIBM Research Tokyo, Japan (författare)
Ayguade, EduardBarcelona Super Computing Center, Spain (författare)
Ishizaki, KazaukiIBM Research Tokyo, Japan (författare)
Brorsson, Mats,1962-KTH,Programvaruteknik och Datorsystem, SCS(Swepub:kth)u1dkd5v9 (författare)
Vlassov, Vladimir,1957-KTH,Programvaruteknik och Datorsystem, SCS(Swepub:kth)u19yb2c8 (författare)
KTHProgramvaruteknik och Datorsystem, SCS (creator_code:org_t)

Ingår i:Proceedings of the International Symposium on Memory Systems, MEMSYS 2017New York, NY, USA : Association for Computing Machinery (ACM), s. 60-67

Av författaren/redakt...: Javed Awan, Ahsa ...; Ohara, Moriyoshi; Ayguade, Eduard; Ishizaki, Kazauk ...; Brorsson, Mats, ...; Vlassov, Vladimi ...

Om ämnet

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.