Search: id:"swepub:oai:DiVA.org:kth-285424" >
Energy-Aware Worklo...
Energy-Aware Workload Allocation for Distributed Deep Neural Networks in Edge-Cloud Continuum
-
- Jin, Y. (author)
- Fudan University, Shanghai, China
-
- Xu, J. (author)
- Fudan University, Shanghai, China
-
- Huan, Y. (author)
- Fudan University, Shanghai, China
-
show more...
-
- Yan, Y. (author)
- Fudan University, Shanghai, China
-
- Zheng, Li-rong (author)
- KTH,Integrerade komponenter och kretsar
-
- Zou, Z. (author)
- Fudan University, Shanghai, China
-
show less...
-
(creator_code:org_t)
- IEEE Computer Society, 2019
- 2019
- English.
-
In: International System on Chip Conference. - : IEEE Computer Society. - 9781728134826 ; , s. 213-217
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- This paper presents an energy-aware workload allocation framework for Distributed Deep Neural Networks (DNNs) in the Edge-Cloud continuum. As opposed to conventional approaches where the inference is performed in a standalone device, a computing-communication mode is proposed to distribute computing tasks of different layers of DNNs to different levels of the Edge-Cloud network to achieve the minimum energy cost per inference. The optimal exit layer (EL) can be determined where the intermediate data of the neural networks are transmitted to the higher level in the Edge-Cloud continuum. Case studies are illustrated for AlexNet and VGG-16 considering a set of DNN processors and wireless interfaces. Using the GPU GTX1080 with 22.8 GOPS/W and the WiFi with 10 nJ/bit transmission efficiency, the optimized energy consumption for AlexNet is estimated to be 0.016 J when the inference exits from the edge at the EL2 (Conv1) layer. For VGG-16, the optimal EL is EL1 with the minimum inference cost of 0.0482 J.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Kommunikationssystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Communication Systems (hsv//eng)
Keyword
- Energy utilization
- Multilayer neural networks
- Power management (telecommunication)
- Programmable logic controllers
- Computing communication
- Conventional approach
- Distribute computing
- Minimum energy costs
- Stand-alone devices
- Transmission efficiency
- Wireless interfaces
- Workload allocation
- Deep neural networks
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database