Search: onr:"swepub:oai:DiVA.org:liu-201070" >
Federated Learning ...
Federated Learning with Partial Gradients Over-the-Air
-
- Wang, Wendi (author)
- Zhejiang Univ, Peoples R China
-
- Chen, Zihan (author)
- Singapore Univ Technol & Design, Singapore
-
- Pappas, Nikolaos (author)
- Linköpings universitet,Databas och informationsteknik,Tekniska fakulteten
-
show more...
-
- Yang, Howard H. (author)
- Zhejiang Univ, Peoples R China
-
show less...
-
(creator_code:org_t)
- IEEE, 2023
- 2023
- English.
-
In: 2023 20TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING, SECON. - : IEEE. - 9798350300529 - 9798350300536
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- We develop a theoretical framework to study the training of federated learning models with partial gradients via over-the-air computing. The system consists of an edge server and multiple clients, aiming to collaboratively minimize a global loss function. The clients conduct local training and upload the intermediate parameters (e.g. the gradients) by analog transmissions. Specifically, each client modulates the entries of its local gradient onto a set of common orthogonal waveforms and sends out the signal simultaneously to the edge server; owing to the limited number of orthogonal waveforms, only a subset of the parameters can be selected for uploading during each round of communication. On the server side, it passes the received analog signal to a bank of match filters and obtains a noisy partial gradient vector. The server then uses this partial gradient to update the global parameter and feeds the new model back to all the clients for another round of local training. We derive the convergence rate of such a model training algorithm. We also conduct experiments to investigate the effects of different masking schemes on the convergence performance. The findings advance the understanding of over-the-air federated learning and provide useful insights for system designs.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database