Sökning: id:"swepub:oai:DiVA.org:kth-314805" >
Adaptive Expert Mod...
Adaptive Expert Models for Personalization in Federated Learning
-
- Isaksson, Martin (författare)
- KTH,Programvaruteknik och datorsystem, SCS,Ericsson Research,GALE
-
- Listo Zec, Edvin (författare)
- KTH,Programvaruteknik och datorsystem, SCS,RISE,GALE
-
- Cöster, Rickard (författare)
- Ericsson AB
-
visa fler...
-
- Daniel, Gillblad (författare)
- 5Chalmers AI Research Center, Chalmers University of Technology, Göteborg, Sweden; AI Sweden
-
- Girdzijauskas, Sarunas (författare)
- KTH,Programvaruteknik och datorsystem, SCS
-
visa färre...
-
(creator_code:org_t)
- 2022
- 2022
- Engelska.
-
Ingår i: International Workshop on Trustworthy Federated Learningin Conjunction with IJCAI 2022 (FL-IJCAI'22).
- Relaterad länk:
-
https://arxiv.org/ab...
-
visa fler...
-
https://kth.diva-por... (primary) (Raw object)
-
https://urn.kb.se/re...
-
https://doi.org/10.4...
-
visa färre...
Abstract
Ämnesord
Stäng
- Federated Learning (FL) is a promising framework for distributed learning whendata is private and sensitive. However, the state-of-the-art solutions in thisframework are not optimal when data is heterogeneous and non-Independent andIdentically Distributed (non-IID). We propose a practical and robust approachto personalization in FL that adjusts to heterogeneous and non-IID data bybalancing exploration and exploitation of several global models. To achieve ouraim of personalization, we use a Mixture of Experts (MoE) that learns to groupclients that are similar to each other, while using the global models moreefficiently. We show that our approach achieves an accuracy up to 29.78 % andup to 4.38 % better compared to a local model in a pathological non-IIDsetting, even though we tune our approach in the IID setting.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Datorsystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Computer Systems (hsv//eng)
Publikations- och innehållstyp
- ref (ämneskategori)
- kon (ämneskategori)