Selective updates and adaptive masking for communication-efficient federated learning

Herzog, Alexander, Southam, Robbie, Belarbi, Othmane ORCID: https://orcid.org/0000-0002-6106-7669, Anwar, Saif, Bullo, Marcello, Carnelli, Pietro and Khan, Aftab 2024. Selective updates and adaptive masking for communication-efficient federated learning. IEEE Transactions on Green Communications and Networking 8 (2) , pp. 852-864. 10.1109/TGCN.2024.3349697

Full text not available from this repository.

Abstract

Federated Learning (FL) is fast becoming one of the most prevalent distributed learning techniques focused on privacy preservation and communication efficiency for large-scale Internet of Things (IoT) deployments. FL is a distributed learning approach to training models on distributed devices. Since local data remains on-device, communication through the network is reduced. However, in large-scale IoT environments or resource constrained networks, typical FL approaches significantly suffer in performance due to longer communication times. In this paper, we propose two methods for further reducing communication volume in resource restricted FL deployments. In our first method, which we term Selective Updates (SU), local models are trained until a dynamic threshold on model performance is surpassed before sending updates to a centralised Parameter Server (PS). This allows for minimal updates being transmitted, thus reducing communication overheads. Our second method, Adaptive Masking (AM), performs parameter masking on both the global and local models prior to sharing. With AM, we select model parameters that have changed the most between training rounds. We extensively evaluate our proposed methods against state-of-the-art communication reduction strategies using two common benchmark datasets, and under different communication constrained settings. Our proposed methods reduce the overall communication volume by over 20%, without affecting the model accuracy.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Schools > Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	2473-2400
Last Modified:	17 Dec 2025 10:45
URI:	https://orca.cardiff.ac.uk/id/eprint/183278

Actions (repository staff only)

Edit Item