- Research Article
- 10.1109/tnse.2025.3648731
Connected Dominating Set Associated Subnetwork Construction for Fast Convergent Heterogeneous Federated Learning
- Jan 01, 2026
- IEEE Transactions on Network Science and Engineering
- Xiaoying Lei + 2 more +2
Despite the growing interest in developing decentralized federated learning (FL) in wireless networks, few works have explored the impact of network topology. I.e., due to devices sharing model parameters (or logits) by following a consensus protocol, the convergence performance of decentralized FL algorithms is affected by the network topology. In case the network topology dynamically changes, the existing solutions may fail. In this work, we investigate a topology control technique in the design of the consensus protocol. Using the strategy as a building block, we develop upon knowledge distillation a decentralized framework for heterogeneous FL, dubbed as DistHFL. By conducting the consensus process on a connected dominating set associated subnetwork rather than the whole network, and updating the subnetwork towards topology change, the DistHFL significantly accelerates the convergence of the model learning algorithm and enhances its robustness against dynamic topology. We develop mathematical models to demonstrate the convergence of the proposed consensus protocol, as well as the convergence of the DistHFL. We derive an upper bound for the generalization performance of the ensemble models trained with DistHFL by applying the domain measurement tools. Through conducting extensive numerical experiments, we verify that DistHFL outperforms the state-of-the-art algorithms under all setups in all cases.
Read more