- Research Article
- 10.1109/tmc.2025.3625123
Energy-Efficient Adaptive Batching for Federated Learning Via Gradient Noise Scale Measurement in Mobile Edge Computing Networks
- Jan 01, 2025
- IEEE Transactions on Mobile Computing
- Guozeng Xu + 5 more +5
Deploying federated learning (FL) in mobile edge computing (MEC) networks has become a prevalent approach to distributed learning. However, the inherent heterogeneity in computing, transmission and data on edge devices (EDs) brings challenges in improving training efficiency and speed. Existing approaches primarily focus on increasing batch sizes or employing adaptive batching to expedite convergence, but often overlook the generalization ability of the model. In this paper, we propose an energy-efficient adaptive batching approach for FL in MEC networks, aiming at minimizing the energy consumption by balancing training efficiency and speed. Initially, we exploit the relationship between batch size and loss improvement while determining the optimal learning rate corresponding to the batch size and understanding the correlation among loss improvement, learning rate, and gradient noise scale (GNS). Then we dynamically adjust the batch size based on the GNS and propose a low-complexity approach for measuring GNS. Finally, we fine-tune the batch size by assessing gradient similarity on each ED to ensure an optimal level of gradient noise during training, thereby enhancing the model's generalization. Experiment results demonstrate the effectiveness of our approach with an approximate 50% and 20% reduction in energy consumption and time consumption compared with existing approaches.
Read more