• Home
  • Search
  • RNEP: Random Node Entropy Pairing for Efficient Decentralized Training with Non-IID Local Data
  • https://doi.org/10.3390/electronics13214193Copy DOI Icon

RNEP: Random Node Entropy Pairing for Efficient Decentralized Training with Non-IID Local Data

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

The proliferation of edge devices and advancements in Internet of Things technology have created a vast array of distributed data sources, necessitating machine learning models that can operate closer to the point of data generation. Traditional centralized machine learning approaches often struggle with real-time big data applications, such as climate prediction and traffic simulation, owing to high communication costs. In this study, we introduce random node entropy pairing, a novel distributed learning method for artificial neural networks tailored to distributed computing environments. This method reduces communication overhead and addresses data imbalance by enabling nodes to exchange only the weights of their local models with randomly selected peers during each communication round, rather than sharing the entire dataset. Our findings indicate that this approach significantly reduces communication costs while maintaining accuracy, even when learning from non-IID local data. Furthermore, we explored additional learning strategies that enhance system accuracy by leveraging the characteristics of this method. The results demonstrate that random node entropy pairing is an effective and efficient solution for distributed learning in environments where communication costs and data distribution present significant challenges.

Similar Papers
  • Research Article
  • Citations14

Detecting the different blends of diesel and biodiesel fuels using electronic nose machine coupled ANN and RSM methods

  • Dec 30, 2021
  • Sustainable Energy Technologies and Assessments
  • Korosh Mahmodi +2
  • PDF
  • Research Article
  • Citations21

Heat Rate Prediction of Combined Cycle Power Plant Using an Artificial Neural Network (ANN) Method

  • Feb 03, 2021
  • Sensors (Basel, Switzerland)
  • Yondha Dwika Arferiandi +2
  • Research Article

Technical Efficiency Evaluation of Ardabil Hospitals Affiliated to University of Medical Sciences using Artificial Neural Network Method

  • Dec 20, 2019
  • Quarterly Journal of Management Strategies in Health System
  • Aziz Rezapour +4
  • Research Article
  • Citations3

Discrimination of earthquakes and quarries in Kula District (Manisa, Turkey) and its vicinity by using linear discriminate function method and artificial neural networks

  • Jun 25, 2020
  • Bulletin Of The Mineral Research and Exploration
  • Aylin Tan +3
  • Research Article
  • Citations13

Adjustment of Non-linear Interaction Parameters for Relativistic Mean Field Approach by Using Artificial Neural Networks

  • May 01, 2018
  • Physics of Atomic Nuclei
  • T Bayram +2
  • Research Article
  • Citations16

Random Forest (RF) and Artificial Neural Network (ANN) Algorithms for LULC Mapping

  • Apr 25, 2020
  • Engineering and Technology Journal
  • Tay Shihab +2
  • Research Article
  • Citations25

Neural network method for solving parabolic two-temperature microscale heat conduction in double-layered thin films exposed to ultrashort-pulsed lasers

  • Jul 11, 2021
  • International Journal of Heat and Mass Transfer
  • Aniruddha Bora +3
  • Research Article
  • Citations2

An Artificial Neural Network Method for Simulating Soliton Propagation Based on the Rosenau-KdV-RLW Equation on Unbounded Domains

  • Mar 22, 2025
  • Mathematics
  • Laurence Finch +2
  • Research Article
  • Citations1

SHORT TERM FORECASTING BEBAN LISTRIK MENGGUNAKAN ARTIFICIAL NEURAL NETWORK

  • Jan 30, 2023
  • Jurnal Pendidikan Teknologi dan Kejuruan
  • Muhdalifah Muhtar +3
  • Research Article
  • Citations18

Computational-Based Approach for Predicting Porosity of Electrospun Nanofiber Mats Using Response Surface Methodology and Artificial Neural Network Methods

  • Sep 11, 2015
  • Journal of Macromolecular Science, Part B
  • Bentolhoda Hadavi Moghadam +3
  • Conference Article
  • Citations2

Classification of Plant Types based on Leaf Image using the Artificial Neural Network Method

  • Sep 19, 2020
  • 2020 International Seminar on Application for Technology of Information and Communication (iSemantic)
  • Petricia Pungki +3
  • PDF
  • Research Article
  • Citations11

Modelling of n-Hexadecane bioremediation from soil by slurry bioreactors using artificial neural network method

  • Nov 16, 2022
  • Scientific Reports
  • Roya Morovati +4
  • PDF
  • Research Article
  • Citations74

Combination of Limited Meteorological Data for Predicting Reference Crop Evapotranspiration Using Artificial Neural Network Method

  • Feb 18, 2022
  • Agronomy
  • Ahmed Elbeltagi +11
  • Research Article
  • Citations1

ARTIFICIAL NEURAL NETWORK TECHNIQUE FOR SOLVING ONE-DIMENSIONAL FRACTIONAL RAYLEIGH–STOCKES EQUATION

  • Mar 14, 2025
  • Fractals
  • Yones Esmaeelzade Aghdam +4
  • Research Article

Designing a Total Productive Maintenance (TPM) Management Model Using a Hybrid Method of Artificial Neural Networks and Hierarchical Clustering in Power Distribution Companies of Northwestern Iran

  • Jan 01, 2024
  • Management Strategies and Engineering Sciences
  • Hadi Golnahali +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.