Decentralized Federated Learning Strategy with Image Classification using ResNet Architecture

This research article is an effort to explore the intriguing fact about the Indian With the rapid advancement of artificial intelligence (AI) technology, we are seeing an explosion of data being transmitted during model training, which unfortunately raises the risk of data leakage. In an age where data privacy is paramount and regulations are becoming increasingly strict, protecting sensitive information from unauthorized access has become a pressing issue. This is where Federated Learning (FL) steps in as a promising solution, finding its way into various sectors. In this paper, we will explore the practical applications of FL in five crucial areas: healthcare, urban transportation, computer vision, the Industrial Internet of Things (IIoT), and 5G networks. We will assess how FL can be effectively implemented in these real-world scenarios to enhance privacy while ensuring model accuracy and efficiency. Additionally, we will compare the FL framework with traditional centralized methods, showcasing how FL improves data privacy and performance, as well as acknowledging some of its current limitations. We will also discuss potential future enhancements that could make FL even more effective. Lastly, we will take a look at the latest research trends and the developmental prospects within this exciting field, providing insight into how FL could shape the future of data protection and AI.

Federated learning for green and sustainable 6G IIoT applications

Real-World Surveillance of FDA-Cleared Artificial Intelligence Models: Rationale and Logistics.

Artificial Intelligence: The Future of Maxillofacial Prognosis and Diagnosis?

The continuous expanded scale of the industrial Internet of Things (IIoT) leads to IIoT equipments generating massive amounts of user data every moment. According to the different requirement of end users, these data usually have high heterogeneity and privacy, while most of users are reluctant to expose them to the public view. How to manage these time series data in an efficient and safe way in the field of IIoT is still an open issue, such that it has attracted extensive attention from academia and industry. As a new machine learning paradigm, federated learning (FL) has great advantages in training heterogeneous and private data. This article studies the FL technology applications to manage IIoT equipment data in wireless network environments. In order to increase the model aggregation rate and reduce communication costs, we apply deep reinforcement learning (DRL) to IIoT equipment selection process, specifically to select those IIoT equipment nodes with accurate models. Therefore, we propose a FL algorithm assisted by DRL, which can take into account the privacy and efficiency of data training of IIoT equipment. By analyzing the data characteristics of IIoT equipments, we use MNIST, fashion MNIST, and CIFAR-10 datasets to represent the data generated by IIoT. During the experiment, we employ the deep neural network model to train the data, and experimental results show that the accuracy can reach more than 97%, which corroborates the effectiveness of the proposed algorithm.

Benefited from privacy improvement during cooperative training, federated Learning (FL) has been popularly applied for intelligent manufacturing within industrial internet of things (IIoT). However, recent studies have shown the vulnerability of existing FL, since the privacy provided by FL might be inferenced on the wireless training stage by interactive data. More seriously, for industrial applications, traditional FL methods of protecting privacy might lead to a drastic decrease in accuracy, caused by the increasing difficulty and costs of managing massive clients. Thus, this paper proposes an Adaptive Noise Trap (ANT). As a protection strategy for privacy applied in FL, our additive noise defense strategy is able to address the challenges posed by massive privacy in the data level and reduce its defense cost by adding noise defense on the server-side global model in FL. Meanwhile, ANT adjusts the noise size according to the privacy carried in the model, which ensures the privacy defense performance and model accuracy in large-scale IIoT. Especially, network traffic classification is chosen as a typical application scenario for the methodology verifications based on simulations. Through experimental comparisons, ANT achieves a lightweight defense, which uses less noise to achieve the desired defense effect. This lightweight defense can play an unimaginable role in the massive scale of IIoT. Moreover, the simulation results also show that ANT guarantees convergence, accuracy and reliability of federated learning.

PurposeThe purpose of this study is to explore the potential of trainable activation functions to enhance the performance of deep neural networks, specifically ResNet architectures, in the task of image classification. By introducing activation functions that adapt during training, the authors aim to determine whether such flexibility can lead to improved learning outcomes and generalization capabilities compared to static activation functions like ReLU. This research seeks to provide insights into how dynamic nonlinearities might influence deep learning models' efficiency and accuracy in handling complex image data sets.Design/methodology/approachThis research integrates three novel trainable activation functions – CosLU, DELU and ReLUN – into various ResNet-n architectures, where “n” denotes the number of convolutional layers. Using CIFAR-10 and CIFAR-100 data sets, the authors conducted a comparative study to assess the impact of these functions on image classification accuracy. The approach included modifying the traditional ResNet models by replacing their static activation functions with the trainable variants, allowing for dynamic adaptation during training. The performance was evaluated based on accuracy metrics and loss profiles across different network depths.FindingsThe findings indicate that trainable activation functions, particularly CosLU, can significantly enhance the performance of deep learning models, outperforming the traditional ReLU in deeper network configurations on the CIFAR-10 data set. CosLU showed the highest improvement in accuracy, whereas DELU and ReLUN offered varying levels of performance enhancements. These functions also demonstrated potential in reducing overfitting and improving model generalization across more complex data sets like CIFAR-100, suggesting that the adaptability of activation functions plays a crucial role in the training dynamics of deep neural networks.Originality/valueThis study contributes to the field of deep learning by introducing and evaluating the impact of three novel trainable activation functions within widely used ResNet architectures. Unlike previous works that primarily focused on static activation functions, this research demonstrates that incorporating trainable nonlinearities can lead to significant improvements in model performance and adaptability. The introduction of CosLU, DELU and ReLUN provides a new pathway for enhancing the flexibility and efficiency of neural networks, potentially setting a new standard for future deep learning applications in image classification and beyond.

Artificial intelligence (AI) has, in the recent past, experienced a rebirth with the growth of generative AI systems such as ChatGPT and Bard. These systems are trained with billions of parameters and have enabled widespread accessibility and understanding of AI among different user groups. Widespread adoption of AI has led to the need for understanding how machine learning (ML) models operate to build trust in them. An understanding of how these models generate their results remains a huge challenge that explainable AI seeks to solve. Federated learning (FL) grew out of the need to have privacy-preserving AI by having ML models that are decentralized but still share model parameters with a global model. This study sought to examine the extent of development of the explainable AI field within the FL environment in relation to the main contributions made, the types of FL, the sectors it is applied to, the models used, the methods applied by each study, and the databases from which sources are obtained. A systematic search in 8 electronic databases, namely, Web of Science Core Collection, Scopus, PubMed, ACM Digital Library, IEEE Xplore, Mendeley, BASE, and Google Scholar, was undertaken. A review of 26 studies revealed that research on explainable FL is steadily growing despite being concentrated in Europe and Asia. The key determinants of FL use were data privacy and limited training data. Horizontal FL remains the preferred approach for federated ML, whereas post hoc explainability techniques were preferred. There is potential for development of novel approaches and improvement of existing approaches in the explainable FL field, especially for critical areas. OSF Registries 10.17605/OSF.IO/Y85WA; https://osf.io/y85wa.

The seamless adoption of the artificial intelligence (AI) in some sensitive areas has heightened discomforts on the privacy of data, security and confidence. Another alternative is Federated Learning (FL), an alternative dedicated to centralized model training and data localization prevention, therefore, eliminating exposure risks. Despite these advantages, FL is also marked by such vulnerabilities as model poisoning, unreliability aggregation, and centralized-coordinator dependency. This paper outlines the current difficulties, and presents a federated learning system with a blockchain-based solution to the current issues - via immutability, decentralization, and transparent use of blockchains. Smart contracts will be used to govern the secure verification of participants, fair incentive systems and the impossibility to tamper with updates to models. Such an integration will allow trustless cooperation between untrusted parties and protect sensitive data. The suggested framework is evaluated in a variety of application permutations of AI, such as healthcare, finance, and IoT environments. Experimental results show that by means of blockchain-enabled FL, the privacy-preserving property is represented, robustness against malicious attacks is boosted and scaleable and trust-sensitive AI solutions are developed. The converge opens the path to sustainable, privacy-preserving and secure AI applications in the real world.

Federated Learning (FL) is a paradigm in distributed machine learning, which has gained significant attention in the recent years especially in the domain of Internet of Things. Federated Learning saves communication bandwidth when compared to centralized machine learning process and is also considered to be privacy preserving as the raw data at the clients need not be transmitted to the server for the FL learning. Recent studies on FL have exposed privacy vulnerabilities particularly in the form of Gradient Leakage Attacks (GLA) in which the adversaries can generate training data of the client from shared gradients or model updates from clients. The available solutions in the literature for GLA based on perturbing the gradients from clients leads to a drop in the performance of the FL system while attempting to preserve privacy. We propose HAFedL, an improved novel hessian aware adaptive privacy preserving FL scheme in which the performance of the model is not significantly affected due to the aspects introduced in the FL architecture to improve the privacy of the model against the GLA. The HAFedL is also robust to the data heterogeneity and device heterogeneity (particularly straggler effect) which may be present in the clients participating in the FL. The performance of HAFedL is tested for two applications- IoT device identification and digit classification. The proposed HAFedL scheme can be utilized in privacy sensitive domains such as smart city applications, Industrial Internet of Things, Internet of Robotic Things, Internet of Medical Things, etc.

Recent technological evolution enables Artificial Intelligence (AI) model training by users’ mobile devices, which accelerates decentralized big data analysis. In particular, Federated Learning (FL) is a key enabler to realize decentralized AI model update without user’s privacy disclosure. However, since the behaviour of workers, who are assigned a training task, cannot be monitored, the state-of-the-art methods require a special hardware and/or cryptography to force the workers behave honestly, which hinders the realization. Furthermore, although blockchain-enabled FL has been proposed to give workers reward, any rigorous reward policy design has not been discussed. In this paper, to tackle these issues, we present a novel method using mechanism design, which is an economic approach to realize desired objectives under the situation that participants act rationally. The key idea is to introduce repeated competition for FL so that any rational worker follows the protocol and maximize their profits. With mechanism design, we propose a generic full-fledged protocol design for FL on a public blockchain. We also theoretically clarify incentive compatibility based on contest theory which is an auction-based game theory in economics.

Statement of problem: Artificial intelligence (AI) applications are increasingly used in restorative process. But existing dentistry restoration effectiveness as well as growth and IA applications have not yet been systematically analyzed or documented. Purpose: The goal of such comprehensive evaluation is to discover & assess the abilities associated with artificial intelligence models in restorative dentistry for the analysis of caries as well as vertical tooth fracture, evaluate margins in preparing tooth, and analyze reconstructive failures. Methods: A systematic electronic review of 5 databases was carried out: PubMed/ MEDLINE, World of Science, EMBASE, Scopus and Cochrane. The investigation was carried out manually as well. Research using AI models was chosen on the basis of 4 criterion: dental caries diagnostics, diagnostics, vertical tooth fracture, tooth preparation recognition, & cause of failure of restoration. Both researchers rated the quality of the study for Critical Appraisal Checklist for Quasi-Experimental Studies (nonrandomized experimental studies). The 3rd author was asked for resolving the dispute. Results: 34 researches were made the part of this analysis: from which 29 contains artificial intelligence techniques including the diagnostics or treatment related to caries and its causes according to sensitivity models, 2 to diagnose vertical tooth fractures, 1 to prepare the teeth. Among the studied analysis, the accuracy of caries diagnosis in the AI models was tested from 76-88.3%, sensitivity from 73-90%, as well as specificity from 61.5-93%. In the study, the accuracy of predicted caries ranges from 83.6-97.1%. The performed research showed the accuracy of the analysis of a vertical tooth fracture from 88.3-95.7%. The study, which uses AI models to find a destination, had details with the range of 90.6-97.4%. Conclusions: AI models are a powerful tool for diagnosing caries as well as vertical tooth fractures, recognizing preparation margins and predicting restoration failures. But, the dental use of AI models continues to evolve. More research is needed to evaluate the clinical effectiveness of artificial intelligence models in restorative dentistry. Keyword: Artificial intelligence, restorative dentistry, vertical tooth fractures.

This paper presents a three-stage optimization mechanism designed to enhance Federated Learning (FL) in Industrial Internet of Things (IIoT) networks. Traditional FL optimizations, which typically focus on a single aspect, fall short in IIoT environments. Our approach integrates a multi-criteria enhancement: first, an Ensembled Client Selection Mechanism (ECSM) selects participants based on accuracy, reputation, and randomness. Second, Adaptive Distributed Client Training (ADCT) dynamically adjusts based on participant performance. Lastly, a Secure and Efficient Communication Channel (SECC), backed by blockchain, meets IIoT’s stringent security demands. The evaluation shows TSFed outperforms baseline methods, enhancing FL performance by increasing accuracy and F1-score. Importantly, TSFed improves the efficiency of achieving 80% accuracy on the MNIST dataset by 29.09% over baseline methods, showcasing significant gains in both security and efficiency. This mechanism also exhibits robustness against malicious attacks, setting a new benchmark for FL in IIoT environments.

ObjectivesMedical artificial intelligence (AI) has recently attracted considerable attention. However, training medical AI models is challenging due to privacy-protection regulations. Among the proposed solutions, federated learning (FL) stands out. FL involves transmitting only model parameters without sharing the original data, making it particularly suitable for the medical field, where data privacy is paramount. This study reviews the application of FL in the medical domain.MethodsWe conducted a literature search using the keywords "federated learning" in combination with "medical," "healthcare," or "clinical" on Google Scholar and PubMed. After reviewing titles and abstracts, 58 papers were selected for analysis. These FL studies were categorized based on the types of data used, the target disease, the use of open datasets, the local model of FL, and the neural network model. We also examined issues related to heterogeneity and security.ResultsIn the investigated FL studies, the most commonly used data type was image data, and the most studied target diseases were cancer and COVID-19. The majority of studies utilized open datasets. Furthermore, 72% of the FL articles addressed heterogeneity issues, while 50% discussed security concerns.ConclusionsFL in the medical domain appears to be in its early stages, with most research using open data and focusing on specific data types and diseases for performance verification purposes. Nonetheless, medical FL research is anticipated to be increasingly applied and to become a vital component of multi-institutional research.

Federated Learning (FL) has emerged as a promising approach to collaborative machine learning without the need to share raw data. It enables decentralized model updates while preserving the privacy of each device and reducing the communication overhead. This experiment evaluates the effectiveness of the personalized FL algorithms, namely FedAvg, APPLE, FedBABU and FedProto, in a decentralized setting, with a particular focus on the Fashion MNIST dataset, which is characterized by a non-ideal data distribution. The objective is to identify which algorithm performs optimally in image classification tasks. The experimental results show that both FedProto and APPLE have nearly equivalent and better performance compared to FedBABU and FedAvg. Interestingly, increasing the number of uploads in FedBABU leads to similar results to APPLE and FedProto. However, under limited upload conditions, FedBABU performs similarly to FedAvg. These results provide valuable insights into the differential performance of personalized FL algorithms in non-id data scenarios and provide guidance for their application in distributed environments, especially in sensitive domains such as medical, military and confidential image analysis tasks where privacy and communication efficiency are paramount concerns.