Enhancing the Performance and Transparency of Machine Learning (ML): Alternative Approaches to ML Interpretability-Explainability

Artificially Intelligent (AI) systems have become part of society. They support decision-making processes and take decisions autonomously. Due to their ability to analyze very large data sets, they can be superior to humans in certain aspects and they will have a major impact on people's lives. Tensions with societal, legal norms or constitutional values have already arisen. They can be observed in different scenarios, ranging from credit scoring and autonomous driving to social profiling and predictive policing. The lack of transparency of AI systems, which were considered as “black-boxes,” has already been identified as a problem. These so-called “black boxes” have been a weak spot for those who develop or use an AI system. This paper demystifies AI by discussing the role of transparency and explainability of machine learning. The paper describes different aspects of transparency and explains methods to increase our understanding of the behavior of AI systems.

Machine Learning and Transparency: A Scoping Exercise

The current discourse on fairness, accountability, and transparency in machine learning is driven by two competing narratives: sociotechnical dogmatism, which holds that society is full of inefficiencies and imperfections that can only be solved by better algorithms; and sociotechnical skepticism, which opposes many instances of automation on principle. Both perspectives, we argue, are reductive and unhelpful. In this chapter, we review a large, diverse body of literature in an attempt to move beyond this restrictive duality, toward a pragmatic synthesis that emphasizes the central role of context and agency in evaluating new and emerging technologies. We show how epistemological and ethical considerations are inextricably intertwined in contemporary debates on algorithmic bias and explainability. We trace the dialectical interplay between dogmatic and skeptical narratives across disciplines, merging insights from social theory and philosophy. We review a number of theories of explanation, ultimately endorsing a sociotechnical pragmatism that combines elements of Floridi’s levelism and Mayo’s reliabilism to place a special emphasis on notions of agency and trust. We conclude that this hybrid does more to promote fairness, accountability, and transparency in machine learning than dogmatic or skeptical alternatives.

This paper intends to provide a better understanding of how these models produce predictions, particularly in complex medical diagnoses, and at the same time bridging the gap between technical model outputs and clinical applications. This study addresses the critical problem of transparency of machine learning (ML) models in health care where interpretability is an essential aspect for ethical decision making and trust building.The goal of this paper is to present a clearer understanding of how these models generate predictions, especially in important fields like complex medical diagnoses, thereby bridging the gap between technical model outputs and clinical applications. The crucial issue of transparency in machine learning (ML) models within healthcare is addressed in this study where interpretability plays a vital role in ethical decision-making and fostering trust. The focus of the research is enhancing model transparency by using SHapley Additive exPlanations (SHAP) and Deep Learning Important FeaTures (DeepLIFT), two crucial methods that are designed to elucidate the decision-making processes of ML models.This mode of approach helps to have more distributed comprehension of the decision pathways by models thus aiding in knowing how each feature contributed to the last prediction. It is this method that has been employed to showcase the efficiency of predicting melanoma and also diabetic retinopathy which are two vital medical diagnostic areas. In healthcare, SHAP along with DeepLIFT has improved the models’ explainability and trustworthiness significantly and hence making them easy for those in the field. The advanced interpretability methods presented in this document enhances ML model transparency especially when dealing with health issues. As a result, interpretability becomes an even bigger issue and they are supposed to be able to use these tools for reliable and open decisions when it comes to medical specialists.

The integration of machine learning (ML) in marine engineering has been increasingly subjected to stringent regulatory scrutiny. While environmental regulations aim to reduce harmful emissions and energy consumption, there is also a growing demand for the interpretability of ML models to ensure their reliability and adherence to safety standards. This research highlights the need to develop models that are both transparent and comprehensible to domain experts and regulatory bodies. This paper underscores the importance of transparency in machine learning through a use case involving a VLGC ship two-stroke propulsion engine. By adhering to the CRISP-DM standard, we fostered close collaboration between marine engineers and machine learning experts to circumvent the common pitfalls of automated ML. The methodology included comprehensive data exploration, cleaning, and verification, followed by feature selection and training of linear regression and decision tree models that are not only transparent but also highly interpretable. The linear model achieved an RMSE of 23.16 and an MRAE of 14.7%, while the accuracy of decision trees ranged between 96.4% and 97.69%. This study demonstrates that machine learning models for predicting propulsion engine fuel consumption can be interpretable, adhering to regulatory requirements, while still achieving adequate predictive performance.

The fact that machine learning is growing more and more entrenched in almost every aspect of society, combined with the opacity of various of its algorithms has induced the relatively young research area of transparent machine learning. The aim of this domain is to provide explanations for automated decisions to increase public trust. In my thesis, I am going to consider certain problems that arise from this research agenda. Particularly, I so far considered, the dilemma of conflicting explanations and the issue of privacy concerns arising from transparency.

PurposeThe first transmission of coronavirus to humans started in Wuhan city of China, took the shape of a pandemic called Corona Virus Disease 2019 (COVID-19), and posed a principal threat to the entire world. The researchers are trying to inculcate artificial intelligence (Machine learning or deep learning models) for the efficient detection of COVID-19. This research explores all the existing machine learning (ML) or deep learning (DL) models, used for COVID-19 detection which may help the researcher to explore in different directions. The main purpose of this review article is to present a compact overview of the application of artificial intelligence to the research experts, helping them to explore the future scopes of improvement.MethodsThe researchers have used various machine learning, deep learning, and a combination of machine and deep learning models for extracting significant features and classifying various health conditions in COVID-19 patients. For this purpose, the researchers have utilized different image modalities such as CT-Scan, X-Ray, etc. This study has collected over 200 research papers from various repositories like Google Scholar, PubMed, Web of Science, etc. These research papers were passed through various levels of scrutiny and finally, 50 research articles were selected.ResultsIn those listed articles, the ML / DL models showed an accuracy of 99% and above while performing the classification of COVID-19. This study has also presented various clinical applications of various research. This study specifies the importance of various machine and deep learning models in the field of medical diagnosis and research.ConclusionIn conclusion, it is evident that ML/DL models have made significant progress in recent years, but there are still limitations that need to be addressed. Overfitting is one such limitation that can lead to incorrect predictions and overburdening of the models. The research community must continue to work towards finding ways to overcome these limitations and make machine and deep learning models even more effective and efficient. Through this ongoing research and development, we can expect even greater advances in the future.

A comprehensive review on detection of plant disease using machine learning and deep learning approaches

Machine and deep learning are used worldwide. Machine Learning (ML) and Deep Learning (DL) are playing an increasingly important role in the healthcare sector, particularly when combined with big data analytics. Some of the ways that ML and DL are being used in healthcare includePredictive Analytics,Medical Image Analysis,Drug Discovery,Personalized Medicine,and Electronic Health Records (EHR) Analysis.It has become one of the advanced and popular tool forcomputer sciencedomain.' Theadvancementof ML and DL forvariousfieldshas opened new avenues for research and development. It could revolutionize prediction and decision-makingcapabilities. Due to increased awarenessabout the ML and DL in the healthcare, it has become one of the vital approaches for thesector. High-volumeof unstructured, and complex medical imaging data from health monitoring devices, gadgets, sensors, etc. Is the biggest trouble forhealthcare sector. The current study uses analysis to examine research trends inadoption of machine learning and deep learningapproaches in the healthcare sector. The WoS database for SCI/SCI-E/ESCIjournals areused as the datasetsfor the comprehensive analysis. Apart from these various search strategy are utilised for therequisitescientificanalysis of the extracted research documents. Bibliometrics R statistical analysis is performed for year-wise, nation-wise, affiliation-wise, research area, sources, documents, and authorbased analysis. VOS viewer software is used to create author, source, country, institution, global cooperation, citation, co-citation, and trending term co-occurrence networks. ML and DL, combined with big data analytics, have the potential to revolutionize healthcare by improving patient outcomes, reducing costs, and accelerating the development of new treatments, so the currentstudy will help academics, researchers, decision-makers, and healthcare professionals understand and direct research.

<span lang="EN-US">The rapid development of information and communication technologies has increased the demand for internet-facing devices that require publicly accessible internet protocol (IP) addresses, resulting in the depletion of internet protocol version 4 (IPv4) address space. As a result, internet protocol version 6 (IPv6) was designed to address this issue. However, IPv6 is still not widely used because of security concerns. An intrusion detection system (IDS) is one example of a security mechanism used to secure networks. Lately, the use of machine learning (ML) or deep learning (DL) detection models in IDSs is gaining popularity due to their ability to detect threats on IPv6 networks accurately. However, there is an apparent lack of studies that review ML and DL in IDS. Even the existing reviews of ML and DL fail to compare those techniques. Thus, this paper comprehensively elucidates ML and DL techniques and IPv6-based distributed denial of service (DDoS) attacks. Additionally, this paper includes a qualitative comparison with other related works. Moreover, this work also thoroughly reviews the existing ML and DL-based IDSs for detecting IPv6 and IPv4 attacks. Lastly, researchers could use this review as a guide in the future to improve their work on DL and ML-based IDS.</span>

Regulation of AI and AI Crimes

The convergence of AI and cultural representation raises critical ethical concerns in the digital age, particularly in culturally diverse and complex societies like Nigeria. This paper takes a conceptual methodological stance to explore the intersection of artificial intelligence (AI) technologies, such as language models and translation systems, in relation to Nigerian cultural and linguistic realities by highlighting the power dynamics of digital language preservation and the risk of reinforcing stereotypes or erasing nuance. Using a bipartite framework involving Floridi’s Information Ethics and the Fairness, Accountability, and Transparency in Machine Learning (FAT/ML) model, this study examines how artificial intelligence (AI) systems, including ChatGPT and Google Translate, may misrepresent or distort Nigerian languages and cultures, such as Yoruba, Hausa, Igbo, and Pidgin. The study advocates for the development of AI that is culturally aware and ethically grounded to promote inclusive frameworks that prioritize linguistic equity and cultural sustainability in the digital representation of Nigerian identities. This research contributes to the development of responsible AI practices that respect and promote cultural diversity in the digital age by exploring the global relevance of these issues.

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

The use of machine learning (ML) has been increasing rapidly in the medical imaging field, including computer-aided diagnosis (CAD), radiomics, and medical image analysis. Recently, an ML area called deep learning emerged in the computer vision field and became very popular in many fields. It started from an event in late 2012, when a deep-learning approach based on a convolutional neural network (CNN) won an overwhelming victory in the best-known worldwide computer vision competition, ImageNet Classification. Since then, researchers in virtually all fields, including medical imaging, have started actively participating in the explosively growing field of deep learning. In this paper, the area of deep learning in medical imaging is overviewed, including (1) what was changed in machine learning before and after the introduction of deep learning, (2) what is the source of the power of deep learning, (3) two major deep-learning models: a massive-training artificial neural network (MTANN) and a convolutional neural network (CNN), (4) similarities and differences between the two models, and (5) their applications to medical imaging. This review shows that ML with feature input (or feature-based ML) was dominant before the introduction of deep learning, and that the major and essential difference between ML before and after deep learning is the learning of image data directly without object segmentation or feature extraction; thus, it is the source of the power of deep learning, although the depth of the model is an important attribute. The class of ML with image input (or image-based ML) including deep learning has a long history, but recently gained popularity due to the use of the new terminology, deep learning. There are two major models in this class of ML in medical imaging, MTANN and CNN, which have similarities as well as several differences. In our experience, MTANNs were substantially more efficient in their development, had a higher performance, and required a lesser number of training cases than did CNNs. "Deep learning", or ML with image input, in medical imaging is an explosively growing, promising field. It is expected that ML with image input will be the mainstream area in the field of medical imaging in the next few decades.

In an open source software development environment, it is hard to decide the number of group members required for resolving software issues. Developers generally reply to issues based totally on their domain knowledge and interest, and there are no predetermined groups. The developers openly collaborate on resolving the issues based on many factors, such as their interest, domain expertise, and availability. This study compares eight different algorithms employing machine learning and deep learning, namely—Convolutional Neural Network, Multilayer Perceptron, Classification and Regression Trees, Generalized Linear Model, Bayesian Additive Regression Trees, Gaussian Process, Random Forest and Conditional Inference Tree for predicting group size in five open source software projects developed and managed using an open source development framework GitHub. The social information foraging model has also been extended to predict group size in software issues, and its results compared to those obtained using machine learning and deep learning algorithms. The prediction results suggest that deep learning and machine learning models predict better than the extended social information foraging model, while the best-ranked model is a deep multilayer perceptron((R.M.S.E. sequelize—1.21, opencv—1.17, bitcoin—1.05, aseprite—1.01, electron—1.16). Also it was observed that issue labels helped improve the prediction performance of the machine learning and deep learning models. The prediction results of these models have been used to build an Issue Group Recommendation System as an Internet of Things application that recommends and alerts additional developers to help resolve an open issue.