Deep Learning in Medical Imaging: A Case Study on Lung Tissue Classification

The use of machine learning (ML) has been increasing rapidly in the medical imaging field, including computer-aided diagnosis (CAD), radiomics, and medical image analysis. Recently, an ML area called deep learning emerged in the computer vision field and became very popular in many fields. It started from an event in late 2012, when a deep-learning approach based on a convolutional neural network (CNN) won an overwhelming victory in the best-known worldwide computer vision competition, ImageNet Classification. Since then, researchers in virtually all fields, including medical imaging, have started actively participating in the explosively growing field of deep learning. In this paper, the area of deep learning in medical imaging is overviewed, including (1) what was changed in machine learning before and after the introduction of deep learning, (2) what is the source of the power of deep learning, (3) two major deep-learning models: a massive-training artificial neural network (MTANN) and a convolutional neural network (CNN), (4) similarities and differences between the two models, and (5) their applications to medical imaging. This review shows that ML with feature input (or feature-based ML) was dominant before the introduction of deep learning, and that the major and essential difference between ML before and after deep learning is the learning of image data directly without object segmentation or feature extraction; thus, it is the source of the power of deep learning, although the depth of the model is an important attribute. The class of ML with image input (or image-based ML) including deep learning has a long history, but recently gained popularity due to the use of the new terminology, deep learning. There are two major models in this class of ML in medical imaging, MTANN and CNN, which have similarities as well as several differences. In our experience, MTANNs were substantially more efficient in their development, had a higher performance, and required a lesser number of training cases than did CNNs. "Deep learning", or ML with image input, in medical imaging is an explosively growing, promising field. It is expected that ML with image input will be the mainstream area in the field of medical imaging in the next few decades.

For a considerable amount of time, medical image processing has been an important topic of research in the field of medicine. The advent of deep learning technology has resulted in the development of revolutionary improvements in this particular sector. Because of its remarkable effectiveness in training enormous amounts of data and performing difficult tasks, deep learning has attracted a lot of attention. It has found extensive application in the analysis, diagnosis, and treatment of medical pictures. This work employs the literature review approach to examine and analyze the existing research conducted by academics on deep learning and medical imaging. It also provides a summary of the utilization of deep learning in medical imaging images and highlights the current development trend in this field.

Internal images of the body may be captured using X-ray technology, which helps doctors diagnose and treat a wide range of medical issues. Recent studies have focused on optimizing the usage of deep learning algorithms to boost medical imaging's accuracy and productivity. Deep learning AI makes use of massive datasets to train computer algorithms to recognize patterns, which are then used to make predictions or classifications about fresh data. This method has shown promise in facilitating quicker and more accurate detection of conditions including lung cancer and bone fractures using X-ray images. Patient outcomes may improve with the use of deep learning algorithms in medical imaging. Healthcare systems may be strengthened, and the effects of health crises lessened by facilitating faster and more accurate diagnosis. Investing in initiatives that promote the use of deep learning in medical imaging will help get us there. A bespoke deep learning model was able to classify 70% of a dataset evenly between the healthy, COVID, and pneumonia patients, yielding an astonishing 97.96% accuracy. Applying deep learning algorithms to the analysis of X-ray images has shown great potential for improving the efficiency and precision of medical diagnoses. Better health outcomes may result from this enhanced ability to identify abnormalities and illnesses such as lung cancer and bone fractures. The healthcare industry stands to benefit greatly from adopting programs that encourage the integration of deep learning in medical imaging and might even save lives by doing so.

The development of computer hardware allows rapid accumulation of medical imaging data. Deep learning has shown great potential in medical imaging data analysis and establish a new area of machine learning. The commonly used deep learning models were firstly introduced in the paper, and then, summarized with the application of deep learning in the detection, classification, diagnosis, segmentation, identification of medical imaging. The application of deep learning in oral and maxillofacial radiology and other discipline of stomatology was proposed. At the end, the paper discussed the problems of deep learning in medical imaging research.

Along with the development of medical imaging technology, medical image analysis has become a crucial part of clinical diagnosis. However, traditional image analysis methods rely on manual feature extraction and expert evaluation, triggering problems such as low efficiency and lack of accuracy. Deep learning techniques, especially convolutional neural networks (CNNs), have made significant breakthroughs in medical image analysis in recent years. The aim of this paper is to study the application of deep learning in medical imaging, and explore the advantages and development potential in early disease diagnosis, image segmentation and feature extraction. This paper reviews the basic principles of deep learning and analyses the applicability of deep learning in medical imaging by combining the characteristics of medical imaging. Through systematic analysis of existing literature, this paper summarises the remarkable achievements of deep learning in processing, analysing and applying it to various medical images, such as Optical Coherence Tomography (OCT), Magnetic Resonance Imaging (MRI) and so on. It has been shown that deep learning methods can significantly improve the accuracy and efficiency of medical image processing and demonstrate performance due to traditional methods in tasks such as classification. However, how to improve the interpretability of models and the generalisability of clinical applications are still current research hotspots and challenges.

The use of deep learning in medical imaging to improve spine care: A scoping review of current literature and clinical applications

The use of deep learning in medical imaging has increased rapidly over the past few years, finding applications throughout the entire radiology pipeline, from improved scanner performance to automatic disease detection and diagnosis. These advancements have resulted in a wide variety of deep learning approaches being developed, solving unique challenges for various imaging modalities. This paper provides a review on these developments from a technical point of view, categorizing the different methodologies and summarizing their implementation. We provide an introduction to the design of neural networks and their training procedure, after which we take an extended look at their uses in medical imaging. We cover the different sections of the radiology pipeline, highlighting some influential works and discussing the merits and limitations of deep learning approaches compared to other traditional methods. As such, this review is intended to provide a broad yet concise overview for the interested reader, facilitating adoption and interdisciplinary research of deep learning in the field of medical imaging.

Deep learning plays a significant role in transforming medical imaging for disease diagnosis. It uses advanced algorithms, especially Convolutional Neural Networks (CNNs), to automatically learn and extract important features from medical images. This technology helps in detecting, classifying, and diagnosing various diseases, such as different types of cancer, brain disorders like aneurysms and strokes, heart diseases, and respiratory conditions. Deep learning improves the accuracy and efficiency of diagnostic workflows and reduces the workload for healthcare professionals. Despite its many advantages, deep learning faces challenges related to data availability, model interpretability, and clinical validation. This review highlights the current applications, performance evaluation methods, and challenges of deep learning in medical imaging for disease diagnosis.

Medical imaging has taken decisive steps in diagnosing the diseases in the past few decades. Many successful diagnosis systems have been developed, and however, there is a scope for improving the accuracy of those systems. Deep learning plays a vital role in improving the performance of medical imaging. Recent developments in deep learning have brought revolution in medical diagnosis. Recent progress in deep learning offers new possibilities in medical imaging for detection of diseases, diagnosis and prediction. Use of deep learning to medical imaging has remarkable achievement in improving the performance in diagnosis. Deep learning has attracted the researchers and the academicians in developing the medical imaging tools based on historical data. However, there are many challenges while blending the deep learning in medical imaging. Some of the key areas where deep learning seems to be challenging are: massive datasets for training, overfitting of data, variations in input, quality of data, understanding of the context, high volume of data and many more. This paper focuses on the deep learning challenges with biomedical imaging. The techniques for analyzing medical images in a heterogeneous environment are also discussed.

The application of deep learning (DL) in medicine introduces transformative tools with the potential to enhance prognosis, diagnosis, and treatment planning. However, ensuring transparent documentation is essential for researchers to enhance reproducibility and refine techniques. Our study addresses the unique challenges presented by DL in medical imaging by developing a comprehensive checklist using the Delphi method to enhance reproducibility and reliability in this dynamic field. We compiled a preliminary checklist based on a comprehensive review of existing checklists and relevant literature. A panel of 11 experts in medical imaging and DL assessed these items using Likert scales, with two survey rounds to refine responses and gauge consensus. We also employed the content validity ratio with a cutoff of 0.59 to determine item face and content validity. Round 1 included a 27-item questionnaire, with 12 items demonstrating high consensus for face and content validity that were then left out of round 2. Round 2 involved refining the checklist, resulting in an additional 17 items. In the last round, 3 items were deemed non-essential or infeasible, while 2 newly suggested items received unanimous agreement for inclusion, resulting in a final 26-item DL model reporting checklist derived from the Delphi process. The 26-item checklist facilitates the reproducible reporting of DL tools and enables scientists to replicate the study’s results.

Medical imaging is becoming indispensable for patients' healthcare. Machine learning plays an essential role in the medical imaging field, including computer-aided diagnosis, image segmentation, image registration, image fusion, image-guided therapy, image annotation, and image database retrieval. With advances in medical imaging, new imaging modalities and methodologies such as cone-beam/multislice CT, 3D ultrasound imaging, tomosynthesis, diffusion-weighted magnetic resonance imaging (MRI), positron-emission tomography (PET)/CT, electrical impedance tomography, and diffuse optical tomography, new machine-learning algorithms/applications are demanded in the medical imaging field. Because of large variations and complexityit is generally difficult to derive analytic solutions or simple equations to represent objects such as lesions and anatomy in medical images. Therefore, tasks in medical imaging require “learning from examples” for accurate representation of data and prior knowledge. Because of its essential needs, machine learning in medical imaging is one of the most promising, growing fields. The main aim of this special issue is to help advance the scientific research within the broad field of machine learning in medical imaging. The special issue was planned in conjunction with the International Workshop on Machine Learning in Medical Imaging (MLMI 2010) [1], which was the first workshop on this topic, held at the 13th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2010) in September, 2010, in Beijing, China. This special issue is one in a series of special issues of journals on this topic [2]; it focuses on major trends and challenges in this area, and it presents work aimed at identifying new cutting-edge techniques and their use in medical imaging. The quality level of the submissions for this special issue was very high. A total of 17 papers were submitted to this issue in response to the call for papers. Based on a rigorous review process, 10 papers (59%) were accepted for publication in the special issue. The special issue starts by a review of studies on a class of machine-learning techniques, called pixel/voxel-based machine learning, in medical imaging by K. Suzuki. A series of medical imaging applications of machine-learning techniques are presented. A large variety of applications are well represented here, including organ modeling by D. Wang et al. and X. Qiao and Y.-W. Chen, brain function estimation by V. Michel et al., image reconstruction by H. Shouno et al., lesion classification by P. Wighton et al., modality classification by X.-H. Han and Y.-W. Chen, lesion segmentation by M. Zortea et al., organ segmentation by S. Alzubi et al., and visualization of molecular signals by F. Mattoli et al. Also, the issue covers various biomedical imaging modalities, including MRI by D. Wang et al., CT by X. Qiao and Y.-W. Chen and H. Shouno et al., functional MRI by V. Michel et al., dermoscopy by P. Wighton et al. and M. Zortea et al., scintigraphy by X.-H. Han and Y.-W. Chen, ultrasound imaging by X.-H. Han and Y.-W. Chen, radiography by X.-H. Han and Y.-W. Chen, MR angiography by S. Alzubi et al., and microscopy by F. Mattoli et al. as well as a variety of organs, including the kidneys by D. Wang et al., liver by X. Qiao and Y.-W. Chen, brain by V. Michel et al. and F. Mattoli et al., chest by S. Alzubi et al., skin by P. Wighton et al. and M. Zortea et al., and heart by F. Mattoli et al. Various machine-learning techniques were developed/used to solve the respective problems, including structured dictionary learning by D. Wang et al., generalized N-dimensional principal component analysis by X. Qiao et al., multiclass sparse Bayesian regression by V. Michel et al., Bayesian hyperparameter inference by H. Shouno et al., supervised learning of probabilistic models based on maximum aposteriori estimation and conditional random fields by P. Wighton et al., joint kernel equal contribution in support vector classification by X.-H. Han and Y.-W. Chen, and iterative hybrid classification by M. Zortea et al. We are grateful to all authors for their excellent contributions to this special issue and to all reviewers for their reviews and constructive suggestions. We hope that this special issue will inspire further ideas for creative research, advance the field of machine learning in medical imaging, and facilitate the translation of the research from bench to bedside. Kenji Suzuki Pingkun Yan Fei Wang Dinggang Shen

Diabetic retinopathy (DR) is a gradual and severe consequence of diabetes that increases the risk of visual impairment and blindness globally. Early and precise identification of DR is crucial for successful care, but availability to specialist diagnostic tools is restricted, especially in low-resource settings. This study aims to improve the automated identification of diabetic retinopathy using cutting-edge deep learning models—specifically ViT, CLIP, BLIP, ViLT, Florence-2, and ResNet50—which are applied to the APTOS Diabetic Retinopathy dataset. Diabetic Retinopathy (DR) diagnosis is often hindered by poor image quality and subtle differences across varying severity levels. The grading of DR is typically categorized into five stages: No DR, Mild, Moderate, Severe, and Proliferative, as defined by the International Clinical Diabetic Retinopathy Disease Severity Scale. To address artifacts such as uneven illumination, we employ Gaussian preprocessing to smooth noise and Wavelet transforms to enhance edge details. This study evaluates the impact of Gaussian and Wavelet preprocessing techniques on the performance of Vision-Language Models (e.g., CLIP, BLIP) and CNNs (e.g., RESNET50). Results indicate that Gaussian Filtering significantly enhances classification accuracy, yielding a 37% improvement for RESNET50 and 36% for BLIP compared to the baseline. This study demonstrates that appropriate preprocessing is critical for maximizing the potential of deep learning in medical imaging. Specifically, Gaussian Filtering proved superior to Wavelet techniques, offering substantial accuracy gains for models like BLIP and RESNET50. Future work will explore hybrid preprocessing pipelines to further distinguish between the subtle early stages of the disease.

We developed a multimodal ultrasound (US) deep learning (DL) fusion model to automatically classify early fibrosis in patients with chronic kidney disease (CKD). This prospective study included patients with CKD who underwent continuous gray-scale US, superb microvascular imaging, and strain elastography from May to November 2022. According to the pathological tubular atrophy and interstitial fibrosis score, patients were divided into minimal and mild groups (affected area ≤10% and 11 − 25% of the total cortical volume, respectively). The dataset was divided into training (70%) and test (30%) sets. A DL model combining the features of the three US modes was developed to predict early fibrosis in patients with CKD. We compared these findings with the area under the receiver operating characteristic curve (AUC) of the clinical model by analyzing the receiver operating characteristic curve in the test set. The AUC of single-mode DL based on gray-scale US, superb microvascular imaging, and strain elastography was 0.682, 0.745, and 0.648, respectively, while that of the multimodal US DL model was 0.86. The accuracy, specificity, and sensitivity of the multimodal US DL model were 0.779, 0.767, and 0.796, respectively, and the negative and positive predictive values were 0.842 and 0.706, respectively. The AUC of the multimodal US DL model was significantly better than that of the single-mode DL and clinical models. The DL algorithm developed using multimodal US images can effectively predict early fibrosis in patients with CKD with significantly greater accuracy than single-mode DL or clinical models.

Deep learning (DL) is affecting each and every sphere of public and private lives and becoming a tool for daily use. The power of DL lies in the fact that it tries to imitate the activities of neurons in the neocortex of human brain where the thought process takes place. Therefore, like the brain, it tries to learn and recognize patterns in the form of digital images. This power is built on the depth of many layers of computing neurons backed by high power processors and graphics processing units (GPUs) easily available today. In the current scenario, we have provided detailed survey of various types of DL systems available today, and specifically, we have concentrated our efforts on current applications of DL in medical imaging. We have also focused our efforts on explaining the readers the rapid transition of technology from machine learning to DL and have tried our best in reasoning this paradigm shift. Further, a detailed analysis of complexities involved in this shift and possible benefits accrued by the users and developers.

Deep learning has shown tremendous potential for transforming healthcare by enabling more accurate diagnoses, improved treatment planning and better patient outcome predictions. In this comprehensive survey, we provide a detailed overview of the state-of-the-art deep learning techniques and their applications across the healthcare ecosystem. We first introduce the fundamentals of deep learning and discuss its key advantages compared to traditional machine learning approaches. We then present an in-depth review of major applications of deep learning in medical imaging, electronic health record analysis, genomics, medical robotics and other domains. For each application, we summarize key advancements, outline the technical details of state-of-the-art methods, discuss challenges and limitations and highlight promising directions for future work. We examine cross-cutting challenges in deploying deep learning in clinical settings, including interpretability, bias and data scarcity. We conclude by proposing a roadmap to accelerate the translation and adoption of high-impact healthcare applications of deep learning. Overall, this survey provides a comprehensive reference for researchers and practitioners working at the intersection of deep learning and healthcare.