Improved out-of-distribution for chest X-Ray image quality classification using energy-based methods

The coronavirus disease 2019 (COVID-19) led to a dramatic increase in the number of cases of patients with pneumonia worldwide. In this study, we aimed to develop an AI-assisted multistrategy image enhancement technique for chest X-ray (CXR) images to improve the accuracy of COVID-19 classification. Our new classification strategy consisted of 3 parts. First, the improved U-Net model with a variational encoder segmented the lung region in the CXR images processed by histogram equalization. Second, the residual net (ResNet) model with multidilated-rate convolution layers was used to suppress the bone signals in the 217 lung-only CXR images. A total of 80% of the available data were allocated for training and validation. The other 20% of the remaining data were used for testing. The enhanced CXR images containing only soft tissue information were obtained. Third, the neural network model with a residual cascade was used for the super-resolution reconstruction of low-resolution bone-suppressed CXR images. The training and testing data consisted of 1,200 and 100 CXR images, respectively. To evaluate the new strategy, improved visual geometry group (VGG)-16 and ResNet-18 models were used for the COVID-19 classification task of 2,767 CXR images. The accuracy of the multistrategy enhanced CXR images was verified through comparative experiments with various enhancement images. In terms of quantitative verification, 8-fold cross-validation was performed on the bone suppression model. In terms of evaluating the COVID-19 classification, the CXR images obtained by the improved method were used to train 2 classification models. Compared with other methods, the CXR images obtained based on the proposed model had better performance in the metrics of peak signal-to-noise ratio and root mean square error. The super-resolution CXR images of bone suppression obtained based on the neural network model were also anatomically close to the real CXR images. Compared with the initial CXR images, the classification accuracy rates of the internal and external testing data on the VGG-16 model increased by 5.09% and 12.81%, respectively, while the values increased by 3.51% and 18.20%, respectively, for the ResNet-18 model. The numerical results were better than those of the single-enhancement, double-enhancement, and no-enhancement CXR images. The multistrategy enhanced CXR images can help to classify COVID-19 more accurately than the other existing methods.

In the last century, we have passed two severe pandemics; the 1957 influenza (Asian flu) pandemic and the 1918 influenza (Spanish flu) pandemic with a high fatality rate. In the last few months, we have been again facing a new epidemic (COVID-19), which is a frighteningly high-risk disease and is globally threatening human lives. Among all attempts and presented solutions to tackle the COVID-19, a publicly available dataset of radiological imaging using chest radiography, also called chest X-ray (CXR) images, could efficiently accelerate the detection process of patients infected with COVID-19 through presented abnormalities in their chest radiography images. In this study, we have proposed a deep neural network (DNN), namely RAM-Net, a new combination of MobileNet with Dilated Depthwise Separable Convolution (DDSC), Residual blocks, and Attention augmented convolution. The network has been learned and validated using the COVIDx dataset, one of the most popular public datasets comprising the chest X-ray (CXR) images. Using this model, we could accurately identify the positive cases of COVID-19 viral infection while a new suspicious chest X-ray image is shown to the network. Our network's overall accuracy on the COVIDx test dataset was 95.33%, with a sensitivity and precision of 92% and 99% for COVID-19 cases, respectively, which are the highest results on the COVIDx dataset to date, to the best of our knowledge. Finally, we performed an audit on RAM-Net based on the Grad-CAM's interpretation to demonstrate that our proposed architecture detects SARS-CoV-2 (COVID-19) viral infection by focusing on vital factors rather than relying on irrelevant information.

Pneumonia, a condition caused by infectious agents such as bacteria, viruses, fungi, or parasites, results in lung infections and the accumulation of pus in affected tissues. Incorrect diagnosis or improper treatment can significantly impact a patient's quality of life. This project focuses on the precise identification and categorization of pneumonia-afflicted patients through the analysis of their chest X-rays. Leveraging advancements in deep learning, healthcare experts can make more accurate diagnostic decisions for various illnesses. This study presents an innovative approach utilizing Convolutional Neural Networks (CNN) to predict and distinguish between patients affected by pneumonia and those who are not, based on chest X-ray images. The methodology involves a series of convolutional and max pooling layers activated using the ReLU activation function. Subsequently, the processed data is passed through dense layers, culminating in the activation of the output neuron through the sigmoidal function. During the training process, the model exhibits increasing accuracy and decreasing loss, demonstrating its effectiveness. To prevent overfitting, data augmentation techniques are applied before model fitting. These strategies collectively enhance the robustness and reliability of the deep learning models, resulting in accurate and persuasive detection of pneumonia from chest X-ray images. Keywords: Pneumonia, CNN, VGG-16, VGG-19, Chest X-rays, Classification, Deeep learning, Data augmenatation, ReLU, softmax.

目的 基于计算机的胸腔X线影像疾病检测和分类目前存在误诊率高，准确率低的问题。本文在视觉Transformer（vision Transformer，ViT）预训练模型的基础上，通过迁移学习方法，实现胸腔X线影像辅助诊断，提高诊断准确率和效率。方法 选用带有卷积神经网络（convolutional neural network，CNN）的ViT模型，其在超大规模自然图像数据集中进行了预训练；通过微调模型结构，使用预训练的ViT模型参数初始化主干网络，并迁移至胸腔X线影像数据集中再次训练，实现疾病多标签分类。结果 在IU X-Ray数据集中对ViT迁移学习前、后模型平均AUC（area under ROC curve）得分进行对比分析实验。结果表明，预训练ViT模型平均AUC得分为0.774，与不使用迁移学习相比提升了0.208。并针对模型结构和数据预处理进行了消融实验，对ViT中的注意力机制进行可视化，进一步验证了模型有效性。最后使用Chest X-Ray14和CheXpert数据集训练微调后的ViT模型，平均AUC得分为0.839和0.806，与对比方法相比分别有0.014～0.031的提升。结论 与其他方法相比，ViT模型胸腔X线影像的多标签分类精确度更高，且迁移学习可以在降低训练成本的同时提升ViT模型的分类性能和泛化性。消融实验与模型可视化表明，包含CNN结构的ViT模型能重点关注有意义的区域，高效获取胸腔X线影像的视觉特征。;Objective The chest X-ray-relevant screening and diagnostic method is essential for radiology nowadays. Most of chest X-ray images interpretation is still restricted by clinical experience and challenged for misdiagnose and missed diagnoses. To detect and identify one or more potential diseases in images automatically，it is beneficial for improving diagnostic efficiency and accuracy using computer-based technique. Compared to natural images，multiple lesions are challenged to be detected and distinguished accurately in a single image because abnormal areas have a small proportion and complex representations in chest X-ray images. Current convolutional neural network（CNN）based deep learning models have been widely used in the context of medical imaging. The structure of the CNN convolution kernel has sensitive to local detail information，and it is possible to extract richer image features. However，the convolution kernel cannot be used to get global information，and the features-extracted are restricted of redundant information like its relevance of background， muscles，and bones. The model’s performance in multi-label classification tasks are affected to a certain extent. At present，the vision Transformer（ViT）model has achieved its priorities in computer vision-related tasks. The ViT can be used to capture information simultaneously and effectively for multiple regions of the entire image. However，it is required to use large-scale dataset training to achieve good performance. Due to some factors like patient privacy and manual annotate costs，the size of the chest X-ray image data set has been limited. To reduce the model's dependence on data scale and improve the performance of multi-label classification，we develop the CNN-based ViT pre-training model in terms of the transfer learning method for diagnosis-assisted of chest X-ray image and multi-label classification. Method The CNN-based ViT model is pre-trained on a huge scale ground truth dataset，and it is used to obtain the initial parameters of the model. The model structure is fine-tuned according to the features of chest X-ray dataset. A 1×1 convolution layer is used to convert the chest X-ray images channels between 1 to 3. The number of output nodes of the linear layer in the classifier is balanced from 1 000 to the number of chest X-ray classification labels，and the Sigmoid is used as an activation function. The parameters of the backbone network are initialized in terms of the pre-trained ViT model parameters，and it is trained in the chest X-ray dataset after that to complete multi-label classification. The experiment is configured of Python3. 7 and PyTorch1. 8 to construct the model and RTX3090 GPU for training. Stochastic gradient descent（SGD）optimizer，binary cross-entropy（BCE）loss function，an initial learning rate of 1E-3，the cosine annealing learning rate decay are used. For training，each image is scaled to a size of 512×512 pixels，and a 224×224 pixels area and it is then cropped in random as the model input，and data augmentation is performed randomly by some of the flipping，perspective transformation， shearing，translation，zooming，and changing brightness. For testing，the chest X-ray image is scaled to 256×256 pixels and center crop a 224×224 area to input the trained model. Result The experiment is performed on the IU X-Ray，which is a small-scale chest X-ray dataset. This model is evaluated in quantitative using the average of area under ROC curve （AUC）scores across all classification labels. The results show that the average AUC score of the pre-trained ViT model is 0. 774. The accuracy and training efficiency of the non-pre-trained ViT model is dropped significantly. The average AUC score is reached to 0. 566 only，which is 0. 208 lower. In addition，the attention mechanism heat map is generated based on the ViT model，which can strengthen the interpretability of the model. A series of ablation experiments are carried out for data augmentation，model structure，and batch size design. The fine-tuned ViT model is trained on the Chest-Ray14 and CheXpert dataset as well. The average AUC score is reached to 0. 839 and 0. 806，which is optimized by 0. 014 and 0. 031. Conclusion A pre-trained ViT model is used for the multi-label classification of chest X-ray images via transfer learning. The experimental results illustrate that the ViT has its stronger multi-label classification performance in chest Xray images，and its attention mechanism is beneficial for lesions precision-focused like the interior of the chest cavity and the heart. Transfer learning is potential to improve the classification performance and model generalization of the ViT in small-scale datasets，and the training cost is reduced greatly. Ablation experiments demonstrate that the incorporated model of CNN and Transformer has its priority beyond single-structure model. Data enhancement and the batch size cutting can improve the performance of the model，but smaller scale of batch is still interlinked to longer training span. To improve the model's ability，we predict that future research direction can be focused on the extraction for complex disease and highlevel semantic information，such as their small lesions，disease location，and severity.

Amid the COVID-19 pandemic, extensive research has focused on deep learning methodologies for accurately diagnosing the virus from chest X-ray images. Various models, including Convolutional Neural Networks (CNNs) and pre-trained models, have achieved accuracies ranging from 85.20% to 99.66%. However, the proposed Fine-Tuned ResNet50 model consistently outperforms others with an impressive accuracy of 98.20%. By leveraging on transfer learning and careful architectural design the proposed model demonstrates superior performance compared to previous studies using DarkNet, ResNet50, and pre-trained models. Graphical comparisons highlight its competitive edge, emphasizing its effectiveness in COVID-19 classification tasks. The ResNet50 architecture, known for its deep residual layers and skip connections, facilitates robust feature extraction and classification, especially in medical imaging. Data pre-processing techniques, like noise reduction and contrast enhancement, ensure input data quality and reliability, enhancing the model's predictive abilities. Training results reveal the model's steady accuracy improvement and loss reduction over 20 epochs, aligning closely with validation metrics. Evaluation on a test set of COVID-19 chest X-ray images confirms exceptional accuracy (98.20%), precision (99.00%), recall (98.82%), and F1-score (98.91%), highlighting its proficiency in identifying COVID-19 cases while minimizing false positives and negatives. Comparative analyses against prior studies further validate its superior performance, establishing the Fine-Tuned ResNet50 model as a reliable tool for COVID-19 diagnosis. Future research should focus on exploring ensemble learning techniques, interpretability methods, and stakeholder collaboration to ensure safe AI deployment in clinical settings. Moreover, larger and diverse datasets are crucial for validating model performance and improving generalization, ultimately enhancing patient care and public health outcomes in the mitigating COVID-19 and future pandemics.

Chest X-ray images are an essential diagnostic tool in the medical field, but transmitting and storing these images can raise security concerns. Privacy-preserving techniques in healthcare databases protect sensitive patient information from unauthorized access, breaches, and misuse. Using a combination of elliptic curve cryptography (ECC) for encryption, a convolutional neural network (CNN) for feature extraction, and a long short-term memory (LSTM) network for classification, the aim of this research is to develop a safe and effective classification system for chest X-ray images. The research integrates hyperparameter optimization, essential for LSTM, as it dramatically impacts the model's performance. Additionally, the research employs an oppositionbased learning strategy, the traditional wild horse optimization (WHO) approach and an enhanced WHO (EWHO), to enhance the classification performance. The research objectives are to diagnose and classify chest X-ray images into four types: normal lung, COVID-19-infected lung, lung opacity, and viral pneumonia. The proposed opposition-based learning model improves the accuracy, efficiency, and consistency of diagnostic and treatment decisions. The proposed EWHO-configured LSTM approach attains 97.4% accuracy for an efficient classification system for chest X-ray images. The research highlights the importance of privacy-preserving techniques in healthcare databases to protect sensitive patient information from unauthorized access, breaches, and misuse.

The coronavirus pandemic has led to an immense loss of human life worldwide. It poses an unprecedented challenge to the education system, economic system, food systems, public health, and the job market. Approximately 220 nations, regions, or territories are now affected by coronavirus disease, and the World Health Organization has recorded about 1,535,982 deaths. The reverse transcription polymerase chain reaction (RT-PCR) or rapid antigen test or computed tomography (CT)-based detection techniques lack rapid testing property due to their low sensitivity and availability issues. Therefore, the use of deep convolutional neural networks (DCNN) to learn and analyze the chest X-ray signatures of COVID-19 patients is becoming crucial. This chapter gives a brief introduction two various deep learning architectures used for chest X-ray analysis for COVID-19 detection, along with their pros and cons. Further in this chapter, it is proposed that there should be a two-stage DCNN architecture to learn the imaging hallmarks of normal, pneumonia, and COVID-19 diseases from chest X-ray images and predict those lung diseases without human intervention. The main objective of this study is to precisely extract the region of interest, i.e., the lung contours, from the chest X-ray images and feed them to the classification network. It directly helps to increase the diagnosis sensitivity, reduce diagnosis time, and enable easier analysis and classification of chest-related diseases. It also helps to efficiently train the deep learning network, even with a minimal number of training samples. The experimental results demonstrate that the proposed model’s misclassification rate is low. The proposed model outperforms other state-of-the-art studies and achieves a COVID-19 diagnosis sensitivity of 99% and an overall accuracy of 98%. The proposed model can be used as a reliable rapid testing tool for COVID-19 disease but not as an alternative to RT-PCR. The performance of the model was also tested in Indian COVID-19 patients. Ultimately, this low-cost, intelligent two-stage DCNN provides a detailed understanding that can be useful to improve patient diagnostic decisions made by medical professionals.

Since this COVID-19 pandemic thrives, the utilization of X-Ray images of the Chest (CXR) as a complementary screening technique to RT-PCR testing grows to its clinical use for respiratory complaints. Many new deep learning approaches have developed as a consequence. The goal of this research is to assess the convolutional neural networks (CNNs) to diagnosis COVID-19 utilizing X-ray images of chest. The performance of CNN with one, three, and four convolution layers has been evaluated in this research. A dataset of 13,808 CXR photographs are used in this research. When evaluated on X-ray images with three splits of the dataset, our preliminary experimental results show that the CNN model with three convolution layers can reliably detect with 96 percent accuracy (precision being 96 percent). This fact indicates the commitment of our suggested model for reliable screening of COVID-19

Over the past decade, deep learning techniques, particularly neural networks, have become essential in medical imaging for tasks like image detection, classification, and segmentation. These methods have greatly enhanced diagnostic accuracy, enabling quicker identification and more effective treatments. In chest X-ray analysis, however, challenges remain in accurately segmenting and classifying organs such as the lungs, heart, diaphragm, sternum, and clavicles, as well as detecting abnormalities in the thoracic cavity. Despite progress, these issues highlight the need for improved approaches to overcome segmentation difficulties and enhance diagnostic reliability. In this context, we propose a novel architecture named CXR-Seg, tailored for semantic segmentation of lungs from chest X-ray images. The proposed network mainly consists of four components, including a pre-trained EfficientNet as an encoder to extract feature encodings, a spatial enhancement module embedded in the skip connection to promote the adjacent feature fusion, a transformer attention module at the bottleneck layer, and a multi-scale feature fusion block at the decoder. The performance of the proposed CRX-Seg was evaluated on four publicly available datasets (MC, Darwin, and Shenzhen for chest X-rays, and TCIA for brain flair segmentation from MRI images). The proposed method achieved a Jaccard index, Dice coefficient, accuracy, sensitivity, and specificity of 95.63%, 97.76%, 98.77%, 98.00%, and 99.05%on MC; 91.66%, 95.62%, 96.35%, 95.53%, and 96.94% on V7 Darwin COVID-19; and 92.97%, 96.32%, 96.69%, 96.01%, and 97.40% on the Shenzhen Tuberculosis CXR Dataset, respectively. Conclusively, the proposed network offers improved performance in comparison with state-of-the-art methods, and better generalization for the semantic segmentation of lungs from chest X-ray images.

Efficacy of Transfer Learning-based ResNet models in Chest X-ray image classification for detecting COVID-19 Pneumonia

This study tries to find the performance of ResNet 50, 101 and 152 version 1 architecture to classify normal and pneumonia using chest X-ray. For the second goal, the effect of image dimension is investigated. Furthermore, the different distribution of training, validation and testing images in the dataset is explored, i.e. dataset A and B. 5,838 chest X-ray images are used in dataset A. For dataset B, 5,856 images are used. These images are distributed randomly as training, validation and testing images with compositions of 80%, 10% and 10%. For each dataset, 12 image dimensions are used, i.e., 96 × 96; 128 × 128; 160 × 160; 192 × 192; 224 × 224; 256 × 256; 288 × 288; 320 × 320; 352 × 352; 384 × 384; 416 × 416 and 448 × 448 pixels. Moreover, this study used exposure fusion framework as image enhancement in the preprocessing stage. In general, ResNet 152 architecture has better performance than ResNet 50 and 152. However, the best performance is achieved by dataset A using ResNet 50 and an image dimension of 384 × 384 pixels. This model has an accuracy, sensitivity, specificity, precision, F1-score and ROC of 97.6%, 99.3%, 93.1%, 97.5%, 98.4% and 96.2%. The pneumonia detection using ResNet is affected by the distribution of training, validation and testing images. Furthermore, there is no correlation between the image dimension and the detection performance.

The pandemic that the SARS-CoV-2 originated in 2019 is continuing to cause serious havoc on the global population’s health, economy, and livelihood. A critical way to suppress and restrain this pandemic is the early detection of COVID-19, which will help to control the virus. Chest X-rays are one of the more straightforward ways to detect the COVID-19 virus compared to the standard methods like CT scans and RT-PCR diagnosis, which are very complex, expensive, and take much time. Our research on various papers shows that the currently researchers are actively working for an efficient Deep Learning model to produce an unbiased detection of COVID-19 through chest X-ray images. In this work, we propose a novel convolution neural network model based on supervised classification that simultaneously computes identification and verification loss. We adopt a transfer learning approach using pretrained models trained on imagenet dataset such as Alex Net and VGG16 as back-bone models and use data augmentation techniques to solve class imbalance and boost the classifier’s performance. Finally, our proposed classifier architecture model ensures unbiased and high accuracy results, outperforming existing deep learning models for COVID-19 detection from chest X-ray images producing State of the Art performance. It shows strong and robust performance and proves to be easily deployable and scalable, therefore increasing the efficiency of analyzing chest X-ray images with high accuracy in detection of Coronavirus.

Underwater habitats are home to about 34,800 fish species. Understanding the various fish species and their therapeutic properties is crucial. The majority of bodies of water have a large number of fish. They can be found in almost all aquatic settings, from high alpine streams (like char and gudgeon) to the abyssal and even hadal depths of the deepest oceans, despite the fact that no species have yet been discovered in the bottom 25% of the ocean (such as cusk-eels and snailfish). In the research, a model for categorizing the various fish species was devised. To ascertain the fish’s possible health advantages, different fish species are categorized. The transfer learning is used to pretrain models with our data which is then given to convolutional neural networks (CNNs), visual geometry group (VGG), residual neural network (RESNET), and densely connected neural network (DENSENET) with a moderate amount of change in the output layer. Additionally, this dataset is input to a CNN model with five sequential convolutional layers that uses the “Adam optimizer,” “ReLU,” and the “SoftMax” activation function. Furthermore, convolutional neural network is used with sixteen layers and softmax activation at the bottom to create the VGG model. The transfer learning is used for RESNET and DENSENET by changing the last layers. The 121 thick layers of the DENSENET that has used were interconnected forward and used Adam optimizer. The 50-layer RESNET, which employs skip connections with ReLU and softmax activation functions. By using classic CNN, we obtain an accuracy of 98.11%; with the help of VGG, and able to achieve an accuracy of 99%; with RESNET, a 99.56% accuracy; and finally, DENSENET, a 98.78% accuracy. Potential health advantages of fish.

ENResNet: A novel residual neural network for chest X-ray enhancement based COVID-19 detection

Human Action Recognition (HAR) has grown significantly because of its many uses, including real-time surveillance and human-computer interaction. Various variations in routine human actions make the recognition process of action more difficult. In this paper, we proposed a novel deep learning architecture known as Inverted Bottleneck Residual with Self-Attention (InBRwSA). The proposed architecture is based on two different modules. In the first module, 6-parallel inverted bottleneck residual blocks are designed, and each block is connected with a skip connection. These blocks aim to learn complex human actions in many convolutional layers. After that, the second module is designed based on the self-attention mechanism. The learned weights of the first module are passed to self-attention, extract the most essential features, and can easily discriminate complex human actions. The proposed architecture is trained on the selected datasets, whereas the hyperparameters are chosen using the particle swarm optimization (PSO) algorithm. The trained model is employed in the testing phase for the feature extraction from the self-attention layer and passed to the shallow wide neural network classifier for the final classification. The HMDB51 and UCF 101 are frequently used as action recognition standard datasets. These datasets are chosen to allow for meaningful comparison with earlier research. UCF101 dataset has a wide range of activity classes, and HMDB51 has varied real-world behaviors. These features test the generalizability and flexibility of the presented model. Moreover, these datasets define the evaluation scope within a particular domain and guarantee relevance to real-world circumstances. The proposed technique is tested on both datasets, and accuracies of 78.80% and 91.80% were achieved, respectively. The ablation study demonstrated that a margin of error value of 70.1338 ± 3.053 (±4.35%) and 82.7813 ± 2.852 (±3.45%) for the confidence level 95%,1.960σx̄ is obtained for HMDB51 and UCF datasets respectively. The training time for the highest accuracy for HDMB51 and UCF101 is 134.09 and 252.10 seconds, respectively. The proposed architecture is compared with several pre-trained deep models and state-of-the-art (SOTA) existing techniques. Based on the results, the proposed architecture outperformed existing techniques.