Deep learning method for lung cancer identification and classification

Background Incidence rate of thyroid cancer is steadily increasing due to overdiagnosis and overtreatment. Thyroid ultrasound is commonly used to diagnose thyroid cancer. The aim of this study is to examine the accuracy of using deep convolutional neural network (DCNN) models to improve diagnosis of thyroid cancer by analyzing sonographic imaging data from clinical thyroid ultrasound. Methods A total of 131,731 sonographic images from 17,627 thyroid cancer patients and 180,668 sonographic images from 25,325 controls used as training set were obtained from Tianjin Cancer Hospital. Images from anatomical sites that did not have cancer according to location sign on the image were not included. All thyroid cancer patients and 13·2% of controls (51,255 images) were confirmed by pathological reports. DCNN is a specific type of neural network optimized for image recognition. We trained two DCNN models on the training set and subsequently evaluated the performance on one independent internal (Tianjin, 1,118 individuals) and two external (Jilin,154 individuals; Weihai, 1,420 individuals) validation sets. Individuals in the validation sets all have pathological examinations. We compared the specificity/sensitivity of DCNN models with the performance of six thyroid ultrasound radiologists on these three validation sets. Findings DCNN model achieved high performance in identifying thyroid cancer patients versus six experience radiologists: for Tianjin validation set, sensitivity was 92·2% versus 96·9% (95% CI 89·7% - 94·3% vs. 93·9% - 98·6%; p = 0·003), and specificity was 85·6% versus 59·4% (95% CI 82·4% - 88·4% vs. 53% - 65·6%; p < 0·0001); for Jilin validation set, sensitivity was 84·3% versus 92·9% (95% CI 73·6% - 91·9% vs. 84·1% - 97·6%; p = 0·05), and specificity was 86·9% versus 57·1% (95% CI 77·8% - 93·3% vs. 45·9% - 67·9%; p < 0·0001); for Weihai validation set, sensitivity was 84·5% versus 89% (95% CI 81·2% - 87·4% vs. 81·9% - 94%; p = 0·2), and specificity was 87·5% versus 68·6% (95% CI 85·1% - 89·6% vs. 60·7% - 75·8%; p < 0·0001). Interpretation DCNN models exhibited high accuracy, sensitivity, and specificity in identifying thyroid cancer patients at levels comparable to or higher than six experienced radiologists. Conferred by the high specificity of DCNN models, the rate of overdiagnosis and overtreatment of patients with thyroid cancer is expected to decrease. This supports future application of the deep learning models to clinical practice for thyroid cancer diagnosis. However, further validation of these DCNN models in prospective clinical trials is warranted. Funding The Program for Changjiang Scholars and Innovative Research Team in University in China (IRT_14R40), National Natural Science Foundation of China (31801117). Citation Format: Xiangchun Li, Sheng Zhang, Qiang Zhang, Xi Wei, Yi Pan, Jing Zhao, Xiaojie Xin, Xiaoqing Wang, Fan Yang, Jianxin Li, Meng Yang, Qinghua Wang, Xiangqian Zheng, Yanhui Zhao, Lun Zhang, Xudong Wang, Zhimin Zheng, Christopher T. Whitlow, Metin N. Gurcan, Boris Pasche, Ming Gao, Wei Zhang, Kexin Chen. Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images from clinical ultrasound exams [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1394.

Deep learning-based computed tomography applied to the diagnosis of rib fractures

The aim of the present study was to explore the diagnostic value of a deep convolutional neural network (DCNN) model for the diagnosis of pulmonary nodules in adolescent and young adult patients with osteosarcoma. For the present study, 675 chest CT images were retrospectively collected from 109 patients with clinically confirmed osteosarcoma who underwent chest CT examination at Hangzhou Third People's Hospital (Hangzhou, China) from March 2011 to February 2022. CT images were then evaluated using the DCNN and manual models. Subsequently, pulmonary nodules of osteosarcoma were divided into calcified nodules, solid nodules, partially solid nodules and ground glass nodules using the DCNN model. Those patients with osteosarcoma who were diagnosed and treated were followed up to observe dynamic changes in the pulmonary nodules. A total of 3,087 nodules were detected, while 278 nodules were missed compared with those determined using the reference standard given by the consensus of three Experienced radiologists., which was analyzed by two diagnostic radiologists. In the manual model group, 2,442 nodules were detected, while 657 nodules were missed. The DCNN model showed significantly higher sensitivity and specificity compared with the manual model (sensitivity, 0.923 vs. 0.908; specificity, 0.552 vs. 0.351; P<0.05). In addition, the DCNN model yielded an area under the curve (AUC) value of 0.795 [95% confidence interval (CI), 0.743-0.846], outperforming that of the manual model (AUC, 0.687; 95% CI, 0.629-0.732; P<0.05). The film reading time of the DCNN model was also significantly shorter compared with that of the manual model [mean ± standard deviation (SD); 173.25±24.10 vs. 328.32±22.72 sec; P<0.05)]. The AUC of calcified nodules, solid nodules, partially solid nodules and ground glass nodules was calculated to be 0.766, 0.771, 0.761 and 0.796, respectively, using the DCNN model. Using this model, the majority of the pulmonary nodules were detected in patients with osteosarcoma at the initial diagnosis (69/109, 62.3%), and the majority of these were found with multiple pulmonary nodules instead of a single nodule (71/109, 65.1% vs. 38/109, 34.9%). These data suggest that, compared with the manual model, the DCNN model proved to be beneficial for the detection of pulmonary nodules in adolescent and young adult patients with osteosarcoma, which may reduce the time of artificial radiograph reading. In conclusion, the proposed DCNN model, developed using data from 675 chest CT images retrospectively collected from 109 patients with clinically confirmed osteosarcoma, may be used as an effective tool to evaluate pulmonary nodules in patients with osteosarcoma.

Variety purity is an important indicator in seed quality detection. Different varieties of corn seeds may be mixed in the growth and development process, which affects the growth and yield of the seeds. Thus, it is necessary to find a fast and non-destructively method to detect the purity. In this paper, the feasibility of combining hyperspectral imaging with deep convolutional neural network (DCNN) was studied to classify four corn seed varieties. Firstly, the average spectra from the region of seed in endosperm side hyperspectral images over the wavelength range of 450–979 nm were extracted. Secondly, the performances of three models were compared, including DCNN, K nearest neighbors (KNN) and support vector machine (SVM). DCNN model has the 100% training accuracy rate, 94.4% testing accuracy rate and 93.3% validation accuracy rate, and outperforms KNN and SVM models in most cases. DCNN model also had the best performance in evaluation indexes (sensitivity, specificity and precision). Finally, the visual classification map was generated according to the results of DCNN. Results show that DCNN can be adopted in spectral data analysis for the variety classification of corn seed; and the classification performance can be improved effectively.

Seed freezing damage is an agricultural disaster, which has a great impact on seed quality assurance. The feasibility of combining hyperspectral imaging with deep convolutional neural network (DCNN) to classify different freeze-damaged corn seeds was studied in this paper. At first, the hyperspectral images of corn seeds subjected to five different freezing temperatures at 400–1000 nm were acquired, and then the average spectra were extracted from the region of embryo hyperspectral images over the wavelength range of 450–979 nm. Next, four models (K nearest neighbors (KNN), support vector machine (SVM), extreme learning machine (ELM), and DCNN) were developed for five-category (5 frozen conditions) and four-category (“no freezing,” “slight freezing,” “moderate freezing,” and “severe freezing”) classifications, and the values of the evaluation indexes (accuracy, sensitivity, specificity, and precision) were calculated for comparison. The results show that DCNN model had the most satisfactory result with accuracy rates of 100% (training set), 96.9% (validation set), and 97.5% (testing set) for five-category classification, with accuracy rates of 100% (training, validation, and testing set) for four-category classification, and DCNN model also had the best performance in the evaluation indexes. At last, the visual classification map was generated according to the results of DCNN. It shows that hyperspectral imaging and DCNN can provide a novel method to detect the freezing damage of corn seeds quickly and inexpensively.

India is experiencing a rapid rise in lung cancer cases, with more than 1 lakh new cases forecast in the next five years. 90% of patients who are not discovered early live for five years, however, only 10-15% of patients who are discovered late live for five years. Lung cancer can be discovered early with computed tomography (CT) imaging. To detect and classify lung nodules and their malignancy levels, Computer Tomography (CT) scans were used on lung patients. Since nodules vary widely in size, shape, and texture, detecting them is a difficult task. Moreover, there are other structures in the lungs that are considered to be non-nodules, for example vessels, fibrosis, diffusive diseases, which often resemble nodules in appearance. Therefore, proposed an end-to-end architecture to recognize nodules from three-dimensional CT volume by modified UNet segmentation and CNN based classification on readily available Lung Image Database Consortium – Image Database Resource Initiative (LIDC-IDRI), virtuously self-governing Indian Lung CT Image Database (ILCID) and LNDb Challenge Dataset. According to the results obtained with the proposed method, nodules can be reliably detected and segmented in contrast to the existing lung segmentation, classification and detection algorithms. For nodule segmentation, attained a Dice Similarity Coefficient (DSC) value is about 0.89 and for nodule detection, achieved the Sensitivity of 98.53%.

e18052 {\rtf1\ansi\ansicpg936\cocoartf1347\cocoasubrtf570 {\fonttbl\f0\froman\fcharset0 Times-Roman;\f1\fnil\fcharset0 Calibri;\f2\fswiss\fcharset0 Helvetica; \f3\fnil\fcharset134 STHeitiSC-Light;\f4\froman\fcharset0 TimesNewRomanPSMT;} {\colortbl;\red255\green255\blue255;\red0\green0\blue0;} \paperw11900\paperh16840\margl1440\margr1440\vieww25400\viewh13600\viewkind0 \deftab720 \pard\pardeftab720 \f0\fs24 \cf2 \expnd0\expndtw0\kerning0 \outl0\strokewidth0 \strokec2 AI platform in mammagraphy to screening breast cancer: a sole center experence. \f1\fs21 \cf0 \kerning1\expnd0\expndtw0 \outl0\strokewidth0 \ \pard\pardeftab720\ri714\qj \cf0 Background: The aim of this study was to use deep convolutional neural network (DCNN) to relieve radiologists ' burden and to minimize misses and interpretation errors of suspicious lesions at digital mammography. Methods: We developed and trained the DCNN model on the training set, then validated it in an internal validation set. The labeled data were used for training the DCNN model, and the mass detection, calcification detection and benign and malignant diagnosis were interpreted respectively. After verifying the feasibility of the DCNN model in the diagnosis of breast cancer, we gradually increased the number of cases in the training set and established the verification set to test the training results. The latest training sets include 21100 atlas of our hospital between April 2010 and October 2017, among which the malignant case atlas is 1774. Each atlas contains 2 ipsilateral mammography images. The verification set includes 1307 atlas, among which the malignant case atlas is 248. Results: The DCNN model achieved high performance in identifying breast cancer patients in the validation sets tested, with sensitivity of 98.02%, specificity of 91.86% \f3 \'a3\'ac \f2 and area under the curve values of 0.9813. As for mass detection, we reached a recall rate of 89.6% on the premise of lowing the false positive to 0.168%. For the latest clinical data between October 2018 and November 2018 including 1043 atlas from 576 patients, the sensitivity was 78.6% (95%CI 62.8-89.1) versus 90.5% (95%CI 76.5 \f4 - \f2 96.9; p=0.021) and specificity was 93.4% (95%CI 91.6 \f4 - \f2 94.8) versus 82.7% (95%CI 80.2 \f4 - \f2 85 \f4 . \f2 0; p&lt;0.0001). Conclusions: The DCNN model showed improved specificity in diagnosis breast cancer compared with a group of skilled radiologists. As the number of cases in the training set increases, the capacity of DCNN model will be further improved.

BackgroundSurgical process modeling automatically identifies surgical phases, and further improvement in recognition accuracy is expected with deep learning. Surgical tool or time series information has been used to improve the recognition accuracy of a model. However, it is difficult to collect this information continuously intraoperatively. The present study aimed to develop a deep convolution neural network (CNN) model that correctly identifies the surgical phase during laparoscopic cholecystectomy (LC).MethodsWe divided LC into six surgical phases (P1–P6) and one redundant phase (P0). We prepared 115 LC videos and converted them to image frames at 3 fps. Three experienced doctors labeled the surgical phases in all image frames. Our deep CNN model was trained with 106 of the 115 annotation datasets and was evaluated with the remaining datasets. By depending on both the prediction probability and frequency for a certain period, we aimed for highly accurate surgical phase recognition in the operation room.ResultsNine full LC videos were converted into image frames and were fed to our deep CNN model. The average accuracy, precision, and recall were 0.970, 0.855, and 0.863, respectively.ConclusionThe deep learning CNN model in this study successfully identified both the six surgical phases and the redundant phase, P0, which may increase the versatility of the surgical process recognition model for clinical use. We believe that this model can be used in artificial intelligence for medical devices. The degree of recognition accuracy is expected to improve with developments in advanced deep learning algorithms.

Electricity theft is harmful to power grids. Integrating information flows with energy flows, smart grids can help to solve the problem of electricity theft owning to the availability of massive data generated from smart grids. The data analysis on the data of smart grids is helpful in detecting electricity theft because of the abnormal electricity consumption pattern of energy thieves. However, the existing methods have poor detection accuracy of electricity theft since most of them were conducted on one-dimensional (1-D) electricity consumption data and failed to capture the periodicity of electricity consumption. In this paper, we originally propose a novel electricity-theft detection method based on wide and deep convolutional neural networks (CNN) model to address the above concerns. In particular, wide and deep CNN model consists of two components: the wide component and the deep CNN component. The deep CNN component can accurately identify the nonperiodicity of electricity theft and the periodicity of normal electricity usage based on 2-D electricity consumption data. Meanwhile, the wide component can capture the global features of 1-D electricity consumption data. As a result, wide and deep CNN model can achieve the excellent performance in electricity-theft detection. Extensive experiments based on realistic dataset show that wide and deep CNN model outperforms other existing methods.

The theoretical basis of the discrete random sample batch classification is not clear and the sample division is not scientific during the process of Deep Convolutional Neural Network (DCNN) model training. Aiming at the problems above, starting from the DCNN detection recognition mechanism, the theory of random discrete samples is given and proved, and a scientific quantitative batch of sample input method is proposed. Combined with image preprocessing, based on the strategy of random dispersion of samples, and scientifically quantified sample input batches, the DCNN model is trained with limited label samples, and then the CT image recognition of pulmonary nodules is carried out. Experimental results based on the LIDC-ID-RI public dataset show that the sensitivity, specificity, and accuracy of the proposed method have reached 96.40%, 95.60%, and 96.00%, respectively. Compared with the multiscale convolutional neural network method and the multiscale multimode image fusion method, the recognition accuracy of the proposed method is improved by 1.6 and 3.49 percentage points, respectively.

Lung cancer is a highly perilous illness ranking as one of the primary causes of disease and death, particularly when diagnosed in its initial stages. It presents significant challenges, as it is often only discernible after it has already diffused. This study proposes a lung cancer prognostication framework that uses deep learning to enhance the accuracy of cancer forecasting and disease determination, thereby enabling personalized treatment approaches based on disease severity. It consists of various steps, including image preprocessing and segmentation of lung CT image features extracted from the segmented images. Three different models, namely a DCNN model, a DCDNN model, and an ANN model, were employed for image classification, and a deep convolutional neural network (DCNN) was employed to detect lung diagnosis based on the extracted feature evaluation results showing the best accuracy of 99.41% in accurately discerning the presence or absence of lung cancer. The GAN model generates realistic lung CT scan images by training a generator to produce authentic images, and a discriminator to distinguish between real and fake images. The outcome of the system depends on the quality of the data, and a well-trained DCNN through training, validation, and testing on diverse datasets is crucial to ensure the reliability and generalizability of the model.

The prevalence of minimally invasive surgeries has increased the need for tumor detection using thoracoscopic images during lung cancer surgery. We conducted this study to analyze the efficacy of a deep convolutional neural network (DCNN) for tumor detection using recorded thoracoscopic images of pulmonary surfaces. We collected 644 intraoperative thoracoscopic images of changes in pulmonary appearance from 427 patients with lung cancer between 2012 and 2021. The lesion areas on the thoracoscopic images were detected by bounding boxes using an advanced version of YOLO, a well-known DCNN for object detection. The DCNN model was trained and evaluated by a 15-fold cross-validation scheme. Each predicted bounding box was considered successful detection when it overlapped more than 50% of the lesion areas annotated by board-certified surgeons. Precision, recall, and F1-measured values of 91.9%, 90.5%, and 91.1%, respectively, were obtained. The presence of lymphatic vessel invasion was associated with successful detection (p = 0.045). The presence of pathological pleural invasion also showed a tendency toward successful detection (p = 0.081). The proposed DCNN-based algorithm yielded an accuracy of more than 90% tumor detection. These algorithms will help surgeons detect lung cancer displayed on a screen automatically.

Lung cancer remains a leading cause of cancer-related mortality worldwide, necessitating early and accurate detection methods. Our study aims to enhance lung cancer detection by integrating VGGNet-16 form of Convolutional Neural Networks (CNNs) and Support Vector Machines (SVM) into a hybrid model (SVMVGGNet-16), leveraging the strengths of both models for high accuracy and reliability in classifying lung cancer types in different 4 classes such as adenocarcinoma (ADC), large cell carcinoma (LCC), Normal, and squamous cell carcinoma (SCC). Using the LIDC-IDRI dataset, we pre-processed images with a median filter and histogram equalization, segmented lung tumors through thresholding and edge detection, and extracted geometric features such as area, perimeter, eccentricity, compactness, and circularity. VGGNet-16 and SVM employed for feature extraction and classification, respectively. Performance matrices were evaluated using accuracy, AUC, recall, precision, and F1-score. Both VGGNet-16 and SVM underwent comparative analysis during the training, validation, and testing phases. The SVMVGGNet-16 model outperformed both, with a training accuracy (97.22%), AUC (99.42%), recall (94.22%), precision (95.28%), and F1- score (94.68%). In testing, our SVMVGGNet-16 model maintained high accuracy (96.72%), with an AUC (96.87%), recall (84.67%), precision (87.40%), and F1-score (85.73%). Our experimental results demonstrate the potential of SVMVGGNet-16 in improving diagnostic performance, leading to earlier detection and better treatment outcomes. Future work includes refining the model, expanding datasets, conducting clinical trials, and integrating the system into clinical practice to ensure practical usability.

BackgroundEarly diagnosis of pulmonary nodules is essential for effective prevention and treatment of pulmonary cancer. However, the heterogeneous and complex characteristics of pulmonary nodules, such as shape, size, speculation, and texture, present significant challenges in clinical diagnosis, which computer-aided diagnosis (CAD) can help address. Moreover, the varied performance of deep learning methods in CAD and limited model interpretability often hinder clinicians’ understanding of CAD results. In this study, we propose a multitask Swin Transformer (MTST) for classifying benign and malignant pulmonary nodules, which outputs nodule features as classification criteria.MethodsWe introduce a MTST model for feature extraction, designed with a multitask layer that simultaneously outputs benign and malignant binary classification, multilevel classification, and a detailed analysis of pulmonary nodule features. In addition, we incorporate image augmentation using a U-Net generative adversarial network (GAN) model to enhance the training process.ResultsExperimental findings on the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) dataset demonstrate that the proposed MTST outperforms conventional convolutional neural networks (CNN)-based networks across multiple tasks. Specifically, MTST achieved an accuracy of 93.24% in binary classification of benign and malignant nodules and demonstrated superior performance in nodule feature evaluation. For multilevel classification of pulmonary nodules, the Swin Transformer achieved an accuracy of 95.73%. On the training, validation, and test sets (9,600/2,400/1,600 nodules), the MTST model achieved an accuracy of 93.74%, sensitivity of 91.55%, and specificity of 96.09%. The results indicate that the MTST model aligns well with clinical diagnostic practices, offering improved performance and reliability.ConclusionsThe MTST model’s efficacy in binary classification, multiclass classification, and feature evaluation confirms its potential as a valuable tool for CAD systems in clinical settings.

Lung cancer presents the highest cause of death among patients around the world, in addition of being one of the smallest survival rates after diagnosis. Therefore, this study proposes a methodology for diagnosis of lung nodules in benign and malignant tumors based on image processing and pattern recognition techniques. Mean phylogenetic distance (MPD) and taxonomic diversity index (Δ) were used as texture descriptors. Finally, the genetic algorithm in conjunction with the support vector machine were applied to select the best training model. The proposed methodology was tested on computed tomography (CT) images from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI), with the best sensitivity of 93.42%, specificity of 91.21%, accuracy of 91.81%, and area under the ROC curve of 0.94. The results demonstrate the promising performance of texture extraction techniques using mean phylogenetic distance and taxonomic diversity index combined with phylogenetic trees. Graphical Abstract Stages of the proposed methodology.