A retinal vessel detection approach using convolution neural network

Effect of CAD on Radiologists' Detection of Lung Nodules on Thoracic CT Scans: Analysis of an Observer Performance Study by Nodule Size

Artificial intelligence in breast imaging

Lung cancer is the most common and the deadliest cancer in the world. Lung cancer staging usually was done by radiologist by detecting mediastinal lymph node (LN) enlargement. Mediastinal LN is difficult to be detected visually due to its low contrast to the surrounding tissues, various size and shape, and sparse location. Therefore, computer-aided detection (CADe) system has been developed as a tool for radiologist to detect mediastinal LN automatically. The state of the art mediastinal LN CADe system use complex architectural convolutional neural network (CNN). However, more simple architecture of the CNN is needed to reduce the computational complexity of the CADe system, especially if the system was intended to be used in a regular computer. Therefore, in this experiment we used simple architectural 2D CNN which is converted to fully convolutional network (FCN) to detect mediastinal LN candidate in a stack of CT images. Then, the mediastinal LN candidates were classified using 3D CNN to reduce the false positive (FP). The best performance of this CADe system was 65% of sensitivity at 5 FP/patient.

Computer-Aided Mass Detection Based on Ipsilateral Multiview Mammograms

Breast cancer is one of the most common female malignancies, as well as the second leading cause of mortality for women. Early detection and treatment can dramatically decrease the mortality rate. Recently, automated breast volume scanner (ABVS) has become one of the most frequently used diagnose methods for breast tumor screening because of its operator-independent and reproducible advantages. However, it is a challenging job to obtain the tumors’ accurate locations and shapes by reviewing hundreds of ABVS slices. In this paper, a novel computer-aided detection (CADe) system is developed to reduce clinicians’ reading time and improve the efficiency. The CADe system mainly contains three parts: tumor candidate acquisition, false-positive reduction and tumor segmentation. Firstly, a local phase-based approach is built to obtain breast tumor candidates for further recognition. Subsequently, a convolutional neural network (CNN) is applied to reduce false positives (FPs). The introduction of CNN can help to avoid complicated feature extraction as well as elevate the accuracy and efficiency. Finally, superpixel-based segmentation is used to outline the breast tumor. Here, superpixel-based local binary pattern (SLBP) is proposed to assist the segmentation, which improves the performance. The methods were evaluated on a clinical ABVS dataset whose abnormal cases were manually labeled by an experienced radiologist. The experiment results were mainly composed of two parts. At the FP reduction stage, the proposed CNN achieved 100% and 78.12% sensitivity with FPs/case of 2.16 and 0. At the segmentation stage, our SLBP obtained 82.34% true positive, 15.79% false positive and 83.59% Dice similarity. In summary, the proposed CADe system demonstrated promising potential to detect and outline breast tumors in ABVS images.

One-stage pulmonary nodule detection using 3-D DCNN with feature fusion and attention mechanism in CT image

The application of deep learning technology has increased rapidly in recent years. Technologies in deep learning increasingly emulate natural human abilities, such as knowledge learning, problem-solving, and decision-making. In general, deep learning can carry out self-training without repetitive programming by humans. Convolutional neural networks (CNNs) are deep learning algorithms commonly used in wide applications. CNN is often used for image classification, segmentation, object detection, video processing, natural language processing, and speech recognition. CNN has four layers: convolution layer, pooling layer, fully connected layer, and non-linear layer. The convolutional layer uses kernel filters to calculate the convolution of the input image by extracting the fundamental features. The pooling layer combines two successive convolutional layers. The third layer is the fully connected layer, commonly called the convolutional output layer. The activation function defines the output of a neural network, such as 'yes' or 'no'. The most common and popular CNN activation functions are Sigmoid, Tanh, ReLU, Leaky ReLU, Noisy ReLU, and Parametric Linear Units. The organization and function of the visual cortex greatly influence CNN architecture because it is designed to resemble the neuronal connections in the human brain. Some of the popular CNN architectures are LeNet, AlexNet and VGGNet.

The objective of this study was to evaluate the performance of a computer-aided detection (CAD) system for the detection of breast cancer, based on mammographic appearance and histopathology. From 1000 consecutive screening mammograms from women with biopsy-proven breast carcinoma, 273 mammograms were selected randomly for retrospective evaluation by CAD. The sensitivity of the CAD system for breast cancer was assessed from the proportion of masses and microcalcifications detected. The corresponding tumor histopathologies also were evaluated. Normal mammograms (n = 155 patients) were used to determine the false-positive rate of the system. Of the 273 breast carcinomas, 149 appeared mammographically as masses, and 88 appeared as microcalcifications, including 36 carcinomas that presented as mixed lesions. The CAD system marked 125 of 149 masses correctly (84%), marked 86 of 88 microcalcifications correctly (98%), and marked 32 of 36 of mixed lesions correctly (89%.). The system showed a high sensitivity for the detection of ductal carcinoma in situ (95%; 73 of 77 lesions), invasive lobular carcinoma (95%; 18 of 19 lesions), invasive ductal carcinoma (85%; 125 of 147 lesions), and invasive mammary carcinoma (90%; 27 of 30 lesions). The highest CAD system sensitivity was for all invasive carcinomas that presented as microcalcifications (100%). On normal mammograms, there was an average of 1.3 false-positive CAD marks per image. The CAD system correctly marked a large majority of biopsy-proven breast cancers, with a greater sensitivity for lesions with microcalcifications and without significant impact of performance based on tumor histopathology. CAD was highly effective in detecting invasive lobular carcinoma (sensitivity, 95%) and ductal carcinoma in situ (sensitivity, 95%). CAD represents a useful tool for the detection of breast cancer.

Optimizing convolutional neural networks on multi-core vector accelerator

Development and validation of artificial neural networks model for detection of Barrett’s neoplasia: a multicenter pragmatic nonrandomized trial (with video)

In this paper, we have developed a new method of accurate detection of retinal blood vessels based on a deep convolutional neural network (CNN) model. This method plays an important role in the observation of many eye diseases. Retinal Images have many issues that make the process of vessels segmentation very hard. We treat each issue of the retina image with the greatest observation to obtain a well-segmented image. The first step is to apply a pre-processing method based on fuzzy logic and image processing tactics. In a second step, in order to generate the segmented images, we propose a strided encoder-decoder CNN model. This network is trained and optimized using the Dice Loss function that supports the class imbalance problem that is in the database. The proposed model has a U-Net shape, but it is deeper and the pooling layers are replaced with strided convolutional layers in the encoder. This modification allows for a more precise segmentation of vessels and accelerates the training process. The last step is post-processing for removing the noisy pixels as well as the shadow of the optic disc. The performance of the proposed method was evaluated on DRIVE and STARE databases. The proposed method gives a sensitivity of 0.802 and 0.801 respectively on DRIVE and STARE, with an accuracy of 0.959 and 0.961 respectively. We focused on sensitivity and accuracy measurements that represent the accuracy of the model, especially tiny vessels. According to the results, the model outperforms many other proposed methods, especially in the above-mentioned measures.

Physicians use sonographic characteristics as a reference for the possible diagnosis of thyroid cancers. The purpose of this study was to investigate whether physicians were more effective in their tentative diagnosis based on the information provided by a computer-aided detection (CAD) system. A computer compared software-defined and physician-adjusted tumor loci. A multicenter, multireader, and multicase (MRMC) study was designed to compare clinician performance without and with the use of CAD. Interobserver variability was also analyzed. Excellent, satisfactory, and poor segmentations were observed in 25.3%, 58.9%, and 15.8% of nodules, respectively. There were 200 patients with 265 nodules in the study set. Nineteen physicians scored the malignancy potential of the nodules. The average area under the curve (AUC) of all readers was 0.728 without CAD and significantly increased to 0.792 with CAD. The average standard deviation of the malignant potential score significantly decreased from 18.97 to 16.29. The mean malignant potential score significantly decreased from 35.01 to 31.24 for benign cases. With the CAD system, an additional 7.6% of malignant nodules would be suggested for further evaluation, and biopsy would not be recommended for an additional 10.8% of benign nodules. The results demonstrated that applying a CAD system would improve clinicians’ interpretations and lessen the variability in diagnosis. However, more studies are needed to explore the use of the CAD system in an actual ultrasound diagnostic situation where much more benign thyroid nodules would be seen.

To assess whether a computer-aided detection (CADe) system could serve as a learning tool for radiology residents in chest X-ray (CXR) interpretation. Eight radiology residents were asked to interpret 500 CXRs for the detection of five abnormalities, namely pneumothorax, pleural effusion, alveolar syndrome, lung nodule, and mediastinal mass. After interpreting 150 CXRs, the residents were divided into 2 groups of equivalent performance and experience. Subsequently, group 1 interpreted 200 CXRs from the "intervention dataset" using a CADe as a second reader, while group 2 served as a control by interpreting the same CXRs without the use of CADe. Finally, the 2 groups interpreted another 150 CXRs without the use of CADe. The sensitivity, specificity, and accuracy before, during, and after the intervention were compared. Before the intervention, the median individual sensitivity, specificity, and accuracy of the eight radiology residents were 43% (range: 35-57%), 90% (range: 82-96%), and 81% (range: 76-84%), respectively. With the use of CADe, residents from group 1 had a significantly higher overall sensitivity (53% [n = 431/816] vs 43% [n = 349/816], p < 0.001), specificity (94% [i = 3206/3428] vs 90% [n = 3127/3477], p < 0.001), and accuracy (86% [n = 3637/4244] vs 81% [n = 3476/4293], p < 0.001), compared to the control group. After the intervention, there were no significant differences between group 1 and group 2 regarding the overall sensitivity (44% [n = 309/696] vs 46% [n = 317/696], p = 0.666), specificity (90% [n = 2294/2541] vs 90% [n = 2285/2542], p = 0.642), or accuracy (80% [n = 2603/3237] vs 80% [n = 2602/3238], p = 0.955). Although it improves radiology residents' performances for interpreting CXRs, a CADe system alone did not appear to be an effective learning tool and should not replace teaching. Although the use of artificial intelligence improves radiology residents' performance in chest X-rays interpretation, artificial intelligence cannot be used alone as a learning tool and should not replace dedicated teaching. • With CADe as a second reader, residents had a significantly higher sensitivity (53% vs 43%, p < 0.001), specificity (94% vs 90%, p < 0.001), and accuracy (86% vs 81%, p < 0.001), compared to residents without CADe. • After removing access to the CADe system, residents' sensitivity (44% vs 46%, p = 0.666), specificity (90% vs 90%, p = 0.642), and accuracy (80% vs 80%, p = 0.955) returned to that of the level for the group without CADe.

Computer-aided detection (CADe) systems could assist endoscopists in detecting early neoplasia in Barrett's oesophagus, which could be difficult to detect in endoscopic images. The aim of this study was to develop, test, and benchmark a CADe system for early neoplasia in Barrett's oesophagus. The CADe system was first pretrained with ImageNet followed by domain-specific pretraining with GastroNet. We trained the CADe system on a dataset of 14 046 images (2506 patients) of confirmed Barrett's oesophagus neoplasia and non-dysplastic Barrett's oesophagus from 15 centres. Neoplasia was delineated by 14 Barrett's oesophagus experts for all datasets. We tested the performance of the CADe system on two independent test sets. The all-comers test set comprised 327 (73 patients) non-dysplastic Barrett's oesophagus images, 82 (46 patients) neoplastic images, 180 (66 of the same patients) non-dysplastic Barrett's oesophagus videos, and 71 (45 of the same patients) neoplastic videos. The benchmarking test set comprised 100 (50 patients) neoplastic images, 300 (125 patients) non-dysplastic images, 47 (47 of the same patients) neoplastic videos, and 141 (82 of the same patients) non-dysplastic videos, and was enriched with subtle neoplasia cases. The benchmarking test set was evaluated by 112 endoscopists from six countries (first without CADe and, after 6 weeks, with CADe) and by 28 external international Barrett's oesophagus experts. The primary outcome was the sensitivity of Barrett's neoplasia detection by general endoscopists without CADe assistance versus with CADe assistance on the benchmarking test set. We compared sensitivity using a mixed-effects logistic regression model with conditional odds ratios (ORs; likelihood profile 95% CIs). Sensitivity for neoplasia detection among endoscopists increased from 74% to 88% with CADe assistance (OR 2·04; 95% CI 1·73-2·42; p<0·0001 for images and from 67% to 79% [2·35; 1·90-2·94; p<0·0001] for video) without compromising specificity (from 89% to 90% [1·07; 0·96-1·19; p=0·20] for images and from 96% to 94% [0·94; 0·79-1·11; ] for video; p=0·46). In the all-comers test set, CADe detected neoplastic lesions in 95% (88-98) of images and 97% (90-99) of videos. In the benchmarking test set, the CADe system was superior to endoscopists in detecting neoplasia (90% vs 74% [OR 3·75; 95% CI 1·93-8·05; p=0·0002] for images and 91% vs 67% [11·68; 3·85-47·53; p<0·0001] for video) and non-inferior to Barrett's oesophagus experts (90% vs 87% [OR 1·74; 95% CI 0·83-3·65] for images and 91% vs 86% [2·94; 0·99-11·40] for video). CADe outperformed endoscopists in detecting Barrett's oesophagus neoplasia and, when used as an assistive tool, it improved their detection rate. CADe detected virtually all neoplasia in a test set of consecutive cases. Olympus.

ObjectiveTo evaluate the effect of computer-aided detection (CAD) system on observer performance in the detection of malignant lung nodules on chest radiograph.Materials and MethodsTwo hundred chest radiographs (100 normal and 100 abnormal with malignant solitary lung nodules) were evaluated. With CT and histological confirmation serving as a reference, the mean nodule size was 15.4 mm (range, 7-20 mm). Five chest radiologists and five radiology residents independently interpreted both the original radiographs and CAD output images using the sequential testing method. The performances of the observers for the detection of malignant nodules with and without CAD were compared using the jackknife free-response receiver operating characteristic analysis.ResultsFifty-nine nodules were detected by the CAD system with a false positive rate of 1.9 nodules per case. The detection of malignant lung nodules significantly increased from 0.90 to 0.92 for a group of observers, excluding one first-year resident (p = 0.04). When lowering the confidence score was not allowed, the average figure of merit also increased from 0.90 to 0.91 (p = 0.04) for all observers after a CAD review. On average, the sensitivities with and without CAD were 87% and 84%, respectively; the false positive rates per case with and without CAD were 0.19 and 0.17, respectively. The number of additional malignancies detected following true positive CAD marks ranged from zero to seven for the various observers.ConclusionThe CAD system may help improve observer performance in detecting malignant lung nodules on chest radiographs and contribute to a decrease in missed lung cancer.