Multi-Reader Multi-Case Study for Performance Evaluation of High-Risk Thyroid Ultrasound with Computer-Aided Detection

Effect of CAD on Radiologists' Detection of Lung Nodules on Thoracic CT Scans: Analysis of an Observer Performance Study by Nodule Size

Computer-Aided Mass Detection Based on Ipsilateral Multiview Mammograms

The objective of this study was to evaluate the performance of a computer-aided detection (CAD) system for the detection of breast cancer, based on mammographic appearance and histopathology. From 1000 consecutive screening mammograms from women with biopsy-proven breast carcinoma, 273 mammograms were selected randomly for retrospective evaluation by CAD. The sensitivity of the CAD system for breast cancer was assessed from the proportion of masses and microcalcifications detected. The corresponding tumor histopathologies also were evaluated. Normal mammograms (n = 155 patients) were used to determine the false-positive rate of the system. Of the 273 breast carcinomas, 149 appeared mammographically as masses, and 88 appeared as microcalcifications, including 36 carcinomas that presented as mixed lesions. The CAD system marked 125 of 149 masses correctly (84%), marked 86 of 88 microcalcifications correctly (98%), and marked 32 of 36 of mixed lesions correctly (89%.). The system showed a high sensitivity for the detection of ductal carcinoma in situ (95%; 73 of 77 lesions), invasive lobular carcinoma (95%; 18 of 19 lesions), invasive ductal carcinoma (85%; 125 of 147 lesions), and invasive mammary carcinoma (90%; 27 of 30 lesions). The highest CAD system sensitivity was for all invasive carcinomas that presented as microcalcifications (100%). On normal mammograms, there was an average of 1.3 false-positive CAD marks per image. The CAD system correctly marked a large majority of biopsy-proven breast cancers, with a greater sensitivity for lesions with microcalcifications and without significant impact of performance based on tumor histopathology. CAD was highly effective in detecting invasive lobular carcinoma (sensitivity, 95%) and ductal carcinoma in situ (sensitivity, 95%). CAD represents a useful tool for the detection of breast cancer.

Development and validation of artificial neural networks model for detection of Barrett’s neoplasia: a multicenter pragmatic nonrandomized trial (with video)

Prostatic adenocarcinoma is the most commonly occurring cancer among men in the United States, second only to skin cancer. Currently, the only definitive method to ascertain the presence of prostatic cancer is by trans-rectal ultrasound (TRUS) directed biopsy. Owing to the poor image quality of ultrasound, the accuracy of TRUS is only 20%-25%. High-resolution magnetic resonance imaging (MRI) has been shown to have a higher accuracy of prostate cancer detection compared to ultrasound. Consequently, several researchers have been exploring the use of high resolution MRI in performing prostate biopsies. Visual detection of prostate cancer, however, continues to be difficult owing to its apparent lack of shape, and the fact that several malignant and benign structures have overlapping intensity and texture characteristics. In this paper, we present a fully automated computer-aided detection (CAD) system for detecting prostatic adenocarcinoma from 4 Tesla ex vivo magnetic resonance (MR) imagery of the prostate. After the acquired MR images have been corrected for background inhomogeneity and nonstandardness, novel three-dimensional (3-D) texture features are extracted from the 3-D MRI scene. A Bayesian classifier then assigns each image voxel a "likelihood" of malignancy for each feature independently. The "likelihood" images generated in this fashion are then combined using an optimally weighted feature combination scheme. Quantitative evaluation was performed by comparing the CAD results with the manually ascertained ground truth for the tumor on the MRI. The tumor labels on the MR slices were determined manually by an expert by visually registering the MR slices with the corresponding regions on the histology slices. We evaluated our CAD system on a total of 33 two-dimensional (2-D) MR slices from five different 3-D MR prostate studies. Five slices from two different glands were used for training. Our feature combination scheme was found to outperform the individual texture features, and also other popularly used feature combination methods, including AdaBoost, ensemble averaging, and majority voting. Further, in several instances our CAD system performed better than the experts in terms of accuracy, the expert segmentations being determined solely from visual inspection of the MRI data. In addition, the intrasystem variability (changes in CAD accuracy with changes in values of system parameters) was significantly lower than the corresponding intraobserver and interobserver variability. CAD performance was found to be very similar for different training sets. Future work will focus on extending the methodology to guide high-resolution MRI-assisted in vivo prostate biopsies.

We have developed a computer-aided detection (CAD) system for breast masses on mammograms. In this study, our purpose was to improve the performance of our mass detection system by using a new dual system approach which combines a CAD system optimized with "average" masses with another CAD system optimized with subtle masses. The latter system is trained to provide high sensitivity in detecting subtle masses. For an unknown mammogram, the two systems are used in parallel to detect suspicious objects. A feed-forward backpropagation neural network trained to merge the scores of the two linear discriminant analysis (LDA) classifiers from the two systems makes the final decision in differentiation of true masses from normal tissue. A data set of 86 patients containing 172 mammograms with biopsy-proven masses was partitioned into a training set and an independent test set. This data set is referred to as the average data set. A second data set of 214 prior mammograms was used for training the second CAD system for detection of subtle masses. When the single CAD system trained on the average data set was applied to the test set, the A_z for false positive (FP) classification was 0.81 and the FP rates were 2.1, 1.5 and 1.3 FPs/image at the case-based sensitivities of 95%, 90% and 85%, respectively. With the dual CAD system, the A_z was 0.85 and the FP rates were improved to 1.7, 1.2 and 0.8 FPs/image at the same case-based sensitivities. Our results indicate that the dual CAD system can improve the performance of mass detection on mammograms.

To assess whether a computer-aided detection (CADe) system could serve as a learning tool for radiology residents in chest X-ray (CXR) interpretation. Eight radiology residents were asked to interpret 500 CXRs for the detection of five abnormalities, namely pneumothorax, pleural effusion, alveolar syndrome, lung nodule, and mediastinal mass. After interpreting 150 CXRs, the residents were divided into 2 groups of equivalent performance and experience. Subsequently, group 1 interpreted 200 CXRs from the "intervention dataset" using a CADe as a second reader, while group 2 served as a control by interpreting the same CXRs without the use of CADe. Finally, the 2 groups interpreted another 150 CXRs without the use of CADe. The sensitivity, specificity, and accuracy before, during, and after the intervention were compared. Before the intervention, the median individual sensitivity, specificity, and accuracy of the eight radiology residents were 43% (range: 35-57%), 90% (range: 82-96%), and 81% (range: 76-84%), respectively. With the use of CADe, residents from group 1 had a significantly higher overall sensitivity (53% [n = 431/816] vs 43% [n = 349/816], p < 0.001), specificity (94% [i = 3206/3428] vs 90% [n = 3127/3477], p < 0.001), and accuracy (86% [n = 3637/4244] vs 81% [n = 3476/4293], p < 0.001), compared to the control group. After the intervention, there were no significant differences between group 1 and group 2 regarding the overall sensitivity (44% [n = 309/696] vs 46% [n = 317/696], p = 0.666), specificity (90% [n = 2294/2541] vs 90% [n = 2285/2542], p = 0.642), or accuracy (80% [n = 2603/3237] vs 80% [n = 2602/3238], p = 0.955). Although it improves radiology residents' performances for interpreting CXRs, a CADe system alone did not appear to be an effective learning tool and should not replace teaching. Although the use of artificial intelligence improves radiology residents' performance in chest X-rays interpretation, artificial intelligence cannot be used alone as a learning tool and should not replace dedicated teaching. • With CADe as a second reader, residents had a significantly higher sensitivity (53% vs 43%, p < 0.001), specificity (94% vs 90%, p < 0.001), and accuracy (86% vs 81%, p < 0.001), compared to residents without CADe. • After removing access to the CADe system, residents' sensitivity (44% vs 46%, p = 0.666), specificity (90% vs 90%, p = 0.642), and accuracy (80% vs 80%, p = 0.955) returned to that of the level for the group without CADe.

ObjectiveTo evaluate the effect of computer-aided detection (CAD) system on observer performance in the detection of malignant lung nodules on chest radiograph.Materials and MethodsTwo hundred chest radiographs (100 normal and 100 abnormal with malignant solitary lung nodules) were evaluated. With CT and histological confirmation serving as a reference, the mean nodule size was 15.4 mm (range, 7-20 mm). Five chest radiologists and five radiology residents independently interpreted both the original radiographs and CAD output images using the sequential testing method. The performances of the observers for the detection of malignant nodules with and without CAD were compared using the jackknife free-response receiver operating characteristic analysis.ResultsFifty-nine nodules were detected by the CAD system with a false positive rate of 1.9 nodules per case. The detection of malignant lung nodules significantly increased from 0.90 to 0.92 for a group of observers, excluding one first-year resident (p = 0.04). When lowering the confidence score was not allowed, the average figure of merit also increased from 0.90 to 0.91 (p = 0.04) for all observers after a CAD review. On average, the sensitivities with and without CAD were 87% and 84%, respectively; the false positive rates per case with and without CAD were 0.19 and 0.17, respectively. The number of additional malignancies detected following true positive CAD marks ranged from zero to seven for the various observers.ConclusionThe CAD system may help improve observer performance in detecting malignant lung nodules on chest radiographs and contribute to a decrease in missed lung cancer.

Computer-aided detection (CADe) systems could assist endoscopists in detecting early neoplasia in Barrett's oesophagus, which could be difficult to detect in endoscopic images. The aim of this study was to develop, test, and benchmark a CADe system for early neoplasia in Barrett's oesophagus. The CADe system was first pretrained with ImageNet followed by domain-specific pretraining with GastroNet. We trained the CADe system on a dataset of 14 046 images (2506 patients) of confirmed Barrett's oesophagus neoplasia and non-dysplastic Barrett's oesophagus from 15 centres. Neoplasia was delineated by 14 Barrett's oesophagus experts for all datasets. We tested the performance of the CADe system on two independent test sets. The all-comers test set comprised 327 (73 patients) non-dysplastic Barrett's oesophagus images, 82 (46 patients) neoplastic images, 180 (66 of the same patients) non-dysplastic Barrett's oesophagus videos, and 71 (45 of the same patients) neoplastic videos. The benchmarking test set comprised 100 (50 patients) neoplastic images, 300 (125 patients) non-dysplastic images, 47 (47 of the same patients) neoplastic videos, and 141 (82 of the same patients) non-dysplastic videos, and was enriched with subtle neoplasia cases. The benchmarking test set was evaluated by 112 endoscopists from six countries (first without CADe and, after 6 weeks, with CADe) and by 28 external international Barrett's oesophagus experts. The primary outcome was the sensitivity of Barrett's neoplasia detection by general endoscopists without CADe assistance versus with CADe assistance on the benchmarking test set. We compared sensitivity using a mixed-effects logistic regression model with conditional odds ratios (ORs; likelihood profile 95% CIs). Sensitivity for neoplasia detection among endoscopists increased from 74% to 88% with CADe assistance (OR 2·04; 95% CI 1·73-2·42; p<0·0001 for images and from 67% to 79% [2·35; 1·90-2·94; p<0·0001] for video) without compromising specificity (from 89% to 90% [1·07; 0·96-1·19; p=0·20] for images and from 96% to 94% [0·94; 0·79-1·11; ] for video; p=0·46). In the all-comers test set, CADe detected neoplastic lesions in 95% (88-98) of images and 97% (90-99) of videos. In the benchmarking test set, the CADe system was superior to endoscopists in detecting neoplasia (90% vs 74% [OR 3·75; 95% CI 1·93-8·05; p=0·0002] for images and 91% vs 67% [11·68; 3·85-47·53; p<0·0001] for video) and non-inferior to Barrett's oesophagus experts (90% vs 87% [OR 1·74; 95% CI 0·83-3·65] for images and 91% vs 86% [2·94; 0·99-11·40] for video). CADe outperformed endoscopists in detecting Barrett's oesophagus neoplasia and, when used as an assistive tool, it improved their detection rate. CADe detected virtually all neoplasia in a test set of consecutive cases. Olympus.

Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): a double-blind randomised study

Background A computer-aided detection (CAD) system may help surveillance for pulmonary metastasis at chest radiography in situations where there is limited access to CT. Purpose To evaluate whether a deep learning (DL)-based CAD system can improve diagnostic yield for newly visible lung metastasis on chest radiographs in patients with cancer. Materials and Methods A regulatory-approved CAD system for lung nodules was implemented to interpret chest radiographs from patients referred by the medical oncology department in clinical practice. In this retrospective diagnostic cohort study, chest radiographs interpreted with assistance from a CAD system after the implementation (January to April 2019, CAD-assisted interpretation group) and those interpreted before the implementation (September to December 2018, conventional interpretation group) of the CAD system were consecutively included. The diagnostic yield (frequency of true-positive detections) and false-referral rate (frequency of false-positive detections) of formal reports of chest radiographs for newly visible lung metastasis were compared between the two groups using generalized estimating equations. Propensity score matching was performed between the two groups for age, sex, and primary cancer. Results A total of 2916 chest radiographs from 1521 patients (1546 men, 1370 women; mean age, 62 years) and 5681 chest radiographs from 3456 patients (2941 men, 2740 women; mean age, 62 years) were analyzed in the CAD-assisted interpretation and conventional interpretation groups, respectively. The diagnostic yield for newly visible metastasis was higher in the CAD-assisted interpretation group (0.86%, 25 of 2916 [95% CI: 0.58, 1.3] vs 0.32%, 18 of 568 [95% CI: 0.20, 0.50%]; P = .004). The false-referral rate in the CAD-assisted interpretation group (0.34%, 10 of 2916 [95% CI: 0.19, 0.64]) was not inferior to that in the conventional interpretation group (0.25%, 14 of 5681 [95% CI: 0.15, 0.42]) at the noninferiority margin of 0.5% (95% CI of difference: -0.15, 0.35). Conclusion A deep learning-based computer-aided detection system improved the diagnostic yield for newly visible metastasis on chest radiographs in patients with cancer with a similar false-referral rate. © RSNA, 2021 Online supplemental material is available for this article.

Costal cartilage fractures are associated with poor prognosis in patients with blunt chest trauma. A Computer-Aided Detection (CAD) system for detecting rib fractures has been used in practice, but it is unclear whether this system recognizes costal cartilage fractures. This study investigated whether the CAD system for rib fracture can detect costal cartilage fractures. A total of 89 patients with costal cartilage fractures from participating hospitals over an 18-year period were included in the study. The presence of a costal cartilage fracture was determined by three radiologists. We reviewed fracture location, cartilage calcification, dislocation, and callus formation. The percentage of agreement between the radiologists and the CAD system (Rib fracture CAD, Fujifilm Medical Co., Ltd) was assessed. We detected 246 costal cartilage fractures in 89 patients. The costal cartilage of rib 7 was injured most frequently. Costal cartilage fractures were categorized as either mid-chondral, costochondral, or chondro-sternal. The CAD system detected 33 lesions; 16 were consistent with the costal cartilage fractures determined by the radiologists (costochondral junction 13, mid-chondral 2, chondro-sternal 1). The CAD system for rib fracture can detect costal cartilage fractures at the costochondral junction but is not sufficiently sensitive to detect costal cartilage fractures without calcification. The CAD system for rib fracture needs further development before it can be used to detect rib cartilage fractures.

The main objective of this paper is to evaluate the performance of the Computer-Aided Detection (CAD) system for automated nodule detection in lungs using CT scan images. The CAD system is applied to CT scans collected in a screening program for lung cancer detection. Each scan consists of a sequence of about 300 slices stored in DICOM (Digital Imaging and Communications in Medicine) format. All true nodules were detected and a very low false-positive detection rate was achieved. The automated extraction of the pulmonary parenchyma in CT images is the most important step in a CAD system. In this paper we describe a method, consisting of techniques which are helpful for the automatic identification of the pulmonary volume. The performance is evaluated as a fully automated computerized method for the detection of lung nodules in computed tomography (CT) scans

Computer aided detection (CADe) colonoscopy has been shown in randomized controlled trials to improve detection of adenomatous colorectal polyps. However, in real-world settings the benefits are less clear. Our objective was to assess CADe colonoscopy compared to routine colonoscopy in a clinical practice setting in the Arab region with a low screening age (40 years old). After the implementation of the CADe system (GI Genius, Medtronic) in our hospital in September 2021 until July 2023, all CADe cases were registered and matched to routine colonoscopy cases with (1:4) ratio. Assignment of patients to the CADe system versus the routine colonoscopy was pragmatic design based on scheduling and availability factors. Primary endpoints were adenoma per colonoscopy (APC), and adenoma detection rate (ADR). A total of 840 patients were included, out of that 72 patients were excluded due to Boston Bowel Prep <6. The final analysis included 768 patients (161 with CADe, 607 without). The CADe system was found to significantly increase the mean APC (0.602 vs. 0.293; rate ratio 1.80 [1.40-2.32]; P < 0.001) and ADR, 30.4% with CADe versus 16.8% without CADe (adjusted RR 1.68 [1.27-2.22], P < 0.001). There was no significant difference in withdrawal time with CADe. In our study, CADe significantly increased the detection of adenomatous polyps in a young screening age population in a clinical practice setting. These findings support recent randomized controlled trials and contrast the findings of recent studies showing lack of benefit in real world practice.

Artificial intelligence in breast imaging