Deep learning for magnification independent breast cancer histopathology image classification

The computer-assisted classification of breast cancer histopathological image in the future is an essential method for the improvement of the diagnostic performance, thus reducing breast cancer deaths. Although deep convolutional neural networks (DCNNs) have made dramatic breakthroughs, many image classification tasks still remain challenging due to the insufficiency of training data and the lack of the ability to focus on improving classification efficiency. To address these issues, we share a densely connected convolutional network (DenseNet) model that is composed of 3 layers DenseNet, pooling layer, and a classification layer for breast cancer classification in microscopic images. Each layer of DenseNet contains 4 dense blocks. Each dense block jointly uses the dense connection and a novel attention learning mechanisms to increase its ability for discriminative representation. Meanwhile, the transfer learning algorithm is applied to determine the model parameters to extract the features of the patient image that is performed. In order to ensure sufficient data volume, a data enhancement method based on the quad-tree principle is proposed for high-resolution images. On the other hand, the classification probability of each part after dicing is fused by three algorithms of addition, product, and maximum. We evaluated our DenseNet model on the BreastKHis dataset. Our results indicate that the DenseNet model and data enhancement method we adopted can adaptively focus on the study of breast cancer histopathological image classification, thus achieving the state-of-the-art performance in breast cancer classification. The results of the experiments are in terms of patient-level and image-level accuracy. The best recognition accuracy increased to 90.9%-92.5% and 89.3%-91.8%, respectively, compared with previous studies.

Convolutional neural network (CNN) based image steganalysis are increasingly popular because of their superiority in accuracy. The most straightforward way to employ CNN for image steganalysis is to learn a CNN-based classifier to distinguish whether secret messages have been embedded into an image. However, it is difficult to learn such a classifier because of the weak stego signals and the limited useful information. To address this issue, in this paper, a multi-task learning CNN is proposed. In addition to the typical use of CNN, learning a CNN-based classifier for the whole image, our multi-task CNN is learned with an auxiliary task of the pixel binary classification, estimating whether each pixel in an image has been modified due to steganography. To the best of our knowledge, we are the first to employ CNN to perform the pixel-level classification of such type. Experimental results have justified the effectiveness and efficiency of the proposed multi-task learning CNN.

Breast cancer is the most prevalent cancer globally and presents a significant threat to human health. The low survival rate for advanced stages highlights the importance of early and accurate diagnosis. Pathology images, providing insights into cancer's cellular aggressiveness, are crucial for breast cancer diagnosis. Advances in deep learning have transformed automated medical image diagnosis. However, traditional deep learning methods, reliant on large labeled datasets, face challenges with the typically small size of medical image datasets. To overcome this, our study combines deep transfer learning (DTL) with convolutional neural networks(CNN). We utilize and enhance a ResNet50 model pretrained on a large dataset. Additionally, we apply four different deep transfer learning methods to feature extraction and classification of the BreakHis dataset, aiming to determine if breast cancer is benign or malignant. Ultimately, our system achieved the best average accuracy rates under four different magnifications: 98.57%, 96.83%, 97.76%, and 97.16%. These results demonstrate the accuracy and potential of deep transfer learning in classifying breast cancer histopathological images and its promising application in tumor prediction.

Breast cancer is the second leading cause of cancer death among women. Breast cancer is not a single disease, but rather is comprised of many different biological entities with distinct pathological features and clinical implications. Pathologists face a substantial increase in workload and complexity of digital pathology in cancer diagnosis due to the advent of personalized medicine, and diagnostic protocols have to focus equally on efficiency and accuracy. Computerized image processing technology has been shown to improve efficiency, accuracy and consistency in histopathology evaluations, and can provide decision support to ensure diagnostic consistency. We show that convolutional neural networks (CNN) can be an effective tool in classifying breast cancer histopathological images and evaluate its performance as a binary classifier in the field of breast cancer diagnosis using whole slide imaging.

MF-OMKT: Model fusion based on online mutual knowledge transfer for breast cancer histopathological image classification

Meta-adaptive-weighting-based bilateral multi-dimensional refined space feature attention network for imbalanced breast cancer histopathological image classification

This chapter looks at several commonly used breast cancer datasets, whether they are text or images, as well as related works demonstrating previous efforts for breast cancer diagnosis. Wisconsin breast cancer dataset downloaded from the UCI machine learning repository in this part. This dataset is utilized to separate between cancerous and benign tumors. The breast carcinoma subtyping dataset is a vast collection of annotated Hematoxylin and Eosin-stained pictures designed to aid in the diagnosis of breast lesions. The breast cancer semantic segmentation dataset comprises approximately 20,000 tissue region segmentation annotations from the cancer genome Atlas breast cancer pictures. The breast cancer histopathological image classification is made up of 9109 microscopic images of breast tumor tissue collected from 82 people at various magnification levels. PatchCamelyon is a dataset for picture categorization. It is made up of 327.680 color pictures taken from lymph node histopathologic scans.

Facial expression recognition and virtual animation character generation are crucial for animation production and human-computer interaction, but traditional models often perform poorly in complex scenes. This paper proposes a novel expression recognition and generation framework based on an improved Multi-Task Convolutional Neural Network (MTCNN), augmented by a High-Resolution Parallel Convolutional Network (HR-PCN) and Octave Convolution (OctConv). Specifically, HR-PCN enhances multi-scale feature extraction for facial keypoint detection, while OctConv improves frequency-aware representation learning. In terms of facial expression generation, Graph Convolutional Networks (GCNs) are adopted to model the semantic relationships between facial Action Units (AUs) and further enhanced with SE-ResNet50 for better spatial attention. The proposed MTCNN model was evaluated on the AFEW and CK+ datasets, achieving 89.70% and 93.50% accuracies, surpassing MTCNN’s 78.90% and 85.30% and SSD’s 85.40% and 90.10%. RMSE was reduced to 0.1 after 30 iterations, and inference time was kept within 40 ms/frame. For expression generation, the SE-ResNet50-GCN model attained a generation accuracy of up to 93.5%, significantly outperforming ResNet50-GCN (90.8%) and GCN (80.2%). These results validate the proposed framework’s effectiveness in improving both recognition accuracy and expression realism under complex conditions.

Two-phase deep convolutional neural network for reducing class skewness in histopathological images based breast cancer detection

Breast cancer has the highest mortality among cancers in women. Computer-aided pathology to analyze microscopic histopathology images for diagnosis with an increasing number of breast cancer patients can bring the cost and delays of diagnosis down. Deep learning in histopathology has attracted attention over the last decade of achieving state-of-the-art performance in classification and localization tasks. The convolutional neural network, a deep learning framework, provides remarkable results in tissue images analysis, but lacks in providing interpretation and reasoning behind the decisions. We aim to provide a better interpretation of classification results by providing localization on microscopic histopathology images. We frame the image classification problem as weakly supervised multiple instance learning problem where an image is collection of patches i.e. instances. Attention-based multiple instance learning (A-MIL) learns attention on the patches from the image to localize the malignant and normal regions in an image and use them to classify the image. We present classification and localization results on two publicly available BreakHIS and BACH dataset. The classification and visualization results are compared with other recent techniques. The proposed method achieves better localization results without compromising classification accuracy.

Time delay after an abnormal screening mammogram may have a critical impact on tumor size, stage at diagnosis, treatment, prognosis, and survival of subsequent breast cancer. This study was undertaken to evaluate disparities between Latina and non-Hispanic white (NHW) women in time to definitive diagnosis of breast cancer after an abnormal screening mammogram, as well as factors contributing to such disparities.As part of the activities of the National Cancer Institute (NCI)-funded Redes En Acción research network, clinical records of 186 Latinas and 74 NHWs who received abnormal screening mammogram results were reviewed to determine the time to obtain a definitive diagnosis. Data was obtained from participating clinics in six U.S. cities and included demographics, clinical history, and mammogram characteristics. Kaplan-Meier estimates and Cox proportional hazards models were used to test differences in median time to definitive diagnosis by ethnicity after adjusting for clinic site, demographics, and clinical characteristics.Time-to-event analysis showed that Latinas took 2.2 times longer to reach 50% definitively diagnosed with breast cancer relative to NHWs, and three times longer to reach 80% diagnosed (p=0.001). Latinas’ median time to definitive diagnosis was 60 days compared to 27 for NHWs, a 59% gap in diagnosis rates (adjusted Hazard Ratio [aHR] = 1.59, 95% CI = 1.09, 2.31; p=0.015). BI-RADS-4/5 women’s diagnosis rate was more than twice that of BI-RADS-3 (aHR = 2.11, 95% CI = 1.18, 3.78; p=0.011).Disparities in time between receipt of abnormal screening result and definitive diagnosis adversely affect Latinas compared to NHWs, and remain significant after adjusting for demographic and clinical variables. With cancer now the leading cause of mortality among Latinos, a greater need exists for ethnically and culturally appropriate interventions like patient navigation to facilitate Latinas’ successful entry into, and progression through, the cancer care system.

Although many machine learning methods have been widely used to predict PM2.5 concentrations, these single or hybrid methods still have some shortcomings. This study integrated the advantages of convolutional neural network (CNN) feature extraction and the regression ability of random forest (RF) to propose a novel CNN-RF ensemble framework for PM2.5 concentration modeling. The observational data from 13 monitoring stations in Kaohsiung in 2021 were selected for model training and testing. First, CNN was implemented to extract key meteorological and pollution data. Subsequently, the RF algorithm was employed to train the model with five input factors, namely the extracted features from the CNN and spatiotemporal factors, including the day of the year, the hour of the day, latitude, and longitude. Independent observations from two stations were used to evaluate the models. The findings demonstrated that the proposed CNN-RF model had better modeling capability compared with the independent CNN and RF models: the average improvements in root mean square error (RMSE) and mean absolute error (MAE) ranged from 8.10% to 11.11%, respectively. In addition, the proposed CNN-RF hybrid model has fewer excess residuals at thresholds of 10 μg/m3, 20 μg/m3, and 30 μg/m3. The results revealed that the proposed CNN-RF ensemble framework is a stable, reliable, and accurate method that can generate superior results compared with the single CNN and RF methods. The proposed method could be a valuable reference for readers and may inspire researchers to develop even more effective methods for air pollution modeling. This research has important implications for air pollution research, data analysis, model estimation, and machine learning.

Breast cancer is a highly heterogeneous malignant tumor, and its accurate classification is of great significance for clinical diagnosis and treatment decision-making. In recent years, convolutional neural networks and Transformer have been widely used in pathological image analysis of breast cancer. Though the former excels at capturing local information and the latter is adept at modeling global dependencies, the former is limited by fixed sampling positions and is hindered to characterize irregular cell morphology, the latter is insufficient in describing the two-dimensional spatial structure of cells and tissues. Based on these, a Spatial-Frequency Domain Feature Extraction Model (S-FDFEM) proposed in this paper integrates spatial and frequency domain information to enhance feature learning for pathological image recognition. Specifically, in the spatial domain, Deformable Bottleneck Convolution (DBottConv) is utilized to effectively represent intricate cell and tissue morphological variations in pathological images and improve the expression ability of local features; in the frequency domain, wavelet low frequencies and Fourier high frequencies are generated based on the input pathological images to capture global approximation and fine structures, then statistical transformer and depth gradient feature extraction modules are integrated to operate on these two frequency domain components, enabling global dynamic focusing and two dimensions spatial characterization of pathological images. Experimental results show that the classification of breast cancer pathological image on BreakHis and BACH datasets verify the superiority of the S-FDFEM proposed in this paper.

Breast cancer is one of the major public health issues and is considered a leading cause of cancer-related deaths among women worldwide. Its early diagnosis can effectively help in increasing the chances of survival rate. To this end, biopsy is usually followed as a gold standard approach in which tissues are collected for microscopic analysis. However, the histopathological analysis of breast cancer is non-trivial, labor-intensive, and may lead to a high degree of disagreement among pathologists. Therefore, an automatic diagnostic system could assist pathologists to improve the effectiveness of diagnostic processes. This paper presents an ensemble deep learning approach for the definite classification of non-carcinoma and carcinoma breast cancer histopathology images using our collected dataset. We trained four different models based on pre-trained VGG16 and VGG19 architectures. Initially, we followed 5-fold cross-validation operations on all the individual models, namely, fully-trained VGG16, fine-tuned VGG16, fully-trained VGG19, and fine-tuned VGG19 models. Then, we followed an ensemble strategy by taking the average of predicted probabilities and found that the ensemble of fine-tuned VGG16 and fine-tuned VGG19 performed competitive classification performance, especially on the carcinoma class. The ensemble of fine-tuned VGG16 and VGG19 models offered sensitivity of for carcinoma class and overall accuracy of . Also, it offered an F1 score of . These experimental results demonstrated that our proposed deep learning approach is effective for the automatic classification of complex-natured histopathology images of breast cancer, more specifically for carcinoma images.

Accurate segmentation and delineation of the sub-tumor regions are very challenging tasks due to the nature of the tumor. Traditionally, convolutional neural networks (CNNs) have succeeded in achieving most promising performance for the segmentation of brain tumor; however, handcrafted features remain very important in identification of tumor's boundary regions accurately. The present work proposes a robust deep learning-based model with three different CNN architectures along with pre-defined handcrafted features for brain tumor segmentation, mainly to find out more prominent boundaries of the core and enhanced tumor regions. Generally, automatic CNN architecture does not use the pre-defined handcrafted features because it extracts the features automatically. In this present work, several pre-defined handcrafted features are computed from four MRI modalities (T2, FLAIR, T1c, and T1) with the help of additional handcrafted masks according to user interest and fed to the convolutional features (automatic features) to improve the overall performance of the proposed CNN model for tumor segmentation. Multi-pathway CNN is explored in this present work along with single-pathway CNN, which extracts simultaneously both local and global features to identify the accurate sub-regions of the tumor with the help of handcrafted features. The present work uses a cascaded CNN architecture, where the outcome of a CNN is considered as an additional input information to next subsequent CNNs. To extract the handcrafted features, convolutional operation was applied on the four MRI modalities with the help of several pre-defined masks to produce a predefined set of handcrafted features. The present work also investigates the usefulness of intensity normalization and data augmentation in pre-processing stage in order to handle the difficulties related to the imbalance of tumor labels. The proposed method is experimented on the BraST 2018 datasets and achieved promising results than the existing (currently published) methods with respect to different metrics such as specificity, sensitivity, and dice similarity coefficient (DSC) for complete, core, and enhanced tumor regions. Quantitatively, a notable gain is achieved around the boundaries of the sub-tumor regions using the proposed two-pathway CNN along with the handcrafted features. Graphical Abstract This data is mandatory. Please provide.