Optimized Octave Convolution Network Model for Histopathological Image Classification

Automated classification of histopathological images is an important research problem in medical imaging. Digital histopathology exhibits two principally distinct characteristics: 1) invariably histopathological images are multi-channel (color) with key geometric information spread across the color channels instead of being captured by luminance alone, and 2) the richness of geometric structures in such tissue imagery makes feature extraction for classification very demanding. Inspired by recent work in the use of sparsity for single channel image classification, we propose a new simultaneous Sparsity model for multi-channel Histopathological Image Representation and Classification (SHIRC). Essentially, we represent a multi-channel histopathological image as a sparse linear combination of training examples under suitable channel-wise constraints and classification is performed by solving a newly formulated simultaneous sparsity-based optimization problem. Experiments on two challenging real-world image databases: 1) provided by pathologists of the Animal Diagnostics Lab (ADL) at Pennsylvania State University, and 2) histopathological images corresponding to intraductal breast lesions [1], reveal the merits of the proposed SHIRC model over state of the art alternatives.

MF-OMKT: Model fusion based on online mutual knowledge transfer for breast cancer histopathological image classification

The field of histopathological image analysis has evolved significantly with the advent of digital pathology, leading to the development of automated models capable of classifying tissues and structures within diverse pathological images. Artificial intelligence algorithms, such as convolutional neural networks, have shown remarkable capabilities in pathology image analysis tasks, including tumor identification, metastasis detection, and patient prognosis assessment. However, traditional manual analysis methods have generally shown low accuracy in diagnosing colorectal cancer using histopathological images. This study investigates the use of AI in image classification and image analytics using histopathological images using the histogram of oriented gradients method. The study develops an AI-based architecture for image classification using histopathological images, aiming to achieve high performance with less complexity through specific parameters and layers. In this study, we investigate the complicated state of histopathological image classification, explicitly focusing on categorizing nine distinct tissue types. Our research used open-source multi-centered image datasets that included records of 100.000 non-overlapping images from 86 patients for training and 7180 non-overlapping images from 50 patients for testing. The study compares two distinct approaches, training artificial intelligence-based algorithms and manual machine learning models, to automate tissue classification. This research comprises two primary classification tasks: binary classification, distinguishing between normal and tumor tissues, and multi-classification, encompassing nine tissue types, including adipose, background, debris, stroma, lymphocytes, mucus, smooth muscle, normal colon mucosa, and tumor. Our findings show that artificial intelligence-based systems can achieve 0.91 and 0.97 accuracy in binary and multi-class classifications. In comparison, the histogram of directed gradient features and the Random Forest classifier achieved accuracy rates of 0.75 and 0.44 in binary and multi-class classifications, respectively. Our artificial intelligence-based methods are generalizable, allowing them to be integrated into histopathology diagnostics procedures and improve diagnostic accuracy and efficiency. The CNN model outperforms existing machine learning techniques, demonstrating its potential to improve the precision and effectiveness of histopathology image analysis. This research emphasizes the importance of maintaining data consistency and applying normalization methods during the data preparation stage for analysis. It particularly highlights the potential of artificial intelligence to assess histopathological images.

Extreme weather modeling is a challenge for modeling experts in Indonesia and the world. Extreme weather prediction is a complex problem because the chances of it happening are very small, so the developed models often have a low level of accuracy. The purpose of this research is to combine the classic model, Autoregressive Integrated Moving Average (ARIMA), recurrent neural network (RNN) model using Adam and SGD estimation (RNN-Adam and RNN-SGD) with the reLU, tanh, sigmoid and gaussian activation functions. In addition, the ARIMA-RNN mix model was also demonstrated in this study. These models are applied to monthly period extreme weather data obtained from the Meteorology, Climatology and Geophysics Agency (BMKG) of West Sulawesi Province which are converted into training data and test data. The RMSE value is used to see the level of prediction accuracy in both training data and test data. Based on the research results, the best model obtained for modeling Indonesia’s extreme weather is the ARIMA-RNN-Adam mix model with the reLU activation function based on the RMSE value on the training and test data. At n = 50, the smallest RMSE and MSE values of the third model are the ARIMA-RNN-Adam model which is 0.23212 using the reLU activation function, then the ARIMA-RNN-SGD model which is 0.25432 with the same activation function, while the ARIMA value is 0.3270. At n=100 it can be seen that the smallest RMSE and MSE values of the three models are the ARIMA-RNN-Adam model which is equal to 0.25149 using the reLU activation function, then the ARIMA-RNN-SGD model which is equal to 0.25256 with the same activation function, while the ARIMA value is 0.2644.

Deep neural network incorporating domain and resolution transformations model for histopathological image classification

Breast cancer is a big concern for women due to its higher mortality compared to other cancers. Objective and accurate early diagnosis is primordial for the treatment and survival improvement of patients. Histopathological image classification is considered the gold standard and is usually the last and most dependent diagnosis approach for doctors to make patient treatment proposals. In particular, recent deep learning-based methods provide remarkable classification results. However, these methods ignore rationale or logical explanation that is important for diagnosis reliability and human-level understanding. This paper proposes a multi-instance classification network (MICNet) with the mechanism of visual explanation to achieve the explainable classification of histopathological breast cancer images. The method uses a simple two-dimensional convolution kernel to generate explanation maps (i.e., visual explanation) through features coming from the end of the feature extractor in the VGG11 model pre-trained by ImageNet. Multiple instance learning (MIL) based on mirror padding and overlap cropping is adopted to improve the network’s classification performance. We also design a weighted average pooling method to encourage the network to learn more accurate visual explanation. Experiments on BreakHis and Camelyon16 patch-based datasets demonstrate that our MICNet outperforms other CNN models in classification and is able to provide a logical visual explanation that supports the network’s prediction.

Histopathological image contains rich pathological information that is valued for the aided diagnosis of many diseases such as cancer. An important issue in histopathological image classification is how to learn a high-quality discriminative dictionary due to diverse tissue pattern, a variety of texture, and different morphologies structure. In this paper, we propose a discriminative dictionary learning algorithm with pairwise local constraints (PLCDDL) for histopathological image classification. Inspired by the one-to-one mapping between dictionary atom and profile, we learn a pair of discriminative graph Laplacian matrices that are less sensitive to noise or outliers to capture the locality and discriminating information of data manifold by utilizing the local geometry information of category-specific dictionaries rather than input data. Furthermore, graph-based pairwise local constraints are designed and incorporated into the original dictionary learning model to effectively encode the locality consistency with intra-class samples and the locality inconsistency with inter-class samples. Specifically, we learn the discriminative localities for representations by jointly optimizing both the intra-class locality and inter-class locality, which can significantly improve the discriminability and robustness of dictionary. Extensive experiments on the challenging datasets verify that the proposed PLCDDL algorithm can achieve a better classification accuracy and powerful robustness compared with the state-of-the-art dictionary learning methods. Graphical abstract The proposed PLCDDL algorithm. 1) A pair of graph Laplacian matrices are first learned based on the class-specific dictionaries. 2) Graph-based pairwise local constraints are designed to transfer the locality for coding coefficients. 3) Class-specific dictionaries can be further updated.

BackgroundHistopathology image analysis is a gold standard for cancer recognition and diagnosis. Automatic analysis of histopathology images can help pathologists diagnose tumor and cancer subtypes, alleviating the workload of pathologists. There are two basic types of tasks in digital histopathology image analysis: image classification and image segmentation. Typical problems with histopathology images that hamper automatic analysis include complex clinical representations, limited quantities of training images in a dataset, and the extremely large size of singular images (usually up to gigapixels). The property of extremely large size for a single image also makes a histopathology image dataset be considered large-scale, even if the number of images in the dataset is limited.ResultsIn this paper, we propose leveraging deep convolutional neural network (CNN) activation features to perform classification, segmentation and visualization in large-scale tissue histopathology images. Our framework transfers features extracted from CNNs trained by a large natural image database, ImageNet, to histopathology images. We also explore the characteristics of CNN features by visualizing the response of individual neuron components in the last hidden layer. Some of these characteristics reveal biological insights that have been verified by pathologists. According to our experiments, the framework proposed has shown state-of-the-art performance on a brain tumor dataset from the MICCAI 2014 Brain Tumor Digital Pathology Challenge and a colon cancer histopathology image dataset.ConclusionsThe framework proposed is a simple, efficient and effective system for histopathology image automatic analysis. We successfully transfer ImageNet knowledge as deep convolutional activation features to the classification and segmentation of histopathology images with little training data. CNN features are significantly more powerful than expert-designed features.

Oral cancer is a prevalent disease happening in the head and neck region. Due to the high occurrence rate and serious consequences of oral cancer, an accurate diagnosis of malignant oral tumors is a major priority. Thus, early diagnosis is very effective to give the patient a prompt response to treatment. The most efficient way for diagnosing oral cancer is from histopathological imaging, which provides a detailed view of inside cells. Accurate and automatic classification of oral histopathological images remains a difficult task due to the complex nature of cell images, staining methods, and imaging conditions. The use of deep learning in imaging techniques and computational diagnostics can assist doctors and physicians in automatically analysing Oral Squamous Cell Carcinoma biopsy images in a timely and efficient manner. Thus, it reduces the operational workload of the pathologist and enhance patient management. Training deeper neural networks takes considerable time and requires a lot of computing resources, due to the complexity of the network and the gradient diffusion problem. With this motivation and inspired by ResNet's significant successes to handle the gradient diffusion problem, in this study we suggest the novel improved ResNet-based model for the automated multistage classification of oral histopathology images. Three prospective candidate model blocks are presented, analyzed, and the best candidate model is chosen as the optimal one which can efficiently classify the oral lesions into well-differentiated, moderately-differentiated and poorly-differentiated in significantly reduced time, with 97.59% accuracy.

Breast cancer is one of the primary causes of cancer-related deaths among women globally. Timely and accurate classification of histopathological images is critical for improving patient outcomes. This study conducts a comparative evaluation of two deep learning architectures—ResNet50V2 and ConvNeXt-Tiny—for binary classification of breast histopathology images into benign and malignant categories. The models were trained and evaluated on a large, balanced dataset containing over 570,000 images, divided into training, validation, and test sets. Performance was assessed using standard metrics including accuracy, precision, recall, F1-score, ROC-AUC, and PR-AUC. To enhance interpretability, Grad-CAM visualizations were employed to highlight class-discriminative regions. Results indicate that although both models reach similar accuracy (~91%), ConvNeXt-Tiny exhibits slightly better precision, while ResNet50V2 demonstrates marginally improved recall, reflecting their different sensitivities. These insights may help guide model selection in clinical contexts where the balance between false positives and false negatives is critical.

Breast cancer is one of the most common cancers occurring in women and is the main cause of mortality among women aged 20 to 59. Detection of breast cancer in the early stage increases survival rate to 80%, and the rate decreases to around 40% if diagnosed in its later stage. There exists significant need to diagnose breast cancer in its early stage itself among women suspected with the disease. The hematoxylin and eosin (H&E)–stained histopathology tissue samples taken by pathologists from suspected breast areas are viewed with whole slide imaging (WSI) and can be stored as digital histopathology images. Manual analysis of histopathology images is time-consuming and leads to inter- and intraobserver variability. Hence, automated classification methods are in research focus. Breast tumors are classified as benign and malignant tumors, which are non-cancerous and cancerous tumors, respectively. Currently, deep learning through convolutional neural networks is an emerging technology and has proven to be successful for image segmentation and classification applications. These deep CNNs require large labeled datasets, which are lacking in the field of medicine, especially for breast cancer images. Also, high computational power, time, and memory are required if CNN is to be trained from scratch. To overcome this, transfer learning from natural images like ImageNet, comprising of 1.2 million natural images belonging to 1,000 classes, is used. Pretrained models like VGG16, ResNet50, Inception, AlexNet, and DenseNet are employed for transfer learning, and fine-tuning is to be performed for refinement. In the proposed method, four different network architectures, namely, AlexNet, VGG16, Inception v3, and DenseNet121, are used for classification of histopathological images using transfer learning. The top dense layers of these architectures are removed, and custom dense layers are added for classification. Also, the weights of the last two layers are fine-tuned with the histopathology input images dataset. The publicly available breast cancer hisopathology images dataset BreakHis is used for validation of the proposed method. The experimental results prove that transfer learning–based CNN gives better classification accuracy compared to networks learned from scratch. Also, it is inferred from the experimental results that the pretrained model of DenseNet121 gives the highest classification accuracy of 0.9520 compared to the other models and state-of-the-art methods.

The application of machine learning techniques to histopathology images enables advances in the field, providing valuable tools that can speed up and facilitate the diagnosis process. The classification of these images is a relevant aid for physicians who have to process a large number of images in long and repetitive tasks. This work proposes the adoption of metric learning that, beyond the task of classifying images, can provide additional information able to support the decision of the classification system. In particular, triplet networks have been employed to create a representation in the embedding space that gathers together images of the same class while tending to separate images with different labels. The obtained representation shows an evident separation of the classes with the possibility of evaluating the similarity and the dissimilarity among input images according to distance criteria. The model has been tested on the BreakHis dataset, a reference and largely used dataset that collects breast cancer images with eight pathology labels and four magnification levels. Our proposed classification model achieves relevant performance on the patient level, with the advantage of providing interpretable information for the obtained results, which represent a specific feature missed by the all the recent methodologies proposed for the same purpose.

Histopathological image classification is an important task in medical image analysis. Recent approaches generally rely on weakly supervised learning due to the ease of acquiring case-level labels from pathology reports. However, patch-level classification is preferable in applications where only a limited number of cases are available or when local prediction accuracy is critical. On the other hand, acquiring extensive datasets with localized labels for training is not feasible. In this paper, we propose a semi-supervised patch-level histopathological image classification model, named CLASS-M, that does not require extensively labeled datasets. CLASS-M is formed by two main parts: a contrastive learning module that uses separated Hematoxylin images and Eosin images generated through an adaptive stain separation process, and a module with pseudo-labels using MixUp. We compare our model with other state-of-the-art models on two clear cell renal cell carcinoma datasets. We demonstrate that our CLASS-M model has the best performance on both datasets. Our code is available at github.com/BzhangURU/Paper_CLASS-M/tree/main.

In this research paper we are introducing a classification approach for determining the texture feature and the subsequent classification of histopathological digital image i.e. applied computer-aided grading of follicular lymphoma (FL) and Neuroblastoma (NB) from whole-slide tissue samples. Basic idea behind this research is to distinguish among nuclei, cytoplasm, extracellular material and red blood cells from H&E stained input image so that doctors (radiologist) can provide better judgment during the prognosis of histopathological image that sometimes wrongly concluded. In this study we proposed a noble algorithm in which we convolve our H&E stained pathological images with 12 different orientation masks, resulting in an output of 12 different representations (corresponding to 12 different orientations) of our H&E stained input image. The information included in the 12 representations coming from the application of Gaussian filter is summarized in twelve images that correspond to each of the orientations used in the filters. We then combine these 12 images into one textured image represented as a 3-dimensional representation of input image. Experimental results on FL & NB demonstrate that the proposed approach outperforms the gray level based texture analysis.

Oral squamous cell carcinoma (OSCC) is a malignancy that destroys the ability of the tissues surrounding the mouth to develop layers and membranes. Automated early diagnosis of oral histopathological images has allowed for the successful diagnosis of oral cancer, thanks to recent advancements in Deep Learning (DL) for biomedical image classification. By using a convolutional neural network (CNN) model based on deep learning for the initial analysis of oral squamous cell carcinoma (OSCC), this work aims to automate the classification of benign and malignant oral biopsy histopathological images. For this study, the CNN model Inception-Resnet-V2 is selected using the transfer learning approach. To enhance OSCC detection, additional layers are incorporated into this pretrained model. By mining a repository of oral cancer histopathology images, we can gauge how well these tweaked models perform. We examine the modified structure of the pre-trained Inception-Resnet-V2 model and suggest a DL-CNN model that uses it. With an accuracy of 91.78%, it has outperformed in terms of performance metrics.