SHIRC: A simultaneous sparsity model for histopathological image representation and classification

Deep neural network incorporating domain and resolution transformations model for histopathological image classification

Breast cancer is a big concern for women due to its higher mortality compared to other cancers. Objective and accurate early diagnosis is primordial for the treatment and survival improvement of patients. Histopathological image classification is considered the gold standard and is usually the last and most dependent diagnosis approach for doctors to make patient treatment proposals. In particular, recent deep learning-based methods provide remarkable classification results. However, these methods ignore rationale or logical explanation that is important for diagnosis reliability and human-level understanding. This paper proposes a multi-instance classification network (MICNet) with the mechanism of visual explanation to achieve the explainable classification of histopathological breast cancer images. The method uses a simple two-dimensional convolution kernel to generate explanation maps (i.e., visual explanation) through features coming from the end of the feature extractor in the VGG11 model pre-trained by ImageNet. Multiple instance learning (MIL) based on mirror padding and overlap cropping is adopted to improve the network’s classification performance. We also design a weighted average pooling method to encourage the network to learn more accurate visual explanation. Experiments on BreakHis and Camelyon16 patch-based datasets demonstrate that our MICNet outperforms other CNN models in classification and is able to provide a logical visual explanation that supports the network’s prediction.

The field of histopathological image analysis has evolved significantly with the advent of digital pathology, leading to the development of automated models capable of classifying tissues and structures within diverse pathological images. Artificial intelligence algorithms, such as convolutional neural networks, have shown remarkable capabilities in pathology image analysis tasks, including tumor identification, metastasis detection, and patient prognosis assessment. However, traditional manual analysis methods have generally shown low accuracy in diagnosing colorectal cancer using histopathological images. This study investigates the use of AI in image classification and image analytics using histopathological images using the histogram of oriented gradients method. The study develops an AI-based architecture for image classification using histopathological images, aiming to achieve high performance with less complexity through specific parameters and layers. In this study, we investigate the complicated state of histopathological image classification, explicitly focusing on categorizing nine distinct tissue types. Our research used open-source multi-centered image datasets that included records of 100.000 non-overlapping images from 86 patients for training and 7180 non-overlapping images from 50 patients for testing. The study compares two distinct approaches, training artificial intelligence-based algorithms and manual machine learning models, to automate tissue classification. This research comprises two primary classification tasks: binary classification, distinguishing between normal and tumor tissues, and multi-classification, encompassing nine tissue types, including adipose, background, debris, stroma, lymphocytes, mucus, smooth muscle, normal colon mucosa, and tumor. Our findings show that artificial intelligence-based systems can achieve 0.91 and 0.97 accuracy in binary and multi-class classifications. In comparison, the histogram of directed gradient features and the Random Forest classifier achieved accuracy rates of 0.75 and 0.44 in binary and multi-class classifications, respectively. Our artificial intelligence-based methods are generalizable, allowing them to be integrated into histopathology diagnostics procedures and improve diagnostic accuracy and efficiency. The CNN model outperforms existing machine learning techniques, demonstrating its potential to improve the precision and effectiveness of histopathology image analysis. This research emphasizes the importance of maintaining data consistency and applying normalization methods during the data preparation stage for analysis. It particularly highlights the potential of artificial intelligence to assess histopathological images.

MF-OMKT: Model fusion based on online mutual knowledge transfer for breast cancer histopathological image classification

BackgroundHistopathology image analysis is a gold standard for cancer recognition and diagnosis. Automatic analysis of histopathology images can help pathologists diagnose tumor and cancer subtypes, alleviating the workload of pathologists. There are two basic types of tasks in digital histopathology image analysis: image classification and image segmentation. Typical problems with histopathology images that hamper automatic analysis include complex clinical representations, limited quantities of training images in a dataset, and the extremely large size of singular images (usually up to gigapixels). The property of extremely large size for a single image also makes a histopathology image dataset be considered large-scale, even if the number of images in the dataset is limited.ResultsIn this paper, we propose leveraging deep convolutional neural network (CNN) activation features to perform classification, segmentation and visualization in large-scale tissue histopathology images. Our framework transfers features extracted from CNNs trained by a large natural image database, ImageNet, to histopathology images. We also explore the characteristics of CNN features by visualizing the response of individual neuron components in the last hidden layer. Some of these characteristics reveal biological insights that have been verified by pathologists. According to our experiments, the framework proposed has shown state-of-the-art performance on a brain tumor dataset from the MICCAI 2014 Brain Tumor Digital Pathology Challenge and a colon cancer histopathology image dataset.ConclusionsThe framework proposed is a simple, efficient and effective system for histopathology image automatic analysis. We successfully transfer ImageNet knowledge as deep convolutional activation features to the classification and segmentation of histopathology images with little training data. CNN features are significantly more powerful than expert-designed features.

Medical image analysis has become a topic under the spotlight in recent years. There is a significant progress in medical image research concerning the usage of machine learning. However, there are still numerous questions and problems awaiting answers and solutions, respectively. In the present study, comparison of three classification models is conducted using features extracted using local binary patterns, the histogram of gradients, and a pre-trained deep network. Three common image classification methods, including support vector machines, decision trees, and artificial neural networks are used to classify feature vectors obtained by different feature extractors. We use KIMIA Path960, a publicly available dataset of 960 histopathology images extracted from 20 different tissue scans to test the accuracy of classification and feature extractions models used in the study, specifically for the histopathology images. SVM achieves the highest accuracy of 90.52% using local binary patterns as features which surpasses the accuracy obtained by deep features, namely 81.14%.

The classification of histopathological imagery has garnered significant interest among researchers in the last decade due to the valuable outcome that could be obtained from classifying such microscopic fractions. This would significantly contribute to examining biological interactions. To do so, researchers in the literature have employed various machine-learning classification algorithms. However, the key to success for a precise classification task lies in utilizing an appropriate set of features with proper color space channels that can extract important characteristics from the histopathological images. However, the literature shows a limited feature extraction method with limited color space channel utilization. The accuracy of classification is significantly influenced by the color channels. This study aims to extend feature learning by using a wide range of feature extraction methods and different employs distinct color channels to categorize histopathological imagery. It utilizes two benchmark datasets pertinent to the imagery of breast and prostate cancer for the study. Additionally, the study incorporated a series of pre-processing procedures, such as segmenting the images and extracting salient features. Image segmentation in this research was conducted using four distinct methodologies, encompassing Lumen, Nuclei, Cytoplasm, and Stroma. The reason behind selecting such feature extraction methods and color channels is their popularity and differences, which ensure diversity. Finally, the study utilized SVM-RFE to select features and classify images. The assessment employed metrics such as sensitivity, f1-score, and accuracy. The empirical findings demonstrate that the RGB color space yielded superior performance particularly on the sensitivity evaluation metrics across both datasets, underscoring RGB’s efficacy in classifying histopathological images.

Accurate histopathological image classification plays a crucial role in cancer detection and diagnosis. In automated cancer detection methods, extraction of histological features of malignant and benign tissues is a challenging task. This paper presents a modified approach on octave convolution to extract high and low-frequency features which help to provide a comprehensive representation of histopathological images. Proposed octave convolution model is used to perform histopathological image classification using three different optimization strategies. Firstly, an optimal alpha value of 0.5 is used to give equal importance to both high-frequency and low-frequency feature maps. This balanced approach ensures that the model effectively considers critical high-frequency features as well as low-frequency features of cancerous tissues. Secondly, high-frequency and low-frequency feature maps are extracted and down sampled into half the spatial dimension size to reduce the computational cost compared to standard CNN. Thirdly, training and validation was conducted using ReLU, PReLU, LeakyReLU, ELU, GELU and Swish activation functions. From the experiment, it was concluded that PReLU is the best activation function for capturing intricate patterns inherent in cancer-related histopathological images. Combining all these optimization strategies, the proposed method proved to provide a classification accuracy of 93% and also to reduce the computational cost by 50%. Performance validation against pre-trained models, CNN variants and vision transformer-based models has also been conducted, which proved superior performance of the proposed model.

Biopsy is the gold standard for definitive diagnosis of cancer. Since the histopathological images obtained in the biopsy process are quite large and contain too much detail, their analysis is quite difficult and time-consuming. Therefore, developing a system that can alleviate the workload of pathologists and support them in making fast and accurate diagnoses is of great importance. In this study, a method that includes feature extraction, feature ranking, feature selection and classification processes is proposed for the classification of histopathological images. The obtained results showed that the presented method is quite successful in the rapid and high-accuracy classification of histopathological images.

In this research paper we are introducing a classification approach for determining the texture feature and the subsequent classification of histopathological digital image i.e. applied computer-aided grading of follicular lymphoma (FL) and Neuroblastoma (NB) from whole-slide tissue samples. Basic idea behind this research is to distinguish among nuclei, cytoplasm, extracellular material and red blood cells from H&E stained input image so that doctors (radiologist) can provide better judgment during the prognosis of histopathological image that sometimes wrongly concluded. In this study we proposed a noble algorithm in which we convolve our H&E stained pathological images with 12 different orientation masks, resulting in an output of 12 different representations (corresponding to 12 different orientations) of our H&E stained input image. The information included in the 12 representations coming from the application of Gaussian filter is summarized in twelve images that correspond to each of the orientations used in the filters. We then combine these 12 images into one textured image represented as a 3-dimensional representation of input image. Experimental results on FL & NB demonstrate that the proposed approach outperforms the gray level based texture analysis.

Most popular image classification methods mainly focus on classification ability rather than recognizing new things. However, human lay emphasis on cognition first and then classification, which is closely related to human memory system. Though many memory models have been proposed, they are studied in word list whereas the reports about natural images are still limited. This paper proposes a memory model for image recognition and classification based on convolutional neural network and Bayesian decision. First the image feature is extracted by convolutional neural network and stored in binary form. Then the representation, storage and retrieval processes of visual images are modeled. The test image feature vector is matched in parallel to the studied image vectors, and the likelihood values are calculated. Finally, the odd that the test image belongs to a new class is computed based on all likelihood values. If the odd value is greater than a certain threshold, the test image is regarded as new; otherwise, the Bayesian decision rule for image classification is performed. Experimental results on Caltech-101 and Caltech-256 datasets show that the proposed method can perform well in image recognition and classification tasks. And the hit probability of the method is higher than two typical methods, SRC and ELM, at present while the false alarm rate is far lower than them.

Histopathological image classification is an important task in medical image analysis. Recent approaches generally rely on weakly supervised learning due to the ease of acquiring case-level labels from pathology reports. However, patch-level classification is preferable in applications where only a limited number of cases are available or when local prediction accuracy is critical. On the other hand, acquiring extensive datasets with localized labels for training is not feasible. In this paper, we propose a semi-supervised patch-level histopathological image classification model, named CLASS-M, that does not require extensively labeled datasets. CLASS-M is formed by two main parts: a contrastive learning module that uses separated Hematoxylin images and Eosin images generated through an adaptive stain separation process, and a module with pseudo-labels using MixUp. We compare our model with other state-of-the-art models on two clear cell renal cell carcinoma datasets. We demonstrate that our CLASS-M model has the best performance on both datasets. Our code is available at github.com/BzhangURU/Paper_CLASS-M/tree/main.

In Health Care, the medical image processing becomes a necessary marathon for the Computer Aided Diagnostic (CAD) systems. Blobs are the heterogeneous small parts of an image, which helps in finding and locating the abnormalities and damages of the body organs from the digital medical images. For the disease early diagnosis and staging purpose, the blobs’ location, size, shape, center and radius like properties should be calculated from the medical images. As on, many former researchers were proposed several blob detections models and algorithms to accurately find the blobs from the medical images. Although many researchers proposed various blob detection models, they are still facing several limitations in detection, due to the indistinct boundaries and the diversity in shape and distribution of the blobs. As part of the research on blob detection, in this survey paper we are presenting the essential information regarding the medical image blob detection and classification models.

Oral cancer is a prevalent disease happening in the head and neck region. Due to the high occurrence rate and serious consequences of oral cancer, an accurate diagnosis of malignant oral tumors is a major priority. Thus, early diagnosis is very effective to give the patient a prompt response to treatment. The most efficient way for diagnosing oral cancer is from histopathological imaging, which provides a detailed view of inside cells. Accurate and automatic classification of oral histopathological images remains a difficult task due to the complex nature of cell images, staining methods, and imaging conditions. The use of deep learning in imaging techniques and computational diagnostics can assist doctors and physicians in automatically analysing Oral Squamous Cell Carcinoma biopsy images in a timely and efficient manner. Thus, it reduces the operational workload of the pathologist and enhance patient management. Training deeper neural networks takes considerable time and requires a lot of computing resources, due to the complexity of the network and the gradient diffusion problem. With this motivation and inspired by ResNet's significant successes to handle the gradient diffusion problem, in this study we suggest the novel improved ResNet-based model for the automated multistage classification of oral histopathology images. Three prospective candidate model blocks are presented, analyzed, and the best candidate model is chosen as the optimal one which can efficiently classify the oral lesions into well-differentiated, moderately-differentiated and poorly-differentiated in significantly reduced time, with 97.59% accuracy.

Histopathological image contains rich pathological information that is valued for the aided diagnosis of many diseases such as cancer. An important issue in histopathological image classification is how to learn a high-quality discriminative dictionary due to diverse tissue pattern, a variety of texture, and different morphologies structure. In this paper, we propose a discriminative dictionary learning algorithm with pairwise local constraints (PLCDDL) for histopathological image classification. Inspired by the one-to-one mapping between dictionary atom and profile, we learn a pair of discriminative graph Laplacian matrices that are less sensitive to noise or outliers to capture the locality and discriminating information of data manifold by utilizing the local geometry information of category-specific dictionaries rather than input data. Furthermore, graph-based pairwise local constraints are designed and incorporated into the original dictionary learning model to effectively encode the locality consistency with intra-class samples and the locality inconsistency with inter-class samples. Specifically, we learn the discriminative localities for representations by jointly optimizing both the intra-class locality and inter-class locality, which can significantly improve the discriminability and robustness of dictionary. Extensive experiments on the challenging datasets verify that the proposed PLCDDL algorithm can achieve a better classification accuracy and powerful robustness compared with the state-of-the-art dictionary learning methods. Graphical abstract The proposed PLCDDL algorithm. 1) A pair of graph Laplacian matrices are first learned based on the class-specific dictionaries. 2) Graph-based pairwise local constraints are designed to transfer the locality for coding coefficients. 3) Class-specific dictionaries can be further updated.