Multipatch-GLCM for Texture Feature Extraction on Classification of the Colon Histopathology Images using Deep Neural Network with GPU Acceleration

BackgroundHistopathology image analysis is a gold standard for cancer recognition and diagnosis. Automatic analysis of histopathology images can help pathologists diagnose tumor and cancer subtypes, alleviating the workload of pathologists. There are two basic types of tasks in digital histopathology image analysis: image classification and image segmentation. Typical problems with histopathology images that hamper automatic analysis include complex clinical representations, limited quantities of training images in a dataset, and the extremely large size of singular images (usually up to gigapixels). The property of extremely large size for a single image also makes a histopathology image dataset be considered large-scale, even if the number of images in the dataset is limited.ResultsIn this paper, we propose leveraging deep convolutional neural network (CNN) activation features to perform classification, segmentation and visualization in large-scale tissue histopathology images. Our framework transfers features extracted from CNNs trained by a large natural image database, ImageNet, to histopathology images. We also explore the characteristics of CNN features by visualizing the response of individual neuron components in the last hidden layer. Some of these characteristics reveal biological insights that have been verified by pathologists. According to our experiments, the framework proposed has shown state-of-the-art performance on a brain tumor dataset from the MICCAI 2014 Brain Tumor Digital Pathology Challenge and a colon cancer histopathology image dataset.ConclusionsThe framework proposed is a simple, efficient and effective system for histopathology image automatic analysis. We successfully transfer ImageNet knowledge as deep convolutional activation features to the classification and segmentation of histopathology images with little training data. CNN features are significantly more powerful than expert-designed features.

Deep neural network incorporating domain and resolution transformations model for histopathological image classification

The histopathology images are effective in identifying the location and level of cancer. In this chapter, a novel model is implemented for an automatic classification of histopathological images related to lung tissues. Initially, the color normalization technique is applied for improving the contrast of the histopathological images, which are acquired from the LC25000 lung histopathological image dataset. Additionally, the cancer segmentation is accomplished utilizing saliency driven region edge-based top-down level set (SDREL). Further, the feature descriptors—Alexnet and Gray Level Co-Occurrence Matrix (GLCM) features—were used for extracting the feature vectors from the segmented histopathology images. Lastly, the enhanced grasshopper optimization algorithm (EGOA) and random forest classifier were used for optimal feature selection and lung tissue classification. The simulation result shows that the EGOA-random forest model obtained 98.50% of accuracy on the LC25000 lung histopathological image dataset.

Histopathology image classification can offer great support towards breast cancer identification. In this paper, an Enhanced fuzzy min max (EFMM) neural network is considered and applied to histopathological images. Gray level co-occurrence matrix (GLCM) based feature extractor is employed to extract the textural information from each histopathology image and then these information are applied on EFMM model to accurately classify the histopathology images. In this work, Breast cancer histopathology (BreaKHis) database is considered, which comprises malignant and benign histopathology images at four different magnifications. Simulation outcomes depict that the magnification factor of $100 \times$ provides greater recognition rate than other magnifying factors.

Oral squamous cell carcinoma (OSCC) is a malignancy that destroys the ability of the tissues surrounding the mouth to develop layers and membranes. Automated early diagnosis of oral histopathological images has allowed for the successful diagnosis of oral cancer, thanks to recent advancements in Deep Learning (DL) for biomedical image classification. By using a convolutional neural network (CNN) model based on deep learning for the initial analysis of oral squamous cell carcinoma (OSCC), this work aims to automate the classification of benign and malignant oral biopsy histopathological images. For this study, the CNN model Inception-Resnet-V2 is selected using the transfer learning approach. To enhance OSCC detection, additional layers are incorporated into this pretrained model. By mining a repository of oral cancer histopathology images, we can gauge how well these tweaked models perform. We examine the modified structure of the pre-trained Inception-Resnet-V2 model and suggest a DL-CNN model that uses it. With an accuracy of 91.78%, it has outperformed in terms of performance metrics.

Prediction of Malignant Cell Infiltration Patterns with Texture Features of Biopsy-Correlated Positron Emission Tomography of Osteolytic Lesions in Multiple Myeloma

Diagnosis of different breast cancer stages using histopathology whole slide images is the gold standard in grading the tissue metastasis. Traditional diagnosis involves labor intensive procedures and is prone to human errors. Computer aided diagnosis assists medical experts as a second opinion tool in early detection which prevents further proliferation. Computing facilities have emerged to an extent where algorithms can attain near human accuracy in prediction of diseases, offering better treatment to curb further proliferation. The work introduced in the paper provides an interface in mobile platform, which enables the user to input histopathology image and obtain the prediction results with its class probability through embedded web-server. The trained deep convolutional neural networks model is deployed into a microcomputer-based embedded system after hyper-parameter tuning, offering congruent performance. The implementation results show that the embedded platform with custom-trained CNN model is suitable for medical image classification, as it takes less execution time and mean prediction time. It is also noticed that customized CNN classifier model outperforms pre-trained models when used in embedded platforms for prediction and classification of histopathology images. This work also emphasizes the relevance of portable and flexible embedded device in real time clinical applications.

The field of histopathological image analysis has evolved significantly with the advent of digital pathology, leading to the development of automated models capable of classifying tissues and structures within diverse pathological images. Artificial intelligence algorithms, such as convolutional neural networks, have shown remarkable capabilities in pathology image analysis tasks, including tumor identification, metastasis detection, and patient prognosis assessment. However, traditional manual analysis methods have generally shown low accuracy in diagnosing colorectal cancer using histopathological images. This study investigates the use of AI in image classification and image analytics using histopathological images using the histogram of oriented gradients method. The study develops an AI-based architecture for image classification using histopathological images, aiming to achieve high performance with less complexity through specific parameters and layers. In this study, we investigate the complicated state of histopathological image classification, explicitly focusing on categorizing nine distinct tissue types. Our research used open-source multi-centered image datasets that included records of 100.000 non-overlapping images from 86 patients for training and 7180 non-overlapping images from 50 patients for testing. The study compares two distinct approaches, training artificial intelligence-based algorithms and manual machine learning models, to automate tissue classification. This research comprises two primary classification tasks: binary classification, distinguishing between normal and tumor tissues, and multi-classification, encompassing nine tissue types, including adipose, background, debris, stroma, lymphocytes, mucus, smooth muscle, normal colon mucosa, and tumor. Our findings show that artificial intelligence-based systems can achieve 0.91 and 0.97 accuracy in binary and multi-class classifications. In comparison, the histogram of directed gradient features and the Random Forest classifier achieved accuracy rates of 0.75 and 0.44 in binary and multi-class classifications, respectively. Our artificial intelligence-based methods are generalizable, allowing them to be integrated into histopathology diagnostics procedures and improve diagnostic accuracy and efficiency. The CNN model outperforms existing machine learning techniques, demonstrating its potential to improve the precision and effectiveness of histopathology image analysis. This research emphasizes the importance of maintaining data consistency and applying normalization methods during the data preparation stage for analysis. It particularly highlights the potential of artificial intelligence to assess histopathological images.

In this research paper we are introducing a classification approach for determining the texture feature and the subsequent classification of histopathological digital image i.e. applied computer-aided grading of follicular lymphoma (FL) and Neuroblastoma (NB) from whole-slide tissue samples. Basic idea behind this research is to distinguish among nuclei, cytoplasm, extracellular material and red blood cells from H&E stained input image so that doctors (radiologist) can provide better judgment during the prognosis of histopathological image that sometimes wrongly concluded. In this study we proposed a noble algorithm in which we convolve our H&E stained pathological images with 12 different orientation masks, resulting in an output of 12 different representations (corresponding to 12 different orientations) of our H&E stained input image. The information included in the 12 representations coming from the application of Gaussian filter is summarized in twelve images that correspond to each of the orientations used in the filters. We then combine these 12 images into one textured image represented as a 3-dimensional representation of input image. Experimental results on FL & NB demonstrate that the proposed approach outperforms the gray level based texture analysis.

An experimental study on classification of thyroid histopathology images using transfer learning

Gray Level Co-occurrence Matrix (GLCM), one of the best known texture analysis methods, estimates image properties related to second-order statistics. These image properties commonly known as texture features can be used for image classification, image segmentation, and remote sensing applications. In this paper, we present an FPGA based co-processor to accelerate the extraction of texture features from GLCM. Handel-C, a recently developed C-like programming language for hardware design, has been used for the FPGA implementation of GLCM texture features measurement. Results show that the FPGA has better speed performances when compared to a general purpose processor for the extraction of GLCM features.

Pathology diagnosis of colorectal cancer is time-consuming and requires a high level of expertise. However, it is an essential step towards establishing the adequate treatment. The need to analyse a large number of these histopathological images calls for automatic tools capable of aiding pathologists in this arduous task. Deep learning techniques, together with the wealth of data available nowadays, provide a promising candidate for such job. Adopting state-of-the-art artificial intelligence algorithms, we developed a model to accurately detect colorectal cancer in digitalised histopathological whole-slide images. Our end-to-end approach uses the principles of multiple-instance learning combined with deep convolutional neural networks in order to fully leverage the information contained within each image and make robust predictions at the patient's level. The model also allows to highlight the areas in the slide most likely to harbour tumour tissue. Given the finite computational resources available, working at maximum resolution can be detrimental. Therefore, we explored the impact of lowering the working image resolution. The algorithms were trained and validated on a subset of more than 1300 patients of the Molecular Epidemiology of Colorectal Cancer study with histopathology images available. These images gave rise to [Formula: see text] tiles of [Formula: see text] pixels each. Once we identified the best-performing model we put it to the test on images from The Cancer Genome Atlas. We obtained the best outcomes working at 4 μm/pix, achieving the following metrics on the test dataset: F1-Score of 0.96, a Matthews correlation coefficient of 0.92 and an area under the receiver operating characteristic curve of 0.99. These results are exceptional and prove that computational costs can be reduced while keeping the performance up to standard.

The increasing use of automated cancer diagnosis based on histopathological images is significant because it is likely to increase the accuracy of diagnosis and decrease the workload on pathologists. This research introduces a hybrid methodology that integrates Haralick texture features with deep learning strategies to improve the automated identification of cancer in human tissue specimens. Haralick texture features, obtained from the Gray-Level Co-Occurrence Matrix (GLCM), offer essential information regarding the spatial relationships and textural characteristics present in tissue samples, which frequently signal the presence of cancerous alterations. The integration of these interpretable texture features with convolutional neural networks (CNNs) makes our approach use the strengths of both traditional texture analysis and deep learning's ability to learn complex patterns. This will process raw image data with the Haralick features leading to a powerful model that, hopefully, makes better classification along with interpretability. These features, handcrafted and capturing features like contrast, correlation, energy, and homogeneity, provide differences in the texture of the tissue that classify between normal cells and abnormal ones. Experimental results were presented in distinguishing cancerous and non-cancerous tissues with high accuracy. The diagnostic efficiency was also enhanced while at the same time providing a reliable and scalable tool that may assist pathologists during clinical decision-making, which consequently leads to efficient cancer diagnosis and patient care.

Automated classification of histopathological images is an important research problem in medical imaging. Digital histopathology exhibits two principally distinct characteristics: 1) invariably histopathological images are multi-channel (color) with key geometric information spread across the color channels instead of being captured by luminance alone, and 2) the richness of geometric structures in such tissue imagery makes feature extraction for classification very demanding. Inspired by recent work in the use of sparsity for single channel image classification, we propose a new simultaneous Sparsity model for multi-channel Histopathological Image Representation and Classification (SHIRC). Essentially, we represent a multi-channel histopathological image as a sparse linear combination of training examples under suitable channel-wise constraints and classification is performed by solving a newly formulated simultaneous sparsity-based optimization problem. Experiments on two challenging real-world image databases: 1) provided by pathologists of the Animal Diagnostics Lab (ADL) at Pennsylvania State University, and 2) histopathological images corresponding to intraductal breast lesions [1], reveal the merits of the proposed SHIRC model over state of the art alternatives.

Cancer is now the leading causes of death. During treatment, if an abnormal mass is detected by routine mammography after histological examination, a biopsy will be performed for further diagnosis. However, the time required to review and evaluate the biopsy slide is very long. An effective algorithm that can identify cancer tissues and reduce the rate of misdiagnosis is urgently needed. The current research methods mainly include: Capsule Network, and Deep Convolutional Neural Networks (CNNs) used in image classification, etc. This paper mainly uses Capsule Network, CNN, CNN trained on Histogram of Oriented Gradient (HOG) images, and Grey Level Co-occurrence Matrix (GLCM) to classify benign and malignant images of the tumor micro-biopsy images. The first step is to download the breast tumor micro-biopsy images from Breakhis. The second step is to preprocess the images, mainly image enhancement, augmentation, and HOG feature extraction. In the third step, the processed image data is used to train CNN and Capsule Network. The last step is to visualize the accuracy of model training and use confusion matrix to calculate the accuracy of image classification, recall rate, and so on. The results show that the accuracy of CNN with the help of transfer learning can reach 98.32%, the accuracy of CNN trained with HOG image is only 82.99%, the accuracy of CNN trained with GLCM is 92.79%, and the accuracy of capsule network can reach 92.39%.