Page Segmentation for Historical Handwritten Document Images Using Color and Texture Features

In this chapter, a content-based image retrieval technique based on the concept of region-based image retrieval has been described. This technique integrates color, texture, and shape features using local binary patterns (LBPs). In this technique, the image is divided into a fixed number of blocks and from each block LBP-based color, texture, and shape features are computed. The color and texture features are extracted using LBP histograms of quantized color image and gray-level images, respectively. Shape features are computed using the binary edge map obtained using Sobel edge detector from each block. All three features are combined to make a single completed binary region descriptor (CBRD) represented in the LBP way. To support region-based retrieval, an effective region code-based scheme is employed. In this technique, the spatial relative locations of objects are also considered to increase the retrieval accuracy.

Image retrieval is the process of finding images in the database that are similar to the query image by measuring how close the feature values of the query image are to other images. Image retrieval is currently dominated by approaches that combine several different representations or features. The optimal weight of each feature is needed in combining the image features such as color features, texture features, and shape features. In this study, we use a multi-layer perceptron artificial neural network (MLP) method to obtain feature weights automatically and simultaneously look for optimal weights. The color moment is used to find nine color features, Gray Level Co-occurrence Matrix (GLCM) to find four texture features, and Hu Moment to find seven shape features totaling 20 neurons and all of these features become the input layer in our MLP network. Three neurons in output layers become the automatic weight of each feature. These weights are used to combine each feature's role in obtaining the relevant image. Euclidean Distance is used to measure similarity. The average precision values obtained using automatic feature weights are 93.94% for the synthetic dataset, 91.19% for the Coil-100 dataset, and 54.31% for the Wang dataset. These results have an average difference of 5.06% with the target so automatic feature weighting works well. This value is obtained at a hidden layer size of 11 and a learning rate of 0.1. In addition, the use of automatic feature weighting gives more accurate results compared to manual feature weighting.

Radiomics has shown potential in disease diagnosis, but its feasibility for non-small cell lung carcinoma (NSCLC) subtype classification is unclear. This study aims to explore the diagnosis value of texture and colour features from positron emission tomography computed tomography (PET-CT) images in differentiation of NSCLC subtypes: adenocarcinoma (ADC) and squamous cell carcinoma (SqCC). Two patient cohorts were retrospectively collected into a dataset of 341 18F-labeled 2-deoxy-2fluoro-d-glucose ([18F] FDG) PET-CT images of NSCLC tumours (125 ADC, 174 SqCC, and 42 cases with unknown subtype). Quantification of texture and colour features was performed using freehand regions of interest. The relation between extracted features and commonly used parameters such as age, gender, tumour size, and standard uptake value (SUVmax) was explored. To classify NSCLC subtypes, support vector machine algorithm was applied on these features and the classification performance was evaluated by receiver operating characteristic curve analysis. There was a significant difference between ADC and SqCC subtypes in texture and colour features (P < 0.05); this showed that imaging features were significantly correlated to both SUVmax and tumour diameter (P < 0.05). When evaluating classification performance, features combining texture and colour showed an AUC of 0.89 (95% CI, 0.78–1.00), colour features showed an AUC of 0.85 (95% CI, 0.71–0.99), and texture features showed an AUC of 0.68 (95% CI, 0.48–0.88). DeLong’s test showed that AUC was higher for features combining texture and colour than that for texture features only (P = 0.010), but not significantly different from that for colour features only (P = 0.328). HSV colour features showed a similar performance to RGB colour features (P = 0.473). The colour features are promising in the refinement of NSCLC subtype differentiation, and features combining texture and colour of PET-CT images could result in better classification performance.

A new, semantically meaningful technique for querying the images from a spectral image database is proposed. The technique is based on the use of both color- and texture features. The color features are calculated from spectral images by using the Self-Organizing Map (SOM) when methods of Gray Level Co-occurrence Matrix (GLCM) and Local Binary Pattern (LBP) are used for constructing the texture features. The importance of texture features in a querying is seen in experimental results, which are given by using a real spectral image database. Also the differences between the results gained by the use of co-occurrence matrix and LBP are introduced.

Batik is a traditional craft of designing patterned fabrics which hold high artistic value in Sri Lankan culture, where hand-painted wax patterns are coloured using specialist dyeing methods to create the finished product. This paper presents a study of vision-based feature extraction of Batik images considering colour, texture and shape features to develop a comprehensive feature descriptor of Batik motifs. Wax drawn patterns are identified from the digital images of Batik motifs to retrieve an outline of patterns demarcating the different coloured layers generated by multiple stages of dyeing. Motifs with repetitive patterns are identified using the Local Binary Pattern (LBP) as a texture feature vector. Both RGB and L*a*b* colour schemes are studied in the representation of Batik motifs. The colour description is presented using Mini Batch K-Means which out-performed the widely used K-Means clustering method. Hu Moment Invariants are used for shape feature extraction, and Gray Level Co-occurrence Matrix (GLCM) for texture feature extraction. A comprehensive feature descriptor is developed to represent Batik designs, which could be used to recommend similar designs based on the shape and texture features of query images presented by the user.

We address the problem of localizing objects using color, texture and shape. Given a handrawn sketch for querying an object shape, and its color and texture, the algorithm automatically searches the database images for objects which meet the query attributes. The database images do not need to be presegmented or annotated. The proposed algorithm operates in two stages. In the first stage, we use local texture and color features to find a small number of candidate images, and identify regions in the candidate images which share similar texture and color as the query example. To speed up the processing, the texture and color features are directly extracted from the Discrete Cosine Transform (DCT) compressed domain. In the second stage, we use a deformable template matching method to match the query shape to the image edges at the locations which possess the desired texture and color attributes. This algorithm is different from the other content-based image retrieval algorithms in that: (i) no presegmentation of the database images is needed, and (ii) the color and texture features are directly extracted from the compressed images. Experimental results show that substantial computational savings can be achieved utilizing multiple image cues.

Object localization using color, texture and shape

The field of machine learning is growing in modern times, computational models are able to go beyond the performance of previous forms of artificial intelligence. The use of evaluation model ,selection of model and algorithm selecting techniques play an major role in machine learning study and also in field of industries. In this work, we made evaluation of various supervised, unsupervised machine learning classifiers for flower datasets. We made use of local features such as Histogram of gradient , Kaze, Local binary pattern(LBP) ,Oriented Fast and Rotated Brief( ORB), global features like Color Histograms, Haralick Textures , Hu Moments , fusion of both and Bag of visual words(BOVW) using Vocabulary builder K-Means clustering which represents color ,texture, shape features of image. Experiment is carried out on 20 classes of flower datasets with 100 images each. .Flower datasets have many characteristic in common like sunflower will be similar to daffodil in terms of color and texture .Hence to quantify the image we need to combine different feature descriptors like color, texture and shape features. We develop a Content based classification system to find efficiency comparison of different machine learning algorithms for classification and retrieval problems. Eleven classifiers mainly Support Vector Machine, K Nearest Neighbor, Gaussian Naive Bayes , CART, Kmeans, Linear Discriminant Analysis, Adaboost ,Logistic Regression, MLP, Random Forest, CNN are analyzed on the shape, color ,texture features. Experimentation are carried out and results are recorded using CPU as well as GPU on google cobalatory platform.

Content-Based Image Retrieval (CBIR) allows to automatically extracting target images according to objective visual contents of the image itself. Representation of visual features and similarity match are important issues in CBIR. Color, texture and shape information have been the primitive image descriptors in content-based image retrieval systems. This paper presents a fast and efficient image indexing and search system based on color and texture features. The color features are represented by combines 2-D histogram and statistical moments and texture features are represented by combines the direction measure and a gray level co-occurrence matrix (GLCM). The detailed experimental analysis is carried out using precision and recall ondataset Wang. The time analysis is also performed to compare processing speeds of the proposed method with the existing similar best. The experimental results demonstrated that proposed method achieved a better image recognition, and the accuracy of classification based on this method has been significantly improved. The performance is measured in terms of recall and precision; also the obtained performances are compared with several state-of-the-art algorithms and showed that our algorithm is simple, fast, and efficient in terms of results and memory. Keywords: Co-occurrence Matrix, Direction Measure, 2-D Histogram, Statistical Moments, CBIR, GLCM

Inspection of paddy seed varietal purity using machine vision and multivariate analysis

With the emerge of multimedia, communication and processing, a typical image database has a large volume of data. It is an essential to build an efficient retrieval system to browse through the entire database. In this paper we proposed precise Relevance Feed Back (RFB) Content Based Image Retrieval (CBIR) using multiple features based on interactive retrieval approach which will extensively reduces the semantic gap between low-level features and high-level semantics. Relevance Feed Back improves the retrieval accuracy of Content Based Image Retrieval(CBIR) by modifying the query based on the user's feedback in which the user can select the most relevant images and provide a weight of preference for each relevant image. In our approach we extracted multiple features by integrating color, texture and shape features with Relevance Feed Back. We extracted color features by cumulative histogram, texture feature are exploited by using Color co-occurrence matrix (CCM) and we describe the shape information contained in an image on the basis of its significant edges. We used Euclidean distance as the similarity measure. In our experiment we used Corel real-world image databases with 1000 images, divided into 10 categories, each category containing 100 images including landscapes, animals, plants, monuments, transport (cars, planes). Our results reflects that integrating color, texture and shape for retrieving similar images improves the retrieval performance with respect to retrieval accuracy and recall rate as compared with the classical color feature. During the experiment we also observed that incorporating Relevance Feed Back (RFB) with multiple features outperforms in comparison with multifeature vector without Relevance Feed Back method.

Rapid development of multimedia technologies made Content Based Image Retrieval (CBIR) an energetic research area for the researchers of multimedia domain. Texture and color features have been the primal descriptors for images in the field of CBIR. This paper proposed a new CBIR system by combining the both color and texture features. Color Layout Descriptor (CLD) from MPEG-7 is used for the color feature extraction while, Mean, variance, skewness, Kurtosis, energy and entropy are used as texture descriptors. Experiments are performed on Coral Database. The results of the proposed method namely CLD-fos are compared with the four well reputed systems (i.e. SIMPLIcity, Histogram based, FIRM, and Variance Segment etc) from the industry. The results of the CLD-fos demonstrated high accuracy rate than the previous systems during the simulations. The proposed CLD-fos achieved significant performance in terms of accuracy.

Mangroves are one of the most important coastal wetland ecosystems, and the compositions and distributions of mangrove species are essential for conservation and restoration efforts. Many studies have explored this topic using remote sensing images that were obtained by satellite-borne and airborne sensors, which are known to be efficient for monitoring the mangrove ecosystem. With improvements in carrier platforms and sensor technology, unmanned aerial vehicles (UAVs) with high-resolution hyperspectral images in both spectral and spatial domains have been used to monitor crops, forests, and other landscapes of interest. This study aims to classify mangrove species on Qi’ao Island using object-based image analysis techniques based on UAV hyperspectral images obtained from a commercial hyperspectral imaging sensor (UHD 185) onboard a UAV platform. First, the image objects were obtained by segmenting the UAV hyperspectral image and the UAV-derived digital surface model (DSM) data. Second, spectral features, textural features, and vegetation indices (VIs) were extracted from the UAV hyperspectral image, and the UAV-derived DSM data were used to extract height information. Third, the classification and regression tree (CART) method was used to selection bands, and the correlation-based feature selection (CFS) algorithm was employed for feature reduction. Finally, the objects were classified into different mangrove species and other land covers based on their spectral and spatial characteristic differences. The classification results showed that when considering the three features (spectral features, textural features, and hyperspectral VIs), the overall classification accuracies of the two classifiers used in this paper, i.e., k-nearest neighbor (KNN) and support vector machine (SVM), were 76.12% (Kappa = 0.73) and 82.39% (Kappa = 0.801), respectively. After incorporating tree height into the classification features, the accuracy of species classification increased, and the overall classification accuracies of KNN and SVM reached 82.09% (Kappa = 0.797) and 88.66% (Kappa = 0.871), respectively. It is clear that SVM outperformed KNN for mangrove species classification. These results also suggest that height information is effective for discriminating mangrove species with similar spectral signatures, but different heights. In addition, the classification accuracy and performance of SVM can be further improved by feature reduction. The overall results provided evidence for the effectiveness and potential of UAV hyperspectral data for mangrove species identification.

Interpreting medical images is certainly a complex task which requires extensive knowledge [1]. According to Computer Aided Diagnosis (CAD) serves as a second opinion that will help radiologists in diagnosis and on the other hand Content-based Image Retrieval uses visual content to help users browse, search and retrieve similar medical images from a database based on the user’s interest [2-4]. The competency of the CBMIR system depends on feature extraction methods [5]. The textural features are very important to determine the content of a medical image. Textural features provide scenic depth, the spatial distribution of tonal variation, and surface orientation [6]. Therefore, this study seeks to compare and evaluate some of the hand-crafted texture feature extraction techniques in CBMIR. This is to help those concerned in enhancing CBIR systems to make informed decisions concerning the selection of the best textural feature extraction techniques. Since there is no clear indication of which of the various texture feature extraction techniques is best suited for a given performance metric when considering which of the techniques to choose for a particular study in CBMIR systems. The objective of this work, therefore, is to comparatively evaluate the performance of the following texture feature extraction techniques; Local Binary Pattern (LBP), Gabor Filter, Gray-Level Co-occurrence Matrix (GLCM), Haralick Descriptor, Features from Accelerated Segment Test (FAST) and Features from Accelerated Segment Test and Binary Robust Independent Elementary Features (FAST &amp;BRIEF) using the metrics; precision, recall, f1-score, mean squared error (MSE), accuracy and time. These techniques are coupled with specific similarity measure to obtain results. The results showed that LBP, Haralick Descriptor, FAST, and GLCM had the best results in terms of (Precision and Accuracy), Time, F1-Score, and Recall respectively. LBP had 82.05% and 88.23% scores for precision and accuracy respectively. The following scores represent the performance of the Haralick descriptor, FAST, and GLCM models respectively; 0.88s, 38.7%, and 44.82%. These test scores are obtained from datasets ranging from 1k-10.5k. Aside from LBP outperforming the other 5 models mentioned, it still outperformed the following proposed models ' [7]’, ‘Tamura texture feature and wavelet transform combined with Hausdorff distance - [8]’, ‘ [9]’ in terms of (precision, accuracy, and recall) and (precision and recall) respectively and probably f1-score (since f1-score is the weighted average of precision and recall). It is believed that an ensemble of LBP, Haralick descriptors, and Support Vector Machine (SVM) can represent a robust system for both medical image retrieval and classification.

A robust method is proposed in this paper to retrieve digital images using combination of color, texture and shape features. The proposed method consists of three stages. Shape detection is done based on TopHat transform to detect and crop object part of the image in the first stage. The second is included a texture feature extraction algorithm using color local binary patterns (CLBP) and local variance features together. Finally, to retrieve mostly closing matching images to the query, log likelihood ratio is used as non-similarity ratio. The performance of the proposed approach is evaluated using Corel and Simplicity image sets and it compared by some of other well-known approaches in terms of precision and recall which shows the superiority of the proposed approach. Shift invariant, Low noise sensitivity, rotation invariant are some of other advantages.