Histogram refinement for texture descriptor based image retrieval

This article proposes a content‐based image retrieval (CBIR) system that employs an informative pattern‐based descriptor. Recent literature has reported the development of efficient local‐pattern‐based descriptors, including the local vector pattern (LVP). This article extends the LVP formulation by making it more computationally efficient and informative. In the extended LVP‐based extraction process, the global index angles are determined using the mutual information between the patterns, which are obtained from a pair of indexed angles. Thus, the Proposed LVP (PLVP) no longer requires a step to identify patterns in every indexed angle found in the querying phase of the CBIR system. A CBIR system with the PLVP is developed in this article, and the system and its associated methods are tested using data from a benchmark texture database and a natural image database. A performance comparison of the PLVP and traditional patterns, such as the local binary pattern (LBP), completely modeled local binary pattern (CLBP) and local tetra pattern (LTrP), is conducted using the CBIR system. The experimental results reveal the superiority of the PLVP in terms of precision, recall, F‐score and computational efficiency.

This paper presents a novel feature extraction framework for content-based image retrieval (CBIR). Discrete wavelet transform (DWT) based Local tetra pattern (LTrP) is used to obtain the feature map from an input image. Decomposition of DWT up to single level and the features obtained from it would make the CBIR system very sensitive to noise. Therefore, decomposition up to three scales is used to remove noise. On each of the sub band LTrP is applied and 130 features are extracted. Further, Artificial Neural Network (ANN) is employed for index matching and image retrieval task which gives the classification accuracy of 97.9 % for Corel 1K database. We have compared our proposed feature extraction scheme with LTrP and other existing local descriptor. Results show that combination of DWT and Local Tetra Patterns (DWT + LTrP) extracts more robust features than LTrP alone. Also, the effect of different wavelet filters on the accuracy of the system has been analyzed. Proposed framework has been tested on Corel-1000 and Corel-10000 databases. We have used average retrieval rate, precision, and recall for performance measure of the CBIR system. Proposed method outperforms the retrieval rate from 75.9% using LTrP to 97.9% using proposed method on Corel 1K database. Improvement in performance measures as compared to the other existing methods evidence that, the proposed spatio-frequency local descriptor is more robust for image retrieval task.

In this paper, a novel local pattern descriptor generated by the proposed local vector pattern (LVP) in high-order derivative space is presented for face recognition. The proposed vector representation of the referenced pixel is generated to provide the one-dimensional structure of micropatterns. To effectively extract more detailed discriminative information in a given sub-region, the vector of LVP is refined by varying local derivative directions from the nth-order LVP in (n−1)th-order derivative space. The proposed LVP is compared with the existing local pattern descriptors including local binary pattern (LBP), local derivative pattern (LDP), and local tetra pattern (LTrP) to evaluate the performances from input grayscale face images. Extensive experiments conducting on benchmark face image databases, FERET and Extended Yale B, demonstrate that the proposed LVP in high-order derivative space indeed performs much better than LBP, LDP and LTrP for face recognition.

This paper proposes a new pattern-based feature called local mesh ternary pattern for biomedical image indexing and retrieval. The standard local binary patterns (LBP) and local ternary patterns (LTP) encode the greyscale relationship between the centre pixel and its surrounding neighbours in two-dimensional (2D) local region of an image, whereas the proposed method encodes the greyscale relationship among the neighbours for a given centre pixel with three selected directions of mesh patterns which is generated from 2D image. The novelty of the proposed method is that it uses ternary patterns from mesh patterns of an image to encode more spatial structure information which leads to better retrieval. The experiments have been carried out for proving the worth of proposed algorithm on three different types of benchmarked biomedical databases; (i) computed tomography (CT) scanned lung image databases named as LIDC-IDRI-CT and VIA/I–ELCAP-CT, (ii) brain magnetic resonance imaging (MRI) database named as OASIS-MRI. The results demonstrate that the proposed method yields better performance in terms of average retrieval precision and average retrieval rate over state-of-the-art feature extraction techniques like LBP, LTP, local mesh pattern, etc.

In the field of computer vision and image processing CBIR (Content based image retrieval) system become an active research area. The CBIR technique involves feature extraction based on image features (like color, shape and texture) and defining rules for comparing image. A classifier is also used by authors for image classification. For this purpose an image database taken from James Z. Wang research group website is used by many authors. Due to enormous increase in the size of database traditional methods of image retrieval by using keywords does not provide accurate result. Thus the concept of CBIR system is emerged. In last couple of years many method of feature extraction is developed but since now researcher are not able to develop a system which has gained high accuracy of human visual perception in distinguishing pictures. Therefore earlier researchers have concentrated to increase the retrieval accuracy of CBIR system by using different combination of features. The objective of this paper is to present review on a CBIR technique which combined four kinds of features set including every kind of feature for developing feature vector. Color based features (histogram), statistical features (mean, median and standard deviation), spatial features (Gabor feature and wavelet features) and texture features (GLCM) is used for forming feature vector. A SVM classifier is used with CBIR system to increase retrieval accuracy. SVM (support vector machine) is a machine learning classifier which provides good classification accuracy. Keywords: CBIR, SVM, NN, GLCM, HSV Color space, Euclidean distance matrix.

Due to the availability of large number of digital images, development of an efficient content-based indexing and retrieval method is required. Also, the emergence of smartphones and modern PDAs has further substantiated the need of such systems. This paper proposes a combination of Local Ternary Pattern (LTP) and moments for Content-Based Image Retrieval. Image is divided into blocks of equal size and LTP codes of each block are computed. Geometric moments of LTP codes of each block are computed followed by computation of distance between moments of LTP codes of query and database images. Then, the threshold using distance values is applied to retrieve images similar to the query image. Performance of the proposed method is compared with other state-of-the-art methods on the basis of results obtained on Corel-1,000 database. The comparison shows that the proposed method gives better results in terms of precision and recall as compared to other state-of-the-art image retrieval methods.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

A rapid growth in medical ultrasound database makes it difficult for medical practitioners to manage and search relevant data with good efficiency. Hence, a novel image retrieval technique using Mean Distance Local Binary Pattern (Mean Distance LBP) has been proposed for content-based image retrieval. The conventional local binary pattern (LBP) converts every pixel of image into a binary pattern based on their relationship with neighbourhood pixels. The proposed feature descriptor differs from local binary pattern as it transforms the mutual relationship of all neighbouring pixels in a binary pattern based on their standard deviation templates as well as Euclidean distance from the center pixel. Color feature and Gray Level Co-occurrence Matrix have also been used in this work. To prove the excellence of the proposed method, experiments have been conducted on two different databases of natural images and face images. Further, the method is applied on real time ultrasound database for retrieval of liver images from a set of ultrasound images of various organs. The performance has been observed using well-known evaluation measures, precision and recall, and compared with some state-of-art local patterns. Comparison shows a significant improvement in the proposed method over existing methods.

This paper proposes a novel high-order local pattern descriptor, local derivative pattern (LDP), for face recognition. LDP is a general framework to encode directional pattern features based on local derivative variations. The n(th)-order LDP is proposed to encode the (n-1)(th) -order local derivative direction variations, which can capture more detailed information than the first-order local pattern used in local binary pattern (LBP). Different from LBP encoding the relationship between the central point and its neighbors, the LDP templates extract high-order local information by encoding various distinctive spatial relationships contained in a given local region. Both gray-level images and Gabor feature images are used to evaluate the comparative performances of LDP and LBP. Extensive experimental results on FERET, CAS-PEAL, CMU-PIE, Extended Yale B, and FRGC databases show that the high-order LDP consistently performs much better than LBP for both face identification and face verification under various conditions.

This paper presents novel approaches for combining re-ranking and rank aggregation methods aiming at improving the effectiveness of Content-Based Image Retrieval (CBIR) systems. Given a query image as input, CBIR systems retrieve the most similar images in a collection by taking into account image visual properties. In this scenario, accurately ranking collection images is of great relevance. Aiming at improving the effectiveness of CBIR systems, re-ranking and rank aggregation algorithms have been proposed. However, different re-ranking and rank aggregation approaches, applied to different image descriptors, may produce different and complementary image rankings. In this paper, we present four novel approaches for combining these rankings aiming at obtaining more effective results. Several experiments were conducted involving shape, color, and texture descriptors. The proposed approaches are also evaluated on multimodal retrieval tasks, considering visual and textual descriptors. Experimental results demonstrate that our approaches can improve significantly the effectiveness of image retrieval systems.

Content based image retrieval is grievous need of present scenario in digital imaging world. This work presents a new multi-scale content based image retrieval system which leverages the multi-resolution property of discrete wavelet transform (DWT) and the local information attribute of local extrema patterns (LEPs). Two level DWT is applied on images and wavelet coefficients are obtained for images, further the LEPs are collected from wavelet coefficients to extract the feature vector. The proposed method abbreviated as DWT+LEP and tested on two benchmark databases for validation and compared with local extrema patterns (LEPs), discrete wavelet transform (DWT), center-symmetric local binary pattern (CS LBP), local edge pattern for image retrieval (LEPINV), local edge pattern for segmentation (LEPSEG), local binary pattern (LBP) and block based local binary pattern (BLK LBP).

This paper represents automatic facial expression analysis method named Local Directional Stigma Mean Patterns (LDSMP) for automatic facial expression analysis and image retrieval using content based facial expression image retrieval and CNN. The traditional local patterns such as Local Binary Patterns (LBP) and Local Ternary Patterns (LTP) are applied for face recognition and expression analysis, calculated using relationship between the center pixel and neighboring pixels. The proposed method calculates the eight directional difference values then divided into the three ranges based on threshold values. Thus, the values are substituted with basic three positive values (+3, +2, +1) and three negative values (-3, -2, -1) to get more sensitive information from an image rather than aforementioned methods. The threshold can be select either static which is selected by user or dynamic is evaluated from image itself and supports to improve the efficiency. The performance of the proposed method is further improved by giving this patterns as input to the Convolutional Neural Networks (CNN) and compared with the existing methods LBP, LTP, and Directional Binary Code (DBC) in terms of Average Precision (AP), Average Recall (AR), and Average Retrieval Rate (ARR) using standard databases COREL 10K (DB1) and JAFFE (The Japanese Female Facial Expression) (DB2) and Extended Cohn-Kanade (CK +) (DB3) dataset.

Content-based image retrieval (CBIR) has been widely researched for medical images. In application of histo- pathological images, there are two issues that need to be carefully considered. The one is that the digital slide is stored in a spatially continuous image with a size of more than 10K x 10K pixels. The other is that the size of query image varies in a large range according to different diagnostic conditions. It is a challenging work to retrieve the eligible regions for the query image from the database that consists of whole slide images (WSIs). In this paper, we proposed a CBIR framework for the WSI database and size-scalable query images. Each WSI in the database is encoded and stored in a matrix of binary codes. When retrieving, the query image is first encoded into a set of binary codes and analyzed to pre-choose a set of regions from database using hashing method. Then a multi-binary-code-based similarity measurement based on hamming distance is designed to rank proposal regions. Finally, the top relevant regions and their locations in the WSIs along with the diagnostic information are returned to assist pathologists in diagnoses. The effectiveness of the proposed framework is evaluated in a fine-annotated WSIs database of epithelial breast tumors. The experimental results show that proposed framework is both effective and efficiency for content-based whole slide image retrieval.

Co-occurrence of adjacent sparse local ternary patterns: A feature descriptor for texture and face image retrieval

Texture is the surface property that is used to identify and recognise objects. This property is widely used in many applications including texture-based face recognition systems, surveillance, identity verification and so on. The Local binary pattern (LBP) texture method is most successful for face recognition. Owing to the great success of LBP, recently many models, which are variants of LBP have been proposed for texture analysis. Some of the derivatives of LBPs are multivariate local binary pattern, centre symmetric local binary pattern, local binary pattern variance, dominant local binary pattern, advanced local binary pattern, local texture pattern (LTP) and local derivative pattern (LDP). In this scenario, it is essential to review, whether LBP or their derivatives perform better for face recognition. The real-time challenges such as illumination changes, rotations, angle variations and facial expression variations are evaluated by different LBP-based models. Experiments were conducted on the Japanese female facial expression, YALE and FRGC version2 databases. The results show that LDP and LTP perform much better than the other LBP-based models.