Automatic Weight of Color, Texture, and Shape Features in Content-Based Image Retrieval Using Artificial Neural Network

In this chapter, a content-based image retrieval technique based on the concept of region-based image retrieval has been described. This technique integrates color, texture, and shape features using local binary patterns (LBPs). In this technique, the image is divided into a fixed number of blocks and from each block LBP-based color, texture, and shape features are computed. The color and texture features are extracted using LBP histograms of quantized color image and gray-level images, respectively. Shape features are computed using the binary edge map obtained using Sobel edge detector from each block. All three features are combined to make a single completed binary region descriptor (CBRD) represented in the LBP way. To support region-based retrieval, an effective region code-based scheme is employed. In this technique, the spatial relative locations of objects are also considered to increase the retrieval accuracy.

Content-Based Image Retrieval (CBIR) allows to automatically extracting target images according to objective visual contents of the image itself. Representation of visual features and similarity match are important issues in CBIR. Color, texture and shape information have been the primitive image descriptors in content-based image retrieval systems. This paper presents a fast and efficient image indexing and search system based on color and texture features. The color features are represented by combines 2-D histogram and statistical moments and texture features are represented by combines the direction measure and a gray level co-occurrence matrix (GLCM). The detailed experimental analysis is carried out using precision and recall ondataset Wang. The time analysis is also performed to compare processing speeds of the proposed method with the existing similar best. The experimental results demonstrated that proposed method achieved a better image recognition, and the accuracy of classification based on this method has been significantly improved. The performance is measured in terms of recall and precision; also the obtained performances are compared with several state-of-the-art algorithms and showed that our algorithm is simple, fast, and efficient in terms of results and memory. Keywords: Co-occurrence Matrix, Direction Measure, 2-D Histogram, Statistical Moments, CBIR, GLCM

The Content Based Image Retrieval (CBIR) is a technique that works on images and in response extracts relevant images. A novel hybrid two stage universal CBIR technique using both colour and texture features extraction is proposed in this paper. In the first stage for colour feature extraction, colour moments up to the fourth order are extracted and are used in deriving the respective histograms which forms the colour feature vector. In the second stage for the texture feature extraction the CCM (Colour Co-occurrence Matrix) technique employed takes into account the correlation between the RGB colour bands in all the eight directions while computing the texture features. In every stage the distance between the query image and the image in the database is calculated by using relative distance measure. The resultant distance between the query image and the image in the database is calculated by using a weighted distance classifier. Thus, a hybrid fusion method is achieved that has better performance than other colour-spatial based methods and promises to give more relevant output to the user.KeywordsCBIRlocal statistics histogramsSkewKurtosisCCM

With the emerge of multimedia, communication and processing, a typical image database has a large volume of data. It is an essential to build an efficient retrieval system to browse through the entire database. In this paper we proposed precise Relevance Feed Back (RFB) Content Based Image Retrieval (CBIR) using multiple features based on interactive retrieval approach which will extensively reduces the semantic gap between low-level features and high-level semantics. Relevance Feed Back improves the retrieval accuracy of Content Based Image Retrieval(CBIR) by modifying the query based on the user's feedback in which the user can select the most relevant images and provide a weight of preference for each relevant image. In our approach we extracted multiple features by integrating color, texture and shape features with Relevance Feed Back. We extracted color features by cumulative histogram, texture feature are exploited by using Color co-occurrence matrix (CCM) and we describe the shape information contained in an image on the basis of its significant edges. We used Euclidean distance as the similarity measure. In our experiment we used Corel real-world image databases with 1000 images, divided into 10 categories, each category containing 100 images including landscapes, animals, plants, monuments, transport (cars, planes). Our results reflects that integrating color, texture and shape for retrieving similar images improves the retrieval performance with respect to retrieval accuracy and recall rate as compared with the classical color feature. During the experiment we also observed that incorporating Relevance Feed Back (RFB) with multiple features outperforms in comparison with multifeature vector without Relevance Feed Back method.

Content-based image retrieval (CBIR) systems utilize low level query image feature as identifying similarity between a query image and the image database.Image contents are plays significant role for image retrieval.There are three fundamental bases for content-based image retrieval, i.e. visual feature extraction, multidimensional indexing, and retrieval system design.Each image has three contents such as: color, texture and shape features.Color and texture both plays important image visual features used in Content-Based Image Retrieval to improve results.Color histogram and texture features have potential to retrieve similar images on the basis of their properties.As the feature extracted from a query is low level, it is extremely difficult for user to provide an appropriate example in based query.To overcome these problems and reach higher accuracy in CBIR system, providing user with relevance feedback is famous for provide promising solution.

Medical image indexing and storage is gaining increased importance. Indexing and retrieval of these images efficiently is becomes an essential task. Indexing of medical images using text or numbers is a cumbersome task, difficult to memorize and time consuming. Indexing and Retrieval of images can be done through query by text and query by image which is also known as content based image retrieval (CBIR). Different medical images possess different texture and shape features. This paper presents a novel and hybrid approach of managing a huge medical image database and retrieving a medical image from the database by fusion of shape and texture features. Image is retrieved by comparing the features of query image and images of database. We attach some document information with each medical image such as patient identity, diseases, age, and case history. It can be used for further diagnostic and analysis purpose. Further the proposed algorithm also updates the database automatically if new query is found. MATLAB ® 7.01 and its image processing toolbox have been used to implement the algorithm.

Research in content-based image retrieval today is a lively discipline, expanding in breadth. Discovering new and innovative processes of locating a desired image from an expanding collection of images has been a major area of interest for many professional fields. This has led to the increasing use of a technique called Content Based Image Retrieval which is used to retrieve images based on low-level features which are automatically driven such as color, shape and texture. CBIR draws many of its methods from the field of image processing and computer vision and can be regarded as subset of that field. Using this technique, the entire database may be searched to find the most closely matching image. In this paper, color and texture features of an image have been used to retrieve all the similar images from the image database. For this purpose, Block Color Histogram as color feature and Gray-level Co-occurrence Matrix (GLCM) and Gabor wavelets as texture features have been used. The proposed approach is very efficient since it uses the prominent and distinct features of an image useful for effective image retrieval using fuzzy heuristics according to human visual system.

According to the recent literature, it is pragmatic that image storage and retrieval through the World Wide Web (WWW) has made impressive progress. Practical searching for image still confronts us with present retrieval systems. A Content Based Image Retrieval (CBIR) system provides an efficient way of retrieving related images from image collections. In this paper we present a new technique to extract the images from the database to achieve better performance and efficiency. The novel method uses an approach, which combines texture information and modified Block Truncation Coding (BTC) method to extract the color features from the image. The whole image is divided into a fixed block of size 4 × 4, 8 × 8, 16 × 16, 32 × 32, 64 × 64, 128 × 128 and 256 × 256 non overlapped blocks. For each block, we calculated the threshold as a mean of the pixel values and the number of pixels which are lower than threshold value and upper than the threshold value are counted and mean of these lower and upper values have been taken and these two are considered as features. Now this process is repeated for the all blocks to extract the features of the image. The second step will compute the four texture features using the Gray-Level Co-occurrence Matrix (GLCM) as a statistical approach to extract energy, contrast, entropy and uniformity. We have used this modified BTC and texture features of the image to retrieve images. Finally, we have conducted experiments on a ground truth image database that has 1000 images of different categories. A different block sizes have been used to demonstrate the experimental results and compared with tabulation. From this we have observed that the performance is better and efficiency is low with smaller block sizes and vice versa with higher block sizes. So we have to choose the middle ranges of block sizes for better performance with better efficiency. As we have observed from the results that the performance of the retrieval system is improved because of combination of texture and color features. The proposed system's performance has been improved by an average precision of 2.41% and recall of 8.22% when compared to existing systems.

Nowadays, the majority of images are in JPEG and MPEG compressed formats, and JPEG2000 is considered to be the next generation of compression standard due to the high- performance of discrete wavelet transform (DWT). It is time- consuming and occupies too much memory in conventional image retrieval ways. In order to solve these problems, we use grading retrieval techniques to implement image retrieval based on discrete cosine transform (DCT) compressed domain and DWT compressed domain. For image retrieval based on DCT domain, we use color features: color moment and color histogram, to describe content of images and propose a new dynamic color space quantization based on color distribution; For image retrieval based on DWT domain, we use texture features as two level feature vectors. The mean and standard deviation of low frequency sub-band coefficients are used as the first level retrieval. The means and standard deviations of selected high frequency sub-band coefficients are used as the second level retrieval. Furthermore, the third level retrieval is achieved by the fast wavelet histogram. Our experiment results clearly show that the two grading image retrieval algorithms work better than other algorithms: store memory is reduced and retrieval accuracy is improved. Index Terms—Content based image retrieval (CBIR), compressed domain, discrete cosine transform (DCT), discrete wavelet transform (DWT), color features, texture features

In content based image retrieval (CBIR) process, every image has been represented in a compact set of local visual features i.e. color, texture, and/or shape of images. This set of local visual features is known as feature vector. In the CBIR process, feature vectors of images have been used to represent or to identify similar images in adequate way. As a result, feature vector construction has always been considered as an important issue since it must reflect proper image semantics using minimal amount of data. The proposed CBIR scheme is based on the combination of color and texture features. In this work initially, we have converted the given RGB image into HSV color image. Subsequently, we have considered H (hue), S (saturation), and V (intensity) components for extraction of visual image features. The texture features have been extracted from the V component of the image using 2D dual-tree complex wavelet transform (2D DT-CWT) where it analyzes the textural patterns in six different directions i.e. ±15\(^{\circ }\), ±45\(^{\circ }\), and ±75\(^{\circ }\). At the same time, we have computed the probability histograms of H and S components of the image respectively and subsequently those are divided into non-uniform bins based on cumulative probability for extraction of color based features. So, in this work both the color and texture features have been extracted simultaneously. Finally, the obtained features have been concatenated to attain the final feature vector and same is considered in image retrieval process. We have tested the novelty and performance of the proposed work in two Corel, two objects, and, a texture image datasets. The experimental results reveal the acceptable retrieval performances for different types of datasets.

Batik is a traditional craft of designing patterned fabrics which hold high artistic value in Sri Lankan culture, where hand-painted wax patterns are coloured using specialist dyeing methods to create the finished product. This paper presents a study of vision-based feature extraction of Batik images considering colour, texture and shape features to develop a comprehensive feature descriptor of Batik motifs. Wax drawn patterns are identified from the digital images of Batik motifs to retrieve an outline of patterns demarcating the different coloured layers generated by multiple stages of dyeing. Motifs with repetitive patterns are identified using the Local Binary Pattern (LBP) as a texture feature vector. Both RGB and L*a*b* colour schemes are studied in the representation of Batik motifs. The colour description is presented using Mini Batch K-Means which out-performed the widely used K-Means clustering method. Hu Moment Invariants are used for shape feature extraction, and Gray Level Co-occurrence Matrix (GLCM) for texture feature extraction. A comprehensive feature descriptor is developed to represent Batik designs, which could be used to recommend similar designs based on the shape and texture features of query images presented by the user.

We implement an efficient image retrieval system via a content-based approach in the relational database system. In our system, as the preprocessing stages, we extract the color and texture features from the input image to get the retrieval keywords in the image database. First, our system classifies the images roughly by the color features using the ART2 neural network model. The classified information is stored in a relational database with the original image. To retrieve images similar to the query image, we extend the relational SQL statement coupled with the ART2 function in the WHERE condition clause. Next, to retrieve final results of images, we compare the query image with the candidate images which have the same category information by the texture features. The proposed system is implemented on Oracle DBMS. It shows satisfactory retrieval results in a test of the sample image database.

Content Based Image Retrieval (CBIR) is a process in which for a given query image similar images will be retrieved based on the image content similarity. Image content refers to its visual features, which are mathematical representations of a digital image. The image retrieval task primarily depends on image feature extraction and similarity measurement between the feature vectors. The performance of CBIR process not only decided by the optimum features extracted from the image but also on the proper choice of the similarity/dissimilarity measures (distance metrics). As the image features broadly diversified in terms of color, texture and shape based, using the same distance metric may not work well for all of these features. In this paper, first we presented overview of geometric and statistical distance metrics used in CBIR along with the comparative analysis of these measures on color and texture features. Color features extracted by computing color histograms in HSV space and texture features by wavelet decompositions. Geometrical distances such as Manhattan, Chebyshev, Euclidean, statistical distance metrics such as Cosine Similarity, Chi-square, KullbackLeibler, Jeffrey and cumulative statistical distance metrics of Kolmogorov-Smirnov, Cramer von Mises and Earthmover's distances were analyzed for feature similarity. We gave certain conclusions on the performance of all these distance metrics in terms of Mean Average Precision (MAP) and Recall rates with color and texture features respectively.

Plants are an inevitable part of ecosystem. Tulsi leaves play a major role in plant species. There exists different varieties of tulsi leaves mainly Rama tulsi, Krishna tulsi, Vana tulsi, Kapoor tulsi etc. This paper proposes a system for identifying and classifying different types of tulsi from its leaf images by analyzing color and texture. Rama tulsi, Krishna tulsi and ordinary tulsi are the three varieties of tulsi leaves used for classification. Initially, a dataset is formed from the images of leaves. The feature values of these images are computed and it becomes the training data for the system. When a test image is scanned its color and texture features are extracted. Using K nearest neighborhood algorithm the extracted features are compared with the training data to display category of the leaf. Texture features are obtained using Gray Level Co-occurrence matrix (GLCM) whereas color features are acquired using color moments. Fusions of these techniques are used in this paper.

Rapid development of multimedia technologies made Content Based Image Retrieval (CBIR) an energetic research area for the researchers of multimedia domain. Texture and color features have been the primal descriptors for images in the field of CBIR. This paper proposed a new CBIR system by combining the both color and texture features. Color Layout Descriptor (CLD) from MPEG-7 is used for the color feature extraction while, Mean, variance, skewness, Kurtosis, energy and entropy are used as texture descriptors. Experiments are performed on Coral Database. The results of the proposed method namely CLD-fos are compared with the four well reputed systems (i.e. SIMPLIcity, Histogram based, FIRM, and Variance Segment etc) from the industry. The results of the CLD-fos demonstrated high accuracy rate than the previous systems during the simulations. The proposed CLD-fos achieved significant performance in terms of accuracy.