A Comparative Study on Retrieved Images by Content Based Image Retrieval System based on Binary Tree, Color, Texture and Canny Edge Detection Approach

Image retrieval is one of the most interesting and fastest growing research areas in all fields. It is an effective and efficient tool for managing large image databases. In most Content-Based Image Retrieval (CBIR) systems, an image is represented by a set of low-level visual features; hence a direct correlation with high-level semantic information will be absent. Therefore, a gap exists between high-level information and low-level features, which is the main reason that hinders the improvement of the image retrieval accuracy. In this work, main focus is on the semantic based image retrieval system using Gray Level Co-occurrence Matrix (GLCM) for texture feature extraction. Based on the texture features, semantic interpretations are given to the extracted textures. The images are retrieved according to user satisfaction and thereby reduce the semantic gap between low level features and high level features.

Retrieving images depend of specific features In Content Based Image Retrieval (CBIR). A common approach is to divide retrieval process into two stages; the first one is based on high-level features followed by the second that is based on low-level features. We focus primarily on medical images, and follow the above approach but make the following two basic contributions: a) introduce the gray cluster co-occurrence matrix as texture feature extraction and use it as high-level features, and b) introduce edge strength levels as shape feature extraction and use it as low-level features. Our proposed system suggests the precision rate was 94.90% and recall rate was 89.72%. The distance variance achieved lowest rate (0.0022) in images retrieval compared to each of partial systems individually and related works. Our method has better performance in retrieving the results than other related works and each of partial system individually.

In a Content Based Image Retrieval (CBIR) system, images are retrieved based on the content of the images such as color, shapes and objects. However, often end users experience a semantic gap between the notion of similarity used by the ranking model versus the users’ perception about image similarity. Explainable AI (XAI) is an emerging research field that attempts to provide transparency of “black box” models, to make AI systems trustworthy and gain user trust. This work aims at building an I mage R etrieval system with T extual EX planations such as “The (global) results are similar to the query by X% due to shape, Y% due to color”. Local explanations are generated using various methods such as comparing images with respect to overlap between low level features such as color, shape and regions (MPEG-7 features). Additionally, high level features such as background-foreground segmentation, deep learned features and major key-points, objects identified (SIFT features) are used to enrich the explanations. We evaluate the quality of rankings on benchmark data-sets such as PASCAL VOC. The XAI facet of user satisfaction and usefulness of the system is evaluated in a lab based user study. Our results show that the semantic gap is better bridged using high level features. While low level features might be better suited for re-ranking of the retrieved images.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

Video text detection plays an important role in semantic-based video analysis. In the field of information retrieval, text detection and extraction from video has become an emerging area to solve the fundamental problem of content-based image retrieval (CBIR) to fill in the semantic gap between low level and high level features. Text detection and extraction enables the understanding of video contents with the help of text recognition using optical character recognition techniques, to give a partial solution to bridge the semantic gap between the low level and high level features. In this paper we have proposed a method which detect & localize horizontal text with uniform background.

In the CBIR- (Content Based Image Retrieval) technique requires low-level or primitive features- color, texture, or other data that can be taken from its image Extracting feature vectors of database images as well as query image can be calculated with the help of slant transform by considering DC & 3 AC coefficients obtained in each block of an image. Slant transform represents the gradual brightness changes in an image line effectively. By calculating the difference between feature vector data base and feature vector for a query by using the distance measuring techniques. The vector of the smaller distance is the closest to query image. The experiment is performed in the Corel 500 Image Database. Finally, CBIR results are evaluated by the recall, precision, and F-Score.

Content-based video retrieval system aims at assisting a user to retrieve targeted video sequence in a large database. Most of the search engines use textual annotations to retrieve videos. These types of engines offer a low-level abstraction while the user seeks high-level semantics. Bridging this type of semantic gap in video retrieval remains an important challenge. In this paper, colour, texture and shapes are considered to be low-level features and motion is a high-level feature. Colour histograms convert the RGB colour space into YcbCr and extract hue and saturation values from frames. After colour extraction, filter mask is applied and gradient value is computed. Gradient and threshold values are compared to draw the edge map. Edges are smoothed for sharpening to remove the unnecessary connected components. These diverse shapes are then extracted and stored in shape feature vectors. Finally, an SVM classifier is used for classification of low-level features. For high-level features, depth images are extracted for motion feature identification and classification is done via echo state neural networks (ESN). ESN are a supervised learning technique and follow the principle of recurrent neural networks. ESN are well known for time series classification and also proved their effective performance in gesture detection. By combining the existing algorithms, a high-performance multimedia event detection system is constructed. The effectiveness and efficiency of proposed event detection mechanism is validated using MSR 3D action pair dataset. Experimental results show that the detection accuracy of proposed combination is better than those of other algorithms

Content-based image retrieval (CBIR) systems use multiple image features to represent an image. These systems suffer from curse of dimensionality since a high-dimensional feature vectors are formed to represent images in the target dataset. Reduction in length of feature vector can speed-up the retrieval process, but it reduces the retrieval accuracy. To overcome the aforementioned problem, an efficient layer-wise feature incremental approach for the CBIR system has been proposed. The proposed approach uses three primitive image features namely color, texture, and shape. The retrieval process is accomplished in three layers, at first a layer-complete dataset is searched but only single-feature space is used. Top 10% of images most similar to query image are retained in the second layer. The second layer uses two features for similarity computation, and only 50% of the most similar images are passed to the third layer. Finally, the third layer uses all three features to compute the similarity. Our aim is to reduce the search space at subsequent layers and use multiple features for a reduced dataset at the final layer. The proposed approach is evaluated on four publicly available image datasets. The retrieval results on the basis of precision, recall, and f-score show the performance improvement in comparison to state-of-the-art CBIR systems.

With the emergence and explosion of huge image databases there is an increasing necessity for effective methods to assess visual information on the level of objects and scene types. A wide variety of Content – Based Image Retrieval (CBIR) systems already exists. As a key issue in CBIR, similarity measure quantifies the resemblance in contents between a pair of images. Depending on the type of features, the formulation of the similarity measure varies greatly. The primary goal of our study is to reduce the computation time and user interaction. The secondary goal is to reduce the semantic gap between high level concepts and low level features. A third goal is to evaluate system performance with regard to speed and accuracy. In the proposed study transform color after statistical transform, such as the Adaptive Color Karhunen Loeve Transform (ACKLT) is used as a color descriptor. The results are showing the advantage of the new algorithm for ACKLT in comparison with the YCrCb color model. Based on the experimental results, we concluded that correct selection of descriptors invariant to light intensity and light color changes affects object and scene category recognition.Keywordscontent-based image retrievalAdaptive Color Karhunen Loeve Transform

In content based image retrieval (CBIR) process, every image has been represented in a compact set of local visual features i.e. color, texture, and/or shape of images. This set of local visual features is known as feature vector. In the CBIR process, feature vectors of images have been used to represent or to identify similar images in adequate way. As a result, feature vector construction has always been considered as an important issue since it must reflect proper image semantics using minimal amount of data. The proposed CBIR scheme is based on the combination of color and texture features. In this work initially, we have converted the given RGB image into HSV color image. Subsequently, we have considered H (hue), S (saturation), and V (intensity) components for extraction of visual image features. The texture features have been extracted from the V component of the image using 2D dual-tree complex wavelet transform (2D DT-CWT) where it analyzes the textural patterns in six different directions i.e. ±15\(^{\circ }\), ±45\(^{\circ }\), and ±75\(^{\circ }\). At the same time, we have computed the probability histograms of H and S components of the image respectively and subsequently those are divided into non-uniform bins based on cumulative probability for extraction of color based features. So, in this work both the color and texture features have been extracted simultaneously. Finally, the obtained features have been concatenated to attain the final feature vector and same is considered in image retrieval process. We have tested the novelty and performance of the proposed work in two Corel, two objects, and, a texture image datasets. The experimental results reveal the acceptable retrieval performances for different types of datasets.

In this paper, we propose a text extraction method from camera-captured document style images and propose a text segmentation method based on a color clustering method. The proposed extraction method detects text regions from the images using two low-level image features and verifies the regions through a high-level text stroke feature. The two level features are combined hierarchically. The low-level features are intensity variation and color variance. And, we use text strokes as a high-level feature using multi-resolution wavelet transforms on local image areas. The stroke feature vector is an input to a SVM (support vector machine) for verification, when needed. The proposed text segmentation method uses color clustering to the extracted text regions. We improved K-means clustering method and it selects K and initial seed values automatically. We tested the proposed methods with various document style images captured by three different cameras. We confirmed that the extraction rates are good enough to be used in real-life applications.

Content-based image retrieval (CBIR) is a technique for images retrieval based on their visual features, i.e. induced by their pixels. The images are, classically, described by the image feature vectors. Those vectors reflect the texture, color or a combination of them. The accuracy of the CBIR system is highly influenced by the (i) definition of the image feature vector describing the image, (ii) indexing and (iii) retrieval process. In this paper, we propose a new CBIR system entitled ISE (Image Search Engine). Our ISE system defines the optimum combination of color and texture features as an image feature vector, including the Particle Swarm Optimization (PSO) algorithm and employing an Interactive Genetic Approach (GA) for the indexing process. The performance analysis shows that our suggested PCM (Proposed Combination Method) upgrades the average precision metric from 66.6% to 89.30% for the “Food” category color histogram, from 77.7% to 100% concerning CCVs (Color Coherence Vectors) for the “Flower” category and from 58% to 87.65% regarding the DCD (Dominant Color Descriptor) for the “Building” category using the Corel dataset. Besides, our ISE system showcases an average precision of 98.23%, which is significantly higher than other CBIR systems presented in related works.

Relevance Feedback (RF) is a powerful technique in Content-Based Image Retrieval (CBIR) system and has become a very active research topic in the past few years. At the early stage of CBIR, research primarily focused on exploring various feature representation and ignored the subjectivity of human perception. There exists a gap between high-level concepts and low-level features. As an effective solution, the RF technique has been used on many CBIR systems to improve the retrieval precision. In this paper, a combined automatic weighting and relevance feedback method is proposed to improve the retrieval performance of CBIR. An approach using genetic algorithm for computing the initial weight of feature vector was introduced. By moving the query vector and updating the weighting factors simultaneously, the convergence speed of the relevance feedback retrieval is accelerated. Experimental results show that this method achieves high accuracy and effectiveness in CBIR.

Content-based image retrieval (CBIR) has suffered from the lack of linkage between low-level features and high-level semantics. Although relevance feedback (RF) CBIR provides a promising solution involving human interaction, certain query images poorly represented by low-level features still have unsatisfactory retrieval results. An innovative method has been proposed to increase the percentage of relevance of target image database by using graph cuts theory with the maximum-flow/minimum-cut algorithm and relevance feedback. As a result, the database is reformed by keeping relevant images while discarding irrelevant images. The relevance is increased and thus during following RF-CBIR process, previously poorly represented relevant images have higher probability to appear for selection. Better performance and retrieval results can thus be achieved.

Introduction: Content-based image retrieval (CBIR) retrieves the images from the vast image repositories. Research in the CBIR domain gets attention due to the massive number of images generated by the mobiles and various image-capturing machines. Objectives: Any image retrieval system’s primary goal is to reduce the semantic gap between low-level features and high-level perception. Methods: The CBIR techniques are classified into multiple categories based on the feature extraction and retrieval mechanism. These categories are feature-based, machine-learning-based, and deep-learning-based methods. The pioneer techniques for each category are explained in detail in this chapter. Results: The comparative analysis has been done to highlight the advantages of techniques over others. Conclusion: The various application area of the CBIR has been described. The most evolving application is the content-based medical image retrieval (CBMIR) system. The applicability of the CBMIR system in different medical science domains is explained in detail.