Design of Feature Extraction in Content Based Image Retrieval (CBIR) using Color and Texture

A conventional color histogram (CCH) considers neither the color similarity across different bins nor the color dissimilarity in the same bin. Therefore, it is sensitive to noisy interference such as illumination changes and quantization errors. Furthermore, CCHs large dimension or histogram bins requires large computation on histogram comparison. To address these concerns, this paper presents a new color histogram representation, called fuzzy color histogram (FCH), by considering the color similarity of each pixel's color associated to all the histogram bins through fuzzy-set membership function. A novel and fast approach for computing the membership values based on fuzzy c-means algorithm is introduced. The proposed FCH is further exploited in the application of image indexing and retrieval. Experimental results clearly show that FCH yields better retrieval results than CCH. Such computing methodology is fairly desirable for image retrieval over large image databases.

Content-based image retrieval (CBIR) has turned into an important and active potential research field with the advance of multimedia and imaging technology. It makes use of image features, such as color, texture and shape, to index images with minimal human intervention. A CBIR system can be used to locate medical images in large databases. In this paper we propose a CBIR system which describes the methodology for retrieving digital human brain magnetic resonance images (MRI) based on textural features and the Adaptive neuro-fuzzy inference system (ANFIS) learning to retrieve similar images from database in two categories: normal and tumoral. A fuzzy classifier has been used, because of the uncertainty in the results of classifier and capacity of learning. ANFIS is a good candidate for our categorization problem. Our proposed CBIR system can locate a query image in the category of normal or tumoral images in the online retrieval part. Finally, using a relevance feedback, we improve the effectiveness of our retrieval system. This research uses the knowledge of the CBIR approach to the application of medical decision support and discrimination between the normal and abnormal medical images based on features. We present and compare the results of the proposed method with the CBIR systems used in recent works. The experimental results indicate that the proposed method is reliable and has high image retrieval efficiency compared with the previous works.

Content-based image retrieval (CBIR) techniques will be part of the next generation of search engines. However, even with a suitable retrieval method, real-time image retrieval from a large image database still requires extremely high computational power. In this paper, a Web-based image database indexing and retrieval system is described. It uses fast CBIR with Beowulf-Class parallel computing engine (Super Abacus) to efficiently and effectively shorten the retrieval time. Content-based image retrieval with several parallel algorithms for images which query different color spaces and the compressed-domain of the images are developed to achieve higher efficiency. Text-based query is also supported for images using a conventional annotation approach.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

In the field of computer vision and image processing CBIR (Content based image retrieval) system become an active research area. The CBIR technique involves feature extraction based on image features (like color, shape and texture) and defining rules for comparing image. A classifier is also used by authors for image classification. For this purpose an image database taken from James Z. Wang research group website is used by many authors. Due to enormous increase in the size of database traditional methods of image retrieval by using keywords does not provide accurate result. Thus the concept of CBIR system is emerged. In last couple of years many method of feature extraction is developed but since now researcher are not able to develop a system which has gained high accuracy of human visual perception in distinguishing pictures. Therefore earlier researchers have concentrated to increase the retrieval accuracy of CBIR system by using different combination of features. The objective of this paper is to present review on a CBIR technique which combined four kinds of features set including every kind of feature for developing feature vector. Color based features (histogram), statistical features (mean, median and standard deviation), spatial features (Gabor feature and wavelet features) and texture features (GLCM) is used for forming feature vector. A SVM classifier is used with CBIR system to increase retrieval accuracy. SVM (support vector machine) is a machine learning classifier which provides good classification accuracy. Keywords: CBIR, SVM, NN, GLCM, HSV Color space, Euclidean distance matrix.

In content based image retrieval (CBIR) process, every image has been represented in a compact set of local visual features i.e. color, texture, and/or shape of images. This set of local visual features is known as feature vector. In the CBIR process, feature vectors of images have been used to represent or to identify similar images in adequate way. As a result, feature vector construction has always been considered as an important issue since it must reflect proper image semantics using minimal amount of data. The proposed CBIR scheme is based on the combination of color and texture features. In this work initially, we have converted the given RGB image into HSV color image. Subsequently, we have considered H (hue), S (saturation), and V (intensity) components for extraction of visual image features. The texture features have been extracted from the V component of the image using 2D dual-tree complex wavelet transform (2D DT-CWT) where it analyzes the textural patterns in six different directions i.e. ±15\(^{\circ }\), ±45\(^{\circ }\), and ±75\(^{\circ }\). At the same time, we have computed the probability histograms of H and S components of the image respectively and subsequently those are divided into non-uniform bins based on cumulative probability for extraction of color based features. So, in this work both the color and texture features have been extracted simultaneously. Finally, the obtained features have been concatenated to attain the final feature vector and same is considered in image retrieval process. We have tested the novelty and performance of the proposed work in two Corel, two objects, and, a texture image datasets. The experimental results reveal the acceptable retrieval performances for different types of datasets.

Content-Based Image Retrieval (CBIR) Systems are becoming increasingly important and finding application in diverse areas of discipline. Due to disturbing factors present in images, e.g. non-uniform illumination and lightening intensities, the retrieval results are not always satisfactory. In this paper, we discuss how fuzzy set theory can be used to formulate an efficient image signature. This signature is 1-D Fuzzy Color Histogram (FCH) consisting of a small number of bins. The signature is obtained from image contents by considering the contribution of each pixels color to all the histogram bins through the use of fuzzy-sets membership functions. Experimental results on a database of over 10,000 images demonstrate that the proposed system is less sensitive light intensity changes and more robust than the Conventional Color Histogram (CCH) in retrieval precision.

Image retrieval is an important problem in multimedia systems. It is determined as the process of searching and fetching images from a dataset. Content-based Image Retrieval (CBIR) is a significant and challenging field of research in digital image processing. The CBIR system's essential requirement is to retrieve the relevant information following a query image with higher system output from a large image database. Unfortunately, not all the methods are suitable to be used to get high accuracy of retrieval. Therefore, this research aims to classify the data of query image with the data of image database to get a similar image retrieval using Support Vector Machine (SVM) and validate its accuracy based on the classification for the performance evaluation using the precision-recall measure. The critical point of SVM is to get an optimal hyperplane that separates the data points into two classes. This method was applied to different image databases because the classified-based proposed scheme proved better performance than various existing methods. This project assessed experimental results toward 500 images of the Caltech-256 image dataset to demonstrate the proposed method. For retrieving a similar image following the query image, 20 images from five classes were successfully retrieved by using this method. It will show that the SVM method's average accuracy from all image classes is 94.79%.

Content-based image retrieval (CBIR) is an application of computer vision techniques to the image retrieval problem. That is, the problem of searching for digital images in large database. In this paper, we apply an image segmentation technique to an image retrieval system which is designed for the use on mobile devices. Given an image captured by the mobile devices, edge detection and region merging mechanisms are used in this segmentation technique to extract the ROI from a complex background scene. The proposed method automatically merges the regions that are initially segmented by mean shift segmentation, and then effectively extracts the object contour by the labeled regions as either background or foreground. With no users interaction, the experimental results show the method is more effective than other automatic segmentation methods.

Radiologists are now confronted with the difficulty of interpreting cross-sectional studies composed of thousands of images. In hospitals, all acquired imaging data are stored in a picture archiving and communication system (PACS). To take advantage of these masses of previously interpreted images, with the ultimate goal to facilitate the diagnosis of new cases, a promising approach would be to integrate a Content-Based Image Retrieval (CBIR) system into PACS. CBIR system performances are inherently limited by the features considered to represent the images. The current state of the art for the extraction of visual features relies on deep learning which requires a sufficient amount of annotated data to learn a generalizable model, such annotated data being rare and difficult to use in medical imaging. At the same time, PACS contain additional information such as radiological reports which supplement visual information carried by the images. We study here how such semantic information, hidden in these reports, can be used to supervise the learning of neuronal models to build a better visual representation of images. In this context our contribution is threefold. We first adapted a contrastive learning approach, which is usually used to learn representation from pairs of positive images in an unsupervised manner, to deal with in-domain medical data. Second, to train such a model to be robust and generalizable with a sufficient amount of data, we propose to re-employ the "dormant" medical imaging literature. Finally, the visual features and the deep models learned in this way, can be considered in CBIR systems as coarse-grained information which can then be fine-tuned in PACS, with more specific images depending on the applications. The obtained experimental result with state of the art contrastive learning methods highlight the interest of this approach.

In this article, we propose a novel system for feature selection, which is one of the key problems in content-based image indexing and retrieval as well as various other research fields such as pattern classification and genomic data analysis. The proposed system aims at enhancing semantic image retrieval results, decreasing retrieval process complexity, and improving the overall system usability for end-users of multimedia search engines. Three feature selection criteria and a decision method construct the feature selection system. Two novel feature selection criteria based on inner-cluster and intercluster relations are proposed in the article. A majority voting-based method is adapted for efficient selection of features and feature combinations. The performance of the proposed criteria is assessed over a large image database and a number of features, and is compared against competing techniques from the literature. Experiments show that the proposed feature selection system improves semantic performance results in image retrieval systems.

Given the growing amount of very large image databases, content based image retrieval (CBIR) is becoming more and more important. One of the major challenges in CBIR is the semantic gap - commonly used feature-based algorithms are not able to identify what really draws human attention in an image. This problem is more crucial for localized CBIR, where certain regions / parts of the image are what the user is really interested in. This paper explores how human gaze can be utilized to extract regions of interest (ROIs) of an image to perform attention based image retrieval. Using eye tracking data and knowledge about foveal and peripheral vision of humans, we present a foveal fixation clustering algorithm that automatically generates ROIs in an image while a person is viewing it. To objectively set different parameters of the algorithm, a small user study was conducted. The method was evaluated for use in a localized CBIR system. Image retrieval results using the publicly available SIVAL dataset were scored using mean average precision (MAP). Comparison to a saliency-based visual attention algorithm as well as to manually labeled regions showed that the retrieval results of the developed algorithm are nearly two times better than the saliency-based visual attention algorithm and very close to the results using hand-labeled regions.

Query by image content is a method to retrieve the most important images from the image database. It is an answer for the problem of searching for digital images in large database. A large number of relevance feedback schemes have been developed to improve the performance of content based image retrieval. In this paper we propose biased discriminant Euclidean embedding that form intraclass geometry and interclass discrimination. In this method images can be grouped by their similarity. In order to achieve this, firstly the visual features of the images are found out. In addition to this we use two clustering algorithms to assemble the images into clusters using their low level visual features. Here we have to filter the images in the hierarchical clustering and then apply the clustered images to K-Means, so that we can get the most relevant images. Query image is compared directly with the images in the clusters. Therefore number of comparisons is reduced because query image is compared only with the images in the clusters instead of comparing with all images in the database.

Semantic gap optimization is the major objective of Content Based Image Retrieval(CBIR) system. It is challenging to derive possible query objectives in case of an image having multiple objects or complex background. The query requirements are defined as the Bag of Words(BoW) and used for retrieval of the similar images. The saliency based segmentation is popularly used to eliminate the background objects that works well when the image is focused on the foreground objects. In case saliency-map fail to extract the foreground object, the feature vectors are equally biased by the background scene and that imposter the actual query objectiveThis paper proposes a two phase framework CBIR system. In the first phase we compute the Local Binary Pattern and the RGB Colour information(LBPC) features of all the images in the large image database. Then the pertinent images are clustered and the image on the cluster centre is assumed as ideal indexed image for the same class. In the second phase, each input image is divided into nine blocks having common central sub-block. The LBPC feature is extracted for all the blocks and only the feature of the block that best matches with the indexed image is stored in the database. The selection of the best block image feature minimizes the effect of the background scene. This approach helps select the potential saliency block of the image with respect to the indexed image. The result section shows the performance of the proposed framework while BoW is defined by the cluster indexed image.

As we all know, the content-based image retrieval (CBIR) is very time-consuming due to the extraction and matching of high dimensional and complex features. The traditional CBIR systems could not respond to a very large number of retrieval requests at mean time, which are submitted from the Internet. In this paper, we propose a content-based parallel image retrieval system to achieve high responding ability. Our system is developed on cluster architectures. It has several retrieval servers to supply the service of content-based image retrieval. Our system adopts the Browser/Server (B/S) mode. The users could visit our system though web pages. Our system uses the Symmetrical Color-Spatial Features (SCSF)[25] to represent the content of an image. The SCSF is effective and efficient for image matching because it is independent of image distortion such as rotation and flip as well as it increases the matching accuracy. The SCSF was organized by M-tree[16], which could speedup the searching procedure. Our experiments show that the image matching is quickly and efficiently with the use of SCSF. And with the support of several retrieval servers, the system could respond to many users at mean time. (Abstract)