COLOR FEATURE WITH SPATIAL INFORMATION EXTRACTION METHODS FOR CBIR: A REVIEW

Image processing is a field to process the images according to horizontal and vertical axis to form some useful results. It deals with edge detection, image compression, noise removal, image segmentation, image identification, image retrieval and image variation etc. Customarily, there are two techniques i.e. text based image retrieval and content based image retrieval that are used for retrieving the image according to features and providing color to all pixel pairs. The system retrieval that is based on TBIR assists to recover an image from the database using annotations. CBIR extorts images to form a hefty degree database using the visual contents of an original image that is called low level features or features of an image. These visual features are extracted using feature extraction and then match with the input image. Histogram, color moment, color correlogram, Gabor filter and wavelet transform are various CBIR techniques that can be used autonomously or pooled to acquire enhanced consequences. This paper states about a novel technique for fetching the images from the image database using two low level features namely color based feature and texture based features. Two techniques- one is color correlogram (for color indexing) and another is wavelet transform (for texture processing) has also been introduced.

In the field of computer vision and image processing CBIR (Content based image retrieval) system become an active research area. The CBIR technique involves feature extraction based on image features (like color, shape and texture) and defining rules for comparing image. A classifier is also used by authors for image classification. For this purpose an image database taken from James Z. Wang research group website is used by many authors. Due to enormous increase in the size of database traditional methods of image retrieval by using keywords does not provide accurate result. Thus the concept of CBIR system is emerged. In last couple of years many method of feature extraction is developed but since now researcher are not able to develop a system which has gained high accuracy of human visual perception in distinguishing pictures. Therefore earlier researchers have concentrated to increase the retrieval accuracy of CBIR system by using different combination of features. The objective of this paper is to present review on a CBIR technique which combined four kinds of features set including every kind of feature for developing feature vector. Color based features (histogram), statistical features (mean, median and standard deviation), spatial features (Gabor feature and wavelet features) and texture features (GLCM) is used for forming feature vector. A SVM classifier is used with CBIR system to increase retrieval accuracy. SVM (support vector machine) is a machine learning classifier which provides good classification accuracy. Keywords: CBIR, SVM, NN, GLCM, HSV Color space, Euclidean distance matrix.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

Color histogram is widely used for image indexing in content-based image retrieval (CBIR). A color histogram describes the global color distribution of an image. It is very easy to compute and is insensitive to small changes in viewing positions. However, the histogram is not robust to large appearance changes. Moreover, the histogram might give similar results for different kinds of images if the distributions of colors are same in the images. On the other hand, color correlogram is efficiently used for image indexing in content-based image retrieval. Color correlogram extracts not only the color distribution of pixels in images like color histogram, but also extracts the spatial information of pixels in the images. The characteristic of the color Correlogram to take into account the spatial information as well as the distribution of color pixels greatly attracts the researcher for content based image retrieval. In this paper, we propose the image bin (histogram value divisions) separation technique followed by extracting maxima of frequencies and plotting a correlogram. At first, the histogram is first calculated for an image. After that, it is subdivided into four equal bins. Each bin is subdivided into four more bins and for every such subdivision the maxima of frequencies s calculated. This information is stored in the form of a correlogram. The distance between correlogram of the query image with the corresponding correlogram of database images is calculated. The proposed algorithm is tested on a database comprising a large number of images.

As we all know, the content-based image retrieval (CBIR) is very time-consuming due to the extraction and matching of high dimensional and complex features. The traditional CBIR systems could not respond to a very large number of retrieval requests at mean time, which are submitted from the Internet. In this paper, we propose a content-based parallel image retrieval system to achieve high responding ability. Our system is developed on cluster architectures. It has several retrieval servers to supply the service of content-based image retrieval. Our system adopts the Browser/Server (B/S) mode. The users could visit our system though web pages. Our system uses the Symmetrical Color-Spatial Features (SCSF)[25] to represent the content of an image. The SCSF is effective and efficient for image matching because it is independent of image distortion such as rotation and flip as well as it increases the matching accuracy. The SCSF was organized by M-tree[16], which could speedup the searching procedure. Our experiments show that the image matching is quickly and efficiently with the use of SCSF. And with the support of several retrieval servers, the system could respond to many users at mean time. (Abstract)

Introduction: Content-based image retrieval (CBIR) retrieves the images from the vast image repositories. Research in the CBIR domain gets attention due to the massive number of images generated by the mobiles and various image-capturing machines. Objectives: Any image retrieval system’s primary goal is to reduce the semantic gap between low-level features and high-level perception. Methods: The CBIR techniques are classified into multiple categories based on the feature extraction and retrieval mechanism. These categories are feature-based, machine-learning-based, and deep-learning-based methods. The pioneer techniques for each category are explained in detail in this chapter. Results: The comparative analysis has been done to highlight the advantages of techniques over others. Conclusion: The various application area of the CBIR has been described. The most evolving application is the content-based medical image retrieval (CBMIR) system. The applicability of the CBMIR system in different medical science domains is explained in detail.

Minimal matrices in the Bruhat order for symmetric (0,1)-matrices

On (0, 1)-matrices with prescribed row and column sum vectors

In this paper, we present a novel approach for medical content based image retrieval (searching for images which are pathologically similar to a given example) and demonstrate its performance on a dataset containing maxillofacial lesions. Recently, distributed databases at hospitals and CT scanning centers are related through Picture Archiving and Communication Systems (PACS). Hence, a content based image retrieval system is helpful for radiologists in medical diagnosis. In our proposed framework, a feature vector is extracted for each image and SIFT sparse codes are employed in this step. After feature extraction based on sparse coding and maximum pooling, we have utilized different similarity measures such as Euclidean norm, Manhattan distance and SVM classifier to choose most relevant images to the query image. We have evaluated our proposed framework on a dataset containing 2023 images belonging to 5 different categories: cleft, impaction, fracture, maxillary sinus cyst and healthy. Classification rate of 97.3% and precision versus recall curve indicate the effectiveness of sparse coding in content-based medical image retrieval.

Content-Based Image retrieval (CBIR) has gained a magnificent deal of consideration because of the digital image data's epidemic growth. The advancement of deep learning has enabled Convolutional Neural Networks to become an influential technique for extraction of discriminative image features. In recent years, convolutional neural networks (CNNs) have proven extremely effective at extracting unique information from images. In contrast to text-based image retrieval, CBIR gathers comparable images based primarily on their visual content. The use of deep learning, especially CNNs, for feature extraction and image processing has been shown to perform better than other techniques. In the proposed study, we investigate CNNs for CBIR focusing on how well they extract discriminative visual features and facilitate accurate image retrieval. Also Principal Component Analysis and Linear Discriminant Analysis are combined for optimization of features resulting in boosting the retrieval results. Using hierarchical representations learned by CNNs, we aim to improve retrieval accuracy and efficiency. In comparison with conventional retrieval techniques, our proposed CBIR system shows superior performance on a benchmark dataset.

Color correlograms are efficiently used for image indexing in content-based image retrieval. Color correlogram extracts not only the color distribution of pixels in images like color histogram, but also extracts the spatial information of pixels in the images. The characteristic of the color correlogram to take into account the spatial information as well as the distribution of color pixels greatly attracts the researcher for content based image retrieval. Even though, a single correlogram is not enough for efficient and robust image retrieval system. In this paper, we propose the use of color correlogram on multiresolution images. The multiresolution color correlogram gives much better retrieval efficiency, but with higher computations. The multiresolution images are generated using the median filters.

In the current years, advancements in medical imaging have prompted the rise of some massive databases, including the pictures from a different scope of modalities. Content based image retrieval (CBIR) is a kind of search that selects examples from an image set that have a similar content to an input query image. Each CBIR system consists of two substantial factors, feature extraction and similarity measure. Based on the type of these parts, many CBIR systems are proposed. In this paper we present not only how to design a CBIR system for MRI brain Tumor images, but also a comparison between the different implemented CBIR systems and ours. Furthermore, in this research, using a DML (Distance Metric Learning) instead of the rigid distance metric such as Euclidean distance as the Similarity measure has helped the researchers to obtain a better mAP (mean Average Precision) as the result. The experimental results of our CBIR system show that it has a better performance than other rivals in the field. The obtained mean average precision of our CBIR system is 92.41 that is significant in MRI brain tumor.

In a content-based image retrieval (CBIR) system, indexing feature vectors and the similarity measure between feature vectors are two key factors for retrieval performance. We present a new CBIR system with statistical-model based image feature extraction in the wavelet domain and a Kullback divergence based similarity measure. A two component Gaussian mixture model (GMM) in the wavelet domain is employed and the model parameters are used to form features for image indexing. A new Kullback divergence based similarity measure is then presented for image retrieval. The experimental results demonstrate that the similarity measure based on the Kullback divergence is more effective than conventional similarity measures, such as the city-block distance and the Euclidean distance. It is shown that the new CBIR system, with the combination of the GMM and the new Kullback divergence based similarity measure, outperforms most other methods in retrieval performance for texture images, while keeping a comparable level of computational complexity.

In the context of content-based image retrieval (CBIR) problem, an image is represented by feature vectors called descriptors, whose efficiency is essential to obtain a good performance in the image indexing and retrieval tasks. In this paper, we propose an algorithm to obtain an efficient color-based descriptor, which is a combination of Color Correlogram (CC) and Dominant Color (DC). The color-based descriptors, such as Histogram Intersection (HI) and DC take into account the global distribution of color in an image, while CC takes into account the local color distribution. So the combination of global and local color distribution provides a good image description. By its design, the proposed descriptor is more compact compared with the CC descriptor, which allows reducing computational complexity. Using the Average Retrieval precision (ARP) with different factors the effectiveness of the proposed descriptor is evaluated and compared with the conventional color-based descriptors, such as HI, CC and DC. The image database used in this work contains 500 images with 25 categories randomly selected from the Corel Dataset.

Radiologists are now confronted with the difficulty of interpreting cross-sectional studies composed of thousands of images. In hospitals, all acquired imaging data are stored in a picture archiving and communication system (PACS). To take advantage of these masses of previously interpreted images, with the ultimate goal to facilitate the diagnosis of new cases, a promising approach would be to integrate a Content-Based Image Retrieval (CBIR) system into PACS. CBIR system performances are inherently limited by the features considered to represent the images. The current state of the art for the extraction of visual features relies on deep learning which requires a sufficient amount of annotated data to learn a generalizable model, such annotated data being rare and difficult to use in medical imaging. At the same time, PACS contain additional information such as radiological reports which supplement visual information carried by the images. We study here how such semantic information, hidden in these reports, can be used to supervise the learning of neuronal models to build a better visual representation of images. In this context our contribution is threefold. We first adapted a contrastive learning approach, which is usually used to learn representation from pairs of positive images in an unsupervised manner, to deal with in-domain medical data. Second, to train such a model to be robust and generalizable with a sufficient amount of data, we propose to re-employ the "dormant" medical imaging literature. Finally, the visual features and the deep models learned in this way, can be considered in CBIR systems as coarse-grained information which can then be fine-tuned in PACS, with more specific images depending on the applications. The obtained experimental result with state of the art contrastive learning methods highlight the interest of this approach.