Feature extraction and relevance evaluation for heterogeneous image database recognition

Introduction: Content-based image retrieval (CBIR) retrieves the images from the vast image repositories. Research in the CBIR domain gets attention due to the massive number of images generated by the mobiles and various image-capturing machines. Objectives: Any image retrieval system’s primary goal is to reduce the semantic gap between low-level features and high-level perception. Methods: The CBIR techniques are classified into multiple categories based on the feature extraction and retrieval mechanism. These categories are feature-based, machine-learning-based, and deep-learning-based methods. The pioneer techniques for each category are explained in detail in this chapter. Results: The comparative analysis has been done to highlight the advantages of techniques over others. Conclusion: The various application area of the CBIR has been described. The most evolving application is the content-based medical image retrieval (CBMIR) system. The applicability of the CBMIR system in different medical science domains is explained in detail.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

In the field of computer vision and image processing CBIR (Content based image retrieval) system become an active research area. The CBIR technique involves feature extraction based on image features (like color, shape and texture) and defining rules for comparing image. A classifier is also used by authors for image classification. For this purpose an image database taken from James Z. Wang research group website is used by many authors. Due to enormous increase in the size of database traditional methods of image retrieval by using keywords does not provide accurate result. Thus the concept of CBIR system is emerged. In last couple of years many method of feature extraction is developed but since now researcher are not able to develop a system which has gained high accuracy of human visual perception in distinguishing pictures. Therefore earlier researchers have concentrated to increase the retrieval accuracy of CBIR system by using different combination of features. The objective of this paper is to present review on a CBIR technique which combined four kinds of features set including every kind of feature for developing feature vector. Color based features (histogram), statistical features (mean, median and standard deviation), spatial features (Gabor feature and wavelet features) and texture features (GLCM) is used for forming feature vector. A SVM classifier is used with CBIR system to increase retrieval accuracy. SVM (support vector machine) is a machine learning classifier which provides good classification accuracy. Keywords: CBIR, SVM, NN, GLCM, HSV Color space, Euclidean distance matrix.

In this paper, we propose a parallel computing technique for content-based image retrieval (CBIR) system. This technique is mainly used for single node with multi-core processor, which is different from those based on cluster or network computing architecture. Due to its specific applications (such as medical image processing) and the harsh terms of hardware resource requirement, the CBIR system has been prevented from being widely used. With the increasing volume of the image database, the widespread use of multi-core processors, and the requirement of the retrieval accuracy and speed, we need to achieve a retrieval strategy which is based on multi-core processor to make the retrieval faster and more convenient than before. Experimental results demonstrate that this parallel architecture can significantly improve the performance of retrieval system. In addition, we also propose an efficient parallel technique with the combinations of the cluster and the multi-core techniques, which is supposed to gear to the new trend of the cloud computing.

Content-based image retrieval (CBIR) techniques will be part of the next generation of search engines. However, even with a suitable retrieval method, real-time image retrieval from a large image database still requires extremely high computational power. In this paper, a Web-based image database indexing and retrieval system is described. It uses fast CBIR with Beowulf-Class parallel computing engine (Super Abacus) to efficiently and effectively shorten the retrieval time. Content-based image retrieval with several parallel algorithms for images which query different color spaces and the compressed-domain of the images are developed to achieve higher efficiency. Text-based query is also supported for images using a conventional annotation approach.

There is a growing trend for using content‐based image retrieval (CBIR) systems these days because of the constantly growing interest in digital content. Therefore, the ability of the CBIR to perform the CBIR process will depend on the feature extraction process and its basis, for the retrieval will be done on. Numerous researchers put forward various techniques for feature extraction to enhance the nature of the system. Since features play a very key role in enhancing performance, various features can be used collectively to attain the requisite goal. To retain this in mind, we present in this paper a multifeature fusion system, where three features are integrated and form one feature to improve the situation of retrieval. For this purpose, scale‐invariant feature transform (SIFT), speeded‐up robust features (SURF), and histogram of oriented gradients (HOG) features are adopted. These features are common features that deliver information about the shape of the object and for matching purposes, two techniques of distance matching such as Euclidean and Hausdrauff distance are adopted. To assess the performance of the proposed multifeature‐based CBIR approach, experiments were conducted with the usage of a MATLAB simulator. The Corel‐1000 dataset, consisting of 10,000 images in 100 semantic classes, turned into applied, with each magnificence containing 100 images. A subset of 2500 images across 50 semantic classes was used to train the system. This research aligns with industry, innovation, and infrastructure by contributing to advancements in image processing and retrieval systems. Key characteristic descriptors, along with SIFT, SURF, HOG, texture, and multicharacteristic combinations, were extracted for retrieval functions. The results display that the usage of the Hausdrauff distance as a similarity degree outperforms Euclidean distance, accomplishing retrieval accuracies of 80.02% for HOG, 77.9% for SIFT, 79. 8% for SURF, 77.2% for texture, and 84.2% for multicharacteristic combinations, surpassing Euclidean distance results via 1.7%–3.6% across capabilities. These findings underscore the effectiveness of Hausdrauff distance in enhancing retrieval precision within the CBIR framework.

Purpose Due to the worldwide growth of digital image sharing and the maturity of the tourism industry, the vast and growing collections of digital images have become a challenge for those who use and/or manage these image data across tourism settings. To overcome the image indexing task with less labour cost and improve the image retrieval task with less human errors, the content-based image retrieval (CBIR) technique has been investigated for the tourism domain particularly. This paper aims to review the relevant literature in the field to understand these previous works and identify research gaps for future directions. Design/methodology/approach A systematic and comprehensive review of CBIR studies in tourism from the year 2010 to 2019, focussing on journal articles and conference proceedings in reputable online databases, is conducted by taking a comparative approach to critically analyse and address the trends of each fundamental element in these research experiments. Findings Based on the review of the literature, the trends of CBIR studies in tourism is to improve image representation and retrieval by advancing existing feature extraction techniques, contributing novel techniques in the feature extraction process through fine-tuning fusion features and improving image query of CBIR systems. Co-authorship, tourist attraction sector and fusion image features have been in focus. Nonetheless, the number of studies in other tourism sectors and available image databases could be further explored. Originality/value The fact that no existing academic review of CBIR studies in tourism makes this paper a novel contribution.

Content-based image retrieval (CBIR) system helps users retrieve relevant images based on their contents. A reliable content-based feature extraction technique is therefore required to effectively extract most of the information from the images. These important elements include texture, colour, intensity or shape of the object inside an image. CBIR, when used in medical applications, can help medical experts in their diagnosis such as retrieving similar kind of disease and patientpsilas progress monitoring. In this paper, several feature extraction techniques are explored to see their effectiveness in retrieving medical images. The techniques are Gabor transform, discrete wavelet frame, Hu moment invariants, Fourier descriptor, gray level histogram and gray level coherence vector. Experiments are conducted on 3,032 CT images of human brain and promising results are reported.

With the rapid growing volume of images in medical databases, development of efficient image retrieval systems to retrieve relevant or similar images to a query image has become an active research area. Despite many efforts to improve the performance of techniques for accurate image retrieval, its success in biomedicine thus far has been quite limited. This article presents an adaptive content-based image retrieval (CBIR) system for improving the performance of image retrieval in mammographic databases. In this work, the authors propose a new relevance feedback approach based on incremental learning with support vector machine (SVM) regression. Also, the authors present a new local perturbation method to further improve the performance of the proposed relevance feedback system. The approaches enable efficient online learning by adapting the current trained model to changes prompted by the user's relevance feedback, avoiding the burden of retraining the CBIR system. To demonstrate the proposed image retrieval system, the authors used two mammogram data sets: A set of 76 mammograms scored based on geometrical similarity and a larger set of 200 mammograms scored by expert radiologists based on pathological findings. The experimental results show that the proposed relevance feedback strategy improves the retrieval precision for both data sets while achieving high efficiency compared to offline SVM. For the data set of 200 mammograms, the authors obtained an average precision of 0.48 and an area under the precision-recall curve of 0.79. In addition, using the same database, the authors achieved a high pathology matching rate greater than 80% between the query and the top retrieved images after relevance feedback. Using mammographic databases, the results demonstrate that the proposed approach is more accurate than the model without using relevance feedback not only in image retrieval but also in pathology matching while maintaining its effectiveness for online relevance feedback applications.

The theme of the work presented here is image retrieval using texture patterns generated from Haar transform matrix and image bitmaps. Different texture patterns namely '4-pattern', '16-pattern', '64-pattern', '256-pattern' and '1024-pattern' are generated using Haar transform matrix and then compared with the bitmap of an image to generate the feature vector as the matching number of ones and minus ones per texture pattern. The proposed content based image retrieval (CBIR) techniques are tested on a generic image database having 1000 images spread across 11 categories. For each proposed CBIR technique 55 queries (randomly selected 5 per category) are fired on the image database. To compare the performance of image retrieval techniques, crossover point of average precision and recall values of all the queries are computed per image retrieval technique. Ameliorated performance (higher precision and recall values) has been observed with the proposed methods compared to the colour averaging based image retrieval techniques. Further the performance of proposed image retrieval methods is enhanced using the combination of original image and even image part. In the discussed image retrieval methods, the combination of original and even image part for 256-pattern texture gives the highest crossover point of precision and recall reflecting better performance.

Image retrieval is a critical task in many fields such as indexing and Content-Based Image Retrieval is a tried and tested method for image retrieval. With advances in graphics and visualization techniques, image retrieval should be easy, quick and flexible. The aim of this work is to develop an efficient image indexing and retrieval system to collate similar images or images based on conditioned queries in the form of an image itself. The indexing method has been performed using wavelet transform and related mechanisms. Its detailing can easily entail description from a broad range to a narrow range. The indexing algorithm applies a Haar Wavelet-Based Perceptual Similarity Index (HaarPSI) for Image Quality Assessment. The HaarPSI utilizes the coefficients obtained from a Haar wavelet decomposition to assess local similarities between two images, as well as the relative importance of image areas. Results show that the algorithm used is able to retrieve and display images with high retrieval accuracy and medium relevance.The proposed methodology has been tested against known image retrieval techniques and was found to be comparable and in some cases better than most prior known techniques. The testing was performed on images of varied types, from multiple datasets and sizes. The accuracy was found to be 99% in most cases. All in all, this study introduces a simple and convenient way of offline image searches on desktop computers and provides a stepping stone to future content-based image retrieval systems built for similar purposes.

Cancer is a sickness brought about by an uncontrolled division of eccentric cells in any part of human body. It is in the top of few places in the killer disease list and pervades in the entire world, but still on the rise. Most of the cases an early detection of lung cancer is cumbersome. This research paper is aimed to present an effective and an efficient way of computer-assisted detection method for lung cancer. In this research we used a set of lung computed tomography scanned images as inputs, obtained from lung image archives and applied image processing techniques such as feature extraction, segmentation. In this approach, a proper combination of Adaptive thresholding segmentation algorithm has been used for segmenting input images, a well-known Support Vector Machine image classification algorithm has been used for lung tumor classification and Content-based image retrieval technique has been used to compare lung image features such as contract, intensity, texture and shape. A set of patient personal data is included to get more accurate and correct prediction results, and it is dealt with data mining approach. The proposed segmentation method shows improved prediction results.

Nowadays, Content Based Image retrieval (CBIR) has been one of the most interesting research areas among researchers of technology-giants and academic institutions. Various CBIR techniques in literature show that there are three key properties in image retrieval viz. color, texture and shape. In this paper a detailed classification along with the challenges and issues of CBIR techniques evolved during recent years covering various methods for segmentation, feature extraction, indexing and feature transformation are described. Also, a technique of combining feature transformation with clustering algorithm is proposed for efficient image retrieval.

Content Based Image Retrieval (CBIR) system supports users to retrieve relevant medical images based on their features. Current content based image retrieval systems are incapable of providing exact results to the users. To address this problem a consistent feature extraction method is required for content based medical image retrieval system to extract similar features from the images. In this study discrete curvelet based feature extraction technique is proposed to retrieve similar images and the similarity distance is calculated by using Euclidean distance. The proposed method gives better precision and recall rate. Experimental results on a database of 200 MRI images.

Image Indexing and Retrieval Using Object-based Point Feature Maps