Content-Based Image Retrieval Using Deep Feature Extraction with ResNet-50

A novel approach for water quality classification based on the integration of deep learning and feature extraction techniques

Determining potential applications for personalized college English instruction through deep feature extraction and scene feature mining is essential for enabling Deep Learning assisted AI systems to generate effective educational outcomes. Traditional instructional approaches often struggle within dynamic digital environments, as they overlook variations in students’ learning styles, engagement levels, and behavioral patterns. This research proposes a hybrid methodology that integrates Convolutional Neural Networks for deep audio feature extraction with Random Forest algorithms for contextual and scene feature mining. The objective is to construct a personalized learning environment capable of adapting dynamically in real time to individual learner behaviors and preferences. A hybrid deep learning model is introduced to predict teaching effectiveness using speech related features such as clarity, rhythm, and engagement level. Feature fusion is employed by combining audio based deep features with contextual scene features to classify teaching effectiveness into three categories: low, medium, and high. Experimental results demonstrate strong predictive performance, achieving an accuracy of 0.9900, precision of 0.9906, recall of 0.9907, and an F1 measure of 0.9905, with minimal performance fluctuations. This AI assisted instructional framework enables college English teachers to enhance teaching quality by receiving immediate, data driven feedback, ultimately fostering improved student centered learning experiences.

Temporal lobe injury (TLI), a form of nervous system damage in the brain, is a major neurological complication after radiation therapy (RT). TLI must be highly valued because of the irreversible brain injury. This article aims to develop a predictive pipeline, called deep longitudinal feature representations (DLFR), to detect TLI at the presymptomatic stage accurately via the learning of effective deep longitudinal feature representations. DLFR characterizes high-level information and developmental changes within and across subjects The DLFR consists of four components: (i) extraction of deep features from a pretrained ResNet50 model; (ii) compression of learned highly representative features by the global max pooling; (iii) fusion of deep longitudinal features for the fully use of all follow-up data; (iv) random forest-based prediction of the diagnostic status. In total, 244 nasopharyngeal carcinoma patients before and after RT with a follow-up period of 0 ~ 9 years were included for analysis. All patients were divided into four different latency groups, and the current latency was used for training to predict the diagnostic status of the next latency. The AUCs of the predicted three different latency groups using DLFR were 0.64 ± 0.11, 0.76 ± 0.10, and 0.88 ± 0.05, while those of radiomics features were 0.56 ± 0.06, 0.63 ± 0.03, and 0.53 ± 0.04, and those of histogram of oriented gradients features were 0.60 ± 0.09, 0.52 ± 0.03, and 0.58 ± 0.06. Most importantly, the AUCs of the predicted three different latency groups for white matter regions were 0.66 ± 0.10, 0.80 ± 0.09, and 0.78 ± 0.09. Our proposed method can dynamically detect TLI at the presymptomatic stage, which can enable the administration of preventive neurological intervention.

Content-based image retrieval is a method of retrieving images based on its semantic features. Classical CBIR models in the literature uses low-level features like color, shape, and texture to retrieve similar images from the database. Low-level features work well when the dataset is small; however, it fails to reduce the semantic gap when the image database becomes large and diverse. In the recent past, many researchers have exploited the usage of pretrained neural network as a feature extractor capable of giving a high-level feature representation for images. In this chapter, we use the output vectors of intermediate layers of an Inception Resnet deep learning model as the feature representation for image retrieval. The high-level feature vectors obtained from the deep layers of Inception Resnet are clustered using K-means clustering algorithm to make the retrieval process faster. The second part of the chapter explores various distance metrics to find most similar images corresponding to the query image. Based on the analysis on various distance measures, it is found that Hamming distance performs better than Euclidean distance in retrieving similar images when using deep features owing to the sparse nature of the feature vectors produced by the intermediate deep layers of Inception Resnet.KeywordsContent-based image retrieval Deep learning Hamming distance K-means clustering Deep features for CBIR Image retrieval

In the field of computer vision and image processing CBIR (Content based image retrieval) system become an active research area. The CBIR technique involves feature extraction based on image features (like color, shape and texture) and defining rules for comparing image. A classifier is also used by authors for image classification. For this purpose an image database taken from James Z. Wang research group website is used by many authors. Due to enormous increase in the size of database traditional methods of image retrieval by using keywords does not provide accurate result. Thus the concept of CBIR system is emerged. In last couple of years many method of feature extraction is developed but since now researcher are not able to develop a system which has gained high accuracy of human visual perception in distinguishing pictures. Therefore earlier researchers have concentrated to increase the retrieval accuracy of CBIR system by using different combination of features. The objective of this paper is to present review on a CBIR technique which combined four kinds of features set including every kind of feature for developing feature vector. Color based features (histogram), statistical features (mean, median and standard deviation), spatial features (Gabor feature and wavelet features) and texture features (GLCM) is used for forming feature vector. A SVM classifier is used with CBIR system to increase retrieval accuracy. SVM (support vector machine) is a machine learning classifier which provides good classification accuracy. Keywords: CBIR, SVM, NN, GLCM, HSV Color space, Euclidean distance matrix.

The classification of hyperspectral images (HSIs) is one of the most popular topics in the remote sensing community. Numerous feature extraction methods have been proposed to improve the classification accuracy of HSIs. Recently, deep features extracted by convolution neural network (CNN) have been introduced into the classification process of HSIs. Due to the nonlinear and invariant advantages of the features, CNN methods provide a powerful tool for representing geographic objects and classifying HSIs. However, traditional deep features only extracted at pixel-level and often neglect multiscale characteristics of geographic objects. In this study, a new deep feature extraction method is proposed, which takes advantage of multi-scale object analysis and the CNN model. Firstly, multiscale image objects are obtained by the multiscale segmentation algorithm and multiscale low-level features of objects are extracted. Secondly, the CNN is devoted to obtain deep features from low-level object features at each scale, respectively. Thirdly, the obtained deep features at all scales are stacked and fed to one fully connected layer to extract the multiscale deep learning features for classification. Finally, the logistic regression classifier is applied to hyperspectral image (HSI) classification based on object-oriented multiscale deep features. The proposed method was carried out on three widely used hyperspectral data sets: University of Pavia, Salinas, and Washington DC. The results reveal that the proposed method provides better results than other state-of-the-art methods.

Medical imaging is becoming a vital component of war on cancer. Tremendous amounts of medical image data are captured and recorded in a digital format during cancer care and cancer research. Facing such an unprecedented volume of image data with heterogeneous image modalities, it is necessary to develop effective and efficient content-based medical image retrieval systems for cancer clinical practice and research. While substantial progress has been made in different areas of content-based image retrieval (CBIR) research, direct applications of existing CBIR techniques to the medical images produced unsatisfactory results, because of the unique characteristics of medical images. In this paper, we develop a new multimodal medical image retrieval approach based on the recent advances in the statistical graphic model and deep learning. Specifically, we first investigate a new extended probabilistic Latent Semantic Analysis model to integrate the visual and textual information from medical images to bridge the semantic gap. We then develop a new deep Boltzmann machine-based multimodal learning model to learn the joint density model from multimodal information in order to derive the missing modality. Experimental results with large volume of real-world medical images have shown that our new approach is a promising solution for the next-generation medical imaging indexing and retrieval system.

DNA is emerging as a promising medium for storing huge volumes of data in a confined space that remains intact for thousands of years. Although this technique is very efficient, especially for multimedia data like images, there is a lack of efficient searching and retrieval technique. This paper addresses this issue and proposes a novel Content Based Image Retrieval (CBIR) technique to retrieve similar images from the generated DNA-based image feature vectors. The features are obtained by a novel encoding scheme that uses the three Most-Significant Bits from the images and converts them into a string of nucleotides that follow run length and GC constraints to form DNA planes stored in a DNA medium. The nucleotides in these planes are interpreted through three consecutive sequences forming codons. The codon-based features are then utilized to perform instance-based image retrieval. The DNA planes are further adapted and implemented on diverse deep learning architectures, including ResNet-50, VGG-16, VGG-19, and Inception V3, to facilitate classification-based image retrieval tasks. The system's performance has been assessed using a range of datasets, encompassing coral, medical, and multi-label images. Experimental results demonstrate that the proposed approach achieves notable improvements when compared to existing state-of-the-art methods.

As the use of digital media increases, effective retrieval and management techniques become more important. In order to extract useful information from this huge amount of data, many content based image retrieval (CBIR) systems have been developed. A typical CBIR system captures image features such as color, texture, or shape of objects in the query image and tries to retrieve images from the database with similar features. The main advantage of CBIR systems with relevance feedback is that these systems take into account the gap between the high-level concepts and low-level features and subjectivity of human perception of visual content. In this paper, a CBIR system based on color histogram has been presented and a new approach for image storage and retrieval called association-based image retrieval (ABIR) has been studied. The results of both systems have been shown.

A privacy-preserving content-based image retrieval method based on deep learning in cloud computing

In recent years a vast amount of visual content has been generated and shared from many fields, such as social media platforms, medical imaging, and robotics. This abundance of content creation and sharing has introduced new challenges, particularly that of searching databases for similar content - Content Based Image Retrieval (CBIR) - a long-established research area in which improved efficiency and accuracy are needed for real-time retrieval. Artificial intelligence has made progress in CBIR and has significantly facilitated the process of instance search. In this survey we review recent instance retrieval works that are developed based on deep learning algorithms and techniques, with the survey organized by deep feature extraction, feature embedding and aggregation methods, and network fine-tuning strategies. Our survey considers a wide variety of recent methods, whereby we identify milestone work, reveal connections among various methods and present the commonly used benchmarks, evaluation results, common challenges, and propose promising future directions.

Wind speed forecasting is important for high‐efficiency utilisation of wind energy and management of grid‐connected power systems. Due to the noise, instability and irregularity of atmosphere system, the current models based on raw historical data have encountered many problems. In this study, a deep novel feature extraction approach is developed based on stacked denoising autoencoders and batch normalisation. Then the deep features extracted from raw historical data are fed to long short‐term memory (LSTM) neural networks for prediction. Meanwhile, density‐based spatial clustering of applications with noise is employed to process the numerical weather prediction data. By picking out the abnormal samples, the representative training samples are selected to improve the efficiency of the model. For illustration and verification purposes, the proposed model is used to predict the wind speed of Wind Atlas for South Africa (WASA). Empirical results show that deep feature extraction can improve the forecasting accuracy of LSTM 49% than feature selection, indicating that proper feature extraction is crucial to wind speed forecasting. And the proposed model outperforms other benchmark methods at least 17%. Hence, the proposed model is promising for wind speed forecasting.

Radiologists are now confronted with the difficulty of interpreting cross-sectional studies composed of thousands of images. In hospitals, all acquired imaging data are stored in a picture archiving and communication system (PACS). To take advantage of these masses of previously interpreted images, with the ultimate goal to facilitate the diagnosis of new cases, a promising approach would be to integrate a Content-Based Image Retrieval (CBIR) system into PACS. CBIR system performances are inherently limited by the features considered to represent the images. The current state of the art for the extraction of visual features relies on deep learning which requires a sufficient amount of annotated data to learn a generalizable model, such annotated data being rare and difficult to use in medical imaging. At the same time, PACS contain additional information such as radiological reports which supplement visual information carried by the images. We study here how such semantic information, hidden in these reports, can be used to supervise the learning of neuronal models to build a better visual representation of images. In this context our contribution is threefold. We first adapted a contrastive learning approach, which is usually used to learn representation from pairs of positive images in an unsupervised manner, to deal with in-domain medical data. Second, to train such a model to be robust and generalizable with a sufficient amount of data, we propose to re-employ the "dormant" medical imaging literature. Finally, the visual features and the deep models learned in this way, can be considered in CBIR systems as coarse-grained information which can then be fine-tuned in PACS, with more specific images depending on the applications. The obtained experimental result with state of the art contrastive learning methods highlight the interest of this approach.

As we all know, the content-based image retrieval (CBIR) is very time-consuming due to the extraction and matching of high dimensional and complex features. The traditional CBIR systems could not respond to a very large number of retrieval requests at mean time, which are submitted from the Internet. In this paper, we propose a content-based parallel image retrieval system to achieve high responding ability. Our system is developed on cluster architectures. It has several retrieval servers to supply the service of content-based image retrieval. Our system adopts the Browser/Server (B/S) mode. The users could visit our system though web pages. Our system uses the Symmetrical Color-Spatial Features (SCSF)[25] to represent the content of an image. The SCSF is effective and efficient for image matching because it is independent of image distortion such as rotation and flip as well as it increases the matching accuracy. The SCSF was organized by M-tree[16], which could speedup the searching procedure. Our experiments show that the image matching is quickly and efficiently with the use of SCSF. And with the support of several retrieval servers, the system could respond to many users at mean time. (Abstract)

Introduction: Content-based image retrieval (CBIR) retrieves the images from the vast image repositories. Research in the CBIR domain gets attention due to the massive number of images generated by the mobiles and various image-capturing machines. Objectives: Any image retrieval system’s primary goal is to reduce the semantic gap between low-level features and high-level perception. Methods: The CBIR techniques are classified into multiple categories based on the feature extraction and retrieval mechanism. These categories are feature-based, machine-learning-based, and deep-learning-based methods. The pioneer techniques for each category are explained in detail in this chapter. Results: The comparative analysis has been done to highlight the advantages of techniques over others. Conclusion: The various application area of the CBIR has been described. The most evolving application is the content-based medical image retrieval (CBMIR) system. The applicability of the CBMIR system in different medical science domains is explained in detail.