Efficient Content Based Video Retrieval System by Applying AlexNet on Key Frames

In this paper, a content-based video retrieval (CBVR) system called Bounded Coordinate of Motion Histogram version 2 (BCMH v2) was processed on a distributed computing platform by using Apache Hadoop framework and a real-time distributed storage system using HBase. In fact, the amount of multimedia data is growing exponentially. Most of this data is available in image and video models. Analyzing huge data involves complex algorithms, which leads to challenges in optimizing processing time and data storage capacity. Many content-based video retrieval systems are suitable for processing large video dataset, but they are limited by the computational time and/or storage on a single machine. Thus, this paper presents the effectiveness of the proposed method with the distributed computing platform and its evaluation on the HOLLYWOOD2 video dataset. The experimental results demonstrate the good performances of the proposed approach.

With the development of multimedia data types and available bandwidth there is huge demand of video retrieval systems as users shift from text based retrieval systems to content based retrieval systems (CBVRS). Selection of extracted features play an important role in content based video retrieval, regardless of video attributes under consideration. Good features selection also allows the time, space and cost saving in the retrieval process. This leads to the interest of selecting only those features that can be extracted from video data and used for indexing and retrieval along with similarity measurement methods. There are certain issues like video store, search, index and retrieve as a trend in area of content based video retrieval systems. In this paper, we have proposed a method. In this paper fractional discrete cosine transform coefficients are used to extract key frames which eventually save space and time with better completeness in the retrieval process.

With the development of multimedia data types and available bandwidth there\nis huge demand of video retrieval systems, as users shift from text based\nretrieval systems to content based retrieval systems. Selection of extracted\nfeatures play an important role in content based video retrieval regardless of\nvideo attributes being under consideration. These features are intended for\nselecting, indexing and ranking according to their potential interest to the\nuser. Good features selection also allows the time and space costs of the\nretrieval process to be reduced. This survey reviews the interesting features\nthat can be extracted from video data for indexing and retrieval along with\nsimilarity measurement methods. We also identify present research issues in\narea of content based video retrieval systems.\n

Rapid development of the multimedia and the associated technologies urge the processing of a huge database of video clips. The processing efficiency lies on the search methodologies utilized in the video processing system. Usage of inappropriate search methodologies may make the processing system ineffective. Hence, an effective video retrieval system is an essential pre-requisite for searching relevant videos from a huge collection of videos. In this paper, an effective content based video retrieval system based on some dominant features such as motion, color and edge is proposed. The system is evaluated using the video clips of format MPEG-2 and then precision-recall is determined for the test clip.

With the improvement of mixed media information composes and accessible transfer speed there is immense interest of video retrieving frameworks, as clients move from content based recovery frameworks to content based retrieval frameworks. Determination of removed features assume an imperative job in substance based video retrieving paying little mind to video qualities being under thought. This work assists the up and coming analysts in the field of video retrieving with getting the thought regarding distinctive procedures and strategies accessible for the video recovery. These highlights are proposed for choosing, ordering and positioning as indicated by their potential enthusiasm to the client. Great feature determination likewise permits the time and space expenses of the recovery procedure to be lessened. This overview surveys the fascinating highlights that can be separated from video information for ordering and retrieving alongside likeness estimation techniques. We likewise recognize present research issues in territory of content based video retrieving frameworks.

There has been tremendous growth of laparoscopic surgical video archives in the past few years. Finding the surgical videos manually from the database is very troublesome and time consuming. As a consequence, efficient methods for retrieval of such videos from a database are needed. In this paper, a content-based video retrieval (CBVR) system is presented using average intensity, colour and shape feature. In the proposed retrieval system, average intensity, colour and shape feature are used. The ordinal measure introduced by Bhat and Nayar, which is based on ranks rather than of their values is used in this work. This is important in the laparoscopic videos because adjacent frames can be distinguished on the basis of ranking of their average intensities. Experimental results reveal that mean average precision of the proposed technique is better than the existing motion intensity and direction descriptor (MIDD) approach. This reflects the effectiveness of proposed method.

Content Based Video Retrieval (CBVR) is so popular these days, because of the increased utilization of video based analytical systems. Video based analytics is quite effective than image analysis, as a series of actions are captured by the video. This ends up with better decision making ability. The CBVR systems play an important role in boosting the human–computer interaction. This paper presents a multimodal CBVR that takes both the visual and audio information into account for retrieving relevant videos to the user. Two modules are employed by this work to deal with video and audio data. The video data is processed to detect the significant frame from shots and is achieved by Lion Optimization Algorithm (LOA). The features are extracted from the visual data and with respect to the audio data, MHEC and LPCC features are extracted. The extracted features are clustered by Kernelized Fuzzy C Mean (KFCM) algorithm. Finally, the feature database is formed and is utilized in the query matching process during the testing phase. The performance of the proposed work is tested in terms of precision, recall, F-measure and time consumption rates. The proposed CBVR system proves better performance than the existing approaches and is evident through attained results.

The paper studies the influence on the similarity by extracting and using m from n frames on videos, the purpose is to evaluate the amount of the proportion similarity between them, and propose a new Content-Based Video Retrieval (CBVR) system. The proposed system uses a Bounded Coordinate of Motion Histogram (BCMH) [1] to characterize videos which are represented by spatio-temporal features (eg. motion vectors) and the Fast and Adaptive Bidimensional Empirical Mode Decomposition (FABEMD). However, a global representation of a video is compared pairwise with all those of the videos in the Hollywood2 dataset using the k-nearest neighbors (KNN). Moreover, this approach is adaptive: a training procedure is presented, and an accuracy of 58.1% is accomplished in comparison with the state-of-the-art approaches on the dataset of 1707 movie clips.

Currently there are several interactive content-based video retrieval techniques and systems available. However, retrieval performance depends heavily on the means of interaction. We argue that effective CBVR requires efficient, specialized user interfaces. In this article we propose guidelines for such an interface, and we propose an effective CBVR engine: the ForkBrowser, which builds upon the principle of focus and context. This browser is evaluated using a combination of user simulation and real user evaluation. Results indicate that the ideas have merit, and that the browser performs very well when compared to the state-of-the-art in video retrieval.

Recent advances in digital video compression and networks have made videos more accessible than ever. Several content-based video retrieval systems have been proposed in the past. In this chapter, we first review these existing content-based video retrieval systems and then propose a new framework, called ClassView, to make some advances towards more efficient content-based video retrieval. This framework includes: (a) an efficient video content analysis and representation scheme to support high-level visual concept characterization; (b) a hierarchical video classification technique to bridge the semantic gap between low-level visual features and high-level semantic visual concepts; and (c) a hierarchical video database indexing structure to enable video access over large-scale database. Integrating video access with efficient database indexing tree structures has provided a great opportunity for supporting more powerful video search engines.

The growing capacity of computers, the abundance of digital cameras and the increased connectivity of the world all point to large digital multimedia archives. They include images and videos from the World Wide Web, museum objects, flowers, trademarks, and views from everyday life. The faster they grow, the more prominently needed is the efficient access to the content of the images and videos. In this paper we have given important step of feature extraction, will be discussed in detail such as color, shape and texture information, particularly paying attention to discriminatory power and invariance. Then, we focus on the concepts of indexing and genre classification as intermediate step to sort the data. We pay attention to (interactive) ways to perform browsing and retrieval by means of information visualization and relevance feedback. Methods are being discussed to localize the retrieved objects in images. We adopt a hybrid approach for such text extraction by exploiting a number of characteristics of text blocks in color images and video frames. Our system detects both caption text as well as scene text of different font, size, color and intensity. Such texts are used for retrieval of video clips based on any given keyword. Content-Based Image And Video Retrieval addresses the basic concepts and techniques for designing content-based image and video retrieval systems.

Segmentation of a video into its constituent shots is a fundamental task for indexing and analysis in content based video retrieval systems. In this paper, a novel approach is presented for accurately detecting the shot boundaries in real time video streams, without any a priori knowledge about the content or type of the video. The edges of objects in a video frame are detected using a spatio-temporal fuzzy hostility index. These edges are treated as features of the frame. The correlation between the features is computed for successive incoming frames of the video. The mean and standard deviation of the correlation values obtained are updated as new video frames are streamed in. This is done to dynamically set the threshold value using the three-sigma rule for detecting the shot boundary (abrupt transition). A look back mechanism forms an important part of the proposed algorithm to detect any missed hard cuts, especially during the start of the video. The proposed method is shown to be applicable for online video analysis and summarization systems. In an experimental evaluation on a heterogeneous test set, consisting of videos from sports, movie songs and music albums, the proposed method achieves 99.24% recall and 99.35% precision on the average.

Content-based image retrieval (CBIR) is one of the most important applications of computer vision. In recent years, there have been many important advances in the development of CBIR systems, especially Convolutional Neural Networks (CNNs) and other deep-learning techniques. On the other hand, current CNN-based CBIR systems suffer from high computational complexity of CNNs. This problem becomes more severe as mobile applications become more and more popular. The current practice is to deploy the entire CBIR systems on the server side while the client side only serves as an image provider. This architecture can increase the computational burden on the server side, which needs to process thousands of requests per second. Moreover, sending images have the potential of personal information leakage. As the need of mobile search expands, concerns about privacy are growing. In this article, we propose a fast image search framework, named DeepSearch, which makes complex image search based on CNNs feasible on mobile phones. To implement the huge computation of CNN models, we present a tensor Block Term Decomposition (BTD) approach as well as a nonlinear response reconstruction method to accelerate the CNNs involving in object detection and feature extraction. The extensive experiments on the ImageNet dataset and Alibaba Large-scale Image Search Challenge dataset show that the proposed accelerating approach BTD can significantly speed up the CNN models and further makes CNN-based image search practical on common smart phones.

Content-based retrieval on a large multimedia database attracts the interest of many researchers. However, the database architecture needed for content-based retrieval is still a problem. Traditional relation database systems do not support high-dimension feature form content description and indexing, and is thus limited in its content-based retrieval function. Some systems do support high-dimension feature form content description and indexing, but lack descriptions and query expressions on media object content and relations. In this paper, we present our study results on query mechanism and proposed CbExpr - a powerful, flexible query expression mechanism on a media object. Based on CbExpr, we proposed GMA (general mediabase architecture) - a general architecture for management and content-based retrieval on large media databases. We also present VideoBase, a content-based video retrieval system, present as example of GMA. Basic thoughts, considerations, and definitions are presented in this paper, along with some details for implementation.

Motion trajectories extracted from certain videos contain sufficient spatio-temporal information which can be effectively used to characterize those videos. But the task of framing text-based queries for such videos in content-based video retrieval systems is very complicated. Sketch based query is an efficient tool to construct motion-based queries but perceptual differences like spatial and temporal variability pose serious challenges to query modelling.