Stereo Matching for Binocular Underwater Images Using SURF Operator and Epipolar Restriction

Due to the advancements in digital technologies and social networking, image collections are growing exponentially. The important aim in content-based image retrieval (CBIR) is to reduce the semantic gap issue that improves the performance of image retrieval. In this paper, the objective is achieved by introducing effective visual words fusion technique based on speeded-up robust features (SURF) and histograms of oriented gradients (HOG) feature descriptors. HOG is used to extract global features, whereas SURF is used for the extraction of local features. Global features are preferred for large-scale image retrieval, whereas local features perform better on those systems that support semantic queries with close visual appearance. Moreover, SURF is scale and rotation-invariant as compared to HOG descriptor and it works better for low illumination. On the contrary, HOG performs better for scene-recognition- or activity-recognition-based applications. In the proposed technique, visual words fusion of SURF and HOG feature descriptors is carried which performed better than features fusion of SURF and HOG feature descriptors as well as state-of-the-art CBIR techniques. The proposed technique based on visual words fusion gives classification accuracy of 98.40% using support vector machine while image retrieval accuracy of 80.61%. Qualitative and quantitative analyses performed on four standard image collections namely, Corel-1000, Corel-1500, Corel-5000, and Caltech-256 demonstrate the effectiveness of the proposed technique based on visual words fusion of SURF and HOG feature descriptors.

Indexing images represents a necessary tool for various domains related to computer vision such as video surveillance and movements analysis. Visual characteristics of image such as color, texture, shape are used to identify the content of these frames. The high increase of data (Big Data) makes us face a problem of curse of dimensionality. In this paper, we propose a cloud-based technique for images indexing images using PCA (Principal component analysis) and a binary tree. Our work consists of exploiting SIFT (Scale Invariant Feature Transform) and SURF (Speeded up Robust Features) descriptors as frames features, PCA as dimensionality reduction method of SIFT and SURF features and the binary tree representation of these images in order to accelerate the research phase and reduce the storage space. Our approach consists of developing a system based on three phases: indexing images with SIFT and SURF features, compression within the application of PCA and finally the image retrieval in the cloud.

Object recognition is a key research area in the field of image processing and computer vision, which recognizes the object in an image and provides a proper label. In the paper, three popular feature descriptor algorithms that are Scale Invariant Feature Transform (SIFT), Speeded Up Robust Feature (SURF) and Oriented Fast and Rotated BRIEF (ORB) are used for experimental work of an object recognition system. A comparison among these three descriptors is exhibited in the paper by determining them individually and with different combinations of these three methodologies. The amount of the features extracted using these feature extraction methods are further reduced using a feature selection (k-means clustering) and a dimensionality reduction method (Locality Preserving Projection). Various classifiers i.e. K-Nearest Neighbor, Naive Bayes, Decision Tree, and Random Forest are used to classify objects based on their similarity. The focus of this article is to present a study of the performance comparison among these three feature extraction methods, particularly when their combination derives in recognizing the object more efficiently. In this paper, the authors have presented a comparative analysis view among various feature descriptors algorithms and classification models for 2D object recognition. The Caltech-101 public dataset is considered in this article for experimental work. The experiment reveals that a hybridization of SIFT, SURF and ORB method with Random Forest classification model accomplishes the best results as compared to other state-of-the-art work. The comparative analysis has been presented in terms of recognition accuracy, True Positive Rate (TPR), False Positive Rate (FPR), and Area Under Curve (AUC) parameters.

Speeded Up Robust Features (SURF) algorithm is a fast robust local feature matching method. Because of the advantage of invariance of scale and rotation, the SURF algorithm has been widely used in the image registration. However, due to the acquired angle, imaging mode, different resolution, SURF algorithm becomes quite difficult in the image registration. This paper presents a normalized SURF algorithm which can reduce the impact of hue difference between remote sensing images. Combined with the idea of two-way matching, the normalized SURF is able to improve the accuracy of the image registration. The experimental results show the normalized SURF algorithm can keep greater accuracy and relatively higher speed of matching than the original SURF algorithm.

This thesis aims to develop an embedded image processing board, which can be used to realize various image feature extraction and processing algorithms for robotic applications. The circuitry of this image board can be divided into two parts, one is for a digital signal processor (DSP) and the other for a field programmable gate array (FPGA). A low power, small size CMOS image sensor with YUV4:2:2 image format and 512x480 pixel size is adopted for image acquisition. The DSP module is mainly used for implementing image processing algorithms, while the FPGA module for lower level image processing and sensor control functions. In this work, the TMS320C6414TGLZ7 DSP from Texas Instruments Corporation and the EP2C35F672C6 FPGA from Altera Corporation were selected for the image board. In this work, speeded-up robust features (SURF) algorithm has been successfully realized on the developed image board. An USB interface with average throughput of 22MB/sec works to transfer acquired image frames and extracted SURF descriptors to a personal computer, where feature matching is executed. Experimental results show that the refresh period of frame grabbing is about 33.5ms. When the number of SURF descriptor is equal to 64, the computing time is about 417.5ms; when the number of SURF descriptor is equal to 199, the computing time is about 985ms. The typical matching rate varies from 70.2% to 20%, depending on the threshold of the patterns used in feature extraction.

위성 SAR 영상의 활용이 증가하면서 영상의 해석 및 융합을 위한 정밀 기하보정에 대한 필요성이 높아지고 있다. 특히 광역감시 목적으로 활용되기 위해 서로 다른 해상도를 갖는 SAR 영상간 정보융합도 활발해지고 있다. 일반적으로 SAR 영상의 기하보정은 위성의 궤도 및 자세정보를 활용하여 수행할 수 있지만 SAR 센서의 궤도 및 시스템 오차, 대상지형 특성에 의한 왜곡으로 인해 추가적인 보정이 필요하게 된다. SAR 영상을 통한 변화탐지나 타 영상과의 융합에 적용하기 위해서는 기하 오차 보정이 반드시 선행되어야 한다. 이를 위해 다수의 지상 기준점을 선정하고 이를 포함하는 기준 영상과 비교하여 원본 영상에서 대응점을 찾는 방식으로 정밀 기하보정을 수행할 수 있다. Speeded Up Robust Feature (SURF) 기법은 쉽고 빠르게 영상의 기준점을 찾을 수 있지만 상대적으로 해상도가 낮고 스펙클 잡음에 영향을 받는 SAR 영상에서는 활용하기가 어렵다고 알려져 있다. 본 논문에서는 SURF 기법을 위성 SAR 영상에 적용할 때 발생할 수 있는 오차를 추출하고 영상 특성에 따른 성능 변화를 분석하였다. SURF 알고리즘의 적용이 가능한 입력 변수의 적정 범위를 제시하고 그에 따른 영상 정합의 오차를 분석하여 중저해상도의 위성 SAR 영상에 대해서도 SURF 기법을 통한 기하 보정 및 영상 정합이 적용될 수 있음을 검증하였다. As applications of spaceborne SAR imagery are extended, there are increased demands for accurate registrations for better understanding and fusion of radar images. It becomes common to adopt multi-resolution SAR images to apply for wide area reconnaissance. Geometric correction of the SAR images can be performed by using satellite orbit and attitude information. However, the inherent errors of the SAR sensor's attitude and ground geographical data tend to cause geometric errors in the produced SAR image. These errors should be corrected when the SAR images are applied for multi-temporal analysis, change detection applications and image fusion with other sensor images. The undesirable ground registration errors can be corrected with respect to the true ground control points in order to produce complete SAR products. Speeded Up Robust Feature (SURF) technique is an efficient algorithm to extract ground control points from images but is considered to be inappropriate to apply to SAR images due to high speckle noises. In this paper, an attempt is made to apply SURF algorithm to SAR images for image registration and fusion. Matched points are extracted with respect to the varying parameters of Hessian and SURF matching thresholds, and the performance is analyzed by measuring the imaging matching accuracies. A number of performance measures concerning image registration are suggested to validate the use of SURF for spaceborne SAR images. Various simulations methodologies are suggested the validate the use of SURF for the geometric correction and image registrations and it is shown that a good choice of input parameters to the SURF algorithm should be made to apply for the spaceborne SAR images of moderate resolutions.

A design of parallel architecture for image feature detection and description is proposed in this article. The major component of this architecture is a 2D cellular network composed of simple reprogrammable processors, enabling the Hessian Blob Detector and Haar Response Calculation, which are the most computing-intensive stage of the Speeded Up Robust Features (SURF) algorithm. Combining this 2D cellular network and dedicated hardware for SURF descriptors, this architecture achieves real-time image feature detection with minimal software in the host processor. A prototype FPGA implementation of the proposed architecture achieves 1318.9 GOPS general pixel processing @ 100 MHz clock and achieves up to 118 fps in VGA (640 × 480) image feature detection. The proposed architecture is stand-alone and scalable so it is easy to be migrated into VLSI implementation.

The speed and accuracy of workpiece recognition is the key to improve the efficiency of automated production lines. The traditional workpiece image recognition algorithm has slow running speed and poor matching precision. To solve the problem of accurate and real-time positioning of workpieces, an improved SURF_FREAK algorithm (ISF) is proposed for workpieces identification and matching. Firstly, the algorithm extracts feature points by using the Speeded Up Robust Features (SURF) algorithm, then adds the medium distance points to the FREAK algorithm to describe the feature points. Finally, the K-Nearest Neighbor (KNN) classification algorithm is used to match the feature points. The experimental results show that the ISF algorithm has a higher improvement on the recognition speed and matching accuracy of the workpiece than the traditional scale-invariant feature transform (SIFT) and SURF and FREAK algorithm.

How to construct compact and powerful feature descriptors is an important research subject in the fields of machine vision and pattern recognition. After the research on SURF, the issue that the Haar descriptor of Speeded Up Robust Features(SURF) algorithm can not make full use of the information around the neighborhood of the feature points is found. To resolve the issue, this paper proposes a improved SURF based on the original SURF algorithm. The algorithm makes full use of the information around the neighborhood of the sub-block by masking with 3*3 window templates and then constructs the descriptor which can obtain better discriminative power. In addition, aimed at the primary direction of the SURF depends too much on the local region, the paper improves the confirmation of the primary direction. At last, this paper combines the nearest distance and the ratio between the nearest distance and the second nearest distance to match the interest points. The experiment shows that the algorithm proposed in this paper has better discriminative power, and the face recognition rate is enhanced.

Recently, we experience the increasing prevalence of wearable cameras, some of which feature Wireless Local Area Network (WLAN) connectivity, and the abundance of mobile devices equipped with on-board camera and WLAN modules. Motivated by this fact, this work presents an indoor localization system that leverages both imagery and WLAN data for enabling and supporting a wide variety of envisaged location-aware applications ranging from ambient and assisted living to indoor mobile gaming and retail analytics. The proposed solution integrates two complementary localization approaches, i.e., one based on WLAN and another one based on image location-dependent data, using a fusion engine. Two fusion strategies are developed and investigated to meet different requirements in terms of accuracy, run time, and power consumption. The one is a light-weight threshold-based approach that combines the location outputs of two localization algorithms, namely a WLAN-based algorithm that processes signal strength readings from the surrounding wireless infrastructure using an extended Naive Bayes approach and an image-based algorithm that follows a novel approach based on hierarchical vocabulary tree of SURF (Speeded Up Robust Features) descriptors. The second fusion strategy employs a particle filter algorithm that operates directly on the WLAN and image readings and also includes prior position estimation information in the localization process. Extensive experimental results using real-life data from an indoor office environment indicate that the proposed fusion strategies perform well and are competitive against standalone WLAN and imaged-based algorithms, as well as alternative fusion localization solutions.

There is a growing trend for using content‐based image retrieval (CBIR) systems these days because of the constantly growing interest in digital content. Therefore, the ability of the CBIR to perform the CBIR process will depend on the feature extraction process and its basis, for the retrieval will be done on. Numerous researchers put forward various techniques for feature extraction to enhance the nature of the system. Since features play a very key role in enhancing performance, various features can be used collectively to attain the requisite goal. To retain this in mind, we present in this paper a multifeature fusion system, where three features are integrated and form one feature to improve the situation of retrieval. For this purpose, scale‐invariant feature transform (SIFT), speeded‐up robust features (SURF), and histogram of oriented gradients (HOG) features are adopted. These features are common features that deliver information about the shape of the object and for matching purposes, two techniques of distance matching such as Euclidean and Hausdrauff distance are adopted. To assess the performance of the proposed multifeature‐based CBIR approach, experiments were conducted with the usage of a MATLAB simulator. The Corel‐1000 dataset, consisting of 10,000 images in 100 semantic classes, turned into applied, with each magnificence containing 100 images. A subset of 2500 images across 50 semantic classes was used to train the system. This research aligns with industry, innovation, and infrastructure by contributing to advancements in image processing and retrieval systems. Key characteristic descriptors, along with SIFT, SURF, HOG, texture, and multicharacteristic combinations, were extracted for retrieval functions. The results display that the usage of the Hausdrauff distance as a similarity degree outperforms Euclidean distance, accomplishing retrieval accuracies of 80.02% for HOG, 77.9% for SIFT, 79. 8% for SURF, 77.2% for texture, and 84.2% for multicharacteristic combinations, surpassing Euclidean distance results via 1.7%–3.6% across capabilities. These findings underscore the effectiveness of Hausdrauff distance in enhancing retrieval precision within the CBIR framework.

A fast image stitching algorithm based on improved speeded up robust feature (SURF) is proposed to overcome the real-time performance and robustness of the original SURF based stitching algorithms. The machine learning method is adopted to build a binary classifier, which identify the key feature points extracted by SURF and remove the non-key feature points. In addition, the RELIEF-F algorithm is used for dimension reduction and simplification of the improved SURF descriptor to achieve image registration. The threshold-based weighted fusion algorithm is used to achieve seamless image stitching. Finally, several experiments are conducted to verify the real-time performance and robustness of the improved algorithm.

Copy-Move forgery is the most widely used way to tamper image for creating the forged images. The meaning of the photograph is changed by forging or concealing the images. Copy move is a very common technique for image forgery; tools used for retouching are applied along with it making naked eyes difficult to detect the copy move. Hence, the verification of authenticity and integrity is very essential of the image. The copy-move forgery detection can be divided into two heads a) Block based method b) Keypoint based. In the case of blocked based method, the method is exceptionally good in detecting the forged regions with higher accuracy but uses extremely high power of computation. Speed up Robust Feature (SURF) and Scale Invariant Feature Transform (SIFT) are invariant with respect to geometrical and illumination transform. In this paper we review the different keypoint approach which is a better approach or alternate to block-based approach due to invariancy property of SURF and SIFT. The keypoint based copy-move forgery detection schemes involve, identifying and relating the localized features of the images using the algorithms like SIFT and SURF.

영상에서 임의의 점에 대한 고유한 특징을 계산하는 알고리즘은 파노라마 영상의 제작, 스테레오 영상의 획득, 물체 인식, 이미지 분석 등에 다양하게 사용되는 중요한 요소이다. 일반적으로 어떤 점의 특징은 스칼라 형태가 아닌 벡터형태로 나타나게 되는데, 무수히 많은 특징 점들을 서로 비교하는 작업은 매우 많은 계산량을 요구한다. 본 연구에서는 영상의 특징점 계산에 SURF(speeded up robust features)를 이용하였고, 이미지로부터 추출된 특징을 PCA(principal component analysis)기법을 이용하여 벡터의 차원을 축소하여 연결리스트 자료구조에 정렬한 다음 특징을 비교하는 기법을 제안한다. 제안된 특징의 비교 방법을 적용할 경우 기존 방법의 매칭 정확도는 유지한 상태에서 계산시간을 줄일 수 있는 것을 실험을 통하여 확인하였다. Extracting unique features from an image is a fundamental issue when making panorama images, acquiring stereo images, recognizing objects and analyzing images. Generally, the task to compare features to other images requires much computing time because some features are formed as a vector which has many elements. In this paper, we present a method that compares features after reducing the feature dimension extracted from an image using PCA(principal component analysis) and sorting the features in a linked list. SURF(speeded up robust features) is used to describe image features. When the dimension reduction method is applied, we can reduce the computing time without decreasing the matching accuracy. The proposed method is proved to be fast and robust in experiments.

Abstract. Remote sensing system fitted on UAV (Unmanned Aerial Vehicle) can obtain clear images and high-resolution aerial photographs. It has advantages of flexibility, convenience and ability to work full-time. However, there are some problems of UAV image such as small coverage area, large number, irregular overlap, etc. How to obtain a large regional map quickly becomes a major obstacle to UAV remote sensing application. In this paper, a new method of fast registration of UAV remote sensing images was proposed to meet the needs of practical application. This paper used Progressive Sample Consensus (PROSAC) algorithm to improve the matching accuracy by removed a large number of mismatching point pairs of remote sensing image registration based-on SURF (Speed Up Robust Feature) algorithm, and GPU (Graphic Processing Unit) was also used to accelerate the speed of improved SURF algorithm. Finally, geometric verification was used to achieve mosaic accuracy in survey area. The number of feature points obtained by using improved SURF based-on PROSAC algorithm was only 9.5% than that of SURF algorithm. Moreover, the accuracy rate of improved method was about 99.7%, while the accuracy rate of improved SURF algorithm was increased by 8% than SURF algorithm. Moreover, the improved running time of SURFGPU algorithm for UAV remote sensing image registration was a speed of around 16 times than SURF algorithm, and the image matching time had reached millisecond level. Thus, improved SURF algorithm had better matching accuracy and executing speed to meet the requirements of real-time and robustness in UAV remote sensing image registration.