Scale Invariant Feature Transform using oriented pattern

SIFT (scale invariant feature transform) is one of the most robust and the widely used image matching algorithms based on local features. It has been used in the aspect of the cameras target matching. For its high complexity, this paper proposes a target matching method for multiple cameras by combining SIFT and the rotation-invariant LBP (local binary patterns). The object detection is obtained by improved Back-ground subtraction technique, and particle filter is used for region-based object tracking. The descriptor combining SIFT and the rotation-invariant LBP is calculated for every object region. The object matching is obtained by comparing the distance of feature matrix. Experimental results show that the proposed algorithm is more rapid than the standard SIFT algorithm while the performance is favorably compared to the standard SIFT algorithm, and it is robust in various scenes.

There remain many difficult problems in computer vision research such as object recognition, three dimensional reconstruction, object tracking, etc. And the basis of solving these problems relies on image matching. The scale invariant feature transform (SIFT) algorithm has been widely used for image matching application. The SIFT algorithm can successfully extract the most descriptive feature points in given input images taken under different viewpoints. However, the performance of the original SIFT algorithm degrades under the influence of noise. We propose to modify the SIFT algorithm to produce better invariant feature points for image matching under noise. We also propose to employ the Earth mover's distance (EMD) as the measurement of similarity between two descriptors. We present extensive experiment results to demonstrate the performance of the proposed methods in image matching under noise.

Multiplicative speckle noise often significantly affects the accuracy and adaptability of the scale-invariant feature transform (SIFT) matching method for synthetic aperture radar (SAR) images. To address this problem, this study proposes a union matching method based on the SIFT and edge strength of the SAR image. First, the rotation constraint iteratively refines the initial SIFT match set based on the parameter decomposition of the common geometry transformation model. Using this model, square summation strength (SSS) similarity is then determined. To get the optimal SIFT matches in the searching space, SSS matching based on pixel migration is applied. Furthermore, we outlined the optimization procedure of a union matching strategy. In the iterative process of global searching, the correctly matched tie-points are added individually. Finally, the accuracy, adaptability, and precision of the proposed method are validated through matching experiments on SAR images. Results showed that the proposed method is accurate and robust with respect to the automatic matching of SAR images.

In this paper, a novel face representation in terms of dense local image descriptors is proposed. Scale Invariant Feature Transform (SIFT) and Gabor, two of the most popular local image descriptors, at dense grid pixels of a face image are used to represent the face. The efficiency of the representation has been investigated in gender recognition. There are four problems when applying the SIFT to facial gender recognition. (1) There may be only a few keypoints that can be found in a face image due to the missing texture and ill-illumined faces; (2) The SIFT descriptors at the keypoints (we called it sparse SIFT) are distinctive whereas alternative descriptors at non-keypoints (e.g. grid) could cause negative impact on the accuracy; (3) Most of the existing methods employ SIFT descriptors matching in which relative larger image size is required in order that enough keypoints can be found to support the matching and (4) The matching is assumed that the faces are well registered. We provide solutions to the above difficulties in this paper and the problem of recognizing gender using the combination of SIFT descriptors and Gabor of face images is studied. The Gabor representations of the face images are fused with the dense SIFT at the feature-level to improve the accuracy. AdaBoost is adopted to select features and form a strong classifier. The experimental results on a large set of faces have shown that the proposed method can achieve high accuracies even for faces that are not aligned.

In computer vision, Local Binary Pattern (LBP) and Scale Invariant Feature Transform (SIFT) are two widely used local descriptors. In this paper, we propose to combine them effectively for scene categorization. First, LBP and SIFT features are regularly extracted from training images for constructing a LBP feature codebook and a SIFT feature codebook. Then, a two-dimensional table is created by combining the obtained codebooks. For creating a representation for an image, LBP and SIFT features extracted from the same positions of the image are encoded together based on sparse coding by using the two-dimensional table. After processing all features in the input image, we adopt spatial max pooling to determine its representation. Obtained image representations are forwarded to a Support Vector Machine classifier for categorization. In addition, in order to improve the scene categorization performance further, we propose a method to select correlated visual words from large codebooks for constructing the two-dimensional table. Finally, for evaluating the proposed method, extensive experiments are implemented on datasets Scene Categories 8, Scene Categories 15 and MIT 67 Indoor Scene. It is demonstrated that the proposed method is effective for scene categorization.

In this paper we propose a novel feature based on SIFT (Scale Invariant Feature Transform) algorithm1 for the robust representation of local visual contents. SIFT features have raised much interest for their power of description of visual content characterizing punctual information against variation of luminance and change of viewpoint and they are very useful to capture local information. For a single image hundreds of keypoints are found and they are particularly suitable for tasks dealing with image registration or image matching. In this work we stretched the spatial coverage of descriptors creating a novel feature as composition of keypoints present in an image region while maintaining the invariance properties of SIFT descriptors. The number of descriptors is reduced, limiting the computational weight, and at the same time a more abstract descriptor is achieved. The new feature is therefore suitable at describing objects and characteristic image regions. We tested the retrieval performance with a dataset used to test PCA SIFT2 and image matching capability among images processed with affine transformations. Experimental results are reported.

In the object recognition based on the bag of visual words, we focus on several main feature extraction algorithms. The Scale Invariant Feature Transform (SIFT) that based on local features with good significance and robustness has became a popular feature extraction method. But we take into consideration that the SIFT will generate a large number of high-dimensional feature vectors, which will increase the computational cost. In this paper, a novel feature extraction algorithm by means of SIFT to fuse region information entropy (SIFT-entropy) is proposed. The algorithm can improve the quality of the feature extracted from the image by cluster similar key points to removing the noisy key points. So a more discriminative high quality “visual word” codebook could be generated. We made a comprehensive comparison between the proposed method and the original SIFT method on Caltech-101 database. The experimental results show that this improvement can reduce the dimension of the feature space, and has higher classification accuracy.

In this paper, an affine invariance feature detection method based on Scale Invariant Feature Transform (SIFT) and Maximally Stable Extremal Regions (MSER) is proposed. Classical SIFT algorithm is not robust to affine deformations, because it is based on DOG detector which extracts circle regions for keypoint location. In order to overcome this disadvantage, DOG detector in conventional SIFT algorithm is replaced by MSER detector which is robust to affine deformation. Then these regions are normalized and extracted using SIFT. Simulation studies are carried out to show the effectiveness of the proposed method to affine transform in comparison to traditional SIFT algorithm.

Scale Invariant Feature Transform (SIFT) is used for local features description of images. The proposed technique employs SIFT in order to match binary images. While the employment of SIFT descriptors on binary image databases could be possible, its power is rather limited. The novelty of the proposed algorithm is make use of SIFT for binary image matching by taking the power of Hough Transform (HT) in line detection. HT can be used on any line orientation. Thus, HT investigates lines as criteria for binary image similarity beside SIFT features for local and corner descriptions. The evaluation is achieved and experimental highlights the superiority of this approach for binary images which contains straight lines.

Keypoint-based and block-based methods are two main categories of techniques for detecting copy-move forged images, one of the most common digital image forgery schemes. In general, block-based methods suffer from high computational cost due to the large number of image blocks used and fail to handle geometric transformations. On the contrary, keypoint-based approaches can overcome these two drawbacks yet are found difficult to deal with smooth regions. As a result, fusion of these two approaches is proposed for effective copy-move forgery detection. First, our scheme adaptively determines an appropriate initial size of regions to segment the image into non-overlapped regions. Feature points are extracted as keypoints using the scale invariant feature transform (SIFT) from the image. The ratio between the number of keypoints and the total number of pixels in that region is used to classify the region into smooth or non-smooth (keypoints) regions. Accordingly, block based approach using Zernike moments and keypoint based approach using SIFT along with filtering and post-processing are respectively applied to these two kinds of regions for effective forgery detection. Experimental results show that the proposed fusion scheme outperforms the keypoint-based method in reliability of detection and the block-based method in efficiency.

Efficient detection and reliable matching of image features constitute a fundamental task in computer vision. When real-time operation is required, the solution to this problem becomes a real challenge, because of increased processing requirements. Scale Invariant Feature Transform (SIFT) is considered as a stable and robust algorithm for the extraction of invariant features, however special hardware is required for high frame-rate applications, in order to overcome its computational complexity in real-time. In this paper, a complete processor for SIFT feature matching in video sequences is presented. It performs SIFT feature extraction and matching, as well as rejection of false correspondences using the random sample consensus (RANSAC) algorithm. The processor was evaluated using metrics like response, repeatability and recall. It was found that the proposed fixed-point hardware implementation has a comparable performance with software implementations of SIFT. The processor architecture can process more than 36 fps with resolution 640×480, when it is implemented in Cyclone IV FPGA technology.

With the emerging techniques of wireless communication and cloud computing, large volumes of multimedia data are outsourced from resource constrained users to the cloud with abundant resource for both delegated storage and computation. Unfortunately, there is a risk of users’ image privacy leakage in the process of outsourcing to untrusted cloud. Most of the existing work achieved privacy-preserving image feature extraction and matching by using public key (fully) homomorphic encryption (FHE), but the heavy computational overhead and communication overhead cannot adapt to resource-constrained mobile devices. Other works disabled to realize image denoising in the encrypted domain or only focused on the scale-invariant feature transform (SIFT) descriptor that is inappropriate for position-sensitive feature extraction. To address these issues, in this paper, a privacy-preserving shape context based image denoising and matching protocol PPOIM with efficient outsourcing is proposed. Firstly, to improve the accuracy of image matching, a privacy-preserving image denoising scheme PPID is proposed without exploiting public key FHE. Then, based on PPID, a privacy-preserving image matching protocol PPOIM adopting shape context descriptor is devised, where two secure and efficient comparison and counting protocols in the encrypted domain are presented. All the original image privacy, query image privacy and image matching result privacy are well protected. Finally, formal security proof and extensive simulations on real-world data sets demonstrate the efficiency and practicability of our proposed PPOIM.

Aiming at the problems of large calculating scale and high complexity in Scale Invariant Feature Transform (SIFT) feature matching algorithm, this paper presents an improved SIFT feature matching algorithm based on quasi Euclidean distance.The traditional Euclidean distance can only calculate out the variance of the two images to the corresponding pixel, so when a slight shift or distortion occurs in the image, it may produce a large deviation.The quasi Euclidean distance instead of Euclidean distance is as the similarity measure of feature descriptors to improve the SIFT feature matching.It reduces the dimensions of SIFT feature vector to improve the efficiency of feature matching.Experimental results show that under the condition of keeping the image matching rate and algorithm robust, the method can not only improve the matching accuracy but also shorten the matching time.The new algorithm has better performance than traditional algorithm, it is possible and valid, which are useful for the fields of image recognition, image reconstruction, etc.

With the advent of e-commerce, digital services and social media, scammers have changed their way to gain illegal benefits in various forms such as capturing the credit card information or exploiting personal cloud accounts which is termed as phishing. For this reason, against this cyber crime, last two decades have witnessed a variety of combatting methodologies like HTML content based similarity analysis, URL based classification and recently visual similarity based matching since phishing web pages visually mimic to their legitimate counterparts in order to create an illusion to deceive innocent users. To this end, in this study, we propose a computer vision and machine learning based approach in order to classify whether a suspicious web page is phishing and further recognize its original brand name. In this regard, we have utilized and investigated two different local image descriptors namely Scale Invariant Feature Transform (SIFT) and DAISY. Apart from their common properties such as scale invariance, the aforementioned descriptors have apparent differences such that in addition to rotational invariance, SIFT employs key-point based sampling whereas DAISY applies dense sampling by default. Therefore, we first aimed to investigate the feasibility of these two local image descriptors in addition to revealing the effects of sampling strategy and rotational invariance in problem domain. Furthermore, in order to create a discriminative representation of a web page, we followed the bag of visual words (BOVW) approach having different vocabulary sizes such as 50, 100, 200 and 400. In order to evaluate the proposed approach, we have utilized a publicly available phishing dataset including snapshots of webpages sampled from both 14 different highly phished brands and ordinary legitimate web pages yielding a challenging open-set problem. The aforementioned dataset involves 1313 training and 1539 testing image samples in total. The visual features extracted via SIFT and DAISY were first transformed to a BOVW histogram and fed to three different machine learning methods such as SVM, Random Forest and XGBoost. According to the conducted experiments, based on a 400-D visual vocabulary, SIFT descriptor along with XGBoost has been found as the best descriptor-learner configuration having reached up to 89.34% validation accuracy with 0.76% false positive rate. Moreover, SIFT has outperformed DAISY descriptor in all settings. As a result, it has been shown that SIFT descriptors equipped with BOVW representation can be effectively used for brand identification of phishing web pages.

최근 멀티미디어 정보가 보편화됨에 따라 인터넷에서 이미지를 기반으로 정보를 검색하려는 다양한 시도가 진행되고 있다. 그러나 이미지에는 다양한 패턴이 포함되어 있기 때문에 정확하게 원하는 이미지를 찾는 것은 아직 어려움이 많다. 본 논문에서는 인터넷 쇼핑몰의 상품검색을 효율적으로 할 수 있는 이미지 기반 검색 시스템을 제안한다. 제안된 검색 방법은 SIFT(Scale Invariant Feature Transform) 알고리즘을 이용하여 이미지 검색을 위한 특징을 추출하고, PCA-SIFT를 이용하여 여러 차원에서 키포인트의 매칭을 반복하여 누적 후 사용자가 원하는 상품을 찾아준다. 제안된 방법의 효율성을 검증하기 위해, 다양한 패턴의 상품 이미지를 이용하여 기존 SIFT, PCA-SIFT 방법과 제안된 방법을 비교한 결과, 상표가 포함되지 않은 이미지의 경우 제안방법이 가장 높은 변별력을 보였으며, 효과적인 이미지 검색의 가능성을 보였다. Recently, as multimedia information becomes popular, there are many studies to retrieve images based on images in the web. However, it is hard to find the matching images which users want to find because of various patterns in images. In this paper, we suggest an efficient images retrieval system based on images for finding products in internet shopping malls. We extract features for image retrieval by using SIFT (Scale Invariant Feature Transform) algorithm, repeat keypoint matching in various dimension by using PCA-SIFT, and find the image which users search for by combining them. To verify efficiency of the proposed method, we compare the performance of our approach with that of SIFT and PCA-SIFT by using images with various patterns. We verify that the proposed method shows the best distinction in the case that product labels are not included in images.