Character texture enhancement of 3D animated keyframe images based on SIFT algorithm and LK optical flow

To solve the low accuracy of image feature matching in horticultural robot visual navigation, an innovative and effective image feature matching algorithm was proposed combining the improved Oriented FAST and Rotated BRIEF (ORB) and Lucas–Kanade (LK) optical flow algorithm. First, image feature points were extracted according to the adaptive threshold calculated using the Michelson contrast. Then, the extracted feature points were uniformed by the quadtree structure, which can reduce the calculated amount of feature matching, and the uniform ORB feature points were roughly matched to estimate the position of the feature points in the matched image using the improved LK optical flow. Finally, the Hamming distance between rough matching points was calculated for precise matching. Feature extraction and matching experiments were performed in four typical scenes: normal light, low light, high texture, and low texture. Compared with the traditional algorithm, the uniformity and accuracy of the feature points extracted by the proposed algorithm were enhanced by 0.22 and 50.47%, respectively. Meanwhile, the results revealed that the matching accuracy of the proposed algorithm increased by 14.59%, whereas the matching time and total time decreased by 39.18% and 44.79%, respectively. The proposed algorithm shows great potential for application in the visual simultaneous localization and mapping (V-SLAM) of horticultural robots to achieve higher accuracy of real-time positioning and map construction.

The strap-down missile-borne image guidance system can be easily affected by the unwanted jitters of the motion of the camera, and the subsequent recognition and tracking functions are also influenced, thus severely affecting the navigation accuracy of the image guidance system. So, a real-time image stabilization technology is needed to help improve the image quality of the image guidance system. To satisfy the real-time and accuracy requirements of image stabilization in the strap-down missile-borne image guidance system, an image stabilization method based on optical flow and image matching with binary feature descriptors is proposed. The global motion of consecutive frames is estimated by the pyramid Lucas-Kanade (LK) optical flow algorithm, and the interval frames image matching based on fast retina keypoint (FREAK) algorithm is used to reduce the cumulative trajectory error. A Kalman filter is designed to smooth the trajectory, which is conducive to fitting to the main motion of the guidance system. Simulations have been carried out, and the results show that the proposed algorithm improves the accuracy and real-time performance simultaneously compared to the state-of-art algorithms.

This study proposes an improved feature-point matching and 3D registration method for augmented reality tourism applications. This method addresses issues such as poor alignment, low stability in complex environments, and low feature-matching accuracy. An improved feature point matching method for tourism images is introduced, which combines the Speeded Up Robust Features (SURF) algorithm with an enhanced Oriented FAST and Rotated BRIEF algorithm. In this method, feature points are initially detected using the SURF algorithm, and their orientation is determined via wavelet response analysis. The Lucas-Kanade optical flow method is employed for feature point tracking. The random sample consensus algorithm is then used to eliminate mistracked points. Furthermore, an augmented reality tourism 3D registration technique based on an improved homography matrix is proposed to overcome the limitations of traditional homography matrices, such as low matching accuracy and registration efficiency. The performance of the proposed method was analyzed through comparative experiments against the SIFT, SURF, and original ORB algorithms under various image transformations, including scale, blur, illumination, and rotation. The correct matching rate and matching time were used as evaluation metrics. Simulation tests were conducted for 3D registration using different 3D models. Registration accuracy and successful registration counts were evaluated under rotational changes. The outcomes indicated that the average correct matching rate of the proposed algorithm is increased by 44.08%, 36.51%, and 16.09% under scale variation than the scale invariant feature transformation algorithm, speeded up robust features algorithm, and unimproved algorithm, respectively. The correct matching rate under fuzzy transformation increased by 33.46%, 19.65%, and 9.35%, respectively. The average registration accuracy of the proposed 3D registration technique was 98.74% under rotational transformation. The outcomes reveal that the study's suggested approach can successfully improve the scene's virtual and real-world fusion effect and offers a fresh approach to the use of augmented reality technology in the travel industry.

Gas–Liquid two-phase flows are a common flow in industrial production processes. Since these flows inherently consist of discrete phases, it is challenging to accurately measure the flow parameters. In this context, a novel approach is proposed that combines the pyramidal Lucas-Kanade (L–K) optical flow method with the Split Comparison (SC) model measurement method. In the proposed approach, videos of gas–liquid two-phase flows are captured using a camera, and optical flow data are acquired from the flow videos using the pyramid L–K optical flow detection method. To address the issue of data clutter in optical flow extraction, a dynamic median value screening method is introduced to optimize the corner point for optical flow calculations. Machine learning algorithms are employed for the prediction model, yielding high flow prediction accuracy in experimental tests. Results demonstrate that the gradient boosted regression (GBR) model is the most effective among the five preset models, and the optimized SC model significantly improves measurement accuracy compared to the GBR model, achieving an R2 value of 0.97, RMSE of 0.74 m3/h, MAE of 0.52 m3/h, and MAPE of 8.0%. This method offers a new approach for monitoring flows in industrial production processes such as oil and gas.

To address the degradation of visual simultaneous localization and mapping (VSLAM) pose estimation accuracy caused by extensive moving objects and the resulting contamination of feature points in indoor dynamic environments, this study proposes a dynamic feature point rejection strategy that integrates a You Only Look Once (YOLO) family detector, YOLO11, with the Lucas–Kanade (LK) optical flow method within the ORB_SLAM3 framework. First, YOLO11 is employed to detect potentially dynamic targets such as pedestrians in the image, and ORB features extracted within the detection bounding boxes are labeled as high-risk dynamic points. Subsequently, based on pyramidal LK optical flow, the motion consistency of feature points is analyzed across multiple frames, and a secondary discrimination is performed on features located at the edges and in the vicinity of the detection boxes. In this way, feature points that conform to a static motion model are maximally preserved, thereby alleviating the excessive removal and misclassification of static points caused by oversized detection boxes. On this basis, a new map is reconstructed using the filtered static feature points, and the pose estimation process is further refined. Experiments on multiple indoor dynamic scenarios demonstrate that, compared with the original ORB_SLAM3, the proposed method effectively suppresses dynamic interference, enhances the stability of feature points, and significantly improves pose estimation accuracy and trajectory continuity, thus providing a valuable reference for robust VSLAM applications in dynamic environments.

We propose a feature-based multi-target tracking algorithm which can track multiple targets in real time with a simple but efficient velocity segmentation method. The optical flow velocity distribution profile of the feature points detected on a moving target or on the background when the camera has ego-motion is assumed to have a Gaussian-like function. We can separate the background feature points and those of moving targets by examining the velocity distribution function profile at each frame without a prior knowledge on the number and texture of the moving objects. The optical flow velocity of a feature point in each image frame is computed by the iterative Lucas-Kanade algorithm. These feature points are divided into groups with the similar velocity. Feature points are further divided into sub-groups according to their proximity the image frame. The feature point group with the largest span is identified as the background feature and its velocity is the camera velocity when the background is fixed. Multiple targets are identified based on their velocities and proximity in one frame. With a pyramidal sampling scheme to reduce the frame size to one-sixteenth of its original size, and the iterative Lucas-Kanade algorithm to find the optical flow in a multi-resolution manner, we are able to track multiple objects in real time with a moving hand-held camera.

Identification methodology of special behaviors for fish school based on spatial behavior characteristics

This paper presents SURF (Speed-Up Robust Features) algorithm and real-time tracking objects using optical flow algorithm. SURF is the fastest algorithm to find features of an object image in real-time and then by using this algorithm we will compare object image features with our real-time object image features. After that match object image features and real-time features. Next, we will apply optical flow algorithm to track the object location. It tracks the object exactly in real-time when object appear in camera’s view. In this paper, we use LK (Lucas-Kanade) optical flow which can operate reduction by choosing an area. We can track object quickly and exactly in real-time.

This paper focuses on crowd motion analysis and consists two parts. Firstly, we propose a new foreground detection approach called optical flow and background model (OFBM) based on Lucas-Kanade optical flow and Gaussian background model methods. This approach overcomes the shortages of optical flow and background subtract, such as sensitiveness of light changing and producing accumulate errors. Secondly, according to moment analysis, we propose a new feature based on the zeroth-order Tehebichef discrete orthogonal moment (TOM), which is employed for crowd density estimation. Some experimental results show that this approach is useful and efficient in crowd density estimation.

Gradient-based optical flow estimation methods such as LucasKanade method work well for scenes with small displacements but fail when objects move with large displacements. Hierarchical matching-based methods do not suffer from large displacements but are less accurate. By utilizing the high speed imaging capability of CMOS image sensors, the frame rate can be increased to obtain more accurate optical flow with wide range of scene velocities in real time. Further, by integrating the memory and processing with the sensor on the same chip, optical flow estimation using high frame rate sequences can be performed without unduly increasing the off-chip data rate. The paper describes a method for obtaining high accuracy optical flow at a standard frame rate using high frame rate sequences. The Lucas-Kanade method is used to obtain optical flow estimates at high frame rate, which are then accumulated and refined to obtain optical flow estimates at a standard frame rate. The method is tested on video sequences synthetically generated by perspective warping. Results demonstrate significant improvements in optical flow estimation accuracy with moderate memory and computational power requirements.

The ORB, SIFT, and SURF algorithms are currently common feature matching algorithms. These three algorithms have certain differences in execution speed and matching robustness. In this paper, the data sets provided by Mikolajczyk and Schmid are used to compare the algorithms in terms of execution speed, image transformation robustness, and noise robustness. The conclusion of this paper is that the ORB algorithm is the fastest, the SURF algorithm is the most robust, and the SIFT algorithm has the most feature points.

Dynamic Vision Sensors (DVS) output asynchronous log intensity change events. They have potential applications in high-speed robotics, autonomous cars and drones. The precise event timing, sparse output, and wide dynamic range of the events are well suited for optical flow, but conventional optical flow (OF) algorithms are not well matched to the event stream data. This paper proposes an event-driven OF algorithm called adaptive block-matching optical flow (ABMOF). ABMOF uses time slices of accumulated DVS events. The time slices are adaptively rotated based on the input events and OF results. Compared with other methods such as gradient-based OF, ABMOF can efficiently be implemented in compact logic circuits. We developed both ABMOF and Lucas-Kanade (LK) algorithms using our adapted slices. Results shows that ABMOF accuracy is comparable with LK accuracy on natural scene data including sparse and dense texture, high dynamic range, and fast motion exceeding 30,000 pixels per second.

Image stitching refers to the combination of multiple images with a certain over lappingarea rate acquired by the image acquisition device into one image, which has a full picture of each image. Image stitching technology is an important part in the field of digital image processing. With the increasing requirements for image quality and the limited resolution of ordinary cameras, it is impossible to obtain large angle of view and clear image at the same time. In this paper, the key technologies involved in pavement crack image stitching are intensively studied, including image feature point detection and matching, internal and external camera parameter estimation and optimization, and image fusion. The work done in this paper and the main innovations include: (1)Two main feature detection and description algorithms, SIFT algorithm and ORBalgorithm, are studied. In view of the fact that the SIFT algorithm has redundancy when the Gaussian pyramid is established, this paper appropriately reduces the number of groups and maintains the number and stability of feature point detection. Combined with the advantages and disadvantages of the improved SIFT algorithm and ORB algorithm, and the performance of the two algorithms in the detection of pavement cracks, the improvedSIF'T algorithm is used as the feature point detection algorithm, and rBRlEF algorithm for describing the feature points in the ORB algorithm is used as the feature point description algorithm. The description algorithm is called the BSIF'T algorithm. Experiments show that the robustness of BSIFT algorithm is similar to that of SIFT algorithm, which is better than ORB algorithm and faster than SIF'T algorithm. (2)Image fiusion algorithms are studied, including best seam-line search and image fusion. Aiming at the ghost phenomenon that may occur in overlapping regions, this paper proposes a best seam-line search algorithm based on distance transform.

A method for detecting optokinetic nystagmus based on the optic flow of the limbus.

In this paper, the feasibility of super-resolution reconstruction of the deformable tissue from temporal sequences of ultrasound images is extensively studied. The proposed image observation model integrates the non-rigid motion and imaging formation process into a unified super-resolution frame. To facilitate the motion estimation, Lucas-Kanade optical flow is chosen for non-rigid motion estimation from mathematical point of view. Finally, optical flow based iterative back-projection algorithm is proposed for Super-resolution reconstruction, where flow driven diffusion method is developed to re-estimate the motion in the high-resolution coordinate, yielding accurate dense flow field. The efficiency of the proposed approach is demonstrated by simulated images and ultrasound carotid vessel images. Experimental results are provided and compared with existing super-resolution method, which indicate the proposed approach is highly efficient and promising.