Specific features of dynamic interactions in nonlinear systems

In indoor dynamic scenes, traditional visual simultaneous localization and mapping (SLAM) algorithms based on RGB-D cameras incorrectly use dynamic features to estimate the poses of the cameras, and do not fully utilize the geometric information in the scenes, resulting in the low positioning accuracy and robustness of SLAM systems. To solve this problem, this paper proposes an RGB-D SLAM algorithm based on multiple geometric features and semantic segmentation. The core of our SLAM system is the proposed robust exclusion method of dynamic point and line features. The method consists of the following three steps: (a) identify potential dynamic point features using motion consistency checks; (b) obtain potential motion regions via semantic segmentation, and then determine dynamic regions by combining these with dynamic point features; (c) remove point and line features in dynamic regions. The exclusion method of dynamic point and line features can be easily integrated into RGB-D SLAM systems for improving the accuracy and robustness of SLAM systems in dynamic scenes. Experimental results on the Technische Universität München (TUM) dataset demonstrate that the proposed algorithm has better positioning accuracy and stability than the original dynamic semantic (DS-SLAM) algorithm in dynamic environments. The effectiveness of the proposed algorithm is verified by comparison with other classical visual SLAM algorithms. Better mapping performance is achieved by this proposed algorithm in actual indoor scenes.

In this paper, we present a new 3D reconstruction approach based on local surface curvature analysis. Its integration can make a normal active stereoscopic system intelligent, and capable to produce directly optimized 3D model. The iterative 3D reconstruction process begins with a sparse and regular point pattern. Based on the reconstructed 3D point cloud, the local surface curvature around each 3D point is estimated. Those 3D points located in flat areas are removed from the 3D model, and a new pattern is created to project more points onto the object where there is high surface curvature. The 3D model is thus refined progressively during the acquisition process, and finally an optimized 3D model is obtained. Our numerous experiments showed that compared to the 3D models generated by commercial system, the loss of morphological quality is negligible, and the gain by the simplification of the model is considerable.KeywordsGaussian CurvatureCamera CalibrationPattern PointMesh SimplificationLocal Surface CurvatureThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This paper presents a novel approach for estimating the ego-motion of a vehicle in dynamic and unknown environments using tightly-coupled inertial and visual sensors. To improve the accuracy and robustness, we exploit the combination of point and line features to aid navigation. The mathematical framework is based on trifocal geometry among image triplets, which is simple and unified for point and line features. For the fusion algorithm design, we employ the Extended Kalman Filter (EKF) for error state prediction and covariance propagation, and the Sigma Point Kalman Filter (SPKF) for robust measurement updating in the presence of high nonlinearities. The outdoor and indoor experiments show that the combination of point and line features improves the estimation accuracy and robustness compared to the algorithm using point features alone.

At present, most of the visual Simultaneous Localization and Mapping (SLAM) systems rely on the surrounding point features to achieve acceptable localization and mapping. However, the number of point features is insufficient in the low-texture environments, so the performance of these SLAM systems will be significantly reduced. In this research, a PLISLAM system that integrates point features, line features and Inertial Measurement Unit (IMU) is proposed to implement high-precision positioning and mapping for dynamic vehicles. Specifically, a state-of-the-art SLAM scheme ORBSLAM3 is built at first. Then, its theoretical formulation is derived step by step to handle the environmental line features and the Bundle Adjustment (BA) is integrated to optimize the data. Finally, the system performance is verified through the EuRoC dataset, the results demonstrate its accuracy could be improved by adding the line features especially in scenes with rich line features.

Most of the existing visual SLAM schemes rely solely on point or line features to estimate camera trajectory. In some scenes such as texture missing or motion blurring, it’s difficult to find a sufficient number of reliable features, resulting in low positioning accuracy. To extract more features, an RPL-SLAM solution is proposed to extract point features and line features respectively. Ulteriorly, the depth information of RGBD image is used to restore the 3D information of point and line features, improving the accuracy of camera track positioning. RPL-SLAM scheme mainly includes three modules: tracking, local mapping and loop detection. Tracking module extends the application of line feature on the basis of point feature extraction and matching. A SLD line segment extraction algorithm which can eliminate the micro segments and a DBM segment matching algorithm based on word bag are proposed respectively. These two algorithms improve the matching efficiency while ensuring the matching accuracy, and effectively track and locate the camera of each frame. In the local mapping and loop detection module, the Plucker coordinates are applied to express the spatial line and define the re-projection error of the straight line, so that the back-end optimization error model of point-line fusion is unified to solve the instability problem in optimization. RPL-SLAM is tested on TUM RGBD and ICL-NUIM data set respectively, and compared with ORB-SLAM2. The result shows that RPL-SLAM can effectively improve the accuracy of pose estimation and map reconstruction while maintaining real-time performance by fusing point-line features with depth images.

Output compensation of nonlinear system response is studied in this work with an inference-based design method used to control the nonlinear dynamics in the presence of non-linear effects. This design which is driven by practical considerations is informed by the comparisons made between nonlinear models and their linearized derivatives. While a detailed mathematical route has not been followed here, the results seem to show the workability of the proposed method and at its core, the design is driven by its intuitiveness. The proposed technique utilizes as primary parameter for comparison, the steady state error term which is derived from the behavior of the linear dynamics. Possible application areas for this design is in reduced energy control of nonlinear systems. The method was tested in simulation on a generic nonlinear system and a cart-driven inverted pendulum benchmark system.

For the visual-inertial system, the key frame loss always emerges in the rotation with the weak texture and strong illumination, which seriously affects the camera positioning accuracy. To solve this problem, a tight-coupling-based visual fusion scheme leveraging line features is proposed in our work, called VinsFusion-Line. It first deeply integrates line features, inertial measurement unit(IMU) pre-integration, and stereo visual observations through a tightly-coupled framework. And the infinitely extended line features provide more geometric and structural information, compared with the base point and line feature tracing methods. Hence, the positioning accuracy is improved greatly. In order to further make the calculation of 3D spatial line features faster and more efficient, Plücker coordinates and straight lines are used to represent the features. In addition, the camera state is optimized by a multi-source cost function that embeds both IMU pre-integration residuals and line feature reprojection errors. This design enables tight-coupled fusion of IMU and binocular visual information, rather than relying solely on point features as in existing methods. Finally, experiments on the public data show that under the strong light and weak texture, the binocular VinsFusion-Line system with infinite extension line in our work has better positioning accuracy than the single-purpose Vins-Fusion system.

Most mainstream visual-inertial SLAM systems rely on the point feature method of front-end images for motion estimation and localization. However, the SLAM system based on the point feature method, in the case of weakly textured environments, may not be able to estimate the motion due to the lack of point features. For this reason, the introduction of line features has received extensive attention. Line features in the environment can improve the localization accuracy of SLAM, but the extraction and matching of line features are relatively time-consuming and cannot satisfy real-time requirements. Based on the EDLines algorithm, we propose a fast visual-inertial odometry that fuses point and line features. The improved EDLines algorithm is used to process line features. By adjusting the internal parameters of the algorithm, the extraction time of line features is decreased while the extraction effect is the same. And the line features screening strategy is proposed to filter out invalid short line segments and merge adjacent line segments. We use the more effective line features after screening for graph matching and back-end optimization, which reduces the calculation amount of line features matching and ensures the accuracy. The proposed algorithm has been tested on the public datasets, and the comparison results with PL-VIO and VINS-Mono show that the algorithm in this paper improved real-time performance and localization accuracy.

An Ito–Taylor weak 3.0 method for stochastic dynamics of nonlinear systems

We use the instantaneous normal mode approach to provide a description of the local curvature of the potential energy surface of a model for water. We focus on the region of the phase diagram in which the dynamics may be described by mode-coupling theory. We find that the diffusion constant depends on the fraction of directions in configuration space connecting different local minima, supporting the hypothesis that the dynamics are controlled by the geometric properties of configuration space. Furthermore, we find a relation between the number of basins accessed in equilibrium and the connectivity between them.

摘要: 确定学习运用自适应控制和动力学系统的概念与方法, 研究未知动态环境下的知识获取、表达、存储和利用等问题. 针对产生周期或回归轨迹的连续 非线性动态系统, 确定学习可以对其未知系统动态进行局部准确建模, 其基本要 素包括: 1)使用径向基函数(Radial basis function, RBF)神经网络; 2)对于周期(或回归)状态轨迹 满足部分持续激励条件; 3)在周期(或回归)轨迹的邻域内实现对非线性系统动态的局部准确神经网络逼近(局部准确建模); 4)所学的知识以时不变且空间分布的方式表达、以常值神经网络权值的方式存储, 并可在动态环境下用于动态模式的快速识别或者闭环神经网络控制. 本文针对离散动态系统, 扩展了确定学习理论, 提出一个根据时态数据序列对离散动态系统进行建模与控制的框架. 首先, 运用确定学习原理和离散系统的自适应辨识方法, 实现对产生时态数据的离散非线性系统的未知动态进行局部准确的神经网络建模, 并利用此建模结果对时态数据序列进行时不变表达. 其次, 提出时态数据序列的基于动力学的相似性定义, 以及对离散动态系统产生的时态数据序列(亦可称为动态模式)进行快速识别方法. 最后, 针对离散非线性控制系统, 实现了基于时态数据序列对控制系统动态的闭环辨识(局部准确建模). 所学关于闭环动态的知识可用于基于模式的智能控制. 本文表明确定学习可以为时态数据挖掘的研究提供新的途径, 并为基于数据的建模与控制等问题提供新的研究思路. 关键词: 确定学习 / 时态数据序列 / 离散动态系统 / 基于数据的建模 / 部分持续激励条件 / 时态数据挖掘 / 动态模式识别 / 基于模式的控制

Image registration is an important basis of image processing, which is of great significance in image mosaicking, target recognition, and change detection. Aiming at the automatic registration problem of multi-angle optical images for ground scenes, a registration method combining point features and line features to register images is proposed. Firstly, the LSD (Line Segment Detector) algorithm is used to extract line features of images. The obtained line segments whose length are less than a given threshold are eliminated by a visual significant algorithm. Then, an affine transform model obtained by estimating a Gaussian mixture model (GMM) is applied to the image to be matched. Lastly, Harris point features are utilized in fine matching to overcome shortages of methods based on line features. In experiments, the proposed algorithm is compared with popular feature-based registration algorithms. The results indicate that the proposed algorithm in this work has obvious advantages in terms of registration accuracy and reliability for optical images acquired at different angles.

Visual Simultaneous Localization and Mapping (SLAM) technologies based on point features achieve high positioning accuracy and complete map construction. However, despite their time efficiency and accuracy, such SLAM systems are prone to instability and even failure in poor texture environments. In this paper, line features are integrated with point features to enhance the robustness and reliability of stereo SLAM systems in poor texture environments. Firstly, method Edge Drawing lines (EDlines) is applied to reduce the line feature detection time. Meanwhile, the proposed method improves the reliability of features by eliminating outliers of line features based on the entropy scale and geometric constraints. Furthermore, this paper proposes a novel Bags of Word (BoW) model combining the point and line features to improve the accuracy and robustness of loop detection used in SLAM. The proposed PL-BoW technique achieves this by taking into account the co-occurrence information and spatial proximity of visual words. Experiments using the KITTI and EuRoC datasets demonstrate that the proposed stereo Point and EDlines SLAM (PEL-SLAM) achieves high accuracy consistently, including in challenging environments difficult to sense accurately. The processing time of the proposed method is reduced by 9.9% and 4.5% when compared to the Point and Line SLAM (PL-SLAM) and Point and stereo Point and Line based Visual Odometry (sPLVO) methods, respectively.

Myosin II Controls Cellular Branching Morphogenesis and Migration in 3D by Minimizing Plasma Membrane Curvature

In this paper we present and compare different fault diagnosis algorithms using space space models for nonlinear dynamic systems. Most fault diagnosis and isolation algorithms for dynamic systems, which can be modeled using a set of state space equations, have relied on the system being linear and the noise and disturbances being Gaussian. In such cases, optimal filtering ideas based on Kalman filtering are utilized in estimation followed by a residual analysis, for which whiteness tests are typically carried out. Linearized approximations (e.g., Extended Kalman filters) have been used in the nonlinear dynamic systems case. However, linearization techniques, being approximate, tend to suffer from poor detection or high false alarm rates. In this paper, we use the sequential Monte Carlo filtering approach where the complete posterior distribution of the estimates are represented through samples or particles as opposed to the mean and covariance of an approximated Gaussian distribution. The particle filter is combined with the innovation-based fault detection techniques to develop a fault detection and isolation scheme. The advantage of particle filters is that they are capable of handling any functional nonlinearity and system or measurement noise of any distribution. An improvement on using a single Extended Kalman filter matched to a particular model is to use the the Interacting Multiple Model estimator, which consists of a number of EKFs running in parallel. Such a multiple model estimator can handle the abrupt changes in the system dynamics, which is essential for fault diagnosis. Here, we compare the fault detection performances of these algorithms on different nonlinear systems.