Intelligent Path Planning for Navigation in Complex Marine Geomagnetic Environments

Path planning plays an extremely important role in the operation of Autonomous Underwater Vehicles (AUVs) to accomplish the underwater task safely, successfully and efficiently. This paper introduces the Fast Marching method for the path planning of AUVs in 3D large-scale battlefield environments to solve the problem that AUVs require low probability of being found, navigation security and low fuel consumption. The algorithm is able to find the optimal path between two waypoints in the work space and comprehensively takes factors such as the risk of collision with obstacles and mine, detection probability, sailing depth and path length into account. It also considers the maneuverability constraints of the AUV, including the safety depth and turning radius, to obtain the final flyable path. Finally, the proposed algorithm is tested in a large-scale area containing underwater terrain elevation map, sonar and mine density map to evaluate its feasibility, stability and efficiency.

Autonomous underwater vehicles (AUVs) are used to execute an increasingly challenging set of missions in commercial, environmental and defense industries. The resources available to the AUV in service of these missions are typically a limited power supply and onboard sensing of its local environment. Optimal path planning is needed to maximize the chances that these AUVs will successfully complete long-endurance missions within their power budget. A time-optimal path planner has been recently developed to minimize AUV mission time required to traverse a dynamic ocean environment at a specified speed through the water. For many missions, time minimization is appropriate because the AUVs operate at a fixed propeller speed. However, the ultimate limiting constraint on AUV operations is often the onboard power supply, rather than mission time. While an empirical or theoretical relationship between mission time and power could be applied to estimate power usage in the path planner, the real power usage and availability on an AUV varies mission-to-mission, as a result of multiple factors, including vehicle buoyancy, battery charge cycle, fin configuration, and water type or quality. In this work, we use data collected from two mid-size AUVs operating in various conditions to learn the mission-to-mission variability in the power budget so that it could be incorporated into the mission planner.

Path planning for Autonomous Underwater Vehicle(AUV) is challenging for the reason that the dynamic system of AUV is under-actuated and the main sensor called sonar suffers from a limit detection range. This paper proposed a reinforcement learning (RL) based path planning method for the high speed AUV considering multi constrains. Firstly, an actor-critic based RL algorithm is designed including the constrains of sonar's detection distance, detect angle and AUV's angular rate. Secondly, an improved reward function is proposed considering total path length, angle change and the position of obstacles and target area. Finally, a priority experience replay(PER) technology is applied to RL algorithm to speed the training process. Simulation results show that the improved algorithm plan the reasonable path with mentioned constrains. Compared with conventional method in simulation, the improved algorithm finishes the path planning task with faster convergence speed, shorter path length and smaller cost about angle action.

Path planning refers to that the mobile robot can obtain the surrounding environment information and its own state information through the sensor carried by itself, which can avoid obstacles and move towards the target point. Deep reinforcement learning consists of two parts: reinforcement learning and deep learning, mainly used to deal with perception and decision-making problems, has become an important research branch in the field of artificial intelligence. This paper first introduces the basic knowledge of deep learning and reinforcement learning. Then, the research status of deep reinforcement learning algorithm based on value function and strategy gradient in path planning is described, and the application research of deep reinforcement learning in computer game, video game and autonomous navigation is described. Finally, I made a brief summary and outlook on the algorithms and applications of deep reinforcement learning.

In the path planning problem for autonomous underwater vehicles, good results can be achieved using deep reinforcement learning models, but the actual effectiveness of the algorithm is extremely dependent on the construction of the neural network, which can require tedious manual tuning. We used AUTORL to automate the search for a neural network architecture and trained a population of intelligences to search for an algorithm that max the final reward. We applied this to the DQN algorithm and trained it in a built simulation environment, demonstrating that the evolved underwater robot path planning algorithm improves both in terms of final reward and convergence speed.

This paper proposes a new method for cruising-type autonomous underwater vehicles (AUVs) to track rough seafloors at low altitudes while also maintaining a high surge velocity. Low altitudes are required for visual observation of the seafloor. The operation of AUVs at low altitudes and high surge velocities permits rapid seafloor imaging over a wide area. This method works without high-grade sensors, such as inertial navigation systems (INS), Doppler velocity logs (DVL), or multi-beam sonars, and it can be implemented in lightweight AUVs. The seafloor position is estimated based on a reflection intensity map defined on a vertical plane, using measurements from scanning sonar and basic sensors of depth, attitude, and surge velocity. Then, based on the potential method, a reference pitch angle is generated that allows the AUV to follow the seafloor at a constant altitude. This method was implemented in the AUV HATTORI, and a series of sea experiments were carried out to evaluate its performance. HATTORI (Highly Agile Terrain Tracker for Ocean Research and Investigation) is a lightweight and low-cost testbed designed for rapid and efficient imaging of rugged seafloors, such as those containing coral reefs. The vehicle succeeded in following a rocky terrain at an altitude of approximately 2 m with a surge velocity of approximately 0.8 m/s. This paper also presents the results of sea trials conducted at Ishigaki Island in 2017, where the vehicle succeeded in surveying the irregular, coral-covered seafloor.

Cooperative robots became a very important research topic due to their capability to accomplish tasks fast and more efficiently. In order for cooperative robots to accomplish their tasks, they need to be able to plan their paths in the environment without any collision. Path planning for cooperative robots with deep reinforcement learning is a new research topic in robotics and artificial intelligence. Path planning via deep reinforcement learning is an end to end method. The robot directly receives the data from the sensor (usually high dimensional images) and generates an optimal policy that plans a safe path to the target. In this paper, we first present an overview of reinforcement learning, deep learning, and deep reinforcement learning. Then, we introduce methods used for path planning. Finally, we discuss the challenges of deep reinforcement learning path planning for cooperative robots.

Path planning and formation control are two of the most significant concepts which can be considered in multi-vehicle systems and particularly in autonomous underwater vehicles (AUVs). The cooperative implementation of complicated commands would lead to desirable results and increase the probability of success in the missions. Due to the nonlinear dynamics and environmental conditions, the cooperative control of AUVs is a challenging topic. The developments in AUV applications demonstrate the significance of research and development in path planning and formation control. Unlike ground or aerial autonomous vehicles, this field of study has not attracted considerable attention and further exploration is required as a result. The present paper reviews the different structures of formation control in AUVs and discusses their advantages and disadvantages. Besides formation control, the cooperative path planning of AUVs along with the limitations specific to the cooperative structure is taken into consideration in the present study. Moreover, avoiding any obstacle collision and preventing any encounter between group members are considered as critical issues in the formation control and cooperative path planning. Some areas are still open to investigation as implied by the technological suggestions, which will facilitate future research. At the end of the article, a simulated sample is given of the triangular formation path planning for AUVs.

With the rapid development of AI technology, personalized learning path planning is becoming an important research field. Dual system teaching models have great influence on the learning effect of students. Therefore, how to optimize the learning process of students through the personalized learning path is a great challenge. A Deep Reinforcement Learning (DRL) algorithm for personalized learning path planning is proposed. Based on deep Q-networks and reinforcement learning feedback mechanisms, the algorithm achieves adaptive optimization. The experimental results show that the algorithm based on the DRL is superior to the traditional method in learning performance, learning efficiency and satisfaction. Compared with traditional path planning algorithms based on rules and collaborative filtering, the proposed algorithm improves learning performance by 20%. Moreover, it has obvious advantages in learning motivation and efficiency. This paper provides a new way of thinking to intelligent education system, especially dual-system teaching model, and it is of great practical significance.

The paper deals with analysis of control performance of an autonomous underwater vehicle named AQUA EXPLORER 1000 (AE1000) for inspection of underwater telecommunication cables up to 1000 m depth, reviewing results of sea trials in autonomous tracking. The control performance of the cable tracking at 40 m water depth, consisting of descent from the surface, cable searching, cable tracking and ascent to the surface, is discussed based on the measured data. Next, the performance of spiral motion control in a limited area from the mother ship, which is an important operation for the AE1000 not to be lost during descent and ascent, is discussed by showing test results. Finally, the performance of the fuzzy controller for cable tracking control in tidal currents is discussed by use of numerical simulation.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Autonomous underwater vehicles (AUVs) are unmanned marine robots that have been used for a broad range of oceanographic missions. They are programmed to perform at various levels of autonomy, including autonomous behaviours and intelligent behaviours. Adaptive sampling is one class of intelligent behaviour that allows the vehicle to autonomously make decisions during a mission in response to environment changes and vehicle state changes. Having a closed-loop control architecture, an AUV can perceive the environment, interpret the data and take follow-up measures. Thus, the mission plan can be modified, sampling criteria can be adjusted, and target features can be traced. This paper presents an overview of existing adaptive sampling techniques. Included are adaptive mission uses and underlying methods for perception, interpretation and reaction to underwater phenomena in AUV operations. The potential for future research in adaptive missions is discussed.

TOUCH is a real-time computer vision system that has been developed in order to aid the operation of autonomous underwater vehicles (AUVs) and remotely operated vehicles (ROVs). The algorithm is based on a modified 4-connectivity approach that scans the incoming frames for a target hue range and based upon the largest connected blobs of hue, tracks an object and provides the two dimensional Cartesian coordinates of the desired object. Since few algorithms exist for tracking and recognizing objects in underwater environments, this algorithm provides a way for AUVs and ROVs to acquire, track or recognize objects by using a relatively fast and inexpensive vision system. This paper presents the details on TOUCH, its testing, some areas that warrant improvement and possible course of action for the future.

High accuracy and reliable navigation in the underwater environment is very critical for the operations of autonomous underwater vehicles (AUVs). This paper proposes an adaptive federated interacting multiple model (IMM) filter, which combines adaptive federated filter and IMM algorithm for AUV in complex underwater environments. Based on the performance of each local system, the information sharing coefficient of the adaptive federated IMM filter is adaptively determined. Meanwhile, the adaptive federated IMM filter designs different models for each local system. When the external disturbances change, the model of each local system can switch in real-time. Furthermore, an AUV integrated navigation system model is constructed, which includes the dynamic model of the system error and the measurement models of strapdown inertial navigation system/Doppler velocity log (SINS/DVL) and SINS/terrain aided navigation (SINS/TAN). The integrated navigation experiments demonstrate that the proposed filter can dramatically improve the accuracy and reliability of the integrated navigation system. Additionally, it has obvious advantages compared with the federated Kalman filter and the adaptive federated Kalman filter.

The operation of Autonomous Underwater Vehicles (AUVs) within underwater sensor network fields provides an opportunity to reuse the network infrastructure for long baseline localisation of the AUV. Computationally efficient localisation can be accomplished using off-the-shelf hardware that is comparatively inexpensive and which could already be deployed in the environment for monitoring purposes. This paper describes the development of a particle filter based localisation system which is implemented onboard an AUV in real-time using ranging information obtained from an ad-hoc underwater sensor network. An experimental demonstration of this approach was conducted in a lake with results presented illustrating network communication and localisation performance.KeywordsSensor NodeCommunication RangeInertial Measurement UnitRound Trip TimeAutonomous Underwater VehicleThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Research on the influence of balance weight parameters on the motion performance of the seafloor mapping AUV in vertical plane