Autonomous collision avoidance method for MASSs based on precise potential field modelling and COLREGs constraints in complex sailing environments

Background: With the development of robotics, more and more robots are being used in industrial production. However, as the production environment surrounding the robots becomes increasingly complex, there is a need for more intelligent industrial robots. For improving the intelligence of industrial robots, the most important thing is to ensure that they can carry out safe industrial production activities in a complex production environment. Therefore, studying the autonomous dynamic obstacle avoidance path planning of industrial robots in complex environments is of great significance for improving the intelligence of industrial robots and the application of human-machine collaboration. Objective: The main purpose of this paper is to improve the traditional artificial potential field method. It aims to improve the disadvantages of the traditional artificial potential field method, such as falling into the local minimum and failing to reach the target. Secondly, the background difference method, which is based on binocular vision and Kalman filtering algorithm, is used, and the environmental map containing the static and dynamic obstacles is obtained. After obtaining the information on the position of static and dynamic obstacles, the robot arm can make good use of the improved artificial potential field method to plan its own trajectory, thus realizing the dynamic obstacle avoidance of the robot arm in a complex environment. Methods: This paper proposes an improved artificial potential field method. First of all, in order to solve the problem of not being able to achieve the goal, the method of modifying the repulsion field function, as proposed by Wang Huili and others, has been cited. In the traditional repulsion function, the relative distance between the robot and the target is introduced. Due to this, the target point is always the minimum point of the potential field. It is necessary to ensure that the robot can reach the target position smoothly. For the local minimum problem, by adding a gravitational increase factor β, the gravitational force received is greater than the repulsive force, thereby breaking the balance of the resultant force. Finally, for the traditional artificial potential field method that does not consider the path planning problem in the presence of dynamic obstacles, the velocity vector of the dynamic obstacle is brought into the potential field function to improve the traditional artificial potential field method. Results: The robot easily falls into the local optimum during path planning, and the improved artificial potential field method overcomes this shortcoming. Therefore, the manipulator can perform autonomous dynamic obstacle avoidance path planning in an environment with dynamic obstacles, finally reaching the target point safely. Conclusions: The industrial production field faces an increasing demand for intelligent industrial robots. This paper improves on the traditional artificial potential field method based on binocular vision so that the mechanical arm can avoid dynamic obstacles autonomously in the presence of dynamic obstacles, thereby improving the degree of intelligence of the robotic arm, enabling the technology to meet the needs of future industrial development and contribute to the development of future industrial robot technology.

A novel model predictive artificial potential field based ship motion planning method considering COLREGs for complex encounter scenarios

COLREGs-abiding hybrid collision avoidance algorithm based on deep reinforcement learning for USVs

During the mission of the USV (Unmanned Surface Vehicle), there may be some static or dynamic obstacles on the pre-planned track that are not displayed on the ground station. To avoid these obstacles in time, a model of DCPA (distance to the closest point of approach) between the USV and the obstacle is proposed, which is used to plan the speed of the USV, and adaptively accelerate and decelerate can safely avoid dynamic obstacles. We solved the problem of target unreachable and heading change optimization by planning the heading at IAPF (improved artificial potential field) in the process of sailing, which can effectively avoid static obstacles and respond to collision avoidance in emergencies. The collision avoidance planning outputs a set of behavior vectors (speed, heading), and hands it over to the USV controller to control the navigation of the USV. In this study, an adaptive speed and heading planning method is used to improve the collision avoidance ability of the USV in the mixed scene of dynamic and static obstacles. Through multiple launching experiments, the actual collision avoidance effect of the method is verified, and the safety and reliability of the USV application requirements are met.

To meet the higher requirements of Maritime Autonomous Surface Ships (MASS) development for autonomous collision avoidance technologies, this paper proposes a multi-ship autonomous collision avoidance decision-making algorithm based on MER-D3QN (Dueling Double Deep Q-Network with mixed experience replay). Firstly, a Reinforcement Learning (RL) test system based on the Markov Decision Process (MDP) with the heterogeneous multi-agent system (HMS) test environment is established to determine the distributed learning-execution mechanism. Secondly, a reward function is designed by considering various factors that affect ship collision avoidance from a global perspective. Meanwhile, the D3QN network is used to train the algorithm model with mixed experience replay technology, which can accelerate the model's convergence speed. Finally, the algorithm's performance is validated using the classic Imazu problem as the testing set. The experimental results show that this algorithm enables all ships to complete collision avoidance tasks safely and efficiently in compliance with the International Regulations for Preventing Collisions at Sea (COLREGs) requirements. Furthermore, the trained model can be applied in the HMS with any number of agents, providing a new research idea for the field of ship autonomous navigation.

With the development of Maritime Autonomous Surface Ships (MASS), considerable research is undertaken to secure their safety. One of the critical aspects of MASS is collision avoidance, and multiple collision avoidance algorithms have been developed. However, due to various reasons, collision avoidance of autonomous merchant vessels appears to be far from resolved. With this study, we aim to discuss the current state of Collision Avoidance Methods (CAMs) and the challenges lying ahead—from a joint academic and practical point of view. To this end, the key Rules from International Regulations for Preventing Collisions at Sea (COLREG) have been reviewed with a focus on their practical application for MASS. Moreover, the consideration of the COLREG Rules in contemporary collision avoidance algorithms has been reviewed. The ultimate objective is to identify aspects of COLREG requiring additional attention concerning MASS developments in terms of collision avoidance. Our conclusions indicate that although a lot of progress has been achieved recently, the feasibility of CAMs for MASS remains questionable. Reasons for so are the ambiguous character of the regulations, especially COLREG, as well as virtually all existing CAMs being at best only partly COLREG-compliant.

It is essential to investigate the path planning and tracking problem for maritime autonomous surface ships (MASS). This study proposed an automatic collision avoidance method based on the separation and recovery mechanism with formation of MASS (F-MASS). First, the marine environment model utilized S-57 electric navigation chart (ENC) data for construction. The Scan-searching method was proposed for multipath and path-optimized redistribution method was developed to address MASS congestion. The formation pattern transformation was settled by separation and recovery mechanism. Considered the ‘unmanned–manned’ encounter situation, formulated avoidance strategies for both the MASS formation and manned ships encounters. Finally, the simulation experiment was carried out in the sea near Zhoushan port to verify the effectiveness of the algorithm. The results indicated that the method can satisfy the integrated operation of collision avoidance in a complex environment and can offer effective collision avoidance strategies for F-MASSs navigating in complex marine environments.

This research develops a performance evaluation model of humans in avoiding ship collision situations compared to the AI ship collision avoidance system (CAS). A human, the remote operator (RO) of Maritime Autonomous Surface Ships (MASS), ought to make compact collision avoidance (CA) decisions to secure safety and efficiency during remote operations. Hence, evaluating RO’s CA performance is important; however, research on developing evaluation methods concentrates merely on evaluating trainees based on instructor’s guidelines, while artificial intelligence (AI) makes CA decisions through parameter-based calculation. Therefore, this research proposes a CA performance evaluation model for RO of MASS based on CAS intervening of RO trainee’s simulation training in ship collision avoidance. In each time interval, the RO’s decisions showed divergent behaviors under given situational conditions compared to the CAS’s behaviors in equivalent situations. Findings denote the benefits of CAS intervention methods and RO performance evaluation model based on the proposed performance features.

Maritime Autonomous Surface Ship (MASS) is promoted as the future of intelligent shipping. While autonomy technologies offer a solution for MASS, they have also resulted in new challenges for performance validation. To address this, a scenario-based validation method to test the autonomous collision avoidance system is proposed in this paper, including mining ship encounter scenarios from massive historical AIS data and randomly generated virtual test scenarios according to the parameter probability distributions from the collected real scenarios, as well as the final experiments: a total of 2900 generated scenarios including single ship and multi-ship encounter situations are created and applied to conduct testing experiments on the further assessment of our collision avoidance algorithm. The results indicate that the proposed method has the ability to quickly create appropriate testing scenarios according to AIS records, which are helpful to catch potential defects in a collision avoidance algorithm of MASS and to further analyze its navigating features. As a result, the research forms a systematic set of validation procedures from data gathering to practical experiments conduction, incorporating both the real statistics and the random generation method.

Deep reinforcement learning with dynamic window approach based collision avoidance path planning for maritime autonomous surface ships

In order to solve the “minimum trap” of artificial potential field method and the limitation of traditional path planning algorithm in dynamic obstacle environment, a path planning control algorithm based on improved artificial potential field method is proposed. Firstly, a virtual potential field detection circle model (VPFDCM) with adjustable radius is proposed to detect the “minimum trap” formed by the repulsion field of obstacles in advance. And the motion model of unmanned vehicle is established. Combined with the improved reinforcement learning algorithm based on Long Short-Term Memory(LSTM), the radius of virtual potential field detection circle is adjusted to achieve effective avoidance of dynamic obstacles, The reliable online collision free path planning of unmanned vehicle in semi closed dynamic obstacle environment is realized. Finally, the reliability and robustness of the algorithm are verified by MATLAB simulation. The simulation results show that the improved artificial potential field method can effectively solve the problem of unmanned vehicle falling into the “minimum trap” and improve the reliability of unmanned vehicle movement. Compared with the traditional artificial potential field method, the improved artificial potential field method can achieve more than 90% success rate in obstacle avoidance.

Wireless ultraviolet light MIMO assisted UAV direction perception and collision avoidance method

COLREGs and their application in collision avoidance algorithms: A critical analysis

Two potential fields fused adaptive path planning system for autonomous vehicle under different velocities

A real-time multi-ship collision avoidance decision-making system for autonomous ships considering ship motion uncertainty