A Multi-Agent Based Intelligent Training System for Unmanned Surface Vehicles

In this paper, the intelligent cooperative control problem of unmanned surface vehicles (USVs) is investigated. We consider a team of USVs used in the protection of a target against potential threats. The task of the USVs is to cooperatively protect the target from being destroyed. A behavior-based fuzzy logic control system is presented to solve the problem. First, we identify two types of behaviors; low and high level behaviors. High level behaviors act as a mechanism to induced coordination and synchronization among USVs. Based on this, four high level behaviors (behavior integrator, intercept, formation and assist behaviors), each implementing a fuzzy inference system and two low level behaviors(collision avoidance and attack behaviors) are proposed. The paper defines behavior-based rules to meet the requirement of a simple operational scenario. Genetic algorithms is used to learn the rule base and the choice of behavior. Simulation results demonstrates the effectiveness of our approach. Results shows that the approach has potential application for a real team of cooperative USVs.

This article proposes a swarm-based path-following guidance system for an autonomous marine multi-vehicle system. In particular, a team of unmanned surface vehicles is required to converge to and navigate along a desired reference path, while at the same time aggregating and maintaining a range-based formation configuration. First, a separate description is given for a swarm methodology, initially developed for small ground mobile robots and exploited to aggregate the robot team, and a virtual target–based path-following guidance system developed for unmanned surface vehicles, exploited to drive not the single vehicles but the robot formation as a whole. Then, the integration of the two proposed methodologies is reported and proven, in order to guarantee the feasibility and stability of the overall guidance framework. Simulative results are proposed to validate the effectiveness of the proposed methodology and to evaluate the system performances.

With the development of technologies related to unmanned vehicles, including unmanned aerial vehicle and unmanned surface vehicle, unmanned vehicles play a pivotal role in maritime management and cruise activities. Meanwhile, lots of evidence shows that a single unmanned vehicle is not qualified for operation under complex environment, whereas the unmanned aerial vehicle–unmanned surface vehicle formation consists of multiple unmanned aerial vehicles and unmanned surface vehicles, which can enhance the performance of the single unmanned vehicle significantly. However, the cooperative operation performance of the unmanned aerial vehicle–unmanned surface vehicle formation is constrained by its communication capacity. Consequently, a cooperative communication framework is designed for the unmanned aerial vehicle–unmanned surface vehicle formation. A distributed dynamic network topology is constructed for fulfilling effective communication for the unmanned aerial vehicle–unmanned surface vehicle formation based on ad hoc network. Experiments are carried out by employing the built unmanned aerial vehicle–unmanned surface vehicle formation platform. Results verify the superiority of the designed cooperative communication framework for the unmanned aerial vehicle–unmanned surface vehicle formation.

Protecting civilian harbours is a field which has received increasing interest after the attack of September 11th. Exploiting a team of Unmanned Surface Vehicles (USVs) for the protection of harbours is one of the areas under major investigation. Indeed the USVs could be used to perform patrolling around the crucial waterways or to investigate possible suspect vessels, increasing the effectiveness of the security system, while at the same time decreasing the number of human beings directly exposed to threats. The coordination of such a team of USVs is the goal of an on-going joint research project, the Swarm Management Unit (SMU), between the authors' organization. This work presents the latest results of the SMU project, i.e. a menace interception system composed by the on-line selection of the best interceptor coupled with the off-line optimization of the positioning of the team of USVs.

Multi-robot cooperative patrolling systems have been extensively employed in the civilian and military fields, including monitoring forest fires, marine search-and-rescue, and area patrol. Multi-robot area patrol problems refer to the activity that a team of robots works cooperatively and regularly to visit the key targets in the given area for security. Following consideration of the low cost and high safety of unmanned surface vehicles (USV), a team of USVs is organized to perform area patrol in a sophisticated maritime environment. In this paper, we establish a mathematical model considering the characteristics of the cooperative patrol task and the limited conditions of USVs. A hybrid partition-based patrolling scheme is proposed for a multi-USV system to visit targets with different importance levels in a maritime area. Firstly, a centralized area partition algorithm is utilized to partition the patrolling area according to the number of USVs. Secondly, a distributed path planning algorithm is applied to planning the patrolling path for each USV to visit the targets in a maritime environment to minimize the length of the patrolling path for the USV team. Finally, comparative experiments between the proposed scheme and other methods are carried out to validate the performance of the hybrid partition-based patrolling scheme. Simulation results and experimental analysis show the efficiency of the proposed hybrid partition-based patrolling scheme compared to several previous patrolling algorithms.

The development of theoretical-based methods for the assessment of multi-agent systems properties is of critical importance. This work is a preliminary investigation on methodologies for modeling, analysis and design of multi-agent systems. Multi-agent systems are regarded as discrete-event dynamic systems and Petri nets are used as a modeling tool to assess the structural properties of the multi-agent system. Our methodology consists of defining a simple multi-agent system based on the abstract architecture for intelligent agents. The abstract architecture is modeled as a discrete-event system using Petri nets and structural analysis of the net provides an assessment of the communication and coordination properties of the multi-agent system. Deadlock avoidance in the multi-agent system is considered as an initial key property, and it is evaluated using liveness and boundedness properties of the Petri net model.

In recent years, many countries have increasingly invested in the marine industry, thus greatly improving the level of ship automation. As the new favorite in the field of reconnaissance, survey and rescue, unmanned surface vehicle (USV) has been widely used. Generally, the USV is carried out by mother ship when performing tasks, which poses great challenges to the launch and recovery of USV in a harsh marine environment. To resolve these problems, this study develops a floating bracket type launch and recovery system (L&RS). When the USV is far away from the floating bracket, it is homing by GPS navigation. As the distance is close, the floating bracket can regulate the direction by the real-time visual information and then the USV travels into floating bracket. This method can improve the accuracy and stability of the USV in the process of entering the floating bracket, which improves the success ration of recovery operation.

Efficient cleaning of floating waste using an intelligent unmanned surface vehicle is an important development trend in inland water governance. Path planning is the core of the decision-making module for unmanned surface vehicle waste cleaning and is key to achieving autonomous operation of the unmanned surface vehicle. However, due to the complexity and dynamic changes of the water surface environment, unmanned surface vehicle path planning methods for floating waste face challenges such as small size, uncertainty, and uneven distribution of floating waste. In response to the above issues, this article studies the problem of insufficient integration and low efficiency between existing path planning algorithms and target-perception modules, and designs an efficient overall path planning method for floating-waste cleaning by an unmanned surface vehicle. This method transforms the path planning problem of floating-waste cleaning unmanned surface vehicle into a Traveling Salesman Problem by setting global patrol points and tracking local targets, and proposes an improved ant colony algorithm, IACO, to solve the Traveling Salesman Problem. This article is based on the TSPLIB dataset and practical applications for experiments. The experimental results show that the proposed method has average optimal path lengths of 75.930 m, 446.555 m, and 703.759 m on the Ulysses22, eil51, and st70 datasets, respectively, which are reduced by 0.355 m, 4.108 m, and 13.575 m compared to the benchmark.

Unmanned surface vehicles have the advantages of maneuverability, concealment, wide activity area and low cost of use. Therefore, they have broad application prospects. This makes unmanned surface vehicles a research hotspot at home and abroad, and the sensing technology is the basis for the unmanned surface vehicles to perform tasks. The perception technology based on optical vision has the advantages of convenient application, relatively low cost, easy data acquisition and large amount of information, and has been widely studied by scholars at home and abroad. This paper mainly discusses the research of optical vision in unmanned surface vehicles from five aspects: Firstly, the water surface image preprocessing based on unmanned surface vehicles, mainly including water surface image defogging enhancement research; second is the use of light vision target detection; the next is the surface target tracking methods. Finally, the light vision research of unmanned surface vehicles is summarized and forecasted.

A consensus algorithm for coordinated control of unmanned surface vehicles (USVs) is studied. The USVs have different driving directions and initial velocities, so the consensus algorithm is needed to coordinate the directions and velocities of the USVs. Firstly, based on the first order linear model of USVs, get the first order nonlinear differential equations of high frequency, and the simulate environment of USVs. Then, based on the Vicsek model, the consensus algorithm in cooperative control of USVs is proposed. Aiming at the problem that USV's angular velocity lags behind the rudder angle, this paper improves the traditional PD control method, and adopts cascade PID control. So, USV can reach the same driving direction in a shorter time. Finally, simulations prove that the algorithm is feasible and compare the difference of efficiency between the PD controller and the cascade PID controller.

We consider an unmanned surface vehicle (USV) whose mission is to approach a maneuvering target ship as fast as possible followed by monitoring the target closely. The USV is equipped with sensors to detect the relative position of the target ship. Also, we assume that the USV is faster than the target and is localized using global positioning system. To achieve the mission, we develop a control law to make the USV approach the designated point (e.g., stern, left side, or right side, etc.) of the target as fast as possible. Once the USV reaches the designated point of the target, the USV checks whether the speed of the USV is fast enough to circle around the target. In the case where the circling maneuver is not feasible, the USV keeps following the designated point of the target. Once the USV determines that the circling maneuver is feasible, then we make the USV circle around the target for close monitoring, while maintaining a designated distance from the target. We present MATLAB simulations to verify our approach.

A course control system of unmanned surface vehicle (USV) using back-propagation neural network (BPNN) and artificial bee colony (ABC) algorithm

Unmanned surface vehicles (USVs) are crucial in ensuring maritime safety and observation, attracting widespread attention and research. However, a single USV exhibits limited performance and cannot effectively observe complex marine environments. In contrast, clusters of USVs can collaborate to execute complex maritime tasks, thereby enhancing the overall operational efficiency. USVs typically form heterogeneous clusters by combining vehicles with varying maneuverabilities and communication network capabilities. This has sparked an increased interest in cooperative communication research within heterogeneous USV clusters. The heterogeneous USVs discussed in this paper share the same dynamic model; however, they differ in dynamic parameters and communication capabilities. First, this study establishes a three-degree-of-freedom motion mathematical model for an underdriven USV considering environmental interference. It estimates the dynamic parameters of four USVs and evaluates their communication abilities, laying the foundation for researching the cooperative control of heterogeneous USV clusters and their application in Ocean Observation. Next, the communication capability of the USVs is assessed by studying the communication mode and signal transmission loss within the USV clusters. This study investigates the problem of cooperative communication in USV cluster formation, starting with the communication delay of USV clusters under a directed switching topology. Finally, a coherent formation controller is designed under a switching communication topology to address the dynamic transformation of communication topologies within heterogeneous USV clusters. This verifies that heterogeneous USV clusters can seamlessly form and maintain formation shapes during communication topology transformations through formation simulation experiments involving four heterogeneous USVs was 22% higher than that of dispersed control topology structures. This study provides a solid foundation for future investigations into the cooperative control of heterogeneous USV clusters and their applications in marine observations.

One of the main methods of the path localization of moving objects is positioning using Global Navigation Satellite Systems (GNSSs) in cooperation with Inertial Navigation Systems (INSs). Its basic task is to provide high availability, in particular in areas with limited access to satellite signals such as forests, tunnels or urban areas. The aim of the article is to carry out the testing and analysis of selected navigation parameters (3D position coordinates (Northing, Easting, and height) and Euler angles (pitch and roll)) of the GNSS/INS system for Unmanned Surface Vehicle (USV) path localization during inland hydrographic surveys. The research used the Ellipse-D GNSS/INS system working in the Real Time Kinematic (RTK) mode in order to determine the position of the "HydroDron" Autonomous Surface Vehicle (ASV). Measurements were conducted on four representative routes with a parallel and spiral arrangement of sounding profiles on Lake Kłodno (Poland). Based on the obtained research results, position accuracy measures of the "HydroDron" USV were determined using the Ellipse-D GNSS/INS system. Additionally, it was determined whether USV path localization using a GNSS/INS system working in the RTK mode meets the positioning requirements for inland hydrographic surveys. Research has shown that the Ellipse-D system operating in the RTK mode can be successfully used to position vessels when carrying out inland hydrographic surveys in all International Hydrographic Organization (IHO) Orders (Exclusive, Special, 1a/1b and 2) even when it does not work 100% correctly, e.g., loss of RTK corrections for an extended period of time. In an area with limited coverage of the mobile network operator (30-40% of the time the receiver operated in the differential mode), the positioning accuracy of the "HydroDron" USV using the Ellipse-D GNSS/INS system working in the RTK mode was from 0.877 m to 0.941 m for the R95(2D) measure, depending on the route travelled. Moreover, research has shown that if the Ellipse-D system performed GNSS/INS measurements using the RTK method, the pitch and roll error values amounted to approx. 0.06°, which is almost identical to that recommended by the device manufacturer. However, when working in the differential mode, the pitch and roll error values increased from 0.06° to just over 0.2°.

Unmanned Surface Vehicles (USVs) have widespread commercial, scientific and military applications. In some of these applications station keeping is essential. Since USVs have a bigger surface/ weight ration than large commercial ships, they are more sensitive to wind disturbances, especially during station keeping. The modeling, identification and control of a 4.9 meter long, 180 kilogram wave adaptive modular vehicle (WAM-V) USV are presented in this paper. The propulsion system of the USV is custom designed with two azimuthing thrusters, making the USV fully actuated. System identification tests were conducted to get the precise model of the USV. A sliding mode controller was first applied to the USV and a wind feedforward controller was designed to aid the nonlinear feedback control to mitigate wind disturbance. For the feedforward controller design, a wind model was formulated that uses the apparent wind speed and direction collected from a high accuracy anemometer. A model based adaptive mechanism was developed to tune the feedforward control gains for the best performance. Station keeping field tests were conducted at a location with an average wind speed of 9 knots. The results show that with the tuned feedforward controller, the USV can hold its position and heading better over extended periods of time than a single feedback controller.