Reservation-Based 3D Intersection Traffic Control System for Autonomous Unmanned Aerial Vehicles

An Adjustable Autonomy Management Module for Multi-agent Systems

In this paper a multiple object detection, recognition, and tracking system for unmanned aerial vehicles (UAVs) has been studied. The system can be implemented on any UAVs platform, with the main requirement being that the UAV has a suitable onboard computational unit and a camera. It is intended to be used in a maritime object tracking system framework for UAVs, which enables a UAV to perform multiobject tracking and situational awareness of the sea surface, in real time, during a UAV operation. Using machine vision to automatically detect objects in the camera's image stream combined with the UAV's navigation data, the onboard computer is able to georeference each object detection to measure the location of the detected objects in a local North‐East (NE) coordinate frame. A tracking algorithm which uses a Kalman filter and a constant velocity motion model utilizes an object's position measurements, automatically found using the object detection algorithm, to track and estimate an object's position and velocity. Furthermore, a global‐nearest‐neighbor algorithm is applied for data association. This is achieved using a measure of distance that is based not only on the physical distance between an object's estimated position and the measured position, but also how similar the objects appear in the camera image. Four field tests were conducted at sea to verify the object detection and tracking system. One of the flight tests was a two‐object tracking scenario, which is also used in three scenarios with an additional two simulated objects. The tracking results demonstrate the effectiveness of using visual recognition for data association to avoid interchanging the two estimated object trajectories. Furthermore, real‐time computations performed on the gathered data show that the system is able to automatically detect and track the position and velocity of a boat. Given that the system had at least 100 georeferenced measurements of the boat's position, the position was estimated and tracked with an accuracy of 5–15 m from 400 m altitude while the boat was in the camera's field of view (FOV). The estimated speed and course would also converge to the object's true trajectories (measured by Global Positioning System, GPS) for the tested scenarios. This enables the system to track boats while they are outside the FOV of the camera for extended periods of time, with tracking results showing a drift in the boat's position estimate down to 1–5 m/min outside of the FOV of the camera.

Analysis of a hydrogen fuel cell-PV power system for small UAV

This work presents a tracking system for autonomous unmanned aerial vehicle (UAV) and any ground vehicle using global positioning system (GPS) and general packet radio service (GPRS). A Google form is created and a Google spreadsheet is set as destination location to store Google form responses on ground station. Whenever UAV is flying autonomously, GPS finds its current location (latitude and longitude). Thereafter, GPRS sends hypertext transfer protocol (HTTP) request which consists of the current location of a UAV and submits a response in Google form and Google spreadsheet. A custom function is added in a Google spreadsheet to monitor the path of an UAV on static Google map using Google Apps Script (GAS).

The paper presents the analysis on stability of digital control system for unmanned vehicle with numerical analysis. The objective of this study is mainly emphasized on the fulfillment of the advanced control techniques according to the fundamental concepts of digital control system approaches for unmanned aerial vehicle system design. The targeted unmanned aerial vehicle system was designed based on the simple construction under the idea of fixed wing flight system approaches. The stability analyses on unmanned aerial vehicle are vital role to enhance the real world applications. The background concepts on digital control system for stability analysis on dynamic control system like unmanned aerial vehicle system. The appropriate controller design for dynamic control system of unmanned aerial vehicle is vital role to analyze the accurate stability condition for reality. The implementation of numerical analysis on compensator design has been developed by using MATLAB. The physical parameters in these analyses are based on the experimental outcomes from the recent research works in dynamical system implementations. The mathematical approaches are very helpful for numerical analysis on compensator design for the unmanned aerial vehicles schemes. The simulation results confirm that the high performance stability test on unmanned aerial vehicle system has been met with the theoretical works.

The proliferation of unmanned aerial vehicles (UAVs) has driven the emergence of urban air mobility (UAM) as a solution to alleviate the increasing demand for UAVs applications in various domains. The concept of UAM envisions a future where UAVs play a pivotal role in short-distance transportation, delivery services, surveillance, emergency rescue, and more. However, the rapid growth of UAVs poses significant challenges arising from the need to ensure the safe coexistence of UAVs with other manned/unmanned aerial vehicles. To ensure the safe integration of UAVs into low-altitude urban airspace and support high-density on-demand mobility, this research focuses on handling the safety-centric challenges related to UAV collision risk assessment, obstacle avoidance, and conflict resolution in complex urban environments.
\nOne of the main challenges is the intrusion of UAVs into airport runways. Airports serve as critical hubs for civil aircraft takeoff and landing operations. However, the increasing presence of UAVs has raised concerns about intruding into airports, leading to flight delays and temporary runway closures. To quantify the potential interference of UAVs on civil aircraft, a collision-course based trajectory planning model is proposed to evaluate the collision risk between manned civil aircraft and intruding UAVs. In this risk assessment model, the trajectory of the intruding UAV is formulated using a collision-course concept, taking into account the limited trajectory information available about intruding UAVs. The planned trajectory of the UAVs is then used to predict its relative position concerning civil aircraft. To account for the possible disturbances of the relative distance, a stochastic position prediction model based on Brownian motion is developed. The collision risk is assessed based on this stochastic kinematic model, providing a quantitative measure of the potential collisions. The proposed model is validated through extensive simulations involving different UAV initial positions, position updates, and different sizes of collision zone tests, as well as comparative tests with the Monte-Carlo algorithm, demonstrating its robustness in assessing the collision risk of the airport restricted area. To facilitate the application, the model is finally used to develop a platform to generate runway heatmaps, accounting for airport runway risk distributions. 
\nAnother safety-centric challenge is ensuring autonomous obstacle avoidance and conflict resolution of UAVs. To enable UAV autonomous safe operations in uncontrolled urban low-altitude airspace, a comprehensive collision-free path planning framework is developed to address the avoidance of both static obstacles and dynamic threats. Firstly, to handle static obstacles, a novel algorithm of 3D voxel jump point research is introduced to generate a global reference path for UAV navigation to avoid static obstacles, particularly for a free flight at different altitudes. Additionally, to optimize the reference path for specific mission requirements, techniques such as trajectory de-diagonalization, reconstruction, and smoothness are proposed to reduce the risk of static collisions, shorten the fly range, and enable UAVs to negotiate turns more efficiently. Secondly, real-time conflict resolution actions based on the Markov decision process are developed to avoid local dynamic threats encountered along the optimized desired path. This allows the host UAV to dynamically adjust its course to a resolution trajectory while maintaining its planned speed without hovering to avoid the potential collision with the approaching intruders. By avoiding near mid-air collisions (NMAC) and preventing the UAV from hovering, the proposed method ensures the timely completion of UAV missions. Simulation results demonstrate that the developed method successfully achieves UAV autonomous global path planning and local real-time conflict resolution in complex urban low-altitude environments, thereby avoiding both static obstacles and dynamic threats. 
\nMoreover, to bridge the research gap of UAV hard conflict resolution in mitigating NMAC risks arising from local dynamic threats, a novel situational NMAC risk assessment approach is developed by integrating the conditional random field (CRF) algorithm with safety metrics and conflict resolution performance to facilitate UAV tiered aerial passage operations. To improve UAV operating environments in urban airspace, a concept of tiered aerial passages is first designed to provide a practical urban airspace planning scheme that addresses UAV heterogeneity and optimizes the utilization of urban airspace. For UAV tiered aerial passage operations, a situational NMAC risk assessment module coupled with a conflict resolution decision-making module is formulated, enabling the host UAV to evaluate and respond to real-time conflicts, ensuring avoidance of potential collisions. To assess NMAC risks, a general risk assessment model is proposed based on the CRF algorithm, considering UAV safety metrics and resolution performance. Then the overtaking, approaching head-on, and converging UAV encounters are analyzed, and situational risk potential scores are created using the Gaussian kernel function in the CRF algorithm, considering advisory, caution, and warning risk alert levels. To resolve conflict, acceptable, tolerable, and unacceptable scenarios are proposed to enhance the flexibility and personalization of the resolution decision-making. The proposed scheme is validated by simulating geometric encounter situations and comparative tests with the previous hard resolution technique. The results indicate that the proposed method outperforms UAV NMAC risk assessment and conflict resolution. Even in the most dangerous unacceptable resolution decision-making scenarios across three conflict encounters, the proposed algorithm achieves NMAC rates of 0.036, 0.070, and 0.043, which are lower than the corresponding NMAC rates associated with the hard resolution approach. Together with the acceptable and tolerable scenarios, the proposed negotiation resolution effectively tailors different risk requirements to accommodate diverse UAV missions. 
\nWith a primary focus on ensuring the safety of the UAM architecture, this research endeavors to assess UAV NMAC risks and efficiently manage potential conflicts. The proposed work are thoroughly validated to demonstrate their effectiveness in real-world scenarios. As a result, this study significantly contributes to the establishment of a robust UAM architecture, facilitating the realization of safe and reliable UAM.

The current research represents a first step towards developing a decentralized network of small autonomous, intelligent and inexpensive unmanned aerial vehicles (UAV), which could be used for a variety of scientific missions where measurements from a distributed network of nodes could significantly improve the assessment. The paper presents an adaptive airborne sensing platform (e.g., UAV) that could be used to fuse the information acquired through multiple sensing modalities (obtained from sensors located close to or inside the phenomena) to monitor environmental processes over space and time. The sensing platform is able to continuously reconfigure its trajectory according to the circumstances (e.g., continuously evolving scientific phenomena) to optimize the location of individual sensing waypoints. As proof of concept and validation, we will apply the proposed sensing approach to monitoring volcanic plumes. The paper focuses on (i) developing a Bayesian statistical method to create sensor fusion algorithms that is used to model the plume and guide the UAV in an optimal way (ii) implementing a distributed task allocation scheme which is able guide all the UAVs efficiently and optimize the UAV paths for various criteria.

This paper discusses the algorithms of vision systems for automatic UAV (Unmanned Aerial Vehicle) landing. The basic algorithms for finding helipad and adapting the UAV control system to an autonomous UAV landing are presented. The authors consider algorithms to solve navigation problems, building block diagrams of automatic UAV control. Also, the developed algorithms make it possible to implement an automatic landing system for UAVs using technical vision systems, using various camera parameters, algorithms allowing research, as part of the autonomous navigation of unmanned aerial vehicles. The article discusses the developed algorithm that allows you to highlight certain characteristic points for visual navigation. Also, a search system for characteristic points has been developed that allows automatic UAV landing. These algorithms may be useful for the autonomous landing UAV systems. Algorithms can also be used to track a trajectory of the UAV system.

A novel metaheuristics with adaptive neuro-fuzzy inference system for decision making on autonomous unmanned aerial vehicle systems

The design of reliable navigation and control systems for Unmanned Aerial Vehicles (UAVs) based only on visual cues and inertial data has many unsolved challenging problems, ranging from hardware and software development to pure control-theoretical issues. This chapter addresses these issues by developing and implementing an adaptive vision-based autopilot for navigation and control of small and mini rotorcraft UAVs. The proposed autopilot includes a Visual Odometer (VO) for navigation in GPS-denied environments and a nonlinear control system for flight control and target tracking. The VO estimates the rotorcraft ego-motion by identifying and tracking visual features in the environment, using a single camera mounted on-board the vehicle. The VO has been augmented by an adaptive mechanism that fuses optic flow and inertial measurements to determine the range and to recover the 3D position and velocity of the vehicle. The adaptive VO pose estimates are then exploited by a nonlinear hierarchical controller for achieving various navigational tasks including take-off, landing, hovering, trajectory tracking, target tracking, etc. Furthermore, the asymptotic stability of the entire closed-loop system has been established using systems in cascade and adaptive control theories. Experimental flight test data over various ranges of the flight envelope illustrate that the proposed vision-based autopilot performs well and allows a mini rotorcraft UAV to achieve autonomously advanced flight behaviours by using vision.

Large areas across the United States are potentially contaminated with UXO, with some ranges encompassing tens to hundreds of thousands of acres. Technologies are needed which will allow for cost effective wide area scanning with 1) near 100 % coverage and 2) near 100 % detection of subsurface ordnance or features indicative of subsurface ordnance. The current approach to wide area scanning is a multi-level one, in which medium altitude fixed wing optical imaging is used for an initial site assessment. This assessment is followed with low altitude manned helicopter based magnetometry followed by surface investigations using either towed geophysical sensor arrays or man portable sensors. In order to be effective for small UXO detection, the sensing altitude for magnetic site investigations needs to be on the order of 1 – 3 meters. These altitude requirements means that manned helicopter surveys will generally only be feasible in large, open and relatively flat terrains. While such surveys are effective in mapping large areas relatively fast there are substantial mobilization/demobilization, staffing and equipment costs associated with these surveys (resulting in costs of approximately $100-$150/acre). Surface towed arrays provide high resolution maps but have other limitations, e.g. in their ability to navigate rough terrain effectively. Thus, other systems are needed allowing for effective data collection. An UAV (Unmanned Aerial Vehicle) magnetometer platform is an obvious alternative. The motivation behind such a system is that it would be safer for the operators, cheaper in initial and O&M costs, and more effective in terms of site characterization. However, while UAV data acquisition from fixed wing platforms for large (> 200 feet) stand off distances is relatively straight forward, a host of challenges exist for low stand-off distance (~ 6 feet) UAV geophysical data acquisition. The objective of SERDP SEED 1509:2006 was to identify the primary challenges associated with a low stand off distance autonomous UAV magnetometer platform and to investigate whether these challenges can be resolved successfully such that a successful UAV magnetometer platform can be constructed. The primary challenges which were identified and investigated include: 1. The feasibility of assembling a payload package which integrates magnetometers, accurate positioning systems (DGPS, height above ground measurement), obstacle avoidance systems, power infrastructure, communications and data storage as well as auxiliary flight controls 2. The availability of commercial UAV platforms with autonomous flight capability which can accommodate this payload package 3. The feasibility of integrating obstacle avoidance controls in UAV platform control 4. The feasibility of collecting high quality magnetic data in the vicinity of an UAV.

The classification of drones - both military and civilian according to the relevant criteria - is presented. Block diagrams of a typical unmanned aerial vehicle and its power system are shown. Typically, a drone power system of the "micro", "mini" or "short range" category, according to the UVS international classification, is a set of DC / DC converters with a microprocessor control system. The power source for such aircraft is usually a battery, less often - fuel cells. During the flight, the engine speed is variable, and its change depends not only on changes in flight speed or direction, but also on weather conditions, such as wind, as the stabilization system constantly aligns the drone. This leads to the fact that the power supply system of such a device is actually a significant part of the time in transition condition. This leads to a significant content of the component of exchange energy that battery consumed which in turn will increase losses, and thus reduces the range of the unmanned aerial vehicle. The phenomenon of the occurrence of exchange power in the power supply systems of electric vehicles which powered from DC sources and specifically in the power supply system of an unmanned aerial vehicle is analyzed. The time diagrams of current, voltage, active and inactive components of power consumed from the mains power supply network of electric locomotive DE1 are illustrated. It can be seen that with a sharp change in the modes of operation of traction units there is a significant component of exchange power in the motor-network system. Such processes are typical for almost any electric vehicle and are associated with the presence of a significant number of reactive elements in the power supply systems, as well as frequent changes in load parameters. A block diagram of a typical unmanned aerial vehicle is presented. The unmanned aerial vehicle system consists of three parts: the air part, the unmanned aerial vehicle itself, the ground control station, which can be autonomous or manned, the control system, which provides communication and data transmission. The block diagram of the power system of a typical unmanned aerial vehicle is presented A simplified schematic diagram of the DC motor power supply system is presented. The relations for determining the amount of exchange power in the power supply system of an unmanned aerial vehicle are derived. It is concluded that to reduce the impact of this phenomenon, it is necessary to modify the power supply system by adding compensation units of inactive power component.

Autonomous unmanned aerial vehicle (UAV) system is depending on state estimation feedback to control flight operation. Estimation on the correct state improves navigation accuracy and achieves flight mission safely. One of the sensors configuration used in UAV state is Attitude Heading and Reference System (AHRS) with application of Extended Kalman Filter (EKF) or feedback controller. The results of these two different techniques in estimating UAV states in AHRS configuration are displayed through position and attitude graphs.

A number of autonomous unmanned aerial vehicles (UAV) are tasked to search an unknown/uncertain environment, and neutralize targets whenever they come across such threats. Due to resource constraints of the UAVs, neutralizing some threats require simultaneous effort of a certain number of UAVs in minimum. When a UAV detects multiple such targets which require team efforts, it needs to communicate with its neighbour UAVs asking for their cooperation to form colaitions to neutralize the targets. Since the involved entities are dynamic in nature, a UAV may have to terminate information exchange with its neighbours within a few iterative steps so that the decision making process can be finished before any topological change takes place. Moreover, due to sensor range and communication bandwidth limitations, a UAV cannot know about other tasks available to its neighbours in an instantaneous manner. Through communication, UAVs can learn correspondence between their own utilities and utilities of the neighbour UAVs to different joint action profiles, but not the decisions of other UAVs. We formulate the problem that a UAV faces when it detects multiple such targets and needs to decide as to which target it should try to neutralize, given the uncertainty over the decisions of its neighbour UAVs, in a game theoretic framework. We propose a correlated equilibrium concept based decentralized game theoretic solution that requires local information of the UAVs.

In this paper, we develop an alternative navigation system for Unmanned Aerial Vehicle (UAV) in Global Positioning Systems (GPS)-denied environment. We use two image inputs, one is acquired with an on-board camera placed on the UAV (which is the large-area image) and the other is from satellite images (which is small known image) with GPS information. We use a convolutional neural network (CNN) architecture based on Oxford’s Visual Geometry Group network (VGG-16) and utilize normalized variant mutual information between these two images to obtain position of the UAV. Satellite images are labelled and given to the UAV. When GPS information is lost, our algorithm starts to function and images from UAV camera are searched whether satellite image is seen by cameras on UAV image or not. If the UAV is in that area, our algorithm finds the GPS information from satellite image data.