Autonomous UAV with Learned Trajectory Generation and Control

With the rapid development of mobile edge computing (MEC) and unmanned aerial vehicle (UAV) communication networks, UAV-assisted edge computing has emerged as a promising paradigm for low-latency and energy-efficient computation. However, the time-varying nature of air-to-ground channels and the coupling between UAV trajectories and computation offloading decisions significantly increase system complexity. To address these challenges, this paper proposes an Adaptive UAV Edge Intelligence Framework (AUEIF) for joint UAV computation offloading and trajectory optimization under dynamic channels. Specifically, a dynamic graph-based system model is constructed to characterize the spatio-temporal correlation between UAV motion and channel variations. A hierarchical reinforcement learning-based optimization framework is developed, in which a high-level actor–critic module is responsible for generating coarse-grained UAV flight trajectories, while a low-level deep Q-network performs fine-grained optimization of task offloading ratios and computational resource allocation in real time. In addition, an adaptive channel prediction module leveraging long short-term memory (LSTM) networks is integrated to model temporal channel state transitions and to assist policy learning and updates. Extensive simulation results demonstrate that the proposed AUEIF achieves significant improvements in end-to-end latency, energy efficiency, and overall system stability compared with conventional deep reinforcement learning approaches and heuristic-based schemes while exhibiting strong robustness against dynamic and fluctuating wireless channel conditions.

Precise timing and precise location information are provided by Global Navigation Satellite Systems (GNSS) and play a crucial role in the positioning, navigation and data acquisition of most Unmanned Aerial Vehicles (UAV). GNSS functions include the following applications in UAVs: time-stamping and geo-referencing of collected data and images, synchronization of swarm flying and follow-me flights, determination of position and attitude in-flight, flight trajectory by following a pre-defined number of waypoints, mission planning, return home automatically without external control, avoidance of obstacles and geo-fencing. 
 Some of these critical operations have implications for the safety of the UAV, the surrounding environment and health and safety of people, for example UAVs threatening to bring down aircrafts at airports, which are no-fly zones for UAVs. The appropriate GNSS based function to avoid this is geo-fencing. Another example is obstacle avoidance to prevent collisions and damages both for the UAV and the obstacle, e.g. anything from a window pane, tree, human being, to a power line.
 In order to ensure health and safety it is thus important to ensure correct function of the navigation and the timing, under a wide variety of circumstances, and in different signal environments. There can be signal disturbances, such as obscurations by buildings or reflected GNSS signals, called multipath. The performance of timing and navigation based on GPS/GNSS can be tested and verified in a controlled and repeatable way in the laboratory with different types of test equipment. We will give an introduction to a wide range of potential threats to GNSS Positioning, navigation and timing and an overview of different test methods. In addition, we are presenting a method for time synchronization of drones to enable safe swarm and follow flights in UAVs.

Caching the contents of unmanned aerial vehicles (UAVs) could significantly improve the content fetching performance of request users (RUs). In this paper, we study UAV trajectory design, content fetching, power allocation, and content placement problems in multi-UAV-aided networks, where multiple UAVs can transmit contents to the assigned RUs. To minimize the energy consumption of the system, we develop a constrained optimization problem that simultaneously designs UAV trajectory, power allocation, content fetching, and content placement. Since the original minimization problem is a mixed-integer nonlinear programming (MINLP) problem that is difficult to solve, the optimization problem was first transformed into a semi-Markov decision process (SMDP). Next, we developed a new technique to solve the joint optimization problem: option-based hierarchical deep reinforcement learning (OHDRL). We define UAV trajectory planning and power allocation as the low-level action space and content placement and content fetching as the high-level option space. Stochastic optimization can be handled using this strategy, where the agent makes high-level option selections, and the action is carried out at a low level based on the chosen option’s policy. When comparing the proposed approach to the current technique, the numerical results show that it can produce more consistent learning performance and reduced energy consumption.

Due to flexible scheduling, and better transmission channel, unmanned aerial vehicle (UAV) can improve transmit performance of Internet of Things (IoT). In this paper, we propose an UAV-enabled multichannel IoT based on intelligent fog computing, where UAV as a relay forwards IoT's information to the data center under the control of fog computing base station in the case of terrestrial channel fading. The IoT's throughput are maximized by jointly optimizing subcarrier, power of IoT, and UAV, and UAV trajectory, subject to the constraints of information causality, maximum transmit power, and maximum UAV speed. The subcarriers are dynamically allocated according to their channel gains, the water filling algorithm is adopted to optimize the power for UAV, and IoT by fixing UAV trajectory, and the optimal UAV trajectory is achieved with successive convex approximation under the fixed power allocation. Then a jointly iterative optimization on subcarrier, power, and trajectory is presented to get the optimal solution. In addition, we propose a fairness optimization scheme to maximize the minimum transmit rate of IoT nodes. The simulations indicate the IoT with mobile UAV, and dynamic subcarrier allocation may achieve better transmit performance, and the fairness optimization can decrease the rate difference of nodes effectively.

This paper discusses the algorithms of vision systems for automatic UAV (Unmanned Aerial Vehicle) landing. The basic algorithms for finding helipad and adapting the UAV control system to an autonomous UAV landing are presented. The authors consider algorithms to solve navigation problems, building block diagrams of automatic UAV control. Also, the developed algorithms make it possible to implement an automatic landing system for UAVs using technical vision systems, using various camera parameters, algorithms allowing research, as part of the autonomous navigation of unmanned aerial vehicles. The article discusses the developed algorithm that allows you to highlight certain characteristic points for visual navigation. Also, a search system for characteristic points has been developed that allows automatic UAV landing. These algorithms may be useful for the autonomous landing UAV systems. Algorithms can also be used to track a trajectory of the UAV system.

This paper studies the integration of data collection and offloading for maritime Internet of Things (IoT) systems with multiple unmanned aerial vehicles (UAVs). In the considered multi-UAV maritime IoT system, the UAVs act as the aerial base stations to complete the missions of data collection from buoys and data offloading to the offshore base station (OBS). In this case, the UAVs need to adaptively select the mission mode between data collection and data offloading according to the network resources and mission requirements. In this paper, we aimed to minimize the completion time of data collection and offloading missions for all UAVs by jointly optimizing the UAV trajectories, mission mode selection, transmit power of buoys, and association relationships between the UAVs and buoy/OBS. In order to solve the mixed-integer non-convex minimization problem, we first designed a multi-agent deep reinforcement learning algorithm based on a hybrid discrete and continuous action space to preliminarily obtain the UAV trajectories, mission mode selection, and the transmit power of buoys. Then, we propose an algorithm based on the stable marriage problem to determine the buoy–UAV and UAV–OBS association relationships. Finally, the simulation results show that the proposed algorithms can effectively shorten the total mission completion time of data collection and offloading for the multi-UAV-assisted maritime IoT system.

In recent years, the utilization of unmanned aerial vehicles (UAVs) has surged in a variety of applications, including weather monitoring, emergency search and rescue operations, and smart agriculture. In these applications, UAVs are instrumental in executing data collection tasks. However, due to the scarcity of resources such as battery capacity, the duration of work is limited, necessitating the optimization of UAV trajectories and resource allocation. In this paper, we introduce a hierarchical task scheduling and resource allocation scheme for UAV data collection tasks, which incorporates the deep reinforcement learning (DRL) technology into a two-layer training framework. The continuous actions, including UAV trajectories, UAV communication power, and UAV CPU main frequency, are first optimized in the lower layer, while the upper one concentrates on the discrete action space for the target allocation. In particular, the well-trained lower-layer network is integrated into the upper layer, facilitating rapid global reward feedback between the two-layer network and accelerating the training process of the upper-layer network. Experimental results demonstrate that the proposed approach achieves superior performance than the baseline methods in terms of the amount of collected data as well as UAV energy consumption.

Technical solutions for the creation of fundamentally new universal multifunctional autonomous navigation system of radar operating principle are proposed. Currently, navigation systems of unmanned aerial vehicles (UAV) are based on global navigation satellite systems (GNSS) receivers, combined with a block of inertial sensors of spatial orientation. GNSS are based on the use of coordinated by motion and radiation signals of Earth artificial navigation satellites network. GNSS provide continuous and almost immediate determination of the position (location) and speed of the UAV almost over the globe. Such a system provides a fairly accurate determination of the UAV position and parameters of its movement subject to a good GNSS signal. At the same time, the GNSS is a radio-technical navigation system and, like any such system, is subject to the influence of external radio interference, both natural and artificial. One of the ways to solve the problem of performing UAV flights in conditions of natural and artificial interference, when information from external sources is not available to estimate the position of the UAV, is the use of path reckoning method. The most important component of the autonomous navigation system implementing the course-Doppler mode of path calculation is the Doppler velocity sensor and hover drift. The R&D of Doppler velocity sensor & hover drift for the UAV (small size and weight) is a complex scientific, technical and design task, the implementation of which became possible due to the use of modern technical (design, schematic, technological, etc.) solutions.

The classification of drones - both military and civilian according to the relevant criteria - is presented. Block diagrams of a typical unmanned aerial vehicle and its power system are shown. Typically, a drone power system of the "micro", "mini" or "short range" category, according to the UVS international classification, is a set of DC / DC converters with a microprocessor control system. The power source for such aircraft is usually a battery, less often - fuel cells. During the flight, the engine speed is variable, and its change depends not only on changes in flight speed or direction, but also on weather conditions, such as wind, as the stabilization system constantly aligns the drone. This leads to the fact that the power supply system of such a device is actually a significant part of the time in transition condition. This leads to a significant content of the component of exchange energy that battery consumed which in turn will increase losses, and thus reduces the range of the unmanned aerial vehicle. The phenomenon of the occurrence of exchange power in the power supply systems of electric vehicles which powered from DC sources and specifically in the power supply system of an unmanned aerial vehicle is analyzed. The time diagrams of current, voltage, active and inactive components of power consumed from the mains power supply network of electric locomotive DE1 are illustrated. It can be seen that with a sharp change in the modes of operation of traction units there is a significant component of exchange power in the motor-network system. Such processes are typical for almost any electric vehicle and are associated with the presence of a significant number of reactive elements in the power supply systems, as well as frequent changes in load parameters. A block diagram of a typical unmanned aerial vehicle is presented. The unmanned aerial vehicle system consists of three parts: the air part, the unmanned aerial vehicle itself, the ground control station, which can be autonomous or manned, the control system, which provides communication and data transmission. The block diagram of the power system of a typical unmanned aerial vehicle is presented A simplified schematic diagram of the DC motor power supply system is presented. The relations for determining the amount of exchange power in the power supply system of an unmanned aerial vehicle are derived. It is concluded that to reduce the impact of this phenomenon, it is necessary to modify the power supply system by adding compensation units of inactive power component.

Unmanned aerial vehicles (UAVs), also known as drones, have gained considerable interest among academics in recent years, which significantly increases the demand for autonomous navigation systems for UAVs. In this study, autonomous navigation is addressed as a two-stage problem. The first stage is the obstacle detection phase, during which the UAVs leverage their onboard sensors to perceive the surroundings and detect obstacles. The second stage is the obstacle avoidance phase, where the UAVs make decisions to continue operations without colliding with anything while approaching the target. This study proposes a self-supervised learning-based depth prediction framework as the criterion for obstacle proximity detection. The framework consists of two subnetworks: the depth and pose estimation modules. The former predicts depth values, while the latter evaluates the object’s translation and rotation matrix. The framework leverages the subnetworks’ outputs to reconstruct the projection relationships of pixels between adjacent frames to optimize the training process. To address the challenge of UAVs operating in large-scale environments, a modified loss function that combines photometric loss and edge-aware smoothness is presented to increase the depth prediction module’s accuracy. This study also presents a deep reinforcement learning-based obstacle avoidance system that takes depth maps as inputs to generate evasive maneuvers. The system works independently from priori maps and models while it learns the collision-free trajectory from interacting with the environment. This study deploys value-based algorithms to learn the nonlinear mapping between the continuous inputs and discrete output motion commands. Furthermore, the proposed system is validated on different simulation scenarios. It is capable of completing the obstacle avoidance task with relatively optimal trajectories in varied environments, demonstrating its superior effectiveness and transferability. Keywords: unmanned aerial vehicles, urban airspace, obstacle detection and avoidance, self-supervised learning, deep reinforcement learning.

This paper underscores the significance of safety and reliability in the realm of unmanned aerial vehicle (UAV) technologies, and how regulations play a pivotal role in ensuring their responsible use. We have analyzed safety incidents and trends both in Canada and globally, noting a decline in incidents attributed to enhanced regulations. Our comparative analysis of different UAV technologies identified batteries as the most reliable power supply, Global Navigation Satellite System as the most effective navigation system, and light detection and ranging as the optimal optical sensor due to regulatory compliance and system redundancies. We also examined the regulatory framework in Canada, comparing it with the risk-based approach of the European Union Aviation Safety Agency and the efforts of Joint Authorities for Rule-making on Unmanned Systems towards global harmonization. Furthermore, we highlighted emerging trends in automation and flight control technologies, with a focus on European regulations shaping UAV automation trends. In conclusion, by adhering to best practices from other regulatory bodies, embracing emerging trends, and adopting a risk-based approach, Canada can promote the growth of the UAV industry while ensuring safety and reliability in UAV technologies.

This study investigates unmanned aerial vehicle (UAV) trajectory planning strategies for localizing a target mobile device in emergency situations. The global navigation satellite system (GNSS)-based accurate position information of a target mobile device in an emergency may not be always available to first responders. For example, 1) GNSS positioning accuracy may be degraded in harsh signal environments and 2) in countries where emergency positioning service is not mandatory, some mobile devices may not report their locations. Under the cases mentioned above, one way to find the target mobile device is to use UAVs. Dispatched UAVs may search the target directly on the emergency site by measuring the strength of the signal (e.g., LTE wireless communication signal) from the target mobile device. To accurately localize the target mobile device in the shortest time possible, UAVs should fly in the most efficient way possible. The two popular trajectory optimization strategies of UAVs are greedy and predictive approaches. However, the research on localization performances of the two approaches has been evaluated only under favorable settings (i.e., under good UAV geometries and small received signal strength (RSS) errors); more realistic scenarios still remain unexplored. In this study, we compare the localization performance of the greedy and predictive approaches under realistic RSS errors (i.e., up to 6 dB according to the ITU-R channel model). From the simulation result, the greedy approach performs better in reducing the localization error at the initial stage of the search; however, the predictive approach performs better once the localization error converges to a certain value. Based on these observations, we propose a hybrid application involving both the approaches. The performance of the proposed hybrid approach was evaluated under less diverse UAV geometries and realistic RSS errors. During simulation tests, the hybrid approach showed localization accuracy improvements of 30.8% and 55.0% over the greedy-only and predictive-only approaches, respectively.

In this paper, a quadcopter unmanned aerial vehicle (UAV) system based on neural-network enhanced dynamic inversion control is proposed for multiple real-world application scenarios. A sigma-pi neural network (SPNN) is used as the compensator to reduce the model error and improve the system performance in the presence of the uncertainties of UAV dynamics, payload, and environment. Besides, we present a technical framework for fast and robust implementation of multipurpose UAV systems and develop a testbed for the evaluation of UAV control system by using a high-precision optical motion capture system. Both simulation results and experiment results demonstrate that the SPNN can reduce the inversion errors related to UAV parameter uncertainties as well as tracking errors related to unknown disturbances and unmodeled dynamics. With the help of an online neural network (NN) learning mechanism, the entire system can achieve much higher accuracy in attitude and trajectory control than that achieved by conventional proportional-integral derivative based control systems under varying flight conditions.

Unmanned Aerial Vehicle (UAV) has emerged as a promising technology to provide wireless signals from air to the ground users in specific scenarios such as earthquakes, tsunamis and other disasters. The performance of the UAV is degraded when the signals are blocked by obstacles in dense urban scenarios. To address this issue and enhance the signal quality available to the ground users, Reconfigurable Intelligent Surface (RIS) has emerged as a new technological paradigm. It offers an intelligent configuration for the signal propagation environment by redirecting the signals to the users. In this article, we solve a non-convex optimization problem of RIS-assisted UAV network by jointly optimizing the RIS phase shift and 3D trajectory of UAV to maximize the energy efficiency of a rotatory-wing UAV. The considered optimization problem is solved using Deep Reinforcement Learning (DRL) based techniques in an on-line fashion to reduce the computational complexity. We leverage Twin-delayed Deep Deterministic Policy Gradient (TD3) to solve the problem by considering the UAV trajectory as a set of continuous actions. For comparison, we also use the Soft Actor-Critic (SAC), Deep Deterministic Policy Gradient (DDPG) and Double Deep Q-Network (DDQN) for continuous and discrete optimization of the UAV trajectory, respectively. Extensive simulations show that the TD3 outperforms all the considered DRL techniques with the highest energy efficiency and throughput, and the lowest propulsion energy.

This study explores the application of Particle Swarm Optimization (PSO) in Unmanned Aerial Vehicle (UAV) path planning within a simulated three-dimensional environment. UAVs, increasingly prevalent across various sectors, demand efficient navigation solutions that account for dynamic and unpredictable elements. Traditional pathfinding algorithms often fall short in complex scenarios, hence the shift towards PSO, a bio-inspired algorithm recognized for its adaptability and robustness. We developed a Python-based framework to simulate the UAV path planning scenario. The PSO algorithm was tasked to navigate a UAV from a starting point to a predetermined destination while avoiding spherical obstacles. The environment was set within a 3D grid with a series of waypoints, marking the UAV's trajectory, generated by the PSO to ensure obstacle avoidance and path optimization. The PSO parameters were meticulously tuned to balance the exploration and exploitation of the search space, with an emphasis on computational efficiency. A cost function penalizing proximity to obstacles guided the PSO in real-time decision-making, resulting in a collision-free and optimized path. The UAV's trajectory was visualized in both 2D and 3D perspectives, with the analysis focusing on the path's smoothness, length, and adherence to spatial constraints. The results affirm the PSO's effectiveness in UAV path planning, successfully avoiding obstacles and minimizing path length. The findings highlight PSO's potential for practical UAV applications, emphasizing the importance of parameter optimization. This research contributes to the advancement of autonomous UAV navigation, indicating PSO as a viable solution for real-world path planning challenges.