DWPIS: Dynamic-Weight Parallel Instance and Skeleton Network for Railway Centerline Detection

Chapter 21 - Event-driven programming-based path planning and navigation of UAVs around a complex urban environment

This paper proposes a framework for unmanned aerial vehicle (UAV) navigation using carrier phase differential cellular (CD-cellular) measurements. The framework requires no prior knowledge of the UAV’s position and achieves centimeter-level position accuracy. A batch weighted nonlinear least-squares estimator is developed to solve for the integer ambiguities and an extended Kalman filter is formulated to initialize the batch estimator. Monte Carlo simulations are presented to characterize the performance of the proposed framework as a function of the total number of hearable cellular base transceiver stations (BTSs) and the size of the batch estimator. Experimental results are presented demonstrating a UAV navigating exclusively using the proposed framework over a 1.72 km trajectory completed in 3 minutes with 62.11 cm root mean-square error (RMSE).

This paper explores the application of artificial intelligence (AI) in the field of unmanned aerial vehicle (UAV) navigation in complex terrains. Traditional navigation systems like GPS often fail in extreme environments due to their limitations. AI techniques, such as reinforcement learning, enhance the UAV’s adaptability, offering a solution to these challenges. By applying continuous optimization methods, including experience replay and dynamic model adjustments, UAVs improve their decisionmaking capabilities. This results in a more powerful ability to operate effectively in various applications, such as disaster relief and precision agriculture. The integration of AI enables drones to autonomously learn and adapt to new conditions, reducing the need for human intervention and lowering costs. As a result, UAVs are becoming increasingly vital in our daily lives, providing innovative solutions in challenging environments where traditional methods fall short.

In the unmanned aerial vehicle (UAV) based localization of slow-moving radio frequency (RF) sources with unknown transmitted strength of signal, such as a person with a cell phone in a search and rescue mission, the UAV navigation errors are significant sources of localization error. Although the use of a global positioning system (GPS) can reduce the UAV’s localization error significantly resulting in more accurate RF source localization, if the GPS signal is lost temporarily or permanently, the accuracy of the UAV-based localization decreases rapidly. In this paper, a simultaneous localization and mapping (SLAM)-inspired approach for simultaneous localization of UAV and RF sources (SLUS) is proposed. The proposed approach solves these two connected problems, i.e. the UAV localization and RF source localization, simultaneously to decrease the error of the UAV position estimation and the error of the RF source localization. In the proposed approach, beside the UAV position prediction, the RF source position prediction is also performed. Then the predicted states are augmented and the augmented predicted state information is corrected using range-ratio and bearing observations, i.e. RF source features, considering the unknown transmitted power. The proposed approach is simulated and the results show that the normal divergence of a target localization and the divergence of the UAV navigation in latitude and longitude channels have been eliminated using this approach. In other words, simultaneous localization of the UAV and RF sources uses the RF sources, as features in the environment, to aid the navigation system. Although the approach is similar to the mapping of RF sources in the environment, the created map would be useless after finding the RF sources. That is why SLUS has been used instead of SLAM. The main contributions of this work are: 1) performing simultaneous localization of a UAV and targets using RF signals, especially in a non-line of sight (NLOS) condition; 2) using difference of signal strength, i.e. differential received strength signal indicator (DRSSI), to eliminate the impact of unknown target signal power; and 3) simultaneous multi-target localization and tracking.

Instance segmentation in medical imaging plays a crucial role in clinical diagnostic tasks, and have shown promising performance in practical applications. In this paper, we discuss a more fine-grained instance segmentation task: dental structured instance segmentation based on panoramic radiographs. However, direct segmentation of tooth structures encounters inherent challenges. Traditional instance segmentation networks often fall short in capturing intricate internal features, and exacerbated by the frequent blurring found in medical imaging, which can result in the deficiency of anatomical details. To deal with these problems, we propose a novel framework called DSISDPR, which combines a dental structured instance segmentation (DSIS) network with an enhanced diffusion prior refinement (DPR) method. Specifically, our innovatively designed structureaware network leverages fine-grained feature fusion, acquiring a richer representation of internal anatomical structures. With the integration of adversarial learning, the model is primed to deliver holistic and subtle predictions of tooth structures. Furthermore, taking inspiration from dentists’ inherent ability to utilize prior knowledge, such as understanding dental structures to label invisible anatomical structures, we propose a diffusion inpainting to refine the results of DSIS without additional annotations. Equipped with built-in structure learning, DPR is capable of modifying anomalies within each predicted segmentation, resulting in a more robust and complete structured segmentation result. Meanwhile, we ensure rigorous oversight over the reconstruction of areas affected by abnormalities, ensuring that any introduced adjustments minimally disrupt the wellpredicted structured segmentation results. Extensive experiments have demonstrated that our DSIS-DPR outperforms all existing classical instance segmentation networks. The collected dataset is available: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Zzz512/TSD</uri> .

Aiming at the formation problem in the cooperative navigation of unmanned aerial vehicle swarm, a cooperative position error analysis method based on cooperative dilution of precision is studied in this article. During cooperative flight, the unmanned aerial vehicle swarm can use the received position and ranging information of the adjacent unmanned aerial vehicles to calculate the position, and fuse with its own sensor position information. The final positioning accuracy depends not only on the capability of the ranging sensor but also on the position accuracy and formation of the adjacent unmanned aerial vehicles. In this article, these influence factors are combined to put forward a cooperative dilution of precision calculation method suitable for unmanned aerial vehicle swarm cooperative navigation. On this basis, a cooperative integrated navigation method based on ranging information is designed. Finally, the performance of cooperative navigation of unmanned aerial vehicles in different formations is simulated and analyzed. The simulation result shows that the cooperative dilution of precision method proposed in this article can effectively analyze the influence of formation on the positioning accuracy of unmanned aerial vehicle swarm, and the final combined positioning result is consistent with the cooperative dilution of precision analysis result.

This paper discusses the algorithms of vision systems for automatic UAV (Unmanned Aerial Vehicle) landing. The basic algorithms for finding helipad and adapting the UAV control system to an autonomous UAV landing are presented. The authors consider algorithms to solve navigation problems, building block diagrams of automatic UAV control. Also, the developed algorithms make it possible to implement an automatic landing system for UAVs using technical vision systems, using various camera parameters, algorithms allowing research, as part of the autonomous navigation of unmanned aerial vehicles. The article discusses the developed algorithm that allows you to highlight certain characteristic points for visual navigation. Also, a search system for characteristic points has been developed that allows automatic UAV landing. These algorithms may be useful for the autonomous landing UAV systems. Algorithms can also be used to track a trajectory of the UAV system.

This paper presents a software framework which combines reactive collision avoidance control approach with path planning techniques for the purpose of safe navigation of multiple Unmanned Aerial Vehicles (UAVs) operating in unknown environments. The system proposed leverages advantages of using a fast local sense-and-react type control which guarantees real-time execution with computationally demanding path planning algorithms which generate globally optimal plans. A number of probabilistic path planning algorithms based on Probabilistic Roadmaps and Rapidly-Exploring Random Trees have been integrated. Additionally, the system uses a reactive controller based on Optimal Reciprocal Collision Avoidance (ORCA) for path execution and fast sense-and-avoid behavior. During the mission execution a 3D map representation of the environment is build incrementally and used for path planning. A prototype implementation on a small scale quad-rotor platform has been developed. The UAV used in the experiments was equipped with a structured-light depth sensor to obtain information about the environment in form of occupancy grid map. The system has been tested in a number of simulated missions as well as in real flights and the results of the evaluations are presented.

This paper considers the navigation of a solar-powered unmanned aerial vehicle (UAV) for securing the communication with an intended ground node in the presence of eavesdroppers in urban environments. To complete this task, the UAV needs to not only fly safely in the complex urban environment, but also take into account the communication performance with the intended node and eavesdroppers. To this end, we formulate a multi-objective optimization problem to plan the UAV path. This problem jointly considers the maximization of the residual energy of the solar-powered UAV at the end of the mission, the maximization of the time period in which the UAV can securely communicate with the intended node and the minimization of the time to reach the destination. We pay attention to the impact of the buildings in the urban environments, which may block the transmitted signals and also create some shadow region where the UAV cannot harvest energy. A Rapidly-exploring Random Tree (RRT) based path planning scheme is presented. This scheme captures the nonlinear UAV motion model, and is computationally efficient considering the randomness nature. From the generated tree, a set of possible paths can be found. We evaluate the security of the wireless communication, compute the overall energy consumption as well as the harvested amount for each path and calculate the time to complete the flight. Compared to a general RRT scheme, the proposed method enables a large time window for the UAV to securely transmit data.

This study explores the application of Particle Swarm Optimization (PSO) in Unmanned Aerial Vehicle (UAV) path planning within a simulated three-dimensional environment. UAVs, increasingly prevalent across various sectors, demand efficient navigation solutions that account for dynamic and unpredictable elements. Traditional pathfinding algorithms often fall short in complex scenarios, hence the shift towards PSO, a bio-inspired algorithm recognized for its adaptability and robustness. We developed a Python-based framework to simulate the UAV path planning scenario. The PSO algorithm was tasked to navigate a UAV from a starting point to a predetermined destination while avoiding spherical obstacles. The environment was set within a 3D grid with a series of waypoints, marking the UAV's trajectory, generated by the PSO to ensure obstacle avoidance and path optimization. The PSO parameters were meticulously tuned to balance the exploration and exploitation of the search space, with an emphasis on computational efficiency. A cost function penalizing proximity to obstacles guided the PSO in real-time decision-making, resulting in a collision-free and optimized path. The UAV's trajectory was visualized in both 2D and 3D perspectives, with the analysis focusing on the path's smoothness, length, and adherence to spatial constraints. The results affirm the PSO's effectiveness in UAV path planning, successfully avoiding obstacles and minimizing path length. The findings highlight PSO's potential for practical UAV applications, emphasizing the importance of parameter optimization. This research contributes to the advancement of autonomous UAV navigation, indicating PSO as a viable solution for real-world path planning challenges.

The paper considers various aspects of the use of the optical flow (OF) methodology in unmanned aerial vehicle (UAV) navigation. OF could gives estimates of the UAV velocities only, therefore its use on the one hand usually leads to an the errors growth in the UAV position estimation. This drawback is due to the presence of bias in the speed estimates. On other hand OF is probably the only navigation tool when there are no other estimates of UAV position available, for examle in GPS denied environment. Therefore it is necessary to approach very thoroughly to the OF and other navigation system elements data fusion. In this work the UAV landing problem on the basis of the OF usage with navigation system sensors is considered.

Autonomous Navigation for Unmanned Aerial Vehicles Based on Chaotic Bionics Theory

In this paper a multiple object detection, recognition, and tracking system for unmanned aerial vehicles (UAVs) has been studied. The system can be implemented on any UAVs platform, with the main requirement being that the UAV has a suitable onboard computational unit and a camera. It is intended to be used in a maritime object tracking system framework for UAVs, which enables a UAV to perform multiobject tracking and situational awareness of the sea surface, in real time, during a UAV operation. Using machine vision to automatically detect objects in the camera's image stream combined with the UAV's navigation data, the onboard computer is able to georeference each object detection to measure the location of the detected objects in a local North‐East (NE) coordinate frame. A tracking algorithm which uses a Kalman filter and a constant velocity motion model utilizes an object's position measurements, automatically found using the object detection algorithm, to track and estimate an object's position and velocity. Furthermore, a global‐nearest‐neighbor algorithm is applied for data association. This is achieved using a measure of distance that is based not only on the physical distance between an object's estimated position and the measured position, but also how similar the objects appear in the camera image. Four field tests were conducted at sea to verify the object detection and tracking system. One of the flight tests was a two‐object tracking scenario, which is also used in three scenarios with an additional two simulated objects. The tracking results demonstrate the effectiveness of using visual recognition for data association to avoid interchanging the two estimated object trajectories. Furthermore, real‐time computations performed on the gathered data show that the system is able to automatically detect and track the position and velocity of a boat. Given that the system had at least 100 georeferenced measurements of the boat's position, the position was estimated and tracked with an accuracy of 5–15 m from 400 m altitude while the boat was in the camera's field of view (FOV). The estimated speed and course would also converge to the object's true trajectories (measured by Global Positioning System, GPS) for the tested scenarios. This enables the system to track boats while they are outside the FOV of the camera for extended periods of time, with tracking results showing a drift in the boat's position estimate down to 1–5 m/min outside of the FOV of the camera.

The proliferation of unmanned aerial vehicles (UAVs) has driven the emergence of urban air mobility (UAM) as a solution to alleviate the increasing demand for UAVs applications in various domains. The concept of UAM envisions a future where UAVs play a pivotal role in short-distance transportation, delivery services, surveillance, emergency rescue, and more. However, the rapid growth of UAVs poses significant challenges arising from the need to ensure the safe coexistence of UAVs with other manned/unmanned aerial vehicles. To ensure the safe integration of UAVs into low-altitude urban airspace and support high-density on-demand mobility, this research focuses on handling the safety-centric challenges related to UAV collision risk assessment, obstacle avoidance, and conflict resolution in complex urban environments.&#13;\nOne of the main challenges is the intrusion of UAVs into airport runways. Airports serve as critical hubs for civil aircraft takeoff and landing operations. However, the increasing presence of UAVs has raised concerns about intruding into airports, leading to flight delays and temporary runway closures. To quantify the potential interference of UAVs on civil aircraft, a collision-course based trajectory planning model is proposed to evaluate the collision risk between manned civil aircraft and intruding UAVs. In this risk assessment model, the trajectory of the intruding UAV is formulated using a collision-course concept, taking into account the limited trajectory information available about intruding UAVs. The planned trajectory of the UAVs is then used to predict its relative position concerning civil aircraft. To account for the possible disturbances of the relative distance, a stochastic position prediction model based on Brownian motion is developed. The collision risk is assessed based on this stochastic kinematic model, providing a quantitative measure of the potential collisions. The proposed model is validated through extensive simulations involving different UAV initial positions, position updates, and different sizes of collision zone tests, as well as comparative tests with the Monte-Carlo algorithm, demonstrating its robustness in assessing the collision risk of the airport restricted area. To facilitate the application, the model is finally used to develop a platform to generate runway heatmaps, accounting for airport runway risk distributions. &#13;\nAnother safety-centric challenge is ensuring autonomous obstacle avoidance and conflict resolution of UAVs. To enable UAV autonomous safe operations in uncontrolled urban low-altitude airspace, a comprehensive collision-free path planning framework is developed to address the avoidance of both static obstacles and dynamic threats. Firstly, to handle static obstacles, a novel algorithm of 3D voxel jump point research is introduced to generate a global reference path for UAV navigation to avoid static obstacles, particularly for a free flight at different altitudes. Additionally, to optimize the reference path for specific mission requirements, techniques such as trajectory de-diagonalization, reconstruction, and smoothness are proposed to reduce the risk of static collisions, shorten the fly range, and enable UAVs to negotiate turns more efficiently. Secondly, real-time conflict resolution actions based on the Markov decision process are developed to avoid local dynamic threats encountered along the optimized desired path. This allows the host UAV to dynamically adjust its course to a resolution trajectory while maintaining its planned speed without hovering to avoid the potential collision with the approaching intruders. By avoiding near mid-air collisions (NMAC) and preventing the UAV from hovering, the proposed method ensures the timely completion of UAV missions. Simulation results demonstrate that the developed method successfully achieves UAV autonomous global path planning and local real-time conflict resolution in complex urban low-altitude environments, thereby avoiding both static obstacles and dynamic threats. &#13;\nMoreover, to bridge the research gap of UAV hard conflict resolution in mitigating NMAC risks arising from local dynamic threats, a novel situational NMAC risk assessment approach is developed by integrating the conditional random field (CRF) algorithm with safety metrics and conflict resolution performance to facilitate UAV tiered aerial passage operations. To improve UAV operating environments in urban airspace, a concept of tiered aerial passages is first designed to provide a practical urban airspace planning scheme that addresses UAV heterogeneity and optimizes the utilization of urban airspace. For UAV tiered aerial passage operations, a situational NMAC risk assessment module coupled with a conflict resolution decision-making module is formulated, enabling the host UAV to evaluate and respond to real-time conflicts, ensuring avoidance of potential collisions. To assess NMAC risks, a general risk assessment model is proposed based on the CRF algorithm, considering UAV safety metrics and resolution performance. Then the overtaking, approaching head-on, and converging UAV encounters are analyzed, and situational risk potential scores are created using the Gaussian kernel function in the CRF algorithm, considering advisory, caution, and warning risk alert levels. To resolve conflict, acceptable, tolerable, and unacceptable scenarios are proposed to enhance the flexibility and personalization of the resolution decision-making. The proposed scheme is validated by simulating geometric encounter situations and comparative tests with the previous hard resolution technique. The results indicate that the proposed method outperforms UAV NMAC risk assessment and conflict resolution. Even in the most dangerous unacceptable resolution decision-making scenarios across three conflict encounters, the proposed algorithm achieves NMAC rates of 0.036, 0.070, and 0.043, which are lower than the corresponding NMAC rates associated with the hard resolution approach. Together with the acceptable and tolerable scenarios, the proposed negotiation resolution effectively tailors different risk requirements to accommodate diverse UAV missions. &#13;\nWith a primary focus on ensuring the safety of the UAM architecture, this research endeavors to assess UAV NMAC risks and efficiently manage potential conflicts. The proposed work are thoroughly validated to demonstrate their effectiveness in real-world scenarios. As a result, this study significantly contributes to the establishment of a robust UAM architecture, facilitating the realization of safe and reliable UAM.

UGV-to-UAV cooperative ranging for robust navigation in GNSS-challenged environments