AI-Embedded UAV System for Detecting and Pursuing Unwanted UAVs

Neural networks (NNs) are now being extensively utilized in various artificial intelligence platforms specifically in the area of image classification and real-time object tracking. We propose a novel design to address the problem of real-time unmanned aerial vehicle (UAV) monitoring and detection using a Zynq UltraScale FPGA-based convolutional neural network (CNN). The biggest challenge while implementing real-time algorithms on FPGAs is the limited DSP hardware resources available on FPGA platforms. Our proposed design overcomes the challenge of autonomous real-time UAV detection and tracking using a Xilinx’s Zynq UltraScale XCZU9EG system on a chip (SoC) platform. Our proposed design explores and provides a solution for overcoming the challenge of limited floating-point resources while maintaining real-time performance. The solution consists of two modules: UAV tracking module and neural network–based UAV detection module. The tracking module uses our novel background-differencing algorithm, while the UAV detection is based on a modified CNN algorithm, designed to give the maximum field-programmable gate array (FPGA) performance. These two modules are designed to complement each other and enabled simultaneously to provide an enhanced real-time UAV detection for any given video input. The proposed system has been tested on real-life flying UAVs, achieving an accuracy of 82%, running at the full frame rate of the input camera for both tracking and neural network (NN) detection, achieving similar performance than an equivalent deep learning processor unit (DPU) with UltraScale FPGA-based HD video and tracking implementation but with lower resource utilization as shown by our results.

Information acquisition and rescue operation management can be facilitated by the use of unmanned aerial vehicles (UAVs) equipped with cameras and sensors that are capable of aerial photography and acquire important information from disaster-stricken areas. UAV technology is a relatively low-cost, flexible, and safe solution in missions that are difficult for humans or other systems. UAV usage in pre-and post-disaster assessment, response, and management is an active area of research. There are two important technical aspects of UAV applications in disaster situations. The first is the limited communication range. Information acquired and photography produced by UAVs are only transmitted in real-time to the ground control station (GCS) within its communication range. Remote real-time monitoring of distant areas beyond the UAV's communication range is not possible using a single UAV. It is only possible through communication among several UAVs. The second is the relatively short flight time due to limited battery capacity. UAV replacement is required in order to carry out a persistent monitoring mission. In this paper, we propose a new remote real-time monitoring system of a distant disaster area using multiple UAVs. Wireless communications between multiple UAVs constitutes a UAV network in our proposed system. Moreover, the proposed system replaces the UAVs in-flight with standby UAVs according to the remaining energy levels. We compare the performance of the proposed system with an existing UAV system. Our simulation results show that the proposed system can achieve efficient remote real-time monitoring.

The classification of drones - both military and civilian according to the relevant criteria - is presented. Block diagrams of a typical unmanned aerial vehicle and its power system are shown. Typically, a drone power system of the "micro", "mini" or "short range" category, according to the UVS international classification, is a set of DC / DC converters with a microprocessor control system. The power source for such aircraft is usually a battery, less often - fuel cells. During the flight, the engine speed is variable, and its change depends not only on changes in flight speed or direction, but also on weather conditions, such as wind, as the stabilization system constantly aligns the drone. This leads to the fact that the power supply system of such a device is actually a significant part of the time in transition condition. This leads to a significant content of the component of exchange energy that battery consumed which in turn will increase losses, and thus reduces the range of the unmanned aerial vehicle. The phenomenon of the occurrence of exchange power in the power supply systems of electric vehicles which powered from DC sources and specifically in the power supply system of an unmanned aerial vehicle is analyzed. The time diagrams of current, voltage, active and inactive components of power consumed from the mains power supply network of electric locomotive DE1 are illustrated. It can be seen that with a sharp change in the modes of operation of traction units there is a significant component of exchange power in the motor-network system. Such processes are typical for almost any electric vehicle and are associated with the presence of a significant number of reactive elements in the power supply systems, as well as frequent changes in load parameters. A block diagram of a typical unmanned aerial vehicle is presented. The unmanned aerial vehicle system consists of three parts: the air part, the unmanned aerial vehicle itself, the ground control station, which can be autonomous or manned, the control system, which provides communication and data transmission. The block diagram of the power system of a typical unmanned aerial vehicle is presented A simplified schematic diagram of the DC motor power supply system is presented. The relations for determining the amount of exchange power in the power supply system of an unmanned aerial vehicle are derived. It is concluded that to reduce the impact of this phenomenon, it is necessary to modify the power supply system by adding compensation units of inactive power component.

Abstract. This paper looks into the latest achievement in the low-cost Unmanned Aerial Vehicle (UAV) technology in their capacity to map the semi-development areas. The objectives of this study are to establish a new methodology or a new algorithm in image registration during interior orientation process and to determine the accuracy of the photogrammetric products by using UAV images. Recently, UAV technology has been used in several applications such as mapping, agriculture and surveillance. The aim of this study is to scrutinize the usage of UAV to map the semi-development areas. The performance of the low cost UAV mapping study was established on a study area with two image processing methods so that the results could be comparable. A non-metric camera was attached at the bottom of UAV and it was used to capture images at both sites after it went through several calibration steps. Calibration processes were carried out to determine focal length, principal distance, radial lens distortion, tangential lens distortion and affinity. A new method in image registration for a non-metric camera is discussed in this paper as a part of new methodology of this study. This method used the UAV Global Positioning System (GPS) onboard to register the UAV image for interior orientation process. Check points were established randomly at both sites using rapid static Global Positioning System. Ground control points are used for exterior orientation process, and check point is used for accuracy assessment of photogrammetric product. All acquired images were processed in a photogrammetric software. Two methods of image registration were applied in this study, namely, GPS onboard registration and ground control point registration. Both registrations were processed by using photogrammetric software and the result is discussed. Two results were produced in this study, which are the digital orthophoto and the digital terrain model. These results were analyzed by using the root mean square errors and mean absolute error to determine the level of accuracy and the precision of photogrammetric products. It can be concluded that the new method of image registration by using the GPS onboard of the UAV produces medium accuracy result compared to the method that uses the ground control point. This new method can be used for the medium accuracy requirements. Unmanned Aerial Vehicle can be used for several applications, which requires a medium accuracy.

Multi-agent cooperative target tracking plays a significant role in distributed artificial intelligence for unmanned aerial vehicle (UAV) systems. Most existing tracking solutions using online path planning focus on general target trajectories. Such trajectories have strong regularity and are smooth with minimal fluctuations. However, in real UAV applications a target will change its trajectory frequently to prevent from being tracked, and thus its trajectory will fluctuate greatly and randomly. To this end, in this paper we consider a realistic scenario where the UAV target trajectory is changeable and random. For real-time target tracking, we formulate the tracking task as a distributed model predictive control (DMPC) problem, the objective of which is to optimize tracking performance under various constraints. To do so, we innovatively combine the adaptive differential evolution (ADE) algorithm with Nash optimization, and then propose a Nash-combined ADE method. Specifically, we use ADE to adaptively adjust the predicted trajectory of each UAV agent and Nash optimization to efficiently solve DMPC formulation for global optimization, which can improve the tracking accuracy and simultaneously reduce the computational complexity. The simulation results show that the proposed method performs well in terms of tracking accuracy, UAV collision avoidance and tracking stability for realistic target trajectories.

Despite there being some researches about unmanned aerial vehicle (UAV), operations with this kind of robots are not yet occurring in search and rescue (SAR) operations. Using adaptive concepts, a Cooperative UAV model applied to search and rescue operations applied is proposed. The adaptive concepts are well suited to the dynamism present in search operations in unknown environment. Thus, applying adaptiveness, each UAV takes decision in order to best accomplish the goal. Simulations were carried out and the results observed show that the model reduces until 75% of the search time (comparing with a manned search using the SAR navigation rules). Furthermore, related works, UAV evolution, conclusion and future works suggestions are presented.

The use of unmanned aerial vehicles (UAVs) in various military and civil applications is the subject of much current attention. With recent developments in personal computer technology, and the availability at affordable cost of peripherals, and electronic and optical sensors, UAVs for long endurance missions, with flight autonomy beyond the visual range, have become an attractive challenge for study in universities and research institutes. This paper describes the development of a target-lock-on optical remote sensing system to be used as a payload in a university-class UAV. To accomplish autonomous way-point navigation for the conduct of optical sensing surveillance, a gimbaled-platform with servo control and an Attitude and Heading Reference System (AHRS) navigation system for UAV position and attitude measurements have been developed. The UAV also utilises a Global Position System (GPS) receiver, a pressure altimeter, gyroscopes and an electric compass. A novel mathematical model is proposed to calculate the optimal parameters for orientating the CCD camera line of sight with a ground target, designated in real time from a ground control station. Both ground and flight test results have demonstrated the feasibility of the navigation control scheme and the UAV’s ability to conduct ground target acquisition and image transmission.

The use of unmanned aerial vehicles (UAVs) that can operate autonomously in dynamic and dangerous operational environments are becoming increasingly common. In such operations, object detection, classification and tracking can often be one of the main goals. In recent years there has been an increased focus on embedded hardware that is both small and powerful, making UAV on-board data processing more viable. Being able to process the video feed on-board the UAV calls for fast and robust real-time algorithms for object identification and tracking. This paper discusses the development and implementation of a machine vision system for a low-cost fixed-wing UAV with a total flying weight of less than 4kg. The machine vision system incorporates the use of a thermal imaging camera and on-board processing power to perform real-time object detection, classification and tracking of objects in the ocean surface. The system is tested on thermal video data from a test flight, and is found to be able to detect 99;6% of objects of interest located in the ocean surface. Of the detected objects, only 5% were false positives. Furthermore, it classifies 93; 3% of the object types it is trained to classify correctly. The classifier is highly agile, allowing the user to quickly define which object characteristics that should be considered during classification, and what types of objects to classify. Finally, the system is found to successfully track 85% of the object types it is actively searching for in a real-time simulation test.

The usage of Unmanned Aerial Vehicles(UAVs) are increasing day by day. UAV's usage for terrorism activities is one of the main threats faced by every country. As per THE HINDU news media, there are 6 lakh rogue drones in India. The ineffectiveness of standard air defence systems against tiny, sluggish, low-flying UAVs has been acknowledged in the National Counter Rogue Drone Guidelines. Due to their various sizes, flying characteristics, capabilities, performance parameters, missions, and weaknesses, the growing drone threats are challenging to fight. So an efficient UAV detecting system is required to detect the UAVs and prevent these illegal activities using UAVs. So for the first, this paper proposes a Generative Adversarial Network (GAN)-based method to detect the UAVs. Pix2Pix generative adversarial network framework for this UAV detection model.

The use of unmanned aerial vehicles (UAVs) is becoming increasingly widespread in many areas of human life every year. Not only military, but also civilian use of UAVs in various fields of science, industry, forestry, agronomy, cartography, ecology, and space research is hard to overestimate. For this reason, the use and development of UAVs in various fields remains extremely promising in the near future. Compared to manned vehicles, UAVs have the following advantages: no crew and no need for life support systems, large airfields; lower cost and low expenses for their development, production and operation; better weight and dimensions; high reliability and maneuverability; a wide range of specialized equipment for placement on board. UAVs are being introduced into all spheres of human life, even those where UAVs have no manned alternative. Some models of multicopters are already being used to deliver goods and extinguish fires. UAVs of new designs continue to be developed.In all areas of UAV application, the task of increasing autonomy remains relevant and important. The duration of con-tinuous operation and flight range directly affect the capabilities of the UAV, its ability to perform tasks and efficiency.UAV power consumption depends on the weight of the payload, weather conditions and drone speed. Energy consumption is a critical criterion for a drone to perform its missions and needs to be further studied. Many studies have been conducted to increase flight time by improving energy efficiency or reducing the energy consumed by the drone.Study the influence of battery parameters (capacity and weight) and propeller group (number of propellers and their diameter) on the maximum possible flight duration of UAVs of different masses.The main factors affecting the maximum flight duration of a UAV are considered. A model for calculating the power consumed by the device in the hover mode is presented. The maximum flight duration of a UAV is calculated depending on the battery capacity and weight, the number of propellers, and the diameter of the propellers for vehicles of different masses.It is shown that there is no point in increasing the battery capacity indefinitely, and there is an optimum point that depends on the ratio of the battery mass to the mass of the vehicle. It is also shown that increasing the diameter of the propellers significantly increases the flight time, while increasing their number is not as effective.

Lately unmanned aerial vehicles (UAV) became an unseparated part of modern life. These machines gained their particular popularity in the field of amateur or professional video production and small cargo deliveries. But they are not only limited by civilian lines of activity. Nowadays they are also used in military conflicts either as scout or as a deadly precise weapon. Due to UAV’s easy market access, these drones can be used by the hands of terrorists groups. It’s not a rocket science to attach an explosive device to UAV, guide it to strategic area and detonate it from far away. This is one of the main danger sources for such places like nuclear power plants. A downward trend also led to new type of thread – swarm attacks, when group of small UAVs strikes their victim. A timely detection of such attacks is not a trivial task. This question is being studied by many researches from different fields. The most promising methods comes from radiolocation and computer vision areas. Next in the paper, modern algorithms of detection, classification and tracking of UAVs by using optical flow will be reviewed. Usually, the common approach for this task comes from classic computer vision methods or, highly popular today, deep learning methods.

In this study, the trend of unmanned aerial vehicle (UAV) technology and its applications in the mining industry were reviewed. To understand the trend of the UAV technology, the definition and classification of the UAVs, their major applications in each field, the characteristics of the sensors of the UAV were investigated. Some examples that used the UAV technology for planning, work management, facility management, safety management, and other works in the mining industry were reviewed. By introducing the UAV technology in the mining site, it is expected that the work efficiency related to mining operations would be increased. Therefore, the application of the UAV technology in the mining industry would be expanded further.

Recent advancements in visual object tracking have markedly improved the capabilities of unmanned aerial vehicle (UAV) tracking, which is a critical component in real-world robotics applications. While the integration of hierarchical lightweight networks has become a prevalent strategy for enhancing efficiency in UAV tracking, it often results in a significant drop in network capacity, which further exacerbates challenges in UAV scenarios, such as frequent occlusions and extreme changes in viewing angles. To address these issues, we introduce a novel family of UAV trackers, termed CGTrack, which combines explicit and implicit techniques to expand network capacity within a coarse-to-fine framework. Specifically, we first introduce a Hierarchical Feature Cascade (HFC) module that leverages the spirit of feature reuse to increase network capacity by integrating the deep semantic cues with the rich spatial information, incurring minimal computational costs while enhancing feature representation. Based on this, we design a novel Lightweight Gated Center Head (LGCH) that utilizes gating mechanisms to decouple target-oriented coordinates from previously expanded features, which contain dense local discriminative information. Extensive experiments on three challenging UAV tracking benchmarks demonstrate that CGTrack achieves state-of-the-art performance while running fast. Code will be available at https://github.com/Nightwatch-Fox11/CGTrack.

Unmanned aerial vehicle (UAV) tracking is of great significance for a wide range of applications, such as delivery and agriculture. Previous benchmarks in this area mainly focused on small-scale tracking problems while ignoring the amounts of data, types of data modalities, diversities of target categories and scenarios, and evaluation protocols involved, greatly hiding the massive power of deep UAV tracking. In this article, we propose WebUAV-3M, the largest public UAV tracking benchmark to date, to facilitate both the development and evaluation of deep UAV trackers. WebUAV-3M contains over 3.3 million frames across 4,500 videos and offers 223 highly diverse target categories. Each video is densely annotated with bounding boxes by an efficient and scalable semi-automatic target annotation (SATA) pipeline. Importantly, to take advantage of the complementary superiority of language and audio, we enrich WebUAV-3M by innovatively providing both natural language specifications and audio descriptions. We believe that such additions will greatly boost future research in terms of exploring language features and audio cues for multi-modal UAV tracking. In addition, a fine-grained UAV tracking-under-scenario constraint (UTUSC) evaluation protocol and seven challenging scenario subtest sets are constructed to enable the community to develop, adapt and evaluate various types of advanced trackers. We provide extensive evaluations and detailed analyses of 43 representative trackers and envision future research directions in the field of deep UAV tracking and beyond. The dataset, toolkits, and baseline results are available at https://github.com/983632847/WebUAV-3M.

Advancement in technology has led to creative and innovative inventions. One such invention includes unmanned aerial vehicles (UAVs). UAVs (also known as drones) are now an intrinsic part of our society because their application is becoming ubiquitous in every industry ranging from transportation and logistics to environmental monitoring among others. With the numerous benign applications of UAVs, their emergence has added a new dimension to privacy and security issues. There are little or no strict regulations on the people that can purchase or own a UAV. For this reason, nefarious actors can take advantage of these aircraft to intrude into restricted or private areas. A UAV detection and identification system is one of the ways of detecting and identifying the presence of a UAV in an area. UAV detection and identification systems employ different sensing techniques such as radio frequency (RF) signals, video, sounds, and thermal imaging for detecting an intruding UAV. Because of the passive nature (stealth) of RF sensing techniques, the ability to exploit RF sensing for identification of UAV flight mode (i.e., flying, hovering, videoing, etc.), and the capability to detect a UAV at beyond visual line-of-sight (BVLOS) or marginal line-of-sight makes RF sensing techniques promising for UAV detection and identification. More so, there is constant communication between a UAV and its ground station (i.e., flight controller). The RF signals emitting from a UAV or UAV flight controller can be exploited for UAV detection and identification. Hence, in this work, an RF-based UAV detection and identification system is proposed and investigated. In RF signal fingerprinting research, the transient and steady state of the RF signals can be used to extract a unique signature. The first part of this work is to use two different wavelet analytic transforms (i.e., continuous wavelet transform and wavelet scattering transform) to investigate and analyze the characteristics or impacts of using either state for UAV detection and identification. Coefficient-based and image-based signatures are proposed for each of the wavelet analysis transforms to detect and identify a UAV. One of the challenges of using RF sensing is that a UAV's communication links operate at the industrial, scientific, and medical (ISM) band. Several devices such as Bluetooth and WiFi operate at the ISM band as well, so discriminating UAVs from other ISM devices is not a trivial task. A semi-supervised anomaly detection approach is explored and proposed in this research to differentiate UAVs from Bluetooth