An Improved YOLOv5-based Network on Pine Wilt Disease Detection Using UAV Image

To improve the efficiency and effectiveness of mosaicking unmanned aerial vehicle (UAV) images, we propose in this paper a rapid mosaicking method based on scale-invariant feature transform (SIFT) for mosaicking UAV images used for crop growth monitoring. The proposed method dynamically sets the appropriate contrast threshold in the difference of Gaussian (DOG) scale-space according to the contrast characteristics of UAV images used for crop growth monitoring. Therefore, this method adjusts and optimizes the number of matched feature point pairs in UAV images and increases the mosaicking efficiency. Meanwhile, based on the relative location relationship of UAV images used for crop growth monitoring, the random sample consensus (RANSAC) algorithm is integrated to eliminate the influence of mismatched point pairs in UAV images on mosaicking and to keep the accuracy and quality of mosaicking. Mosaicking experiments were conducted by setting three types of UAV images in crop growth monitoring: visible, near-infrared, and thermal infrared. The results indicate that compared to the standard SIFT algorithm and frequently used commercial mosaicking software, the method proposed here significantly improves the applicability, efficiency, and accuracy of mosaicking UAV images in crop growth monitoring. In comparison with image mosaicking based on the standard SIFT algorithm, the time efficiency of the proposed method is higher by 30%, and its structural similarity index of mosaicking accuracy is about 0.9. Meanwhile, the approach successfully mosaics low-resolution UAV images used for crop growth monitoring and improves the applicability of the SIFT algorithm, providing a technical reference for UAV application used for crop growth and phenotypic monitoring.

Recent advances in structure from motion (SfM) and dense matching algorithms enable surface reconstruction from unmanned aerial vehicle (UAV) images with high spatial resolution, allowing for new insights into earth surface processes. However, accuracy issues are inherent in parallel‐axes UAV image configurations. In this study, the quality of digital elevation models (DEMs) is assessed using images from a simulated UAV flight. Five different SfM tools and three different cameras are compared. If ground control points (GCPs) are not integrated into the adjustment process with parallel‐axes image configurations, significant dome‐effect systematic errors are observed, which can be reduced based on calibration parameters retrieved from a testfield captured with convergent images immediately before or after the UAV flight. A comparison between DEMs of a soil surface generated from UAV images and terrestrial laser‐scanning data show that natural surfaces can be very accurately reconstructed from UAV images, even when GCPs are missing and simple geometric camera models are considered.

Less effective information is obtained by the object detection network, due to the small size of the detection object in the entire image, the complex background, and the dense object in unmanned aerial vehicle (UAV) images. In response to the difficulties encountered, a small object detection method in UAV images is proposed as an improved YOLOv5-based algorithm in this paper. First, the space-to-depth(SPD) conv module is introduced into the basic feature extraction network, to improve significant loss of image information during downsampling. Then, various attention mechanisms are added, to intensify the acquisition of regions of interest in UAV images. Finally, the multiscale detection module is improved, to enhance the network's ability to detect small objects in UAV images. By conducting experiments on the VisDrone-DET2019 dataset, the test results of the established model show. The improved algorithm achieved a Mean Average Precision (mAP) of 41.8%, which is 7.8% better than the baseline network. In addition, the detection performance is better than most current mainstream target detection algorithms and is of some practical value.

Robust and rapid image dense matching is the key to large-scale three-dimensional (3D) reconstruction for multiple Unmanned Aerial Vehicle (UAV) images. However, the following problems must be addressed: (1) the amount of UAV image data is very large, but ordinary computer memory is limited; (2) the patch-based multi-view stereo-matching algorithm (PMVS) does not work well for narrow-baseline cases, and its computing efficiency is relatively low, and thus, it is difficult to meet the UAV photogrammetry’s requirements of convenience and speed. This paper proposes an Image-grouping and Self-Adaptive Patch-based Multi-View Stereo-matching algorithm (IG-SAPMVS) for multiple UAV imagery. First, multiple UAV images were grouped reasonably by a certain grouping strategy. Second, image dense matching was performed in each group and included three processes. (1) Initial feature-matching consists of two steps: The first was feature point detection and matching, which made some improvements to PMVS, according to the characteristics of UAV imagery. The second was edge point detection and matching, which aimed to control matching propagation during the expansion process; (2) The second process was matching propagation based on the self-adaptive patch. Initial patches were built that were centered by the obtained 3D seed points, and these were repeatedly expanded. The patches were prevented from crossing the discontinuous terrain by using the edge constraint, and the extent size and shape of the patches could automatically adapt to the terrain relief; (3) The third process was filtering the erroneous matching points. Taken the overlap problem between each group of 3D dense point clouds into account, the matching results were merged into a whole. Experiments conducted on three sets of typical UAV images with different texture features demonstrate that the proposed algorithm can address a large amount of UAV image data almost without computer memory restrictions, and the processing efficiency is significantly better than that of the PMVS algorithm and the matching accuracy is equal to that of the state-of-the-art PMVS algorithm.

The sparse representation error (SRE) exists when the images are represented sparsely. The SRE is particularly large in unmanned aerial vehicles (UAV) images due to the disturbance of the harsh environment or the instability of its flight, which will bring more noise. In the compressed sensing (CS) system, the projected SRE in the compressed measurement will bring a significant challenge to the recovery accuracy of the images. In this work, a new SRE structure is proposed. Following the new structure, a lower sparse representation error (LSRE) is achieved by eliminating groups of sparse representation. With the proposed LSRE modeling, a robust sensing matrix is designed to compress and encrypt the UAV images. Experiments for UAV images are carried out to compare the recovery performance of the proposed algorithm with the existing related algorithms. The results of the proposed algorithm reveal superior recovery accuracy. The new CS framework with the proposed sensing matrix to address the scenario of UAV images with large SRE is dominant.

Semantic segmentation of weed and crop images is a key component and prerequisite for automated weed management. For weeds in unmanned aerial vehicle (UAV) images, which are usually characterized by small size and easily confused with crops at early growth stages, existing semantic segmentation models have difficulties to extract sufficiently fine features. This leads to their limited performance in weed and crop segmentation of UAV images. We proposed a fine-grained feature-guided UNet, named FG-UNet, for weed and crop segmentation in UAV images. Specifically, there are two branches in FG-UNet, namely the fine-grained feature branch and the UNet branch. In the fine-grained feature branch, a fine feature-aware (FFA) module was designed to mine fine features in order to enhance the model's ability to segment small objects. In the UNet branch, we used an encoder-decoder structure to realize high-level semantic feature extraction in images. In addition, a contextual feature fusion (CFF) module was designed for the fusion of the fine features and high-level semantic features, thus enhancing the feature discrimination capability of the model. The experimental results showed that our proposed FG-UNet, achieved state-of-the-art performance compared to other semantic segmentation models, with mean intersection over union (MIOU) and mean pixel accuracy (MPA) of 88.06% and 92.37%, respectively. The proposed method in this study lays a solid foundation for accurate detection and intelligent management of weeds. It will have a positive impact on the development of smart agriculture. © 2024 Society of Chemical Industry.

Woody plant encroachment in grassy ecosystems is a widely reported phenomenon associated with negative impacts on ecosystem functions. Most studies of this phenomenon have been carried out in arid and semi-arid grasslands. Therefore, studies in tropical regions, particularly savannas, which are composed of grassland and woodland mosaics, are needed. Our objective was to evaluate the accuracy of woody encroachment classification in the Brazilian Cerrado, a tropical savanna. We acquired dry and wet season unmanned aerial vehicle (UAV) images using RGB and multispectral cameras that were processed by the support vector machine (SVM), decision tree (DT), and random forest (RF) classifiers. We also compared two validation methods: the orthomosaic and in situ methods. We targeted two native woody species: Baccharis retusa and Trembleya parviflora. Identification of these two species was statistically (p < 0.05) most accurate in the wet season RGB images classified by the RF algorithm, with an overall accuracy (OA) of 92.7%. Relating to validation assessments, the in situ method was more susceptible to underfitting scenarios, especially using an RF classifier. The OA was higher in grassland than in woodland formations. Our results show that woody encroachment classification in a tropical savanna is possible using UAV images and field surveys and is suggested to be conducted during the wet season. It is challenging to classify UAV images in highly diverse ecosystems such as the Cerrado; therefore, whenever possible, researchers should use multiple accuracy assessment methods. In the case of using in situ accuracy assessment, we suggest a minimum of 40 training samples per class and to use multiple classifiers (e.g., RF and DT). Our findings contribute to the generation of tools that optimize time and cost for the monitoring and management of woody encroachment in tropical savannas.

Accurate extraction of buildings using high spatial resolution imagery is essential to a wide range of urban applications. However, it is difficult to extract semantic features from a variety of complex scenes (e.g., suburban, urban and urban village areas) because various complex man-made objects usually appear heterogeneous with large intra-class and low inter-class variations. The automatic extraction of buildings is thus extremely challenging. The fully convolutional neural networks (FCNs) developed in recent years have performed well in the extraction of urban man-made objects due to their ability to learn state-of-the-art features and to label pixels end-to-end. One of the most successful FCNs used in building extraction is U-net. However, the commonly used skip connection and feature fusion refinement modules in U-net often ignore the problem of feature selection, and the ability to extract smaller buildings and refine building boundaries needs to be improved. In this paper, we propose a trainable chain fully convolutional neural network (CFCN), which fuses high spatial resolution unmanned aerial vehicle (UAV) images and the digital surface model (DSM) for building extraction. Multilevel features are obtained from the fusion data, and an improved U-net is used for the coarse extraction of the building. To solve the problem of incomplete extraction of building boundaries, a U-net network is introduced by chain, which is used for the introduction of a coarse building boundary constraint, hole filling, and "speckle" removal. Typical areas such as suburban, urban, and urban villages were selected for building extraction experiments. The results show that the CFCN achieved recall of 98.67%, 98.62%, and 99.52% and intersection over union (IoU) of 96.23%, 96.43%, and 95.76% in suburban, urban, and urban village areas, respectively. Considering the IoU in conjunction with the CFCN and U-net resulted in improvements of 6.61%, 5.31%, and 6.45% in suburban, urban, and urban village areas, respectively. The proposed method can extract buildings with higher accuracy and with clearer and more complete boundaries.

A Bayesian network (BN) model was developed to predict susceptibility to PWD(Pine Wilt Disease). The distribution of PWD was identified using QuickBird and unmanned aerial vehicle (UAV) images taken at different times. Seven factors that influence the distribution of PWD were extracted from the QuickBird images and were used as the independent variables. The results showed that the BN model predicted PWD with high accuracy. In a sensitivity analysis, elevation (EL), the normal differential vegetation index (NDVI), the distance to settlements (DS) and the distance to roads (DR) were strongly associated with PWD prevalence, and slope (SL) exhibited the weakest association with PWD prevalence. The study showed that BN is an effective tool for modeling PWD prevalence and quantifying the impact of various factors.

Enhancing in-season yield forecast accuracy for film-mulched wheat: A hybrid approach coupling crop model and UAV remote-sensing data by ensemble learning technique

• Introduced a semi-automated annotation workflow for efficient large-scale UAV labeling. • Proposed a lightweight hybrid segmentation framework integrating Mamba, Transformer, and CNN. • Achieved a superior balance between segmentation accuracy and computational efficiency. • Demonstrated strong performance and generalizability across diverse landscapes. • Enabled scalable regional mapping and monitoring of Acacia tortilis from UAV images. Acacia tortilis (Umbrella thorn acacia), native to the dry and semi-arid zones of Africa and the Middle East, can withstand extreme climatic conditions and provides substantial ecological and socioeconomic benefits. Reliable, regional-scale mapping and monitoring are increasingly critical as populations face mounting environmental and anthropogenic pressures. This study presents an efficient and lightweight deep learning framework for the regional-scale delineation of A. tortilis from ultra-high spatial resolution unmanned aerial vehicle (UAV) images. A comprehensive field campaign was conducted to collect ground-truth samples across diverse urban, agricultural, and mountainous settings. Aiming to expedite the labor-intensive labeling process and generate consistent, reliable training data, a semi-automated annotation workflow was developed, expanding the annotated dataset nearly fourfold to approximately 36,800 A. tortilis instances. The study also introduces a hybrid U-shaped Mamba-transformer architecture, designed to maximize the advantages of Mamba units, Transformers, and convolutional networks for joint modeling of local detail and extensive contextual information. The proposed framework was evaluated against several representative CNN–, Transformer-, and Mamba-based models, as well as alternative decoder designs, to assess segmentation quality, efficiency, and generalizability. Using an independent testing dataset, the hybrid model family (tiny, small, and base variants) demonstrated a strong balance between accuracy and efficiency, achieving mean intersection over union values ranging from 85.30% to 85.44% and mean F-scores between 91.52% and 91.61%, maintaining consistent performance across geographically distinct regions. The lightweight CNN-based decoder offered an optimal balance between accuracy and computational cost, with substantially reduced training time compared to more complex decoders. Across an extensive regional survey extent (∼250 km 2 ), the framework consistently delineated A. tortilis crowns, underscoring robust and scalable performance. Thus, the proposed framework can facilitate systematic monitoring of A. tortilis and support the conservation, restoration, and sustainable management of native tree species across arid and semi-arid ecosystems.

Agricultural intensification and efficient use and targeting of fertilizer inputs on smallholder farms is key to sustainably improve food security. The objective of this paper is to demonstrate how high-resolution satellite and unmanned aerial vehicle (UAV) images can be used to assess the spatial variability of yield, and yield response to fertilizer. The study included 48 and 50 smallholder fields monitored during the 2014 and 2015 cropping seasons south-east of Koutiala (Mali), cropped with the five major crops grown in the area (cotton, maize, sorghum, millet and peanuts). Each field included up to five plots with different fertilizer applications and one plot with farmer practice. Fortnightly, in-situ in each field data were collected synchronous with UAV imaging using a Canon S110 NIR camera. A concurrent series of very high-resolution satellite images was procured and these images were used to mask out trees. For each plot, we calculated vegetation index means, medians and coefficients of variation. Cross-validated general linear models were used to assess the predictability of relative differences in crop yield and yield response to fertilizer, explicitly accounting for the effects of fertility treatments, between-field and within-field variabilities. Differences between fields accounted for a much larger component of variation than differences between fertilization treatments.Vegetation indices from UAV images strongly related to ground cover (R2 = 0.85), light interception (R2 = 0.79) and vegetation indices derived from satellite images (R2 values of about 0.8). Within-plot distributions of UAV-derived vegetation index values were negatively skewed, and within-plot variability of vegetation index values was negatively correlated with yield. Plots on shallow soils with poor growing conditions showed the largest within-plot variability. GLM models including UAV derived estimates of light interception explained up to 78% of the variation in crop yield and 74% of the variation in fertilizer response within a single field. These numbers dropped to about 45% of the variation in yield and about 48% of the variation in fertilizer response when lumping all fields of a given crop, with Q2 values of respectively 22 and 40% respectively when tested with a leave-field-out procedure. This indicates that remotely sensed imagery doesn’t fully capture the influence of crop stress and management. Assessment of crop fertilizer responses with vegetation indices therefore needs a reference under similar management. Spatial variability in UAV-derived vegetation index values at the plot scale was significantly related to differences in yields and fertilizer responses. The strong relationships between light interception and ground cover indicate that combining vertical photographs or high-resolution remotely sensed vegetation indices with crop growth models allows to explicitly account for the spatial variability and will improve the accuracy of yield and crop production assessments, especially in heterogeneous smallholder conditions.

In recent years, research on Unmanned Aerial Vehicles (UAVs) has developed rapidly. Compared to traditional remote-sensing images, UAV images exhibit complex backgrounds, high resolution, and large differences in object scales. Therefore, UAV object detection is an essential yet challenging task. This paper proposes a multi-scale object detection network, namely YOLO-DroneMS (You Only Look Once for Drone Multi-Scale Object), for UAV images. Targeting the pivotal connection between the backbone and neck, the Large Separable Kernel Attention (LSKA) mechanism is adopted with the Spatial Pyramid Pooling Factor (SPPF), where weighted processing of multi-scale feature maps is performed to focus more on features. And Attentional Scale Sequence Fusion DySample (ASF-DySample) is introduced to perform attention scale sequence fusion and dynamic upsampling to conserve resources. Then, the faster cross-stage partial network bottleneck with two convolutions (named C2f) in the backbone is optimized using the Inverted Residual Mobile Block and Dilated Reparam Block (iRMB-DRB), which balances the advantages of dynamic global modeling and static local information fusion. This optimization effectively increases the model’s receptive field, enhancing its capability for downstream tasks. By replacing the original CIoU with WIoUv3, the model prioritizes anchoring boxes of superior quality, dynamically adjusting weights to enhance detection performance for small objects. Experimental findings on the VisDrone2019 dataset demonstrate that at an Intersection over Union (IoU) of 0.5, YOLO-DroneMS achieves a 3.6% increase in mAP@50 compared to the YOLOv8n model. Moreover, YOLO-DroneMS exhibits improved detection speed, increasing the number of frames per second (FPS) from 78.7 to 83.3. The enhanced model supports diverse target scales and achieves high recognition rates, making it well-suited for drone-based object detection tasks, particularly in scenarios involving multiple object clusters.

Accurate object detection in unmanned aerial vehicle (UAV) images plays a crucial role in fields such as aviation, transportation, and agriculture. However, UAV images often contain a high proportion of small objects, and the limited resources of UAV platforms make it challenging for existing small object detection algorithms to balance detection performance and resource consumption. To address these issues, a lightweight small object detection algorithm called SRP-YOLO is proposed. Compared to the YOLOv8 network, the following improvements are made: first, a high-resolution detection head is designed; second, a receptive field attention convolution module tailored for small UAV objects is introduced to replace the standard convolution module, enhancing the detection capability for small objects and significantly improving their feature representation; Third, partial convolution is combined with C2f to replace some of the standard convolutions, fully leveraging the high-resolution information from shallow features. Finally, A normalized Gaussian Wasserstein Distance (NWD) metric is introduced to reduce the sensitivity of Intersection over Union (IoU) to minor positional deviations of small objects. On VisDrone-DET2019, SRP-YOLO reduces parameters while improving mAP 0.5 by 7.9%. Generalization tests on TinypersonV2 and RAIVD confirm significant gains in small object detection.

Investigating post-earthquake surface ruptures is important for understanding the tectonics of seismogenic faults. The use of unmanned aerial vehicle (UAV) images to identify post-earthquake surface ruptures has the advantages of low cost, fast data acquisition, and high data processing efficiency. With the rapid development of deep learning in recent years, researchers have begun using it for image crack detection. However, due to the complex background and diverse characteristics of the surface ruptures, it remains challenging to quickly train an effective automatic earthquake surface rupture recognition model on a limited number of samples. This study proposes a workflow that applies an image segmentation algorithm based on convolutional neural networks (CNNs) to extract cracks from post-earthquake UAV images. We selected the 16-layer visual geometry group (VGG16) network as the primary network architecture. Then, we improved the VGG16 network and deleted several convolutional layers to reduce computation and memory consumption. Moreover, we added dilated convolution and atrous spatial pyramid pooling (ASPP) to make the network perform well in the surface crack identification of post-earthquake UAV images. We trained the proposed method using the data of the MS 7.4 Maduo earthquake and obtained a model that could automatically identify and draw small and irregular surface ruptures from high-resolution UAV images.