Animal Intrusion Detection Using Deep Learning

Accurate identification of vehicles and estimating density in traffic surveillance systems is a challenging task, particularly in scenarios with closely spaced lanes. Single Shot MultiBox Detector (SSD) is introduced in vehicle detection and classification due to its speed and accuracy. It utilizes a transfer learning technique that enables them to utilize features from pretrained Convolutional Neural Networks (CNNs). Although the utilization of multi-scale feature maps in SSD has achieved efficient results in vehicle detection, it struggles to identify key features of vehicles due to its one-stage detection approach. Furthermore, the use of VGG16 as the backbone network in these approaches leads to the loss of fine-grained details, posing challenges in accurately localizing and classifying small vehicles. Also, there is no interaction between high- and low-level features, which restricts the networks ability to effectively integrate and utilize both features for accurate vehicle detection. To overcome these limitations, an improved SSD approach is introduced in this paper, leveraging interactive multi-scale attention characteristics to accurately detect and classify vehicles. This approach utilizes ResNet50 as the network backbone to overcome the limitations of traditional SSDs in detecting small vehicles. Also, an attention block is incorporated into it to focus on key details and assign higher attention to relevant pixels within the feature map. Also, the network employs a parallel detection framework and shares multi-scale layers (both high and low), enabling efficient detection of vehicles with various sizes. Then, traffic density is estimated based on the weights assigned to the categorized vehicles obtained from the improved SSD and the recorded area. Finally, traffic is classified as high, low, or moderate by comparing the estimated density to a threshold value. By adding attention characteristics of different scales to the original detection branch and replacing the VGG16 with ResNet50 of the SSD technique using our method, the feature representation capability and detection accuracy are both significantly improved.

ObjectiveWe aimed to develop a computer-aided detection (CAD) system for accurate identification of benign pigmented skin lesions (PSLs) from images captured using a digital camera or a smart phone.MethodsWe collected a total of 12,836 clinical images which had been classified and location-labeled for training and validating. Four models were developed and validated; you only look once, v4 (YOLOv4), you only look once, v5 (YOLOv5), single shot multibox detector (SSD) and faster region-based convolutional neural networks (Faster R-CNN). The performance of the models was compared with three trained dermatologists, respectively. The accuracy of the best model was further tested and validated using smartphone-captured images.ResultsThe accuracies of YOLOv4, YOLOv5, SSD and Faster R-CNN were 0.891, 0.929, 0.852 and 0.874, respectively. The precision, sensitivity and specificity of YOLOv5 (the best model) were 0.956, 0.962 and 0.952, respectively. The accuracy of YOLOv5 model for images captured using a smart-phone was 0.905. The CAD based YOLOv5 system can potentially be used in clinical identification of PSLs.ConclusionWe developed and validated a CAD system for automatic identification of benign PSLs using digital images. This approach may be used by non-dermatologists to easily diagnose by taking a photo of skin lesion and guide on management of PSLs.

Deep learning techniques help computer vision automatically learn the intrinsic patterns within complex data. This research mainly concentrates on creating a mobile application based on augmented reality for elderly mobile users that helps in identifying the traffic signals and other signboards in real‐time using deep learning techniques. TensorFlow serves as an implementation platform to build the object detection system with deep learning. The single shot multibox detector (SSD) model and the two‐stage faster‐regional convolutional neural network (RCNN) models from TensorFlow's object detection application programming interface (API) are compared in this study. The SSD model with MobileNet as a backbone network serves well for this study as it is faster than the RCNN model with comparable accuracy. However, unconstrained environments like occlusions can be an obstacle to the effective performance of an object detection system. This research provides a solution to handle occlusions by developing a robust object detection system through image segmentation techniques. The model introduced is based on the SSD MobileNet model which enables it to be deployable on mobile devices for real‐time offline detection. The developed model exhibits faster performance than the state‐of‐the‐art instance segmentation model, Mask RCNN with comparable accuracy. Elaborated implementation of this system and results are presented in further sections.

With the development of industrial automation, the importance of mechanical parts in the production process is becoming increasingly important. In recent years, deep learning technology has made breakthrough progress in fields such as image recognition and object detection. Deep learning models can learn a large amount of data through multiple epochs, automatically extract features from it, and achieve image recognition and object detection. This provides potent technical assistance for the design of mechanical component recognition systems. In industrial production, there are a wide variety of mechanical parts with complex shapes, and the differences between different models are often very small, making it difficult to identify them manually. Therefore, it is necessary to develop a system that can automatically identify mechanical parts to improve production efficiency and quality. This article takes mechanical parts as the research object and studies the recognition technology of mechanical parts based on deep learning and image recognition. The main content of the article includes the following aspects. Research was conducted on image quality enhancement methods for images with different characteristics, and different image preprocessing methods were applied to different images. YOLOv5 and SSD (Single Shot MultiBox Detector) algorithms are used to perform deep learning and recognition detection on the processed images, respectively. By comprehensively comparing the differences between the two algorithms, YOLOv5 was selected as the focus of this design, and based on this, deep training was conducted, and the code was imported into the embedded system.

Hand gesture recognition has great applications in human-computer interaction (HCI), human-robot interaction (HRI), and supporting the deaf and mute. To build a hand gesture recognition model using deep learning (DL) with high results then needs to be trained on many data and in many different conditions and contexts. In this paper, we publish the TQU-HG dataset of large RGB images with low resolution (640×480) pixels, low light conditions, and fast speed (16 fps). TQU-HG dataset includes 60,000 images collected from 20 people (10 male, 10 female) with 15 gestures of both left and right hands. A comparative study with two branches: i) based on Mediapipe TML and ii) Based on convolutional neural networks (CNNs) (you only look once (YOLO); YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLO-Nas, single shot multiBox detector (SSD) VGG16, residual network (ResNet)18, ResNext50, ResNet152, ResNext50, MobileNet V3 small, and MobileNet V3 large), the architecture and operation of CNNs models are also introduced in detail. We especially fine-tune the model and evaluate it on TQU-HG and HaGRID datasets. The quantitative results of the training and testing are presented (F1-score of YOLOv8, YOLO-Nas, MobileNet V3 small, ResNet50 is 98.99%, 98.98%, 99.27%, 99.36%, respectively on the TQU-HG dataset and is 99.21%, 99.37%, 99.36%, 86.4%, 98.3%, respectively on the HaGRID dataset). The computation time of YOLOv8 is 6.19 fps on the CPU and 18.28 fps on the GPU.

To develop and evaluate the performance of a deep learning system based on convolutional neural network (ConvNet) to detect dental caries from oral photographs. 3,932 oral photographs obtained from 625 volunteers with consumer cameras were included for the development and evaluation of the model. A deep ConvNet was developed by adapting from Single Shot MultiBox Detector. The hard negative mining algorithm was applied to automatically train the model. The model was evaluated for: (i) classification accuracy for telling the existence of dental caries from a photograph and (ii) localization accuracy for locations of predicted dental caries. The system exhibited a classification area under the curve (AUC) of 85.65% (95% confidence interval: 82.48% to 88.71%). The model also achieved an image-wise sensitivity of 81.90%, and a box-wise sensitivity of 64.60% at a high-sensitivity operating point. The hard negative mining algorithm significantly boosted both classification (p<.001) and localization (p<.001) performance of the model by reducing false-positive predictions. The deep learning model is promising to detect dental caries on oral photographs captured with consumer cameras. It can be useful for enabling the preliminary and cost-effective screening of dental caries among large populations.

Over the last few years, researchers have focused on computer‐aided polyp detection in gastroscopy. Deep learning (DL) has shown great promise for polyps' identification. The most exceptional contribution of DL methods in gastroenterology is their ability to identify polyps quickly and accurately using convolution neural network. Nonetheless, despite significant advancements, automatic detection of small polyps remains a challenging and complex task. Furthermore, due to multiple pooling operations, the features of small polyps are lost, resulting in low detection accuracy. This paper proposes an efficient object detection method for polyp detection using gastric images to address this issue. A single‐shot multi‐box detector (SSD) was combined with the feature extractor VGG‐16, and the Refined Map Block (RMB) was integrated into SSD's high‐resolution feature maps to get more semantic information. The RMB output was used as the input to the successive layers. The RMB comprises of attention cascade and feature map concatenation cascade. The attention cascade improved the localization accuracy, while the feature map concatenation cascade improved the classification accuracy. Using the former, the proposed attention‐based SSD for gastric polyps (ASSD‐GPNet) model focused on the specific information, a polyp, rather than the background. Furthermore, the feature map concatenation cascade adds semantic information while reducing computational complexity. The output of these two cascades was combined to produce a refined feature map that enhances the detection of small polyps. The model was trained and tested on 1970 gastric images and Pascal VOC07 + 12. Image augmentation was applied to increase the training data of gastric images to reduce overfitting and skip connections were used to overcome the vanishing gradient problem. Overall, the experimental results demonstrated that the proposed model outperformed than compared models in both medical and natural images. The ASSD‐GPNet obtained mean average precision (mAP) of 94.2% on gastric images and 76.9% on Pascal VOC.

Fast, robust and accurate posture detection algorithm based on Kalman filter and SSD for AGV

We propose a lightweight detection algorithm based on the Single Shot MultiBox Detector (SSD) algorithm in order to facilitate sheep management and to realize sheep facial identification, and we take the self-constructed dataset as the research object. First, the SSD replaces the VGG16 backbone network with MobileNetv3, a lightweight neural network, to create a hybrid model that is much smaller. Second, the ECA attention mechanism is incorporated into the backend of the 72 × 160 bottleneck layer. Finally, the SmoothL1 loss function is substituted with the BalancedL1 loss function. The optimized model’s size decreases significantly from the original SSD’s 132 MB to just 22.4 MB. It achieves a mean average precision of 83.47% and maintains an average frame rate of 68.53 frames per second. Compared to the basic SSD model, the mean average precision has increased by 3.25 percentage points, the model size has decreased by 109.6 MB, and the detection speed has improved by 9.55 frames per second. In comparative experiments using the same dataset with different object detection models, the proposed model outperforms the SSD, Faster R-CNN, Retinanet, and CenterNet in terms of mean average precision, with improvements of 3.25 percentage points, 4.71 percentage points, 2.38 percentage points, and 8.13 percentage points, respectively. The detection speed has shown significant improvements, increasing by 9.55, 58.55, 53.1, and 12.37 frames per second, respectively. The improved model presented in this paper significantly reduces the model’s size and computational requirements while maintaining an excellent performance. This provides a valuable reference for the digitalization of animal husbandry and livestock farming.

The single shot multi-box detector (SSD) exhibits low accuracy in small-object detection; this is because it does not consider the scale contextual information between its layers, and the shallow layers lack adequate semantic information. To improve the accuracy of the original SSD, this paper proposes a new single shot multi-box detector using trident feature and squeeze and extraction feature fusion (SSD-TSEFFM); this detector employs the trident network and the squeeze and excitation feature fusion module. Furthermore, a trident feature module (TFM) is developed, inspired by the trident network, to consider the scale contextual information. The use of this module makes the proposed model robust to scale changes owing to the application of dilated convolution. Further, the squeeze and excitation block feature fusion module (SEFFM) is used to provide more semantic information to the model. The SSD-TSEFFM is compared with the faster regions with convolution neural network features (RCNN) (2015), SSD (2016), and DF-SSD (2020) on the PASCAL VOC 2007 and 2012 datasets. The experimental results demonstrate the high accuracy of the proposed model in small-object detection, in addition to a good overall accuracy. The SSD-TSEFFM achieved 80.4% mAP and 80.2% mAP on the 2007 and 2012 datasets, respectively. This indicates an average improvement of approximately 2% over other models.

Posture detection targeted towards providing assessments for the monitoring of health and welfare of pigs has been of great interest to researchers from different disciplines. Existing studies applying machine vision techniques are mostly based on methods using three-dimensional imaging systems, or two-dimensional systems with the limitation of monitoring under controlled conditions. Thus, the main goal of this study was to determine whether a two-dimensional imaging system, along with deep learning approaches, could be utilized to detect the standing and lying (belly and side) postures of pigs under commercial farm conditions. Three deep learning-based detector methods, including faster regions with convolutional neural network features (Faster R-CNN), single shot multibox detector (SSD) and region-based fully convolutional network (R-FCN), combined with Inception V2, Residual Network (ResNet) and Inception ResNet V2 feature extractions of RGB images were proposed. Data from different commercial farms were used for training and validation of the proposed models. The experimental results demonstrated that the R-FCN ResNet101 method was able to detect lying and standing postures with higher average precision (AP) of 0.93, 0.95 and 0.92 for standing, lying on side and lying on belly postures, respectively and mean average precision (mAP) of more than 0.93.

This paper describes the use of two different deep-learning algorithms for object detection to recognize different badgers. We use recordings of four different badgers under varying background illuminations. In total four different object detection algorithms based on deep neural networks are compared: The single shot multi-box detector (SSD) with the Inception-V2 or MobileNet as a backbone, and the faster region-based convolutional neural network (Faster R-CNN) combined with Inception-V2 or residual networks. Furthermore, two different activation functions are compared to compute probabilities that some badger is in the detected region: the softmax and sigmoid functions. The results of all eight models show that SSD obtains higher recognition accuracies (97.8%–98.6%) than Faster R-CNN (84.8%–91.7%). However, the training time of Faster R-CNN is much shorter than that of SSD. The use of different output activation functions seems not to matter much.

Offshore and inland river ship detection has been studied on both synthetic aperture radar (SAR) and optical remote sensing imagery. However, the classic ship detection methods based on SAR images can cause a high false alarm ratio and be influenced by the sea surface model, especially on inland rivers and in offshore areas. The classic detection methods based on optical images do not perform well on small and gathering ships. This paper adopts the idea of deep networks and presents a fast regional-based convolutional neural network (R-CNN) method to detect ships from high-resolution remote sensing imagery. First, we choose GaoFen-2 optical remote sensing images with a resolution of 1 m and preprocess the images with a support vector machine (SVM) to divide the large detection area into small regions of interest (ROI) that may contain ships. Then, we apply ship detection algorithms based on a region-based convolutional neural network (R-CNN) on ROI images. To improve the detection result of small and gathering ships, we adopt an effective target detection framework, Faster-RCNN, and improve the structure of its original convolutional neural network (CNN), VGG16, by using multiresolution convolutional features and performing ROI pooling on a larger feature map in a region proposal network (RPN). Finally, we compare the most effective classic ship detection method, the deformable part model (DPM), another two widely used target detection frameworks, the single shot multibox detector (SSD) and YOLOv2, the original VGG16-based Faster-RCNN, and our improved Faster-RCNN. Experimental results show that our improved Faster-RCNN method achieves a higher recall and accuracy for small ships and gathering ships. Therefore, it provides a very effective method for offshore and inland river ship detection based on high-resolution remote sensing imagery.

The technique for target detection based on a convolutional neural network has been widely implemented in the industry. However, the detection accuracy of X-ray images in security screening scenarios still requires improvement. This paper proposes a coupled multi-scale feature extraction and multi-scale attention architecture. We integrate this architecture into the Single Shot MultiBox Detector (SSD) algorithm and find that it can significantly improve the effectiveness of target detection. Firstly, ResNet is used as the backbone network to replace the original VGG network to improve the feature extraction capability of the convolutional neural network for images. Secondly, a multi-scale feature extraction (MSE) structure is designed to enrich the information contained in the multi-stage prediction feature layer. Finally, the multi-scale attention architecture (MSA) is fused onto the prediction feature layer to eliminate the redundant features’ interference and extract effective contextual information. In addition, a combination of Adaptive-NMS and Soft-NMS is used to output the final prediction anchor boxes when performing non-maximum suppression. The results of the experiments show that the improved method improves the mean average precision (mAP) value by 7.4% compared to the original approach. New modules make detection much more accurate while keeping the detection speed the same.

The fabric defect detection algorithm based on object detection has become a research hotspot. The method based on the Single Shot MultiBox Detector (SSD) model has a fast detection speed, but the detection accuracy is insufficient. To balance the detection speed and accuracy of the model and meet the actual needs of the industry, an improved fabric defect detection algorithm based on SSD is proposed in this study. The Fully Convolutional Squeeze-and-Excitation (FCSE) block is added into the traditional SSD to improve the detection accuracy of the model. The number of default boxes was adjusted to accommodate the detection of long strip defects on fabric surface. Experimental results on the TILDA and Xuelang dataset confirm that our detection method based on SSD efficiently detected various fabric defects.