Design and Implementation of an Object Detection System Using Faster R-CNN

Nematodes represent very abundant and the largest species diversity in the world. Nematodes, which live in a soil environment, possess several functions in agricultural systems. There are two huge groups of soil nematodes, a non-parasitic nematode, which contributes positively to ecological processes, and a plant-parasitic nematode, which cause various disease and reduces yield losses in the agricultural system. Early detection and classification in the agricultural area infected with plant-parasitic nematode and interpreting the soil level condition in this area required a fast and reliable detection system. However, nematode identification is challenging and time-consuming due to their similar morphology. This study applied a pre-trained faster region-based convolutional neural network (RCNN) for plant-parasitic and non-parasitic nematodes detection. These deep learning-based object detection models gave satisfactory results as the accuracy reached 87.5%.

The YOLOv8 model has high detection efficiency and classification accuracy in detecting commutator surface defects, aimed at the problem of low working efficiency of a commutator, caused by commutator surface defects. First, the theoretical framework of Region-based Convolutional Neural Networks (R-CNN), spatial pyramid pooling (SPP)-net, Fast R-CNN, and Faster R-CNN is introduced, and the detection principle and process are described in detail. Secondly, the principle of the YOLOv8 network structure, head structure, neck structure, and C2f module are explained, and the loss function is described. The average precision of the proposed algorithm for detecting cracks and small points is more than 98%, and the frames per second (FPS) is 27. The detection results are mapped to the original image, and the visualization of the commutator surface defect detection is obtained, which has a higher robustness, accuracy, and real-time performance than the R-CNN, SPP-net, Fast R-CNN, and Faster R-CNN algorithms.

Coronavirus disease 2019 (COVID‐19) has a significant impact on human life. The novel pandemic forced humans to change their lifestyles. Scientists have broken through the vaccine in many countries, but the face mask is the only protection for public interaction. In this study, deep neural networks (DNN) have been employed to determine the persons wearing masks correctly. The faster region‐based convolutional neural networks (RCNN) model has been used to train the data using graphics processing unit (GPU) device. To achieve our goals, we used a multiphase detection model: first, to label the face mask, and second to detect the edge and compute edge projection for the chosen face region within the face mask. The current findings revealed that faster RCNN was efficient and precise, giving 97% accuracy. The overall loss after 200,000 epochs is 0.0503, with a trend to decrease. While the loss is falling, we are getting more accurate results. As a result, the faster RCNN technique effectively identifies whether a person is wearing face masks or not, and the training period was decreased with better accuracy. In the future, Deep Neural Network (DNN) might be used first to train the data and then compress the dimensions of the input to run it on low‐powered devices, resulting in a lower computational cost. Our proposed system can achieve high face detection accuracy and coarsely obtain face posture estimation based on the specified rule. The faster RCNN learning algorithm returns high precision, and the model’s lower computational cost is achieved on GPU. We use the “label‐image” application to label the photographs extracted from the dataset and apply Inception V2 of faster RCNN for face mask detection and classification.

The automation of agricultural practices offers significant potential for boosting productivity while reducing labor requirements, particularly in fruit harvesting. However, accurately detecting tomatoes in dynamic and complex field environments remains a challenge due to issues such as high false positive rates, missed detections, variable illumination, occlusion, and heterogeneous foliage. In this research, tomato recognition for autonomous picking robots is conducted using the deep learning model Faster R-CNN (Region-based Convolutional Neural Network). Faster R-CNN excels in object detection tasks within complex scenes containing multiple objects and diverse backgrounds by generating region proposals and performing classifications, thereby addressing these challenges effectively. The Faster R-CNN model is trained and optimized on a comprehensive dataset of tomato plants collected under diverse field conditions for real-time detection. To enhance robustness and reliability in challenging environments, sensor fusion techniques integrating RGB and depth information are employed. This approach is expected to significantly reduce false positives and missed detections, improving the overall efficiency of autonomous picking robots. The proposed solution not only addresses critical inefficiencies in the tomato harvesting process but also advances the application of deep learning models in precision agriculture, promoting sustainable and efficient farming practices.

In the neck part of a two-stage object detection network, feature fusion is generally carried out in either a top-down or bottom-up manner. However, two types of imbalance may exist: feature imbalance in the neck of the model and gradient imbalance in the region of interest extraction layer due to the scale changes of objects. The deeper the network is, the more abstract the learned features are, that is to say, more semantic information can be extracted. However, the extracted image background, spatial location, and other resolution information are less. In contrast, the shallow part can learn little semantic information, but a lot of spatial location information. We propose the Both Ends to Centre to Multiple Layers (BEtM) feature fusion method to solve the feature imbalance problem in the neck and a Multi-level Region of Interest Feature Extraction (MRoIE) layer to solve the gradient imbalance problem. In combination with the Region-based Convolutional Neural Network (R-CNN) framework, our Balanced Feature Fusion (BFF) method offers significantly improved network performance compared with the Faster R-CNN architecture. On the MS COCO 2017 dataset, it achieves an average precision (AP) that is 1.9 points and 3.2 points higher than those of the Feature Pyramid Network (FPN) Faster R-CNN framework and the Generic Region of Interest Extractor (GRoIE) framework, respectively.

Existing segmentation and augmentation techniques on convolutional neural network (CNN) has produced remarkable progress in object detection. However, the nominal accuracy and performance might be downturned with the photometric variation of images that are directly ignored in the training process, along with the context of the individual CNN algorithm. In this paper, we investigate the effect of a photometric variation like brightness and sharpness on different CNN. We observe that random augmentation of images weakens the performance unless the augmentation combines the weak limits of photometric variation. Our approach has been justified by the experimental result obtained from the PASCAL VOC 2007 dataset, with object detection CNN algorithms such as YOLOv3 (You Only Look Once), Faster R-CNN (Region-based CNN), and SSD (Single Shot Multibox Detector). Each CNN model shows performance loss for varying sharpness and brightness, ranging between −80% to 80%. It was further shown that compared to random augmentation, the augmented dataset with weak photometric changes delivered high performance, but the photometric augmentation range differs for each model. Concurrently, we discuss some research questions that benefit the direction of the study. The results prove the importance of adaptive augmentation for individual CNN model, subjecting towards the robustness of object detection.

Knowledge of the number and distribution of oil palm trees during the crop cycle is vital for sustainable management and predicting yields. The accuracy of the conventional image processing method is limited for the hand-crafted feature extraction method and the overfitting problem occurs due to the insufficient dataset. We propose a modification of the Faster Region-based Convolutional Neural Network (FRCNN) for palm tree detection to reduce the overfitting problem and improve the detection accuracy. The enhanced FRCNN (EFRCNN) leads to improved performance for detecting objects (in the same image) when they are of multiple sizes by using a feature concatenation method. Transfer learning based on a ResNet50 model is used to extract the features of the input image. High-resolution images of oil palm trees from a drone are used to form the data set, containing mature, young, and mixed oil palm tree regions. We train and test the EFRCNN, the FRCNN, a CNN used recently for oil palm image detection, and two standard methods, namely, the support vector machine (SVM) and template matching (TM). The results reveal an overall accuracy of ≥96.8% for the EFRCNN on the three test sets. The accuracy is higher than the CNN and FRCNN and substantially higher than SVM and TM. For large-scale plantations, the accuracy improvement is significant. This research provides a method for automatically counting the oil palm trees in large-scale plantations.

Distinguishing between primary clear cell carcinoma of the liver (PCCCL) and common hepatocellular carcinoma (CHCC) through traditional inspection methods before the operation is difficult. This study aimed to establish a Faster region-based convolutional neural network (RCNN) model for the accurate differential diagnosis of PCCCL and CHCC. In this study, we collected the data of 62 patients with PCCCL and 1079 patients with CHCC in Beijing YouAn Hospital from June 2012 to May 2020. A total of 109 patients with CHCC and 42 patients with PCCCL were randomly divided into the training validation set and the test set in a ratio of 4:1.The Faster RCNN was used for deep learning of patients' data in the training validation set, and established a convolutional neural network model to distinguish PCCCL and CHCC. The accuracy, average precision, and the recall of the model for diagnosing PCCCL and CHCC were used to evaluate the detection performance of the Faster RCNN algorithm. A total of 4392 images of 121 patients (1032 images of 33 patients with PCCCL and 3360 images of 88 patients with CHCC) were uesd in test set for deep learning and establishing the model, and 1072 images of 30 patients (320 images of nine patients with PCCCL and 752 images of 21 patients with CHCC) were used to test the model. The accuracy of the model for accurately diagnosing PCCCL and CHCC was 0.962 (95% confidence interval [CI]: 0.931-0.992). The average precision of the model for diagnosing PCCCL was 0.908 (95% CI: 0.823-0.993) and that for diagnosing CHCC was 0.907 (95% CI: 0.823-0.993). The recall of the model for diagnosing PCCCL was 0.951 (95% CI: 0.916-0.985) and that for diagnosing CHCC was 0.960 (95% CI: 0.854-0.962). The time to make a diagnosis using the model took an average of 4 s for each patient. The Faster RCNN model can accurately distinguish PCCCL and CHCC. This model could be important for clinicians to make appropriate treatment plans for patients with PCCCL or CHCC.

In the past few years, automatic building detection in aerial images has become an emerging field in computer vision. Detecting the specific types of houses will provide information in urbanization, change detection, and urban monitoring that play increasingly important roles in modern city planning and natural hazard preparedness. In this paper, we demonstrate the effectiveness of detecting various types of houses in aerial imagery using Faster Region-based Convolutional Neural Network (Faster-RCNN). After formulating the dataset and extracting bounding-box information, pre-trained ResNet50 is used to get the feature maps. The fully convolutional Region Proposal Network (RPN) first predicts the bounds and objectness score of objects (in this case house) from the feature maps. Then, the Region of Interest (RoI) pooling layer extracts interested regions to detect objects that are present in the images. To the best of our knowledge, this is the first attempt at detecting houses using Faster R-CNN that has achieved satisfactory results. This experiment opens a new path to conduct and extent the works not only for civil and environmental domain but also other applied science disciplines.

The present paper exposes a system for detection, classification, and grip of occluded objects by machine vision, artificial intelligence, and an anthropomorphic robot, to generate a solution for the subjection of elements that present occlusions. The deep learning algorithm used is based on Convolutional Neural Networks (CNN), specifically Fast R-CNN (Fast Region-Based CNN) and DAG-CNN (Directed Acyclic Graph CNN) for pattern recognition, the three-dimensional information of the environment was collected through Kinect V1, and tests simulations by the tool VRML. A sequence of detection, classification, and grip was programmed to determine which elements present occlusions and which type of tool generates the occlusion. According to the user's requirements, the desired elements are delivered (occluded or not), and the unwanted elements are removed. It was possible to develop a program with 88.89% accuracy in gripping and delivering occluded objects using networks Fast R-CNN and DAG-CNN with achieving of 70.9% and 96.2% accuracy respectively, detecting elements without occlusions for the first net and classifying the objects into five tools (Scalpel, Scissor, Screwdriver, Spanner, and Pliers), with the second net. The grip of occluded objects requires accurate detection of the element located at the top of the pile of objects to remove it without affecting the rest of the environment. Additionally, the detection process requires that a part of the occluded tool be visible to determine the existence of occlusions in the stack

The objective of this paper is to detect tomato leaf disease using Faster region-based convolutional neural network (R-CNN). The tomato leaf disease recognition system utilizes a dataset consisting of healthy tomato leaves and eight leaf diseases, including early blight, late blight, leaf mold, mosaic virus, septoria, spider mites, yellow leaf curl virus, and leaf miner. The dataset is obtained from various sources, such as Kaggle, Google Images, Bing Images, and Roboflow Universe. Pre-processing techniques, including collage, tile, static crop, and resize, are applied to prepare the dataset for training. Data augmentation methods, such as flipping, 90° rotation, exposure adjustment, and hue modification, are applied to enhance the model’s robustness and generalize its performance. Specifically, we implemented Faster R-CNN as part of Detectron2 using its base models and configurations. The results demonstrate that the X101-FPN base model for Faster R-CNN with the default configurations of Detectron2 is efficient and general enough to be applied to defect detection. This approach results in an average precision (AP) detection score of 87.01% for validation results.

Modern people who value healthy eating habits have shown increasing interest in plum (Prunus mume) fruits, primarily owing to their nutritiousness and proven efficacy. As consumption increases, it becomes important to monitor work to prevent Prunus mume fruits from falling out. Moreover, determining the growth status of Prunus mume is also crucial and is attracting increasing attention. In this study, convolutional neural network (CNN)-based deep learning object detection was developed using RGBD images collected from Prunus mume farms. These RGBD images consider various environments, including the depth information of objects in the outdoor field. A faster region-based convolutional neural network (R-CNN), EfficientDet, Retinanet, and Single Shot Multibox Detector (SSD) were applied for detection, and the performance of all models was estimated by comparing their respective computing speeds and average precisions (APs). The test results show that the EfficientDet model is the most accurate, and SSD MobileNet is the fastest among the four models. In addition, the algorithm was developed to acquire the growth status of P. mume fruits by applying the coordinates and score values of bounding boxes to the depth map. Compared to the diameters of the artificial Prunus mume fruits used as the experimental group, the calculated diameters were very similar to those of the artificial objects. Collectively, the results demonstrate that the CNN-based deep learning Prunus mume detection and growth estimation method can be applied to real farmlands.

Small unmanned aerial vehicles applications had erupted in many fields including conservation management. Automatic object detection methods for such aerial imagery were in high demand to facilitate more efficient and economical wildlife management and research. This paper aimed to detect hoofed animals in aerial images taken from a quad-rotor in Southern Africa. Objects captured in this way were small both in absolute pixels and from an object-to-image ratio point of view, which were not perfectly suit for general purposed object detectors. We proposed a method based on the iconic Faster region-based convolutional neural networks (R-CNN) framework with atrous convolution layers in order to retain the spatial resolution of the feature map to detect small objects. A good choice of anchors was of prime importance in detecting small objects. The performance of the proposed Faster R-CNN with atrous convolutional filters in the backbone network was proven to be outstanding in our scenario by comparing to other object detection architectures.

ABSTRACTAircraft detection is one of hot issues of remote sensing (RS) image interpretation. Different from existing methods which aim at detecting objects in regions of interest (ROI) of airports, in this work, we propose a novel and effective aircraft detection framework based on convolutional neural networks (CNN) to detect multi-scale targets in extremely large and complicated scenes. In particular, we design a constrained EdgeBoxes (CEdgeBoxes) approach to generate a modest number of target candidates quickly and precisely. Then, in order to overcome the drawbacks of using handcrafted features and traditional classifiers, a modified GoogLeNet combined with Fast Region-based CNN (R-CNN) is designed to extract useful features from RS images and then detect various kinds of multi-scale aircrafts. Most importantly, we propose a new multi-model ensemble method to decrease the false alarm rate (FAR) caused by the imbalanced distribution of complicated targets and backgrounds. Thorough experiments, which are conducted on the dataset acquired by QuickBird with a resolution of 0.6 m, demonstrate our method can effectively detect aircrafts in large scenes with low FARs.

In automated Chest X-Ray (CXR) screening process, foreign objects, such as coins/buttons, medical tubes and devices, and jewelries can adversely impact the performance. In an automated process, conventional machine learning algorithms did not separately consider them into account, and as a consequence, they results in false positive cases. In this paper, we address the use of Deep Neural Network (DNN) to detect circle-like foreign objects of difference sizes in CXRs. We present faster Region-based Convolutional Neural Network (R-CNN) for foreign object detection on a set of 400 publicly available CXR images hosted by LHNCBC, U.S. National Library of Medicine (NLM), National Institutes of Health (NIH). The proposed DNN achieved 97% precision, 90% recall, and 93% F1-score. The results are comparable with the existing techniques.