Artificial intelligence‐empoweredvision‐based self driver assistance system for internet of autonomous vehicles

With the development of the vehicular communications technology, roadside units (RSUs) placement problem has recently received considerable attentions in vehicular ad hoc networks (VANETs). This paper addresses the roadside units (RSUs) placement problem for traffic flow coverage requirement number in vehicular ad hoc networks (VANETs). Given a set of road segments, some traffic flows and a coverage requirement number n, the problem is how to find the optimal placement of RSUs, such that each traffic flow is covered by at least n RSUs. We first investigate full RSUs placement problem, which place all the RSUs on the given road segments totally. We prove that this problem is NP-hard. Then, we propose a greedy algorithm to solve the problem and theoretical analysis is given. We also study incremental RSUs placement problem, which place the partial RSUs based on the deployed RSUs on the given road segments. Based on the proposed greedy algorithm, we also propose a algorithm to solve the incremental RSUs placement problem. Extensive simulations have been conducted to show the performance of our proposed algorithms is superior to the other algorithms.

Object localization and detection is the emerging area of computer vision and image processing that finds out the location of the object in the video frames or in the digital images. Object localization and detection have many challenges like occlusion, scale variations, intraclass similarities, illumination conditions, pose variations, etc. Multi-view object detection focuses on different views of objects like the top, bottom, side view, etc. We aim to discuss the different Object detection models based on Machine learning and Deep neural network approaches in a multi-view environment. We also discuss different datasets used for object detections and their applications. We apply some object detection models like SSD and Faster R-CNN to specific object categories of Open Image Dataset V6 and compare the results based on mAP (Mean Average Precision).KeywordsObject detectionConvolution neural networksR-CNNFast R-CNNFaster R-CNNEfficientDetCenterNet

Real-time video surveillance, especially CCTV systems, requires fast and accurate face detection. Object detection models with slow inference times are ineffective in real-time. This study addresses this challenge by improving the inference speed of the YOLOv8 model, a leading object detection framework known for its accuracy and speed. We focus on pruning the model's architecture, particularly the P5 head section, which detects larger objects. According to Bochkovskiy's 2020 research, this modification enhances the model's performance specifically for medium and small objects in CCTV footage. The standard YOLOv8 model and its modified version were compared for inference time, mean Average Precision (mAP), and model weight. The pruned YOLOv8 model cuts inference time by 15.56%, from 4.5 ms to 3.8 ms, and reduces model weight. The advantages mentioned above are offset by a 1.6% decrease in mean average precision. This research advances object detection technology by demonstrating architectural modifications' efficacy. These changes make the model faster and lighter, making it suitable for real-time surveillance. The accuracy trade-off is slight. The implications of these findings are crucial for implementing efficient object detection systems in CCTV surveillance. These findings also lay the groundwork for future research to improve such systems' speed-accuracy trade-off.

Intelligent Transportation Systems (ITS) deployment became a need nowadays in order to improve quality and efficiency of transportation systems. However, an effective distribution of Roadside Units (RSUs) is considered to be one of the main challenges for deployment of roadside networks, especially due to the wide range of influencing factors that can affect the distribution process. Some of these influencing factors are traffic, topological and infrastructure characteristics of the roads and technology used. This paper introduces the Cumulative Weight based Method (CWM) as a solution to the placement problem in the urban, rural and mountainous areas. The CWM gets the weight of each Site of Interest (SoI) and adds the weights of the surrounding neighbors to its weight and considers the highest weight first in the distribution process. The CWM during the current state of development considers working with the radius of RSUs and connectivity requirements. Moreover, it will be influenced by many other factors. The tests conducted on selected areas in Rostock (Germany) and Spiringen (Switzerland) showed: (1) a reduction in the number of SoIs compared to the original number acquired during the scanning process; (2) only the highest priority SoIs are chosen as the best location for an RSU placement; (3) 3D space calculations for distance on mountainous areas gave a different, more accurate results than 2D space calculations.

Recently, edge computing has emerged as a prevailing paradigm in applying deep learning-based object detection models, offering a promising solution for time-sensitive tasks. However, existing edge object detection faces several challenges: 1) These methods struggle to balance detection precision and model lightweightness. 2) Existing generalized edge-deployment designs offer limited adaptability for object detection. 3) Current works lack real-world evaluation and validation. To address these challenges, we propose the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><u>E</u>dge <u>D</u>etection <u>Toolbox</u></i> (ED-TOOLBOX), which leverages generalizable plug-and-play components to enable edge-site adaptation of object detection models. Specifically, we propose a lightweight <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Reparameterized Dynamic Convolutional Network</i> (Rep-DConvNet) that employs a weighted multi-shape convolutional branch structure to enhance detection performance. Furthermore, ED-TOOLBOX includes a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Sparse Cross-Attention</i> (SC-A) network that adopts a localized-mapping-assisted self-attention mechanism to facilitate a well-crafted <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Joint Module</i> in adaptively transferring features for further performance improvement. Moreover, we propose an <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Efficient Head</i> for the classification and location modules to achieve more efficient prediction. Additionally, in practical industrial scenarios, we identify that helmet detection-one of the most representative edge object detection tasks-overlooks band fastening, which introduces potential safety hazards. To address this, we build a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Helmet Band Detection Dataset</i> (HBDD) and apply an edge object detection model optimized by the ED-TOOLBOX to tackle this real-world task. Extensive experiments validate the effectiveness of components in ED-TOOLBOX. In visual surveillance simulations, ED-TOOLBOX-assisted edge detection models outperform six <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">state-of-the-art</i> methods, enabling real-time and accurate detection. These results demonstrate that our approach offers a superior solution for edge object detection.

Sea turtles exhibit high migratory rates and occupy a broad range of habitats, which in turn makes monitoring these taxa challenging. Applying deep learning (DL) models to vast image datasets collected from citizen science programs can offer promising solutions to overcome the challenge of monitoring the wide habitats of wildlife, particularly sea turtles. Among DL models, object detection models, such as the You Only Look Once (YOLO) series, have been extensively employed for wildlife classification. Despite their successful application in this domain, detecting objects in images with complex backgrounds, including underwater environments, remains a significant challenge. Recently, instance segmentation models have been developed to address this issue by providing more accurate classification of complex images compared to traditional object detection models. This study compared the performance of two state-of-the-art DL methods namely; the object detection model (YOLOv5) and instance segmentation model (YOLOv5-seg), to detect and classify sea turtles. The images were collected from iNaturalist and Google and then divided into 64% for training, 16% for validation, and 20% for test sets. Model performance during and after finishing training was evaluated by loss functions and various indexes, respectively. Based on loss functions, YOLOv5-seg demonstrated a lower error rate in detecting rather than classifying sea turtles than the YOLOv5. According to mean Average Precision (mAP) values, which reflect precision and recall, the YOLOv5-seg model showed superior performance than YOLOv5. The mAP0.5 and mAP0.5:0.95 for the YOLOv5 model were 0.885 and 0.795, respectively, whereas for the YOLOv5-seg, these values were 0.918 and 0.831, respectively. In particular, based on the loss functions and classification results, the YOLOv5-seg showed improved performance for detecting rather than classifying sea turtles compared to the YOLOv5. The results of this study may help improve sea turtle monitoring in the future.

Object detection with deep learning model has achieved good results in many fields, but in some fields that think highly of data privacy, such as medical care, its applications is greatly limited by data. And Federated Learning allows clients to train a model together, while leaving their data in the local, without sharing with the server or other clients. Using the methods of Federated Learning, such as Federated Averaging(FedAvg), to train models can provide privacy, security benefits. Nonetheless, there is little experiment applying Federated Learning algorithms to train the model with a large number of parameters, such as deep learning object detection model. With non-IID data, the accuracy of object detection model trained by FedAvg reduces significantly, and need more rounds to coverage. In this work, we use Kullback-Leibler divergence(KLD) measure the weights divergence between different model trained with non-IID data. And we propose a useful scheme to improve FedAvg based Abnormal Weights Supression, reducing the influence of the weights divergence caused by non-IID and unbalanced data. As a representative of object detection, we choose Single Shot MultiBox Detector(SSD) as the base model. The results of the experiments show that the Mean Average Precision(mAP) get obvious improvement in Pascal VOC 2007 test dataset.

Recent object detection models show promising advances in their architecture and performance, expanding potential applications for the benefit of persons with blindness or low vision (pBLV). However, object detection models are usually trained on generic data rather than datasets that focus on the needs of pBLV. Hence, for applications that locate objects of interest to pBLV, object detection models need to be trained specifically for this purpose. Informed by prior interviews, questionnaires, and Microsoft's ORBIT research, we identified thirty-five objects pertinent to pBLV. We employed this user-centric feedback to gather images of these objects from the Google Open Images V6 dataset. We subsequently trained a YOLOv5x model with this dataset to recognize these objects of interest. We demonstrate that the model can identify objects that previous generic models could not, such as those related to tasks of daily functioning - e.g., coffee mug, knife, fork, and glass. Crucially, we show that careful pruning of a dataset with severe class imbalances leads to a rapid, noticeable improvement in the overall performance of the model by two-fold, as measured using the mean average precision at the intersection over union thresholds from 0.5 to 0.95 (mAP50-95). Specifically, mAP50-95 improved from 0.14 to 0.36 on the seven least prevalent classes in the training dataset. Overall, we show that careful curation of training data can improve training speed and object detection outcomes. We show clear directions on effectively customizing training data to create models that focus on the desires and needs of pBLV.Clinical Relevance- This work demonstrated the benefits of developing assistive AI technology customized to individual users or the wider BLV community.

Vehicular Ad-hoc Networks (VANETs) form the basis for critical services that improve traffic safety and alleviate traffic congestion. The reliability of VANET-based services and applications that are based solely on vehicle-to-vehicle (V2V) communications, however, is hindered due primarily to limited and often fluctuating V2V communications. To address this limitation, Road-Side Units (RSU) have been proposed to complement V2V communications by providing stable event and data brokering capability. Effective placement of the RSUs is a key requirement in improving reliability of VANET services. This poster describes a novel Voronoi network-based algorithm for the effective placement of RSUs. The reliability metric considered in placing the RSUs involves bounding both the delay incurred by communication packets and packet loss, which in turn ensure timeliness and correct operation of the VANET services.

Wheat is a primary carbohydrate-rich food commodity in the world, and the health of the wheat plants influences its production. Farmers can face a challenge due to decreased productivity caused by infected plants. However, wheat farmers have used conventional methods to survey diseases; however, these methods are often ineffective and inefficient, taking a lot of time and labor. And for enhanced wheat production, new strategies must be employed. Deep learning, specifically computer vision-based techniques, has proven significant capability in tasks like image classification, segmentation, and object detection. Deep learning techniques such as You Only Look Once (YOLO) models are state-of-the-art neural network algorithms used for accurate object detection. this study presents a comparative evaluation of two state-of-the-art object detection models, YOLOv5 and YOLOv8, for disease detection. Data augmentation techniques such as image noise, rotation, and flipping were implemented to improve the model’s performance during the training phase. The model’s performance was evaluated using metrics such as precision, recall, F1-score, and mean Average Precision (mAP).. The results show that the YOLOv5 and YOLOV8 models achieved good performance. They were able to detect the healthy and disease in images, These findings demonstrate that while both models are highly effective, but YOLOv8 offers greater robustness and accuracy for real-time detection.

Improved YOLOv7 model for underwater sonar image object detection

Backdoor Attacks with Wavelet Embedding: Revealing and enhancing the insights of vulnerabilities in visual object detection models on transformers within digital twin systems

In the "blind review" mode for technical bid evaluation within the power industry, review experts must make impartial judgments based on anonymized technical response documents. However, these documents often contain a large amount of complex graphical content, which existing general Optical Character Recognition (OCR) technology struggles to accurately identify. To address this, this study first constructs a specialized image dataset covering typical power industry response document scenarios. Subsequently, an improved You Only Look Once (YOLO) object detection model is developed, incorporating an anchor box clustering strategy optimized for small, densely packed power symbols and a multi-scale feature fusion mechanism. Then, a local contextual relationship inference module based on Graph Neural Networks is designed and integrated. Finally, an end-to-end recognition pipeline from image input to structured information output is constructed. Experimental results indicate that the improved model achieves a mean Average Precision (mAP) of 90.0% in key equipment detection tasks; in topology relationship restoration experiments, the average Graph Edit Distance (GED) is 0.172; in end-to-end efficiency experiments simulating real blind review scenarios, the average processing time per document is only 8.7 seconds, with an information completeness rate of 98.2%. The research demonstrates that the YOLO-based object detection and relationship modeling method, customized for the blind review mode, can effectively address the challenge of recognizing complex image content in power response documents, providing reliable technical support for the efficiency and fairness of blind reviews.

The article discusses a texture operator called Local Binary Patterns (LBP) and its applications in image processing and object detection. We provide a description of the algorithm for computing LBP together with a rationale for using LBP as a feature for object detection and image recognition. Based on the algorithm we show that LBP features have a low computational overhead compared to more complicated image features such as the commonly used SIFT or SURF features or neural network based approaches because they exploit the use of extremely fast bitwise and integer operations of the CPU. We demonstrate that LBP is robust to changes in brightness, contrast, image rotation, image scale. We develop two enhancements for LBP that improve its resistance to camera noise and enhance the discriminative power of LBP when it is used as a feature for machine learning algorithms. We present the results on a challenging real-world object detection task. Keywords: computer vision, object detection, local binary patterns.

Intelligent Transport System uses real time traffic information and thus in an urban environment the time delay in shifting patients to hospital is reduced increasing the possibility of saving life. Road traffic congestion plays a major obstruction for the ambulance from its location to the hospital.In the proposed system, traffic status is monitored by the Road Side Units (RSUs). For sharing the traffic information status, RSUs decides the route and guides the ambulance to move on the less congested path. During transition of the patient health parameters will be monitored in the ambulance and broadcasted to the medical consultant. On arrival of the patient to hospital necessary arrangements are made to receive the patient for further investigation and treatment.During transition, ambulance broadcasts for short path/shortest time to the destination. After realizing congestion in different routes to the destination, the ultimate path to encounter the congestion is to take shortest path using metro rail. Medical consultant arranges an ambulance to receive the patient from nearest metro station. On arrival of the patient to hospital, source ambulance receives a confirmation message.