Employing Real-Time Object Detection for Visually Impaired People

For real-time object detection and speech alarms, Research offers a sophisticated blind aid solution that smoothly combines the YOLO algorithm with Open CV's DNN (Deep Neural Network) module. The main objective is to improve the safety and freedom of people with visual impairments by offering quick object recognition and audio feedback. The YOLO method, which is tuned for real-time inference, is used by the system to precisely recognize objects after using a webcam to record live video input. Then, using audio description, it produces speech notifications that provide crucial details about the things it has spotted. Because of its exceptional versatility, the research can provide speech outputs in the user's preferred language, increasing its usability and accessibility. Its versatility is further demonstrated by its capacity to precisely handle a variety of object classes, making it a priceless tool for greatly enhancing the lives of those who are blind or visually impaired. Challenges in real-time object detection include occlusion, scale variations, and cluttered environments. Researchers must navigate the trade-offs between accuracy and speed. Real- time object detection is pivotal in computer vision, enabling intelligent systems across diverse applications. Real-time object detection systems designed for assistive technologies are becoming increasingly important in empowering individuals with visual impairments. The research integrates the YOLO algorithm with OpenCV’s DNN module to deliver a highly responsive blind-aid solution capable of capturing live video through a webcam and processing it instantly. YOLO’s architecture, optimized for speed and accuracy, enables the system to detect and classify multiple objects within each video frame, even in dynamic or unpredictable environments. Once an object is identified, the system generates immediate speech output, providing descriptive audio alerts in the user’s preferred language, thus enhancing accessibility and user experience. This multilingual capability makes the solution versatile across different regions and cultures. Additionally, the system supports a wide range of object categories such as vehicles, household items, and obstacles helping visually impaired users navigate daily surroundings more safely and independently. However, the implementation faces challenges, including handling occlusions, varying object scales, low-light conditions, and cluttered backgrounds. These factors require careful balancing between detection accuracy and processing speed to maintain real-time performance. Despite these challenges, the integration of advanced deep learning models with user-friendly audio interfaces demonstrates significant potential to improve mobility, safety, and overall quality of life for people with visual impairments.

The real-time detection of objects and persons in their approach remains vital for applications that need safety measures security protocols and efficiency in autonomous systems and surveillance operations and industrial automation. The proposed research creates a durable real-time detection system through sensor combination using ultrasonic along with infrared and LiDAR and radar sensors and computer vision-based sensors to enhance detection accuracy and response times in changing environmental scenarios. The method starts by processing data gathered from arrays of multiple sensors through optimized filtering techniques and extraction methods before machines learn to classify objects while reducing false detection instances. The assessment of performance takes place in different environmental conditions to track both detection speed along with accuracy levels and system reliability. Sensor fusion enables real-time detection systems to perform better because it reduces the impact of environmental changes and sensor distortions. System capabilities increase in different operational areas when researchers demonstrate pre-processing optimization works alongside intelligent data processing systems. The research findings combine autonomous navigation systems with smart surveillance technology together with safety protocols for industrial security which enable real-time scalability and reduced risk elements. Research demonstrates a specific achievement through its analysis that machines learn better when combined with multi-sensor integration over single-sensor models which improves system reliability when used in real-world applications. Multi-sensor arrays and advanced processing techniques generate enhanced system responsiveness alongside increased adaptability and reliability thus improving detection systems within industrial security measures and automation operations.

IoT Enabled Automated Object Recognition for the Visually Impaired

Over the past few years, deep learning has played a tremendous role in real time object detection, recognition and classification. Today, algorithms use deep learning not only for simple object detection but have also paved way for vehicle detection that is complex situation such as Indian roads. Different deep learning models can learn features of varied complexity and perform according to surrounding environment in which they are deployed. In this paper a comparison of six models is performed for detection of vehicles on roads that are unstructured or unconstrained. Till date, deep learning algorithms are being used for vehicle (car, bus, truck, motorcycle etc.) detection. A dataset based on Indian road scenario has been used for training on models: faster RCNN and Single Shot Detector (SSD) combined with convolution classifiers mobilenet, resnet and inceptionnet. The six models are compared by evaluating mean average precision (mAP) and classification time complexity for IDD dataset. The observations suggested faster RCNN Resnet50 resolves the trade-off of time and accuracy. Whereas SSD mobilenet V1 takes 31.89% less time than faster RCNN resnet101. On the flipped side, faster RCNN resnet101is 34.38% more accurate than SSD mobilenet v1.

Innovative soft computing-enabled cloud optimization for next-generation IoT in digital twins

With the rapid development of autonomous driving, real-time object detection on 360° images becomes more and more important. In this paper, we propose a panoramic virtual dataset for training object detectors on 360° images. The most important feature of our dataset includes (1) an auto-generated city scene is created for rendering 360° dataset. (2) annotation work for this dataset is automatic. In addition, we propose a modified YOLOv3 model called Pano-YOLO for real-time panoramic object detection. Compared with YOLOv3, mAP of Pano-YOLO drops 0.39%. While speed is 32.47% faster. Experiments are performed to show that models trained on our virtual dataset can be applied in real world. And Pano-YOLO is capable of real-time object detection task on high-resolution 360° panoramic images and videos.

Tiny object detection is an important and challenging object detection subfield. However, many of its numerous applications (e.g., human tracking and marine rescue) have tight detection time constraints. Namely, two-stage object detectors are too slow to fulfill the real-time detection needs, whereas one-stage object detectors have an insufficient detection accuracy. Consequently, enhancing the detection accuracy of one-stage object detectors has become an essential aspect of real-time tiny objects detection. This work presents a novel model for real-time tiny objects detection based on a one-stage object detector YOLOv5. The proposed YOLO-P4 model contains a module for detecting tiny objects and a new output prediction branch. Next, a weighted bi-directional feature pyramid network (BiFPN) is introduced in YOLO-P4, yielding an improved model named YOLO-BiP4 that enhances the YOLO-P4 feature input branches. The proposed models were tested on the Tiny-Person dataset, demonstrating that the YOLO-BiP4 model outperforms the original model in detecting tiny objects. The model satisfies the real-time detection needs while obtaining the highest accuracy compared to existing one-stage object detectors.

Computer vision (CV) and human-computer interaction (HCI) are essential in many technological fields. Researchers in CV are particularly interested in real-time object detection techniques, which have a wide range of applications, including inspection systems. In this study, we design and implement real-time object detection and recognition systems using the single-shoot detector (SSD) algorithm and deep learning techniques with pre-trained models. The system can detect static and moving objects in real-time and recognize the object's class. The primary goals of this research were to investigate and develop a real-time object detection system that employs deep learning and neural systems for real-time object detection and recognition. In addition, we evaluated the free available, pre-trained models with the SSD algorithm on various types of datasets to determine which models have high accuracy and speed when detecting an object. Moreover, the system is required to be operational on reasonable equipment. We tried and evaluated several deep learning structures and techniques during the coding procedure and developed and proposed a highly accurate and efficient object detection system. This system utilizes freely available datasets such as MS Common Objects in Context (COCO), PASCAL VOC, and Kitti. We evaluated our system's accuracy using various metrics such as precision and recall. The proposed system achieved a high accuracy of 97% while detecting and recognizing real-time objects.

Real-time object detection in indoor settings is a challenging area of computer vision, faced with unique obstacles such as variable lighting and complex backgrounds. This field holds significant potential to revolutionize applications like augmented and mixed realities by enabling more seamless interactions between digital content and the physical world. However, the scarcity of research specifically fitted to the intricacies of indoor environments has highlighted a clear gap in the literature. To address this, our study delves into the evaluation of existing datasets and computational models, leading to the creation of a refined dataset. This new dataset is derived from OpenImages v7[14], focusing exclusively on 32 indoor categories selected for their relevance to real-world applications. Alongside this, we present an adaptation of a CNN detection model, incorporating an attention mechanism to enhance the model’s ability to discern and prioritize critical features within cluttered indoor scenes. Our findings demonstrate that this approach is not just competitive to existing state-of-the-art models in accuracy and speed but also opens new avenues for research and application in the field of real-time indoor object detection.

Real-time object detection and ranging of multiple objects on the road are the essential tasks in the field of autonomous driving. In this paper, we introduce a system for simultaneous detection and ranging of vehicles, people, non-motor vehicles and lanes based on RGB-D images. Among them, the detection of vehicles, people and non-motor vehicles belongs to general detection task and the lane detection belongs to segmentation task. In order to improve the accuracy and speed, we use two networks to complete these two tasks. We propose a real-time synchronization method with multi-GPU, which achieves separate training and simultaneous detection of lane detectior and vehicle, people and non-motor vehicle detector. We also propose a center-selective ranging module based on binocular ranging technology to distance the detected object. The system reaches nearly 15 FPS with four 1080Ti GPUs. We construct datasets about these problems including daytime and night in which the system achieves high accuracy. A real-time test of the system on the streets of Tianjin, China has been conducted by us, it has proved that the system can be applied to actual driving.

Dental caries, a widespread oral health issue, necessitates early and accurate detection to ensure effective treatment and prevention. Traditional diagnostic methods often involve manual inspection and X-ray imaging, which can be time-consuming and subject to human error. This study introduces a cutting-edge approach by integrating machine learning with the YOLO (You Only Look Once) algorithm and leveraging the computational power of a Raspberry Pi to automate and enhance caries detection. The research focuses on developing a real-time, portable system for detecting dental caries from intraoral images using a Raspberry Pi. The YOLO algorithm, known for its efficiency in real-time object detection, is employed to train a model capable of identifying and classifying carious lesions in dental radiographs with high precision. This study aims to advance dental diagnostic capabilities by combining machine learning and embedded systems technology. The use of the YOLO algorithm with Raspberry Pi not only enhances the accuracy and speed of caries detection but also makes this advanced technology accessible and practical for everyday clinical use. Key Words: Dental caries, Open cv ,raspberry pi4 ,yoloV7

The rapid integration of unmanned aerial vehicles (UAVs) into civil, defense, and emergency response sectors has fundamentally transformed data collection and analysis methodologies in time-critical scenarios. UAVs have become indispensable tools in missions where human access is restricted, dangerous, or logistically challenging. Their capacity to capture high-resolution real-time aerial imagery makes them vital assets in search-and-rescue operations, post-disaster damage assessments, criminal investigations, and surveillance monitoring. This research addresses the fundamental challenge of implementing efficient real-time object detection and recognition systems that operate with minimal human intervention while accommodating the inherent computational limitations of onboard UAV hardware. This study proposes an innovative approach leveraging external computational resources by transmitting UAV video feeds to ground-based processing systems where advanced YOLOv8 neural network models perform sophisticated real-time object detection and classification. The YOLOv8 architecture represents an optimal balance between processing speed and detection accuracy. This methodology significantly enhances recognition capabilities without requiring modifications to existing UAV hardware configurations, ensuring broad compatibility and cost-effectiveness. The system demonstrates remarkable performance metrics: preprocessing time averaging 22.5 ms, inference time of 5.5 ms, and visualization rendering within 3 ms per frame. Multiple specialized datasets were utilized, including Top-View Drone Car Detection Dataset and YOLO HighVis Person Detection Dataset, ensuring robust multi-class object recognition capabilities. Experimental results conclusively confirm the technical and practical feasibility of seamlessly integrating AI-based detection systems into existing UAV monitoring infrastructures, achieving stable operation with accuracy fluctuations not exceeding 1% at 5m, 10% at 50m, and 35% at 100+ meters, thereby significantly enhancing the capabilities and effectiveness of future autonomous aerial surveillance platforms.

Low-cost real-time aerial object detection and GPS location tracking pipeline

Aerial surveillance is considered a developing sphere. One of the reasons is because the YOLO-8 model can improve both detection accuracy and speed to a great extent. The research used the YOLO-8(You Only Look Once) model to detect vehicles and humans through drone imagery in real time an application noted for its speed and accuracy under varying environmental conditions to know how effective it would be. Results shows YOLO-8 model performs better than existing methods with high level performance feature both robust accuracy and speed, an approach aimed to enhance detection accuracy and processing speed while addressing this challenge, developing a method that combines the YOLO-8 model with drone imagery for real-time detection of vehicles and people. The applied model in this greatly improve detection precision and speed, it suitable for dynamic surveillance environments. Object recognition is effective high altitude drone-based person detection. The YOLOv8 model was able to detect objects in a drone view that acted as a person detector, achieving an application for most cases of person object in the image with 0.91% accuracy. The images were captured by drones far from objects since they had a 900 × 900-pixel resolution and runtime speed of 238.41 ms, by information about these objects was very vital. This led to innovations in drone-based detection systems powered by deep learning models, YOLOv8 which is very effective in vehicle detection using drone image data.

The Smart Hat is an advanced wearable assistive system designed to improve mobility and independence for visually impaired users. It integrates voice-guided navigation, real-time object detection, ultrasonic obstacle sensing, and contextual feedback to enable safe and independent movement. Built on a Raspberry Pi 5 platform with edge computing capabilities, the system ensures low-latency processing while utilizing secure cloud services (Firebase, Firestore, Google Cloud Platform) for data storage and analysis. Real-time remote monitoring is facilitated through Ngrok. Experimental validation demonstrates robust performance in obstacle avoidance, accurate navigation, and responsive feedback across diverse environments. By enhancing user autonomy and confidence, this innovative solution highlights the transformative potential of wearable assistive technologies in improving accessibility for the visually impaired.