Computer Vision for Increased Efficiency of Delivery Drones Using NVIDIA Jetson Toolkit

Counterfeit and substandard pharmaceuticals represent a critical global health crisis, with the World Health Organisation (WHO) reporting that falsified medicines comprise 10% of the global pharmaceutical trade, constituting one of the fastest-growing grey economies worldwide. This illicit market affects all regions, including high-income countries, causing devastating health and economic consequences that contribute to increased mortality and morbidity rates. The problem is particularly severe in developing nations with inadequate regulatory systems. Mobile health (mHealth) technologies have emerged as promising solutions for enhancing pharmaceutical supply chain integrity. However, comprehensive frameworks that integrate multiple authentication mechanisms remain limited in addressing the growing counterfeit drug crisis. The primary objective of this study is to design and implement a novel mobile health framework that integrates innovative packaging technology and computer vision to enhance pharmaceutical integrity and patient safety. This innovative approach enables consumers to authenticate genuine drugs and detect counterfeit/spurious products through advanced Quick Response (QR) code verification systems and artificial intelligence- powered tablet recognition capabilities. The proposed system utilises individual strip QR codes that enable real-time scanning at the point of sale to verify drug authenticity, directly addressing critical gaps identified in current pharmaceutical authentication methods. To overcome the practical challenge of expiration date loss when medication strips are cut at pharmacies, we developed a computer vision-based Artificial Intelligence (AI) model that automatically recognises the number of tablets remaining in a strip and correlates this information with the unique Identifier (ID). This approach leverages recent advances in computer vision for pharmaceutical applications and automated packaging inspection technologies. Each medication strip is assigned to an individual customer at the time of purchase, with pharmacists recording detailed customer information to ensure comprehensive tracking and accountability throughout the pharmaceutical supply chain. The integrated mobile application creates a robust anti-counterfeiting ecosystem by combining secure QR code authentication with intelligent visual recognition capabilities. The computer vision model provides accurate tablet counting and strip identification, maintaining continuity of medication tracking even when packaging is modified during dispensing processes, thus significantly enhancing supply chain transparency. This dual-authentication approach builds consumer confidence in pharmaceutical authenticity while directly addressing critical vulnerabilities identified in current regulatory frameworks. This comprehensive mobile health solution provides a scalable, evidence-based approach to pharmaceutical authentication that can be readily implemented across diverse healthcare systems globally, offering substantial potential for reducing the circulation of falsified medicines and improving patient safety outcomes in the ongoing battle against the pandemic of counterfeit pharmaceuticals. To overcome the practical challenge of expiration date loss when medication strips are cut at pharmacies, we developed a computer vision-based Artificial Intelligence (AI) model that automatically recognises the number of tablets remaining in a strip and correlates this information with the unique Identifier (ID). This approach leverages recent advances in computer vision for pharmaceutical applications and automated packaging inspection technologies. Each medication strip is assigned to an individual customer at the time of purchase, with pharmacists recording detailed customer information to ensure comprehensive tracking and accountability throughout the pharmaceutical supply chain. The integrated mobile application creates a robust anti-counterfeiting ecosystem by combining secure QR code authentication with intelligent visual recognition capabilities. The computer vision model provides accurate tablet counting and strip identification, maintaining continuity of medication tracking even when packaging is modified during dispensing processes, thus significantly enhancing supply chain transparency. This dual-authentication approach builds consumer confidence in pharmaceutical authenticity while directly addressing critical vulnerabilities identified in current regulatory frameworks. This comprehensive mobile health solution provides a scalable, evidence-based approach to pharmaceutical authentication that can be readily implemented across diverse healthcare systems globally, offering substantial potential for reducing the circulation of falsified medicines and improving patient safety outcomes in the ongoing battle against the pandemic of counterfeit pharmaceuticals.

With the rapid development of computer vision technology and the maturity of 2D object detection technology, 3D object detection has attracted more and more attention of scholars. As an extension of 2D object detection, 3D object detection can not only detect the object category and position in the image, but also output the spatial position and pose angle of the object in a certain 3D coordinate system. It has a considerable application prospects in automatic driving, robot operation and augmented reality. However, 3D object detection is much more difficult than 2D object detection, and it is very difficult to make and label the data set, which has high hardware requirements. At present, there is no dominant algorithm, and scholars use a variety of methods. In order to solve the above problems, this paper proposes a method of making and synthesising 3D object detection data sets. Based on the improved 2D object detection algorithm, 3D object detection of single RGB image is realised.

Computer vision (CV) is a subfield of artificial intelligence (AI) that trains computers to understand our visual world based on digital images. There are many successful applications of CV including face and hand gesture detection, weather recording, smart farming, and self-driving cars. Recent advances in computer vision with machine learning (ML) provide a new avenue for microbiological analysis. ML has been proven efficient and precise due to its automatic analysis of the geometric features and texture of organisms in optical microscopy images. This work describes a workshop that teaches basics of CV using ML (image classification, object detection) using Python notebook examples in Google Colab and Jetson Nano. The workshop is designed for senior undergraduate or beginning graduate chemistry students who would like to learn how to classify and detect microorganisms such as amoebae. The workshop content includes three sections: image classification with convolutional neutral netowork (CNN) in Google Colab, object detection with Mask R-CNN in Google Colab, and object detection with SSD-mobilenet in Jetson Nano.

Accurate object detection is a fundamental requirement for autonomous systems to operate in dynamic urban environments. Considering the intricacy of the environment and the occlusion of objects, various point cloud based three-dimensional (3D) object detection methods have been proposed, such as point-based or voxel-based methods. In this paper, a feature selection mechanism is proposed in a voxel-based method to generate bird’s eye view (BEV) feature maps from the original point cloud. For the 3D Backbone, the U-shaped structure and single scale feature selection module are combined. After combining high-level semantics and low-level fine-grained features, the optimized features after the BEV feature maps are applied to region of interest (RoI) refinement, so that the voxel features can better serve the subsequent 3D object detection. The experimental results on KITTI dataset show higher 3D object detection accuracy compared to the state-of-the-art 3D detection methods, which reflects the effectiveness of the proposed architecture.

Recent advances in Computer Vision have contributed to solid accuracy and efficiency improvements in many tasks such as object detection and tracking, enabling new opportunities for video analytics. In this paper, we initiate the study of ranked window queries that aim to retrieve clips from large video repositories in which objects co-occur in a query-specified fashion. For example, ranked window queries allow retrieval of clips of a set duration (e.g., 10 seconds) with the highest score from a long video, where at least the same 3 cars (with matching conditions based on suitably defined metadata) appear jointly. To answer such queries, we propose a two-phased approach, which builds indexes for all desired objects of the given videos during an Ingestion Phase and evaluates query answers efficiently in the Query Phase. During the Ingestion Phase, the proposed Partition-Based Index Construction (PBIC) algorithm builds indexes on partitions obtained by splitting each given video. Leveraging such indexes, queries are answered in the Query Phase using the Partition-Based Query Processing (PBQP) algorithm, which efficiently produces the desired (query-specified) number of results with the highest scores. We present the outcome of a thorough performance study on real videos that evaluates the performance of the proposed algorithms by varying parameters of interest. Our results indicate that the proposed set of techniques are capable of processing queries efficiently at scale, demonstrating multiple orders of magnitude speedups over other applicable approaches.

Object detection is a major branch and fundamental task in computer vision, aiming to localize, identify and classify even the smallest objects of interest in images. Features can be extracted efficiently by deep convolutional neural networks (CNNs) as the backbone for real-time or near real-time object detection performance than the hand-crafted-based traditional methods. In the past few years, the advent of transformer-based models with robust self-attention mechanisms has not only raised object detection performance to a higher level but has also enabled it to produce excellent results. Many object detection tasks in the real world require that 3D information about the object be obtained, thus strengthening active research in 3D object detection. However, the algorithms for detecting 3D objects are not easy to propagate in real-world applications due to many factors, making reconstruction of 2D object detection algorithms to 3D object detection algorithms the suitable alternative. Therefore, we review the evolution of 2D object detection algorithms for digital imaging applications, focusing on their developments, models, applications, datasets, evaluation metrics, strengths and weaknesses, for better understanding of their landmarks and contributions to the advancement of the field.

Deep learning belongs to the field of artificial intelligence, where machines perform tasks that typically require some kind of human intelligence. Deep learning tries to achieve this by drawing inspiration from the learning of a human brain. Similar to the basic structure of a brain, which consists of (billions of) neurons and connections between them, a deep learning algorithm consists of an artificial neural network, which resembles the biological brain structure. Mimicking the learning process of humans with their senses, deep learning networks are fed with (sensory) data, like texts, images, videos or sounds. These networks outperform the state-of-the-art methods in different tasks and, because of this, the whole field saw an exponential growth during the last years. This growth resulted in way over 10,000 publications per year in the last years. For example, the search engine PubMed alone, which covers only a sub-set of all publications in the medical field, provides already over 11,000 results in Q3 2020 for the search term ‘deep learning’, and around 90% of these results are from the last three years. Consequently, a complete overview over the field of deep learning is already impossible to obtain and, in the near future, it will potentially become difficult to obtain an overview over a subfield. However, there are several review articles about deep learning, which are focused on specific scientific fields or applications, for example deep learning advances in computer vision or in specific tasks like object detection. With these surveys as a foundation, the aim of this contribution is to provide a first high-level, categorized meta-survey of selected reviews on deep learning across different scientific disciplines and outline the research impact that they already have during a short period of time. The categories (computer vision, language processing, medical informatics and additional works) have been chosen according to the underlying data sources (image, language, medical, mixed). In addition, we review the common architectures, methods, pros, cons, evaluations, challenges and future directions for every sub-category.

In recent years, the realm of computer vision has experienced a significant surge in the importance of 3D object detection, especially in the context of autonomous driving. The capability to precisely identify the locations, dimensions, and types of key 3D objects surrounding an autonomous vehicle is crucial, rendering 3D object detection a vital component of any advanced perception system. This review delivers an extensive overview of the emerging technologies in 3D object detection tailored for autonomous vehicles. It encompasses a thorough examination, evaluation, and integration of the current research landscape in this domain, staying up-to-date with the latest advancements in 3D object detection and suggesting prospective avenues for future research. Our survey begins by clarifying the principles of 3D object detection and addressing its present challenges in the 3D domain. We then introduce three distinct taxonomies: camera-based, point cloudbased, and multi-modality-based approaches, providing a comprehensive classification of contemporary 3D object detection methodologies from various angles. Diverging from previous reviews, this paper also highlights and scrutinizes common issues and solutions for specific scenarios (such as pedestrian detection, lane lines, roadside cameras, and weather conditions) in object detection. Furthermore, we conduct an in-depth analysis and comparison of different classifications and methods, utilizing various datasets and experimental outcomes. Conclusively, we suggest several potential research directions, offering valuable insights for the ongoing evolution of 3D object detection technology. This review aims to serve as a comprehensive resource for researchers and practitioners in the field, guiding future innovations in 3D object detection for autonomous driving.

<p>Two-Dimensional (2D) object detection has been an intensely discussed and researched field of computer vision. With numerous advancements made in the field over the years, we still need to identify a robust approach to efficiently conduct classification and localization of objects in our environment by just using our mobile devices. Moreover, 2D object detection limits the overall understanding of the detected object and does not provide any additional information in terms of its size and position in the real world. This work proposes an object localization solution in Three-Dimension (3D) for mobile devices using a novel approach. The proposed method works by combining a 2D object detection Convolutional Neural Network (CNN) model with Augmented Reality (AR) technologies to recognize objects in the environment and determine their real-world coordinates. We leverage the in-built Simultaneous Localization and Mapping (SLAM) capability of Google’s ARCore to detect planes and know the camera information for generating cuboid proposals fromanobject’s2Dboundingbox. Theproposedmethodisfastandefficientforidentifyingeveryday objects in real-world space and, unlike mobile offloading techniques, the method is well designed to work with limited resources of a mobile device.</p> <p><br></p>

Point cloud-based three-dimensional (3D) object detection is a critical task in autonomous driving, robotics, and augmented reality, where accurate localization and classification of objects are essential under diverse and challenging scenarios. This work introduces a point cloud-based multi-target 3D object detection framework using Light Detection and Ranging (LiDAR) sensors. The key contribution lies in improving the encoding technique to preserve spatial information and adapt to varying point densities, enabling efficient processing of raw LiDAR data for robust 3D detection. Specifically, we design an efficient network architecture that incorporates a single unified classification head to jointly handle positive and negative samples, simplifying the design and improving training stability. Our model detects all classes (car, pedestrian, cyclist) simultaneously within a single network, enhancing computational efficiency while avoiding separate networks for each class. Furthermore, the proposed feature extraction pipeline combines a voxel-based encoder with a sparsely embedded convolutional backbone and a feature pyramid network, facilitating multi-scale feature representation and effective detection of objects at different scales. This encoding method facilitates the efficient processing of raw LiDAR data, enabling accurate object detection across diverse scenarios. As a result, our model achieves state-of-the-art performance on the KITTI dataset, surpassing baseline methods such as PointPillars and VoxelNet by delivering superior Average Precision (AP) across all difficulty levels for the car class in both bird’s-eye view (BEV) and 3D object detection tasks. Specifically, it achieves AP40 scores of 92.84%, 88.63%, and 85.68% in BEV detection and 87.84%, 76.65%, and 73.60% in 3D detection for Easy, Moderate, and Hard levels, respectively. These results highlight the effectiveness of our encoding technique in enhancing model efficiency and detection accuracy across diverse scenarios.

Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation or object detection rely on a large amount of annotated data. Yet annotating 3D Lidar data for these tasks is tedious and costly. In this context, we propose a self-supervised pretraining method for 3D perception models that is tailored to autonomous driving data. Specifically, we leverage the availability of synchronized and calibrated image and Lidar sensors in autonomous driving setups for distilling self-supervised pre-trained image representations into 3D models. Hence, our method does not require any point cloud nor image annotations. The keyingredient of our method is the use of superpixels which are used to pool 3D point features and 2D pixel features in visually similar regions. We then train a 3D network on the self-supervised task of matching these pooled point features with the corresponding pooled image pixel features. The advantages of contrasting regions obtained by superpixels are that: (1) grouping together pixels and points of visually coherent regions leads to a more meaningful contrastive task that produces features well adapted to 3D semantic segmentation and 3D object detection; (2) all the different regions have the same weight in the contrastive loss regardless of the number of 3D points sampled in these regions; (3) it mitigates the noise produced by incorrect matching of points and pixels due to occlusions between the different sensors. Extensive experiments on autonomous driving datasets demonstrate the ability of our image-to-Lidar distillation strategy to produce 3D representations that transfer well on semantic segmentation and object detection tasks.

Advancements in computer vision have significantly improved motion and object recognition accuracy. These advancements should aid the automatic recognition of chemical experiments, potentially contributing to the recording of experiments. Creating an electronic laboratory notebook from experiment filming enhances convenience and allows more detailed information storage compared to traditional manual recording methods. Our previous research focused on employing object detection and action recognition to automate the recognition of chemical experiments. This paper presents a novel system that combines object detection, action recognition, multiple object tracking, and barcode recognition to automatically generate experimental flowcharts. We implemented our system as a graphical user interface-based application for laboratory use that successfully constructs flowcharts from videos of chemical experiments, including simple chemical manipulations.

In the last few years, many examples of blood and medicine delivery drones have been demonstrated worldwide, which mainly rely on aeronautical experience that is not common in the medical world. Speaking about drone delivery, attention should focus on the most important thing: the transported lifesaving good. Traditional boxes that monitor temperature are not usually in real time, and are not suitable for drone transportation because they are heavy and bulky. This means that the biomedical characteristics of delivery are of primary importance. A Smart Capsule, equipped with artificial intelligence (AI), is the first system ever proposed to provide a fully autonomous drone delivery service for perishable and high-value medical products, integrating real-time quality monitoring and control. It consists in a smart casing that is able to guide any autonomous aerial vehicle attached to it, specifically designed for transporting blood, organs, tissues, test samples and drugs, among others. The system monitors the conditions of the product (e.g., temperature, agitation and humidity) and adjusts them when needed by exploiting, for instance, vibrations to maintain the required agitation, ensuring that goods are ready to be used as soon as they are delivered. The Smart Capsule also leverages external temperature to reduce energy uptake from the drone, thus improving the drone’s battery life and flight range. The system replaces the need for specialized drivers and traditional road-bound transportation means, while guaranteeing compliance with all applicable safety regulations. A series of 16 experimental tests was performed to demonstrate the possibility of using the smart capsule to manage the flight and internal good delivery. Eighty-one missions were carried out for a total of 364 min of flight. The Smart Capsule greatly improves emergency response and efficiency of healthcare systems by reducing delivery times by up to 80% and costs by at least 28%. The Smart Capsule and its enabling technology based on AI for drone deliveries are discussed in this paper. The aim of this work is to show the possibility of managing drone delivery with an AI-based device.

Object detection and tracking could be an immense, vivacious however inconclusive and trending area of computer vision. Due to its immense use in official surveillances, tracking modules applied in security and lots of other’s applications have made researchers to devise a lot of optimized and specialized methods. For validation purpose live input video will be taken for the same where objects will be getting detected and it can be simulated same for real-time through external hardware added. In the end we see the proper optimized and efficient algorithm for object detection and alert for security. Object Detection is computer vision technique used to detect object and identify its localization. This technique is not only used to identify the location but also to identify which type of object it is. This CV technique is used to detect objects in real time while maintaining the level of accuracy. By bringing some advancement in it, this system can be very helpful for people to keep track of their precious things or devices which are very expensive and need to be protected. Open CV (Open-Source Computer Vision Library) is a library of programming functions mainly aimed at real- time computer vision. Open CV features GPU acceleration for real-time operations. This feature helps us to write computationally intensive codes in C/C++ and create a Python wrapper for it so that we can use these wrappers as Python modules.

In this paper a multiple object detection, recognition, and tracking system for unmanned aerial vehicles (UAVs) has been studied. The system can be implemented on any UAVs platform, with the main requirement being that the UAV has a suitable onboard computational unit and a camera. It is intended to be used in a maritime object tracking system framework for UAVs, which enables a UAV to perform multiobject tracking and situational awareness of the sea surface, in real time, during a UAV operation. Using machine vision to automatically detect objects in the camera's image stream combined with the UAV's navigation data, the onboard computer is able to georeference each object detection to measure the location of the detected objects in a local North‐East (NE) coordinate frame. A tracking algorithm which uses a Kalman filter and a constant velocity motion model utilizes an object's position measurements, automatically found using the object detection algorithm, to track and estimate an object's position and velocity. Furthermore, a global‐nearest‐neighbor algorithm is applied for data association. This is achieved using a measure of distance that is based not only on the physical distance between an object's estimated position and the measured position, but also how similar the objects appear in the camera image. Four field tests were conducted at sea to verify the object detection and tracking system. One of the flight tests was a two‐object tracking scenario, which is also used in three scenarios with an additional two simulated objects. The tracking results demonstrate the effectiveness of using visual recognition for data association to avoid interchanging the two estimated object trajectories. Furthermore, real‐time computations performed on the gathered data show that the system is able to automatically detect and track the position and velocity of a boat. Given that the system had at least 100 georeferenced measurements of the boat's position, the position was estimated and tracked with an accuracy of 5–15 m from 400 m altitude while the boat was in the camera's field of view (FOV). The estimated speed and course would also converge to the object's true trajectories (measured by Global Positioning System, GPS) for the tested scenarios. This enables the system to track boats while they are outside the FOV of the camera for extended periods of time, with tracking results showing a drift in the boat's position estimate down to 1–5 m/min outside of the FOV of the camera.