Retracted: Lightweight Deep Learning Model for Object Detection in Resource Constrained Environments

To develop a natural language processing system that identifies relations of medications with adverse drug events from clinical narratives. This project is part of the 2018 n2c2 challenge. We developed a novel clinical named entity recognition method based on an recurrent convolutional neural network and compared it to a recurrent neural network implemented using the long-short term memory architecture, explored methods to integrate medical knowledge as embedding layers in neural networks, and investigated 3 machine learning models, including support vector machines, random forests and gradient boosting for relation classification. The performance of our system was evaluated using annotated data and scripts provided by the 2018 n2c2 organizers. Our system was among the top ranked. Our best model submitted during this challenge (based on recurrent neural networks and support vector machines) achieved lenient F1 scores of 0.9287 for concept extraction (ranked third), 0.9459 for relation classification (ranked fourth), and 0.8778 for the end-to-end relation extraction (ranked second). We developed a novel named entity recognition model based on a recurrent convolutional neural network and further investigated gradient boosting for relation classification. The new methods improved the lenient F1 scores of the 3 subtasks to 0.9292, 0.9633, and 0.8880, respectively, which are comparable to the best performance reported in this challenge. This study demonstrated the feasibility of using machine learning methods to extract the relations of medications with adverse drug events from clinical narratives.

The task of object pose estimation has been a challenge since the early days of computer vision. To estimate the pose (or viewpoint) of an object, people have mostly looked at object intrinsic features, such as shape or appearance. Surprisingly, informative features provided by other, external elements in the scene, have so far mostly been ignored. At the same time, contextual cues have been shown to be of great benefit for related tasks such as object detection or action recognition. In this paper, we explore how information from other objects in the scene can be exploited for pose estimation. In particular, we look at object configurations. We show that, starting from noisy object detections and pose estimates, exploiting the estimated pose and location of other objects in the scene can help to estimate the objects' poses more accurately. We explore both a camera-centered as well as an object-centered representation for relations. Experiments on the challenging KITTI dataset show that object configurations can indeed be used as a complementary cue to appearance-based pose estimation. In addition, object-centered relational representations can also assist object detection.

In this paper, alternative direction finding methods have been proposed using deep learning techniques. Firstly, Regeression and Classification models have created by using Convolutional Neural Networks (CNNs). In the second Convolutional Neural Networks and Recurrent Neural Networks (RNNs) have been utilized in the proposed methods. Despite having vast amount of direction finding studies, utilization of neural networks is scarce in literature and past works mostly only includes usage of CNNs. In this study, direction finding is performed by learning signals reaching multiple antenna arrays by networks. Created neural networks have been fed with different data formats and their performances against noisy and no-noise data have been shown. In addition, comparative analysis of the developed models were made in the similar Signal-to-Noise Ratio (SNR) range with the subspace based MUSIC algorithm, which is frequently used in direction finding.

This paper proposes a novel deep learning architecture involving combinations of Convolutional Neural Networks (CNN) layers and Recurrent neural networks (RNN) layers that can be used to perform segmentation and classification of 5 cardiac rhythms based on ECG recordings. The algorithm is developed in a sequence to sequence setting where the input is a sequence of five second ECG signal sliding windows and the output is a sequence of cardiac rhythm labels. The novel architecture processes as input both the spectrograms of the ECG signal as well as the heartbeats' signal waveform. Additionally, we are able to train the model in the presence of label noise. The model's performance and generalizability is verified on an external database different from the one we used to train. Experimental result shows this approach can achieve an average F1 scores of 0.89 (averaged across 5 classes). The proposed model also achieves comparable classification performance to existing state-of-the-art approach with considerably less number of training parameters.

Global climate change has become a critical factor influencing marine and coastal safety. According to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6), even with global mitigation efforts, the trend of global warming remains irreversible. The increasing intensity of future extreme climate events is expected to affect wave dynamics, storm surges, and coastal hazards. This study aims to assess long-term variations in extreme waves and storm surges around Taiwan under climate change scenarios and to establish design parameters that reflect future conditions for coastal hazard mitigation and engineering applications.Atmospheric data from the EC-Earth3 global climate model under the high-emission scenario (SSP5-8.5) were used to drive wave and ocean models simulating wave fields and storm surge residuals over the Northwest Pacific. To address the coarse resolution of global climate models, an artificial intelligence–based statistical downscaling framework was developed. This approach integrates Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) into a Convolutional Recurrent Neural Network (CRNN) architecture, improving spatial and temporal resolution and generating data representative of coastal-scale processes. The downscaled wave and surge results were analyzed using the Generalized Pareto Distribution (GPD) for extreme-value statistics to estimate design wave heights and storm surge residuals corresponding to return periods of 10, 25, 50, 75, 100, and 200 years. Statistical uncertainties were evaluated using a bootstrap resampling method.Results show that under the high-emission scenario, significant wave heights and storm surge residuals exhibit an increasing trend with longer return periods. Wave analysis reveals marked changes in northern coastal waters, where design wave heights increase from 3.05 m to 5.65 m. The eastern coast shows moderate increases (4.08–4.22 m), while the Taiwan Strait and southern waters remain relatively stable at about 3.6 m and 5.2 m, indicating higher sensitivity of the north to extreme forcing. For storm surges, historical maximum residuals ranged from 0.36 m to 1.49 m, while future projections range from 0.31 m to 1.35 m, showing a slight decrease but similar spatial distribution, with larger deviations along western and island coasts. Design storm surge residuals increase with return period, from about 0.20 m for a 10-year event to 0.32 m for a 200-year event. Under future conditions, increases are projected mainly for western and island coasts, with southern and eastern shores also showing gradual rises.Overall, extreme waves and storm surges around Taiwan exhibit long-term variations under climate change. Although short-term fluctuations remain moderate, both wave and surge intensities increase at longer return periods, implying that future coastal design standards should consider higher thresholds. The AI-based downscaling and extreme-value framework established in this study supports quantitative assessment of coastal hazards, engineering design, and adaptation planning in Taiwan.

The chapter discusses the design and development of a novel object detection model keeping the motive that anyone and everyone with little to no prior knowledge can easily use it. The object detection is a part of computer vision which deals with detection and localization of objects in images or videos. These systems can be implemented for surveillance, keeping track of goods, robotics, medical field, self-driving cars, and much more. A lot of organizations are using it for various purposes such as it is used by NASA for analysis for deep space analysis, self-driving cars use it for making accurate decisions, and airports use it for security and surveillance. Although it has numerous use cases, but because of complex implementation and need of expertise in the field, it is not being widely used currently. In this chapter, we have made an effort to automate most of the process that a user should do in order to train and use models for object detection. The most complex part of using these technologies is training custom models, and only people having expertise in field are doing it. With the system designed by us, anyone would be able to train custom models on their own and they don’t have to do much for it. Normally, first users have to gather large amount of images and then annotate them 124one by one, which is a tedious and time taking process. One has to do this for thousands of images and each of those images can have multiple instances of various objects to train a model to give a good accuracy. We are automating the whole process with the help of AWS recognition module of AWS. You only look once (YOLO) object detection model is used for automation, as it is fast and accurate at the same time which gives it edge over the other models available for use. This model is based on deep learning to learn through the images provided by user in training phase and then later on can be used to perform detection on images or real-time videos. A graphic user interface (GUI) is also developed, so the users can easily interact with the system and train their own custom models and use as they want it to be used. Data are sent over the AWS servers and retrieve the results using a block of python code, then the response collected from AWS is manipulated and the data are extracted that is required to annotate the images and then processing is done according to the need of our target model. This format can be different for various models which can be used for object detection.

Underwater imaging suffers from various challenges such as color distortion, low contrast, and reduced visibility caused by light attenuation. Addressing these issues is crucial for improving the performance of computer vision tasks in underwater environments. Different approaches are proposed in the literature to enhance the underwater images, however the dynamically varying environmental conditions remains challenging. It requires adaptive approach to adjust the color dynamically and to estimate the features. In this study, we propose a novel hybrid approach for underwater image enhancement that integrates a customized color correction algorithm with Recurrent Convolutional Neural Networks (R-CNN), offering superior image enhancement capabilities compared to conventional methods. The proposed method comprises three key stages: color correction, recurrent feature extraction, and enhancement. The color correction algorithm goes beyond traditional method by adjusting the color channels based on dynamically estimated attenuation coefficients specific to underwater environments, effectively restoring natural color tones and also enhancing overall visual accuracy. The recurrent design enables the network to enhance feature representations by continuously refining them across iterations, thus preserving intricate scene details better than static CNNs. Finally, the novel enhancement strategy guided by the recurrently extracted features, further improves the clarity, contrast and visibility. Experimental evaluation conducted on diverse underwater image datasets demonstrate the superiority of proposed approach, offering significant improvements in image quality over state-of-the-art techniques. Qualitative and quantitative analyses reveal that the proposed method not only enhances images aesthetics but also facilitates better performance in downstream computer vision tasks such as object detection, recognition and environmental monitoring.

Spatial-temporal action detection in videos is a challenging problem that has attracted considerable attention in recent years. Most current approaches address action detection as an object detection problem, which utilizes successful object detection frameworks such as Faster R-CNN to operate action detection at every single frame first, and then generates action tubes by linking bounding boxes across the whole video in an offline fashion. However, unlike object detection in static images, temporal context information is vital for action detection in videos. Therefore, we propose an online action detection model that leverages the spatial-temporal context information existing in videos to perform action inference and localization. More specifically, we try to depict the spatial-temporal context pattern of actions via an encoder-decoder model that is based on a convolutional recurrent neural network. The model accepts a video snippet as input and encodes the dynamic information inside the snippet in the forward pass. During the backward pass, the decoder resolves the information for action detection with the current appearance or motion cue at each time stamp. In addition, we devise an incremental action-tube construction algorithm that enables our model to accomplish action prediction ahead of time and performs action detection in an online fashion. To evaluate the performance of our method, we conduct experiments on three popular public datasets UCF-101, UCF-Sports, and J-HMDB-21. The experimental results demonstrate that our method can achieve competitive or superior performance when compared to the state-of-the-art methods. To encourage further research, we release our project on "https://github.com.hjjpku.OATD."

Object Detection Technology has been a subject to much research and development due to increasing use of images and videos as data sources and their huge number of applications. Traditional models for object detection had limitations in training and did not use transfer learning for their benefit. With the evolution of deep learning and Neural networks, newer and powerful tools have made way to achieve Object Detection in real-time, with the added advantage of transfer learning and detection of multiple instances of different classes of interest in the given image context. The proposed system is an Object Detection model based on the Single Shot Detector (SSD) algorithm trained with MobileNetV2 feature extraction that can be utilized and integrated in e-commerce, hospitality industry, security and surveillance, real estate, self-driving cars and floor inventory management.

To monitor objects of interest, such as wildlife and people, image-capturing devices are used to collect a large number of images with and without objects of interest. As we are recording valuable information about the behavior and activity of objects, the quality of images containing objects of interest should be better than that of images without objects of interest, even if the former exhibits more severe distortion than the latter. However, according to current methods, quality assessments produce the opposite results. In this study, we propose an end-to-end model, named DETR-IQA (detection transformer image quality assessment), which extends the capability to perform object detection and blind image quality assessment (IQA) simultaneously by adding IQA heads comprising simple multi-layer perceptrons at the top of the DETRs (detection transformers) decoder. Using IQA heads, DETR-IQA carried out blind IQAs based on the weighted fusion of the distortion degree of the region of objects of interest and the other regions of the image; the predicted quality score of images containing objects of interest was generally greater than that of images without objects of interest. Currently, the subjective quality score of all public datasets is in accordance with the distortion of images and does not consider objects of interest. We manually extracted the images in which the five predefined classes of objects were the main contents of the largest authentic distortion dataset, KonIQ-10k, which was used as the experimental dataset. The experimental results show that with slight degradation in object detection performance and simple IQA heads, the values of PLCC and SRCC were 0.785 and 0.727, respectively, and exceeded those of some deep learning-based IQA models that are specially designed for only performing IQA. With the negligible increase in the computation and complexity of object detection and without a decrease in inference speeds, DETR-IQA can perform object detection and IQA via multi-tasking and substantially reduce the workload.

Background: Fundamental advances in stroke care will require pooling imaging phenotype data from multiple centers, to complement the current aggregation of genomic, environmental, and clinical information. Sharing clinically acquired MRI data from multiple hospitals is challenging due to inherent heterogeneity of clinical data, where the same MRI series may be labeled differently depending on vendor and hospital. Furthermore, the de-identification process may remove data describing the MRI series, requiring human review. However, manually annotating the MRI series is not only laborious and slow but prone to human error. In this work, we present a recurrent convolutional neural network (RCNN) for automated classification of the MRI series. Methods: We randomly selected 1000 subjects from the MRI-GENetics Interface Exploration study and partitioned them into 800 training, 100 validation and 100 testing subjects. We categorized the MRI series into 24 groups (see Table). The RCNN used a modified AlexNet to extract features from 2D slices. AlexNet was pretrained on ImageNet photographs. Since clinical MRI are 3D and 4D, a gated recurrent unit neural network was used to aggregate information from multiple 2D slices to make the final prediction. Results: We achieved a classification accuracy (correct/total cases) of 99.8%, 98.5% and 97.5% on the training, validation and testing set, respectively. The averaged F1-score (percent overlap between predicted cases and actual cases) over all categories were 99.8% 98.2% and 94.4% on the training, validation and testing set. Conclusion: We showed that automated annotation of MRI series by repurposing deep-learning techniques used for photographic image recognition tasks is feasible. Such methods can be used to facilitate high throughput curation of MRI data acquired across multiple centers and enable scientifically productive collaboration by researchers and, ultimately enhancing big data stroke research.

With the continuous progress of remote sensing image object detection tasks in recent years, researchers in this field have gradually shifted the focus of their research from horizontal object detection to the study of object detection in arbitrary directions. It is worth noting that some properties are different from horizontal object detection during oriented object detection that researchers have yet to notice much. This article presents the design of a straightforward and efficient arbitrary-oriented detection system, leveraging the inherent properties of the orientation task, including the rotation angle and box aspect ratio. In the detection of low aspect ratio objects, the angle is of little importance to the orientation bounding box, and it is even difficult to define the angle information in extreme categories. Conversely, in the detection of objects with high aspect ratios, the angle information plays a crucial role and can have a decisive impact on the quality of the detection results. By exploiting the aspect ratio of different targets, this letter proposes a ratio-balanced angle loss that allows the model to make a better trade-off between low-aspect ratio objects and high-aspect ratio objects. The rotation angle of each oriented object, which we naturally embed into a two-dimensional Euclidean space for regression, thus avoids an overly redundant design and preserving the topological properties of the circular space. The performance of the UCAS-AOD, HRSC2016, and DLR-3K datasets show that the proposed model in this paper achieves a leading level in terms of both accuracy and speed.

Object detection and recognition is an essential task in computer vision with numerous real-world applications such as surveillance, self-driving cars, and robotics. In recent years, deep learning-based approaches have significantly improved the accuracy and speed of object detection and recognition. The You Only Look Once version 3 (YOLOv3) algorithm is a popular deep learning-based approach that can detect and recognize objects in real-time. The Common Objects in Context (COCO) dataset is a large-scale dataset with over 330,000 labeled images and more than 2.5 million object instances, making it a popular choice for object detection and recognition tasks. In this paper, we propose a deep learning-based approach for real-time object detection and recognition using the YOLOv3 architecture and COCO dataset. We evaluate our approach based on several performance metrics, including mean average precision (mAP), frames per second (FPS), total object detection time, object detection accuracy, false positive rate, number of detected objects, and mean intersection over union (mIoU). Our results show that our approach achieves a mean average precision of 0.76 on the COCO dataset and a real-time performance of 40 frames per second on a single GPU. Additionally, our approach achieves an object detection accuracy of 93.5%, a false positive rate of 6.5%, and a mean intersection over union of 0.65. Our proposed approach shows promising results for real-time object detection and recognition and can be applied to various real-world applications.

The presented paper proposes a new speech command recognition model for novel engineering applications with limited resources. We built the proposed model with the help of a Convolutional Recurrent Neural Network (CRNN). The use of CRNN instead of Convolutional Neural Network (CNN) helps us to reduce the model parameters and memory requirement as per resource constraints. Furthermore, we insert transmute and curtailment layer between the layers of CRNN. By doing this we further reduce model parameters and float number of operations to half of the CRNN requirement. The proposed model is tested on Google’s speech command dataset. The obtained result shows that the proposed CRNN model requires 1/3 parameters as compared to the CNN model. The number of parameters of the CRNN model is further reduced by 45% and the float numbers of operations between 2% to 12 % in different recognition tasks. The recognition accuracy of the proposed model is 96% on Google’s speech command dataset, and on laboratory recording, its recognition accuracy is 89%.

Self-attention based recurrent convolutional neural network for disease prediction using healthcare data