Learning Object Grasping for Soft Robot Hands

Recommending music based on a user’s music preference is a way to improve user listening experience. Finding the correlation between the user data (e.g., location, time of the day, music listening history, emotion, etc.) and the music is a challenging task. In this paper, we propose an emotion-aware personalized music recommendation system (EPMRS) to extract the correlation between the user data and the music. To achieve this correlation, we combine the outputs of two approaches: the deep convolutional neural networks (DCNN) approach and the weighted feature extraction (WFE) approach. The DCNN approach is used to extract the latent features from music data (e.g., audio signals and corresponding metadata) for classification. In the WFE approach, we generate the implicit user rating for music to extract the correlation between the user data and the music data. In the WFE approach, we use the term-frequency and inverse document frequency (TF-IDF) approach to generate the implicit user ratings for the music. Later, the EPMRS recommends songs to the user based on calculated implicit user rating for the music. We use the million songs dataset (MSD) to train the EPMRS. For performance comparison, we take the content similarity music recommendation system (CSMRS) as well as the personalized music recommendation system based on electroencephalography feedback (PMRSE) as the baseline systems. Experimental results show that the EPMRS produces better accuracy of music recommendations than the CSMRS and the PMRSE. Moreover, we build the Android and iOS APPs to get realistic data of user experience on the EPMRS. The collected feedback from anonymous users also show that the EPMRS sufficiently reflect their preference on music.

Detecting major depressive disorder presence using passively-collected wearable movement data in a nationally-representative sample

Skin cancer is one of the most dangerous types of cancer due to its immediate appearance and the possibility of rapid spread. It arises from uncontrollably growing cells, rapidly dividing cells in one area of the body, invading other bodily tissues, and spreading throughout the body. Early detection helps prevent cancer progress from reaching critical levels, reducing the risk of complications and the need for more aggressive treatment options. Convolutional neural networks (CNNs) revolutionize skin cancer diagnosis by extracting intricate features from images, enabling an accurate classification of lesions. Their role extends to early detection, providing a powerful tool for dermatologists to identify abnormalities in their nascent stages, ultimately improving patient outcomes. This study proposes a novel deep convolutional neural network (DCNN) approach to classifying skin cancer lesions. The proposed DCNN model is evaluated using two unbalanced datasets, namely HAM10000 and ISIC-2019. The DCNN model is compared with other transfer learning models, including VGG16, VGG19, DenseNet121, DenseNet201, and MobileNetV2. Its performance is assessed using four widely used evaluation metrics: accuracy, recall, precision, F1-score, specificity, and AUC. The experimental results demonstrate that the proposed DCNN model outperforms other deep learning (DL) models that utilized these datasets. The proposed DCNN model achieved the highest accuracy with the HAM10000 and ISIC-2019 datasets, reaching 98.5%\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$98.5\\%$$\\end{document} and 97.1%\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$97.1\\%$$\\end{document}, respectively. These experimental results show how competitive and successful the DCNN model is in overcoming the problems caused by class imbalance and raising skin cancer classification accuracy. Furthermore, the proposed model demonstrates superior performance, particularly excelling in terms of accuracy, compared to other recent studies that utilize the same datasets, which highlights the robustness and effectiveness of the proposed DCNN.

Diabetic Retinopathy (DR) is eye disease caused through the retinal damage induced through long-term diabetes mellitus illness. In the initial stage, DR has minor vision difficulties or no symptoms but it outputs in vision loss if it is not treated early. However, overfitting occurs when a model learns noise or specific features from a small dataset which leading to poor generalization. To solve this issue, this research proposed an Otsu Multi-level Adaptive Thresholding with Deep Convolution Neural Network (OMAT+DCNN) approach for DR segmentation and classification. The Contrast Limited Adaptive Histogram Equalization (CLAHE) is used for preprocessing input image which enhances the contrast level and image visibility without amplifying noise. The OMAT is used for segmenting the affected regions and ResNet50 is used for extracting Deep Learning (DL) features. Then, relevant features are selected through Multi-Verse Optimizer (MVO) and DCNN is used for classification. The OMAT improves segmentation accuracy by considering multiple thresholds which adopts to local intensity variations within the image, even when the dataset is limited. DCNN capturing intricate patterns and spatial hierarchies within images and its deep architecture allows to learn complex representations which leads to enhance accuracy. The parameters like dice coefficient, Intersection over Union (IoU), Mean IoU (MIoU), precision, accuracy, f1-score and sensitivity are used for assessing performance. The OMAT+DCNN reaches 0.993 of accuracy when compared to existing techniques such as Convolutional Transformer Network (CTNet) and Residual Attention Network (RAN).

How to refine and improve the prediction power of a deep learning model is still a challenge. In this paper, we propose a data-selective multiple-stage approach to refine the prediction results from a single 3D convolutional neural network (3D CNN) in terms of precision and recall measurements. In the initial stage of the learning process, a 3D CNN is trained with a pre-trained model and the precisions and recalls for each class are calculated. An over-predicted ratio is also calculated as summarizing the true positive and false negative ratios of each predicted class according to the normalized confusion matrix. From the training result, those with both of the precision and recall larger than a preset threshold and the over-predicted ratio ≤ 1 are directly output as the accepted classes at this stage. For the other classes not satisfied the above three criterions, the corresponding training data are selected as the input for the next stage. If the number of selected clusters is less than that at the beginning of this stage, another new 3D CNN is created and trained with the selected data of unsolved classes. After repeating the procedures until no new 2D CNN is needed to be created, all trained models and accepted classes at each stage are saved. In the testing phase, each data is input to the model at the first stage. If the predicted class is belonged to the accepted class at this stage, the result is output directly. Otherwise, the data is input to the next stage. After repeating the process until the predicted class is belonged to the accepted class at some stage, then the testing phase is terminated. In the results, we have used two video datasets of mouse behaviors in cage and human actions in the wild to examine the proposed method and found that our method can significantly improve both of the precisions and recalls of the predictions in comparison with only using a single 3D CNN model.

Although the left ventricle (LV) is commonly assessed in current clinical practice, the assessment of the right ventricle (RV) also plays an important role in the diagnosis of cardiovascular disease. RV failure has numerous causes, including pulmonary hypertension, myocardial infarction, and congenital heart disease. However, assessment of the RV is more challenging than the LV due to its complex shape and thin walls. This study proposes an automated approach to delineate the RV from magnetic resonance imaging (MRI) scans using a deep convolutional neural network approach. The proposed method uses nnU-Net, a self-adapting framework based on the U-Net neural network approach for the segmentation of the RV from short and long axis MRI images at the end-systolic and end-diastolic phases of the heart. The proposed neural network models were trained using the datasets provided by Multi-Disease, Multi-View & Multi-Center Right Ventricular Segmentation in Cardiac MRI Challenge hosted by MICCAI 2021 conference. The quantitative evaluations were performed by the challenge organizers on a test set consisting of MRI scans acquired from 160 patients where the images and ground truth were blinded to the challenge participants. The proposed method yielded an overall Dice metric of \(92.47\%\) with \(92.73\%\) and \(91.71\%\) for short and long axis images, respectively. The corresponding Hausdorff distance values were 9.08 mm, 10.05 mm, and 6.16 mm, respectively.KeywordsCardiac magnetic resonance imagingDeep convolutional neural networksRight ventricleImage segmentation

Classification of non-small cell lung cancer using one-dimensional convolutional neural network

We are developing a decision support system for treatment response assessment of bladder cancer in CT urography (CTU). Accurate segmentation of bladder cancer is a critical and challenging task. We previously developed a bladder cancer segmentation method using a deep learning convolutional neural network and level set (DL-CNN+LS) approach. In this study we investigated the application of a U-Net based deep learning (U-Net) model for bladder cancer segmentation. Our new U-Net method did not require the second-stage level set refinement, greatly simplifying the overall segmentation pipeline. The proposed U-Net model utilized a user-defined box to direct the attention of the U-Net to the lesion region by masking out the structured background outside the box. We trained and evaluated the performance of the U-Net segmentations by using hand-drawn 3D contours from a radiologist as reference standard. The segmentation accuracy was evaluated by the average volume intersection ratio (AVI), average percent volume error (AVE), average absolute volume error (AAVE), average minimum distance (AMD), and the Jaccard index (JI). On the validation set, the cropped U-Net achieved values of AVI = 65.5±20.2%, AVE = 3.7±44.4%, AAVE = 30.9±30.8%, AMD = 2.9±1.5 mm, and JI = 51.4±16.8%. The previous DL-CNN+LS approach achieved values of AVI = 36.2±28.4%, AVE = 51.1±39.3%, AAVE = 52.0±38.0%, AMD = 4.1±1.7 mm, and JI = 32.9±27.2%. On the independent test set, the cropped U-Net achieved values of AVI = 66.0±22.8%, AVE = -3.7±39.4%, AAVE = 28.1±27.3%, AMD = 4.5±3.3 mm, and JI = 49.2±20.0%. The DL-CNN+LS achieved values of AVI = 31.2±24.3%, AVE = 59.9±30.9%, AAVE = 60.8±29.0%, AMD = 5.5±2.2 mm, and JI = 27.9±20.8%, respectively. The results demonstrated that the U-Net model could achieve a higher accuracy than the previous DL-CNN+LS model while reducing the complexity of the segmentation pipeline.

WiDet: Wi-Fi based device-free passive person detection with deep convolutional neural networks

In this paper we describe a Deep Convolutional Neural Network (DNN) approach to perform two sentiment detection tasks: message polarity classification and contextual polarity disambiguation.We apply the proposed approach for the SemEval-2014 Task 9: Sentiment Analysis in Twitter.Despite not using any handcrafted feature or sentiment lexicons, our system achieves very competitive results for Twitter data.

In this paper, we propose a deep learning convolutional neural network (CNN) approach to classify arrhythmia based on the time interval of the QRS complex of the ECG signal. The ECG signal was denoised using multiple filters based on the Pan Tompkins algorithm. QRS detection has been done using Pan Tompkins Algorithm. Then the QRS complex is identified using local peaks based technique inside the layers of the Convolutional Neural Network where the repeated application of the same filter to our input results in a map of activations called a feature map, indicating the locations and strength of a detected feature in an input which in our case is the changes in the q-s time interval. Based on the R-R time interval, Heart rate variability (HRV) was computed, and Poincare plot was generated. Instead of using raw ECG signal to train the CNN, we used the feature extracted from ECG signal obtained from Physionet database to train the CNN and map the pattern changes for different classes of diseases. The classifier was then used to classify the test input as either or normal, tachyarrhythmia or intracardiac atrial fibrillation. Data acquisition, ECG data pre-processing and CNN classifier are the several methods that are involved for the classification of several arrhythmias.

Diabetic retinopathy (DR) is one of the primary causes of preventable blindness, highlighting the necessity for accurate and automated retinal screening systems. Manual diagnosis through fundus image inspection is time-consuming and prone to subjective interpretation, particularly in regions with limited access to ophthalmic specialists. This study presents a deep convolutional neural network (CNN) approach based on ResNet50 architecture with fine-tuning for multi-class classification of retinal diseases. The proposed model was developed using the APTOS 2019 Blindness Detection dataset, consisting of 3,662 fundus images categorized into five levels of DR severity. A robust preprocessing pipeline, including illumination correction, contrast enhancement, normalization, and extensive data augmentation, was implemented to improve image quality and balance the dataset. The network was trained using the Adam optimizer with a learning rate of 1×10?? and categorical cross-entropy loss for 30 epochs under an 80:20 train–validation split. Experimental evaluation demonstrated high performance with 92.4% accuracy, 0.91 precision, 0.92 recall, 0.91 F1-score, and an AUC of 0.95, outperforming baseline CNN and VGG16 models. Furthermore, Grad-CAM visualization confirmed that the model accurately localized critical retinal regions associated with microaneurysms, hemorrhages, and exudates, enhancing interpretability and clinical trust. The proposed ResNet50-based framework provides an explainable, efficient, and reliable solution for automated diabetic retinopathy detection, supporting large-scale tele-ophthalmology and early diagnosis applications in medical imaging

Protective measures against small unmanned aerial vehicles (UAVs) are vital from a national security perspective. As a result, the importance of surveillance systems that automatically identify and classify low radar cross section (RCS) aerial targets increases. In this work, an indigenously developed continuous wave (CW) (X-band: 10 GHz) radar is used to build a diversified “DIAT- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mu $ </tex-math></inline-formula> SAT” dataset comprising 4849 micro-Doppler signature images of five different small aerial targets. We also proposed a transfer learning-based deep convolutional neural network (DCNN) approach for classifying low RCS aerial targets. We demonstrated the classification accuracy of 95% and 97%, with VGG16 and VGG19 as feature extractors, respectively, with minimal false-negative and -positive results. The open-field experimental classes covered in this work are: 1) a two-blade rotor; 2) a three-short-blade rotor; 3) a three-long-blade rotor; 4) a quadcopter; 5) a bionic bird; and 6) a two-blade-rotor and bionic bird. We also observed a good classification accuracy (>97%) when more than one target is operated simultaneously.

The feasibility of localizing, segmenting, and classifying individual cells in multi-channel confocal microscopy images is highly dependent on image quality. In certain applications, with good image quality, the segmentation can be trivial and accomplished via thresholding, watershed, or a collection of other well-established and studied heuristics; however, at the limit of poor image quality and complex image features, these techniques fail. It is at this limit that deep convolutional neural network (DCNN) approaches excel. Our research studies the interaction of individual immune cells and their shape changes relative to inflammatory immune reactions1 using multi-channel immunofluorescence imaging of renal biopsies from patients with inflammatory kidney disease. We present here a deep learning methodology for application to nuclear and cell membrane immunofluorescent stains to automatically segment and classify multiple T-cell and dendritic cell types. With both T-cells and dendritic cells segmented, we are able to study how T-cells with different surface antigens change shape with proximity to dendritic cells. Shape changes are seen when T-cells move close to dendritic cells and interact. We use a sliding window, max-filtering DCNN to segment and classify 3 cell types from 6 image stains channels within a single DCNN. This DCNN maintains images at original resolution throughout the network using dilated convolutions and max-filtering in place of max pooling layers. In addition, we use 3D convolution kernels with two spatial dimensions and one channel dimension. This allows us to output a multi-class binary classification based on multichannel data at the original image resolution. We trained and validated the network across 24 patients with 8,572 segmented cells. Our results demonstrate a mean Dice-Sorensen score of 0.78 +/- 0.18, a mean classification sensitivity of 0.76, and a mean classification specificity of 0.75 across all 3 segmented cell types.

Fluorescence lifetime imaging of the co-enzyme reduced nicotinamide adenine dinucleotide (NADH) offers a label-free approach for detecting cellular metabolic perturbations. However, the relationships between variations in NADH lifetime and metabolic pathway changes are complex, preventing robust interpretation of NADH lifetime data relative to metabolic phenotypes. Here, a three-dimensional convolutional neural network (3D CNN) trained at the cell level with 3D NAD(P)H lifetime decay images (two spatial dimensions and one time dimension) was developed to identify metabolic pathway usage by cancer cells. NADH fluorescence lifetime images of MCF7 breast cancer cells with three isolated metabolic pathways, glycolysis, oxidative phosphorylation, and glutaminolysis were obtained by a multiphoton fluorescence lifetime microscope and then segmented into individual cells as the input data for the classification models. The 3D CNN models achieved over 90% accuracy in identifying cancer cells reliant on glycolysis, oxidative phosphorylation, or glutaminolysis. Furthermore, the model trained with human breast cancer cell data successfully predicted the differences in metabolic phenotypes of macrophages from control and POLG-mutated mice. These results suggest that the integration of autofluorescence lifetime imaging with 3D CNNs enables intracellular spatial patterns of NADH intensity and temporal dynamics of the lifetime decay to discriminate multiple metabolic phenotypes. Furthermore, the use of 3D CNNs to identify metabolic phenotypes from NADH fluorescence lifetime decay images eliminates the need for time- and expertise-demanding exponential decay fitting procedures. In summary, metabolic-prediction CNNs will enable live-cell and in vivo metabolic measurements with single-cell resolution, filling a current gap in metabolic measurement technologies.