Deep Learning in Electromyography Signal-based Lower Limb Angle Prediction and Activity Classification

With the advancement of technology and the increasing use of wearable devices, information security have become a necessity. Although many biometrics authentication methods have been studied on these devices to ensure information security, an activity-aware deep learning (DL) model that is compatible with different device types and uses only electrocardiogram signals has not been studied. Our objective is to investigate DL models that exclusively use ECG signals during several physical activities, facilitating their implementation on various devices. Through this research, we aim to contribute to the advancement of wearable devices for the purpose of biometric verification. In this context, this study investigates the application of adaptive techniques that rely on prior activity classification to potentially improve biometric performance using DL models. In this study, we compare three time-frequency representations to generate images for activity classification using GoogleNet, ResNet50 and DenseNet201, and for biometric verification using ResNet50 and DenseNet201. Despite employing various convolutional neural network (CNN) models, we could not achieve high accuracy in activity classification. Consequently, manually classified samples were used for activity-aware biometric verification. We also provide a detailed comparison of various DL parameters. We use a public dataset simultaneously collected from both medical and wearable devices to offer a cross-device comparison. The results demonstrate that our method can be applied to both wearable and medical devices for activity classification and biometric verification. Besides, although it is known that DL requires a large amount of training data, our model, which was created using a small amount of training data and a real-life biometric verification scenario, achieved comparable results to studies using a large amount of data. The model was achieved 0.16% to 30.48% better results when classified according to their physical activities.

Deep learning has become widely used in image analysis. Transfer learning can make use of information from other datasets for the analysis of the chosen dataset. When there is a small number of images at hand, transfer learning using pre-trained models with coefficients already estimated from other datasets is recommended. This is in contrast to deep learning, where most model parameters are re-estimated. Deep transfer learning uses pre-trained models with fixed weight parameters in the lower layers; thus, deep learning can be viewed as a two-stage approach: (1) feature extraction from a lower neural network layer and (2) estimation of a neural network using the extracted features as inputs. Since deep transfer learning is feature extraction, we can extend the two-stage approach to a more general two-stage framework: (1) feature extraction using multiple methods and (2) machine learning methods taking extracted features as inputs. We evaluate the performance of methods with different Stage 1 and Stage 2 approaches in predicting the phenotype leaf numbers based on a multi-view plant imaging dataset. This paper contains an evaluation of different two-stage machine learning methods for multi-view image data in plant image phenotyping.

Cognitive learning strategies are focused on the improvement of the learner’s ability to analyze information in a deeper manner and efficiently handle new situations by transferring and applying the knowledge. These techniques result in enhanced and better- retained learning. In order to cater to the needs of different students having different levels of cognitive learning, it’s very important to assess their learning ability. In this paper, a method based on deep learning is presented to classify the learners based on their past performance. This technique takes the students’ past semester marks, their total failures in subjects/passing heads, and their current semester attendance. The proposed method classifies the learners into three categories, namely slow, fast, and average learners. A deep learning classifier with multilayer perceptron–based nodes is built for the classification. The proposed method is fully automatic and robust. The final accuracy of 90% is achieved in the classification of the learners in their cognitive learning level.

Recurrent Neural Network (RNN) is a deep learning model that uses the concept of supervised learning. Deep learning belongs to the family of machine learning. It is also called hierarchical learning or deep structured learning. The classic machine learning algorithms are definite, while the deep learning algorithms follow a chain of command. Deep learning has the capability to deal with more complex neural networks and it mainly deals with sequential data. Recurrent networks can process examples one at a time, preserving an element, that reflects over a long period of time.

Recently, clinical phenotypic semantic information has begun to play an important role in some brain network classification methods based on deep learning. However, most current methods only consider the phenotypic semantic information of individual brain networks but ignore the potential phenotypic characteristics among group brain networks. To address this problem, we present a deep hashing mutual learning (DHML)-based brain network classification method. Specifically, we first design a separable CNN-based deep hashing learning to extract individual topological features of brain networks and map them into hash codes. Secondly, we construct a group brain network relationship graph based on the similarity of phenotypic semantic information, in which each node is a brain network, and the properties of the nodes are the individual features extracted in the previous step. Then, we adopt a GCN-based deep hashing learning to extract the group topological features of the brain network and map them to hash codes. Finally, the two deep hashing learning models perform mutual learning by measuring the distribution differences between the hash codes to achieve the interaction of individual and group features. The experimental results on the three commonly used brain atlases (AAL Atlas, Dosenbach160 Atlas, and CC200 Atlas) of the ABIDE I dataset show that our proposed DHML method achieves optimal classification performance compared with some state-of-the-art methods.

Diabetic Retinopathy (DR), a diabetes-related eye condition, damages retinal blood vessels and can lead to vision loss if undetected early. Precise diagnosis is challenging due to subtle, varied symptoms. While classical deep learning (DL) models like CNNs and ResNet's are widely used, they face resource and accuracy limitations. Quantum computing, leveraging quantum mechanics, offers revolutionary potential for faster problem-solving across fields like cryptography, optimization, and medicine. This research introduces QuantumNet, a hybrid model combining classical DL and quantum transfer learning to enhance DR detection. QuantumNet demonstrates high accuracy and resource efficiency, providing a transformative solution for DR detection and broader medical imaging applications. The method is as follows:•Evaluate three classical deep learning models-CNN, ResNet50, and MobileNetV2-using the APTOS 2019 blindness detection dataset on Kaggle to identify the best-performing model for integration.•QuantumNet combines the best-performing classical DL model for feature extraction with a variational quantum classifier, leveraging quantum transfer learning for enhanced diagnostics, validated statistically and on Google Cirq using standard metrics.•QuantumNet achieves 94.11 % accuracy, surpassing classical DL models and prior research by 11.93 percentage points, demonstrating its potential for accurate, efficient DR detection and broader medical imaging applications.

Deep learning has shown promising results in various text-based classification tasks. However, deep learning performance is affected by the number of data, i.e., when the number of data is small, deep learning algorithms do not perform well, and vice versa. Classical machine learning algorithms commonly work well for a few data, and their performance reaches an optimal value and does not increase with the increase in sample data. Therefore, this study aimed to compare the performance of classical machine learning and deep learning methods to detect temperament based on Indonesian Twitter. In this study, the proposed Indonesian Linguistic Inquiry and Word Count were employed to analyze the context of Twitter. The classical machine learning methods implemented were support vector machine and K-nearest neighbor, whereas the deep learning method employed was a convolutional neural network (CNN) with three different architectures. Both learning methods were implemented using multiclass classification and one versus all (OVA) multiclass classification. The highest average f-measure was 58.73%, obtained by CNN OVA with a pool size of 3, a dropout value of 0.7, and a learning rate value of 0.0007.

Effect of foot posture, foot orthoses and footwear on lower limb muscle activity during walking and running: A systematic review

Sleep stage classification is important to accurately predict and diagnose patients with sleep disorders. Though various deep learning approaches have been implemented to classify sleep classes, these consist limitations that impact the accuracy and processing time of the classification model. The aim of this research is to enhance the accuracy and minimize the training time of the deep learning classification model. The proposed system consists of One Dimensional Convolutional Neural Network (CNN) with enhanced loss function to improve the accuracy of scoring of five different sleep classes. Preprocessing, Feature Extraction and Classification are the main components of the proposed system. Initially, EEG signals are fed to an adaptive filter for preprocessing, in order to remove any noise in signal. Thereafter, feature is extracted through multiple convolutional and pooling layers, and finally the classification is done by fully connected layer using softmax activation with enhanced loss function. The proposed solution is tested on data samples from multiple datasets with five classes of Sleep classification. Based on the obtained results, the proposed solution has found to achieve an accuracy of 96.26% which is almost 4.2% higher than the state-of-the-art solution which is 92.76%. Furthermore, the processing time has been reduced by 11 milliseconds against the state-of-the-art solution. The proposed system focused on classifying sleep stages in five classes using EEG signals with deep learning approach. It enhances the loss function in order to minimize errors in the prediction of sleep classes and improves the accuracy of the model. Furthermore, the training speed of the model has also been reduced by applying batch normalization techniques inside the model. In the future, larger datasets of different sleep disorder patients with varying features can be used for training and implementing the proposed solution. The datasets can also be pre-processed using additional techniques to refine the data before feeding to the neural network model.

The recent development in learning deep representations has demonstrated its wide applications in traditional vision tasks like classification and detection. However, there has been little investigation on how we could build up a deep learning framework in a weakly supervised setting. In this paper, we attempt to model deep learning in a weakly supervised learning (multiple instance learning) framework. In our setting, each image follows a dual multi-instance assumption, where its object proposals and possible text annotations can be regarded as two instance sets. We thus design effective systems to exploit the MIL property with deep learning strategies from the two ends; we also try to jointly learn the relationship between object and annotation proposals. We conduct extensive experiments and prove that our weakly supervised deep learning framework not only achieves convincing performance in vision tasks including classification and image annotation, but also extracts reasonable region-keyword pairs with little supervision, on both widely used benchmarks like PASCAL VOC and MIT Indoor Scene 67, and also a dataset for image-and patch-level annotations.

Deep learning is one machine learning method based on the layers used in artificial neural networks. The breakthrough of deep learning in classification led to its rapid application in speech recognition, natural language understanding, and image processing and recognition. In the field of biodiversity informatics, deep learning efforts are being applied in rapid species identification and counts of individuals identified based on image, audio, video, and other data types. However, deep learning methods hold great potential for application in all aspects of biodiversity informatics. We present a case study illustrating how to increase data collection quality and efficiency using well-established technology such as optical character recognition (OCR) and some image classification. Our goal is to image data from the scanned documents of various butterfly atlases, add species, specimens, collections, photographs and other relevant information, and build a database of butterfly images. Information collection involves image annotation and text-based descritpion input. Although the work of image annotation is simple, this process can be accelerated by deep learning-based target segmentation to make the selection process easier, such as changing box select to a double click. The process of information collection is complicated, involving input of species names, specimen collection, specimen description, and other information. Generally, there are many images in atlases, the text layout is rather messy, and overall OCR success is poor. Therefore, the measures we take are as follows: Step A: select the screenshot of the text and then call the OCR interface to generate the text material; Step B: proceed with NLP- (natural language processing) related processing; Step C: perform manual operations on the results, and introduce the NLP function again to this process; Step D: submit the result. The deep learning applications we integrated in our client tool include: target segmentation of the annotated image for automatic positioning and background removal, etc. to improve the quality of the image used for identification; making a preliminary judgment on various attributes of the labeled image and using the results to assist the automatic filling of relevant information in step B, including species information, specimen attributes (specimen image, nature photo, hand drawing pictures, etc.), insect stage (egg, adult, etc.); OCR in step A. target segmentation of the annotated image for automatic positioning and background removal, etc. to improve the quality of the image used for identification; making a preliminary judgment on various attributes of the labeled image and using the results to assist the automatic filling of relevant information in step B, including species information, specimen attributes (specimen image, nature photo, hand drawing pictures, etc.), insect stage (egg, adult, etc.); OCR in step A. Some simple machine learning methods such as k-nearest neighbor can be used to automatically determine gender, pose, and so on. While complex information such as collection place, time, and collector can be analyzed by deep learning-based NLP methods in the future. In our infomation collection process, ten fields are required to submit one single record. Of those, about 4-5 input fields can be dealt with the AI-assistant. It can thus be seen from the above process that deep learning has reduced the workload of manual information annotation by at least 30%. With improvements in accuracy, the era of using automatic information extraction robots to replace manual information annotation and collection is just around the corner.

Electromyographic activity in the immobilized shoulder girdle musculature during contralateral upper limb movements

Cell identification and phenotyping using classical machine learning and deep learning Recent image analysis and machine learning technologies have enabled the characterization of biology and human health in multiple dimensions, even at the single cell level. By revealing unique characteristics of any cells of interest, single cell analysis offers significant advantages in various fields of science from cancer or brain research through drug development to personalized and targeted treatments. Usually the first step in most microscopy-based single cell analyses task is the identification of nuclei. Precise localization and identification are fundamental for the accurate assessment of important cell functions. Previously the leading approaches were based on classical image processing methods which usually require prior knowledge to accurately fine-tune the parameters assessed. Recently, the revolutionary approach of deep learning has been incorporated into image analysis, and has fundamentally contributed to achieve ground-breaking results in single cell analysis, including image classification, image registration, object detection and recognition, and its applications such as computer-aided diagnosistics. This thesis consists of two parts: phenotypic analysis (with machine learning) and single cell analysis (with deep learning). In the first part, I have focused on answering major questions in phenotypic data analysis, including how to discover the whole dataset effectively or how to increase the accuracy of classification. In the second part the primary focus is on deep learning based approaches. During my research I used and developed various software tools and created algorithms to support in-depth single cell analysis. All of these are aimed to support a higher level of single cell detection and segmentation. This part covers some major research tasks in which I have participated, thus a full automation of a patch-clamping system previously driven manually and a standalone tool to help the user analyze object occurrences on specific regions of an image are presented here. As a result, we have successfully demonstrated how to apply machine learning methods effectively by implementing flexible software tools appropriate for phenotyping. Thereby, we have successfully accomplished the main aim of our research to improve time-efficiency of biological image-based data analysis for human experts. We have also demonstrated that deep learning, a more advanced machine learning technique, utilized in various approaches is capable of finding cells at high precision. Thereby, it has the potential to support automatizing and replacing human tasks in single cell research.

The dynamic modulus (|E*|) of hot-mix asphalt (HMA) is a crucial mechanistic characteristic essential in defining the strain response of asphalt concrete (AC) mixtures under varying loading rates and temperatures. This paper aims to conduct a comprehensive investigation of classical machine learning (ML) and deep learning (DL) algorithms as applied to the prediction of |E*| and compare their performance with renowned |E*| regression models (Witczak NCHRP 1-37A, Witczak NCHRP 1-40D, and Hirsch). Eight state-of-the-art ML and DL algorithms are attempted with diverse structures, including multiple linear regression (MLR), decision trees (DT), support vector regression (SVR), ensemble trees (ET), Gaussian process regression (GPR), artificial neural networks (ANN), recurrent neural networks (RNN), and convolutional neural networks (CNN). A comprehensive database was assembled, incorporating 50 AC mixtures, of which 25 were from the Kingdom of Saudi Arabia and 25 were from the state of Idaho, USA. This database encompasses an extensive dataset of 3,720 |E*| measurements, associated with thirteen input features representing the proposed AC mixtures’ aggregate gradations, binder characteristics, and volumetric properties. This pioneering study surpasses existing research by examining various algorithms to predict |E*| on the same dataset, applying them with different structures and individual optimization to achieve optimal performance. The developed models are evaluated based on multi-stage assessment criteria, including the accuracy and complexity performance measures and rationality based on a sensitivity analysis. The multi-stage comparative analysis results reveal that the bagging ETs, GPR with exponential kernel, and DT record the highest prediction accuracy; however, only the bagging ETs yield the highest accuracy, lowest training and testing complexity, and rational trends throughout the sensitivity analysis. The research outcome has the potential to provide pavement engineers with advanced tools for predicting |E*| and, therefore, optimizing pavement designs and rehabilitations. Doi: 10.28991/CEJ-2025-011-01-06 Full Text: PDF

Nowadays, science and technology has rapidly increasing due to the specific requirements of education. The main aim of this technique is to enhance the physical education activities and helps sports man to finest teaching facilities of these activities. Moreover, the body changes with sports activities based on Deep Learning (DL) frameworks and classifier technology are examined to promote the practical application. Therefore, this paper Deep Reinforcement Learning based Chimp optimization (DRLbCO) algorithm was developed to improve the teaching efficiency of physical education system through the intelligent computer aided assessment models. Also, this model improving the performance, enhancing coaching effectiveness, and gaining competitive advantages in sports. Consequently, the proposed system is based on DL based image detection model DRL, which can analyse and provides proper actions in teaching students and enhance the ability of motion analysis in sports video training quality. Moreover, the DL model is integrated with optimization algorithm to optimize the performance. This could involve reinforcement learning, and other classifiers such as Support Vector Machine (SVM). Based on this provides feedback to students and teachers during physical education classes. The developed model is significantly enhances the physical education teaching student action in virtual sports instruction. Overall intention of the video assessment system of the sports training performance in analyzed.