Deep High-order Tensor Convolutional Sparse Coding for Stereo Matching

Deep features for automatic spoofing detection

Urban traffic passenger flows prediction is practically important to facilitate many real applications including transportation management and public safety. Recently, deep learning based approaches are proposed to learn the spatio-temporal characteristics of the traffic passenger flows. However, it is still very challenging to handle some complex factors such as hybrid transportation lines, mixed traffic, transfer stations, and some extreme weathers. Considering the multi-channel and irregularity properties of urban traffic passenger flows in different transportation lines, a more efficient and fine-grained deep spatio-temporal feature learning model is necessary. In this paper, we propose a deep irregular convolutional residual LSTM network model called DST-ICRL for urban traffic passenger flows prediction. We first model the passenger flows among different traffic lines in a transportation network into multi-channel matrices analogous to the RGB pixel matrices of an image. Then, we propose a deep learning framework that integrates irregular convolutional residential network and LSTM units to learn the spatial-temporal feature representations. To fully utilize the historical passenger flows, we sample both the short-term and long-term historical traffic data, which can capture the periodicity and trend of the traffic passenger flows. In addition, we also fuse other external factors further to facilitate a real-time prediction. We conduct extensive experiments on different types of traffic passenger flows datasets including subway, taxi and bus flows in Beijing as well as bike flows in New York. The results show that the proposed DST-ICRL significantly outperforms both traditional and deep learning based urban traffic passenger flows prediction methods.

Accurate segmentation of abdominal organs on MRI is crucial for computer-aided surgery and computer-aided diagnosis. Most state-of-the-art methods for MRI segmentation employ an encoder-decoder structure, with skip connections concatenating shallow features from the encoder and deep features from the decoder. In this work, we noticed that simply concatenating shallow and deep features was insufficient for segmentation due to the feature gap between shallow features and deep features. To mitigate this problem, we quantified the feature gap from spatial and semantic aspects and proposed a spatial loss and a semantic loss to bridge the feature gap. The spatial loss enhanced spatial details in deep features, and the semantic loss introduced semantic information into shallow features. The proposed method successfully aggregated the complementary information between shallow and deep features by formulating and bridging the feature gap. Experiments on two abdominal MRI datasets demonstrated the effectiveness of the proposed method, which improved the segmentation performance over a baseline with nearly zero additional parameters. Particularly, the proposed method has advantages for segmenting organs with blurred boundaries or in a small scale, achieving superior performance than state-of-the-art methods.

This paper takes the problems and ways of diversified curriculum construction of vocal music education in colleges and universities as the entry point and constructs a deep blended learning model of vocal music diversified curriculum based on the deep learning model. The deep evolutionary knowledge tracking model is constructed by combining the self-attention mechanism embedding model with vocal music knowledge evolution based on Transformer. To verify the effectiveness of the deep blended learning model constructed in this paper, model comparison experiments and empirical analysis were conducted. The results show that compared with the SAKT model, the DBL model in this paper has a 5.19% improvement in the average ROC-AUC value. The vocal posttest scores of the students in the experimental class were 5.09 points higher than those of the control class, with a two-tailed significance value of 0.027, which is less than 0.05 and a significant difference. This indicates that the deep learning model can effectively promote the innovative design of diversified curricula for vocal music education in colleges and universities and enhance students’ vocal music learning ability.

This paper compares the classification performance of machine learning classifiers vs. deep learning-based handcrafted models and various pretrained deep networks. The proposed study performs a comprehensive analysis of object classification techniques implemented on low-altitude UAV datasets using various machine and deep learning models. Multiple UAV object classification is performed through widely deployed machine learning-based classifiers such as K nearest neighbor, decision trees, naïve Bayes, random forest, a deep handcrafted model based on convolutional layers, and pretrained deep models. The best result obtained using random forest classifiers on the UAV dataset is 90%. The handcrafted deep model's accuracy score suggests the efficacy of deep models over machine learning-based classifiers in low-altitude aerial images. This model attains 92.48% accuracy, which is a significant improvement over machine learning-based classifiers. Thereafter, we analyze several pretrained deep learning models, such as VGG-D, InceptionV3, DenseNet, Inception-ResNetV4, and Xception. The experimental assessment demonstrates nearly 100% accuracy values using pretrained VGG16- and VGG19-based deep networks. This paper provides a compilation of machine learning-based classifiers and pretrained deep learning models and a comprehensive classification report for the respective performance measures.

Accurately forecasting vessel motions is a critical step towards achieving fast and accurate intelligent vessel control systems. Intelligent vessel control relies on accurate predictions of vessel motion to make informed decisions regarding control, maneuvering, and positioning, particularly during times of exogenous loading caused by adverse weather conditions. Hence, by accurately forecasting vessel motion accurately, the control system can anticipate potential issues (i.e., excessive trim or roll) and prescribe corrective actions before they become problematic. In this study, the authors propose two approaches to address the problem of vessel motion forecasting. The first approach relies on classical shallow learning models, whereas the second approach involves the use of state-of-the-art deep learning models for improved accuracy at further forecast horizons. Unlike shallow models, deep models can learn the required features directly from the data and therefore do not require a priori knowledge or additional features engineering. By leveraging deep learning models, the authors show that vessel motions can be forecasted further into the future without a significant loss in accuracy, thereby improving the overall effectiveness of the intelligent vessel control system. To support their statements, the authors use real operational data and compare the performance of the shallow and deep learning models. The results show that deep learning outperforms shallow learning models in terms of accuracy without a significant increase in the computational demand. Additionally, the authors demonstrate that their models remain accurate even under adverse weather conditions, indicating that they have practical applicability for vessel motions forecasting and can potentially improve the overall effectiveness of intelligent vessel control systems.

Asymmetric double-winged multi-view clustering network for exploring diverse and consistent information

This paper introduces an approach to employ deep features for person re-identification. In contrast to existing works, we focus on using pre-trained deep models and their concept-based output to enhance attribute presentations of person images. There are two main contributions. First, we investigate recent state-of-the-art deep learning models for the task and provide a comprehensive evaluation. Second, we present an approach to improve identification accuracy of a standard attribute-based person re-identification approach. By using pre-trained models, we avoid re-training new deep models which always require a huge amount of training data and high computational cost. The idea is to utilize the correlation between generic concepts learned by the deep models and specific pre-defined attributes commonly used for person re-identification. We employ the deeply learned features from generic concepts to represent person images. These images and their manually annotated attributes are then used to train attribute classifiers. Given the classifiers, attributes of the probe and gallery images can be automatically extracted to compose attribute-based feature vectors. Re-identification is done by matching the vectors. Experiments conducted on several benchmark datasets demonstrated the effectiveness of the proposed approach.

Predicting the wafer material removal rate (MRR) is an important step in semiconductor manufacturing for total quality control. This work proposes a deep learning model called a fusion network to predict the MRR, in which we consider separating features into shallow and deep features and use the characteristics of deep learning to perform a fusion of these two kinds of features. In the proposed model, the deep features go through a sequence of nonlinear transformations and the goal is to learn the complex interactions among the features to obtain the deep feature embeddings. Additionally, the proposed method is flexible and can incorporate domain knowledge into the model by encoding the knowledge as shallow features. Once the learning of deep features is completed, the proposed model uses the shallow features and the learned deep feature embeddings to obtain new features for the subsequent layers. This work performs experiments on a dataset from the 2016 Prognostics and Health Management Data Challenge. The experimental results show that the proposed model outperforms the competition winner and three ensemble learning methods. The proposed method is a single model, whereas the comparison methods are ensemble models. Besides the experimental results, we conduct extensive experiments to analyze the proposed method.

Due to the COVID-19 pandemic, computerized COVID-19 diagnosis studies are proliferating. The diversity of COVID-19 models raises the questions of which COVID-19 diagnostic model should be selected and which decision-makers of healthcare organizations should consider performance criteria. Because of this, a selection scheme is necessary to address all the above issues. This study proposes an integrated method for selecting the optimal deep learning model based on a novel crow swarm optimization algorithm for COVID-19 diagnosis. The crow swarm optimization is employed to find an optimal set of coefficients using a designed fitness function for evaluating the performance of the deep learning models. The crow swarm optimization is modified to obtain a good selected coefficient distribution by considering the best average fitness. We have utilized two datasets: the first dataset includes 746 computed tomography images, 349 of them are of confirmed COVID-19 cases and the other 397 are of healthy individuals, and the second dataset are composed of unimproved computed tomography images of the lung for 632 positive cases of COVID-19 with 15 trained and pretrained deep learning models with nine evaluation metrics are used to evaluate the developed methodology. Among the pretrained CNN and deep models using the first dataset, ResNet50 has an accuracy of 91.46% and a F1-score of 90.49%. For the first dataset, the ResNet50 algorithm is the optimal deep learning model selected as the ideal identification approach for COVID-19 with the closeness overall fitness value of 5715.988 for COVID-19 computed tomography lung images case considered differential advancement. In contrast, the VGG16 algorithm is the optimal deep learning model is selected as the ideal identification approach for COVID-19 with the closeness overall fitness value of 5758.791 for the second dataset. Overall, InceptionV3 had the lowest performance for both datasets. The proposed evaluation methodology is a helpful tool to assist healthcare managers in selecting and evaluating the optimal COVID-19 diagnosis models based on deep learning.

Coronavirus, also known as COVID-19, has spread to several countries around the world. It was announced as a pandemic disease by The World Health Organization (WHO) in 2020 for its devastating impact on humans. With the advancements in computer science algorithms, the detection of this type of virus in the early stages is urgently needed for the fast recovery of patients. In this paper, a study of neutrosophic set significance on deep transfer learning models will be presented. The study will be conducted over a limited COVID-19 x-ray. The study relies on neutrosophic set and theory to convert the medical images from the grayscale spatial domain to the neutrosophic domain. The neutrosophic domain consists of three types of images, and they are the True (T) images, the Indeterminacy (I) images, and the Falsity (F) images. The dataset used in this research has been collected from different sources. The dataset is classified into four classes {COVID-19, normal, pneumonia bacterial, and pneumonia virus}. This study aims to review the effect of neutrosophic sets on deep transfer learning models. The selected deep learning models in this study are Alexnet, Googlenet, and Restnet18. Those models are selected as they have a small number of layers on their architectures. To test the performance of the conversion to the neutrosophic domain, more than 36 trials have been conducted and recorded. A combination of training and testing strategies by splitting the dataset into (90–10%, 80–20%, 70–30) is included in the experiments. Four domains of images are tested, and they are, the original domain, the True (T) domain, the Indeterminacy (I) domain, and the Falsity (F) domain. The four domains with the different training and testing strategies were tested using the selected deep transfer models. According to the experimental results, the Indeterminacy (I) neutrosophic domain achieves the highest accuracy possible with 87.1% in the testing accuracy and performance metrics such as Precision, Recall, and F1 Score. The study concludes that using the neutrosophic set with deep learning models may be an encouraging transition to achieve better testing accuracy, especially with limited COVID-19 datasets.

Manufacturing process of Lithium-ion battery electrode has a direct impact on the resulting practical properties of the cell such as durability, safety and overall performance. In this scenario, together with experimental efforts to understand the correlation between manufacturing process parameters and final overall electrode performance, computational tools have shown the potential to produce insights on the manufacturing properties interdependencies. The ARTISTIC initiative [1] pioneered the development of a series of computational 3D-resolved physics-based models describing each step of the manufacturing process following a sequential pattern, going from the slurry phase, through the drying phase, to produce a calendered electrode. Such physics-based models have the capability to predict how manufacturing parameters impact the electrode microstructure. At the end of each phase the output microstructure is carefully validated with experimental data, assuring that the model is in good agreement with real properties. For the calendering phase, the Discrete Element Method (DEM) is used for the model simulation.One of the main limitations of the DEM simulations is their high computational cost, preventing their direct application in electrode optimization loops. In this matter, and given the great amount of already validated data that was produced in our previous works by using the ARTISTIC model, we take one step forward in the development of a new generation model employing machine learning (ML) techniques to accelerate the physics-based simulations but keeping their accuracy. In this presentation we report a novel time-dependent deep learning (DL) model of the battery electrodes manufacturing process. The DL model is demonstrated for calendering of nickel manganese cobalt (NMC111) electrodes, and trained with time-series data arising from physics-based DEM simulations coming from the ARTISTIC physics-based modeling pipeline [2]. The innovative DL model presented in this work can predict an electrode microstructure evolution over time at a given compression degree during calendering and provide the associated final relaxed electrode microstructure. Here we used the formulation of 96% AM and 4% CBD as a proof of concept.The DL model predictions are validated by comparing data evaluation metrics (e.g., mean square error (MSE) and R2 score) and electrode functional metrics (contact surface area, porosity, diffusivity, and tortuosity factor), showing very good accuracy with respect to the DEM simulations (all the properties are above 90% accurate when compared to target data). Regarding transport properties and given the high accuracy of the DL model to predict tortuosity factor and porosity values we can conclude that the model correctly predicts the effect of the calendering on the transport properties since tortuosity factor and porosity has a high impact on the effective transport properties of Li-ions in the electrolyte. The DL model can remarkably capture the elastic recovery of the electrode upon compression (spring-back phenomenon) and the main 3D electrode microstructure features without using the functional descriptors during its training. In terms of computational cost, the DL model performs a timestep in 15 seconds (wall time) while the DEM model performs an equivalent time step in ∼47 minutes (wall time). Given the DL model significant lower computational cost than the DEM simulations, it paves the way toward quasi-real-time optimization loops of the 3D electrode architecture predicting the calendering conditions to adopt in order to obtain the desired electrode performance. Moreover, we consider that our model has tremendous potential to grow in several aspects such as accuracy and predictability. Therefore, our incoming efforts will be focused on continuing the development of the model and testing it for other formulations and in other manufacturing stages.[1] ARTISTIC Project website. https://www.erc-artistic.eu.[2] D. E. Galvez-Aranda, T. L. Dinh, U. Vijay, F. M. Zanotto, A. A. Franco, Time-Dependent Deep Learning Manufacturing Process Model for Battery Electrode Microstructure Prediction. Adv. Energy Mater. 2024, 2400376. https://doi.org/10.1002/aenm.202400376 Figure 1

Sentiment analysis is a subfield of Natural Language Processing (NLP) which tries to process a text to extract opinions or attitudes towards topics or entities. Recently, the use of deep learning methods for sentiment analysis has received noticeable attention from researchers. Generally, different deep learning methods have shown superb performance in sentiment analysis problem. However, deep learning models are different in nature and have different strengths and limitations. For example, convolutional neural networks are useful for extracting local structures from data, while recurrent models are able to learn order dependence in sequential data. In order to combine the advantages of different deep models, in this paper we have proposed a novel approach for aspect-based sentiment analysis which utilizes deep ensemble learning. In the proposed method, we first build four deep learning models, namely CNN, LSTM, BiLSTM and GRU. Then the outputs of these models are combined using stacking ensemble approach where we have used logistic regression as meta-learner. The results of applying the proposed method on the real datasets show that our method has increased the accuracy of aspect-based prediction by 5% to 20% compared to the basic deep learning methods.

Voice-based age, gender, and language recognition based on ResNet deep model and transfer learning in spectro-temporal domain

To explore the value of deep learning-based multi-parametric magnetic resonance imaging (mp-MRI) nomogram in predicting the Ki-67 expression in rectal cancer. The data of 491 patients with rectal cancer from two centers were retrospectively analyzed and divided into training, internal validation, and external validation sets. They were categorized into high- and low-expression group based on postoperative pathological Ki-67 expression. Each patient's mp-MRI data were analyzed to extract and select the most relevant features of deep learning, and a deep learning model was constructed. Independent predictive risk factors were identified and incorporated into a clinical model, and the clinical and deep learning models were combined to obtain a nomogram for the prediction of Ki-67 expression. The performance characteristics of the DL-model, clinical model, and nomogram were assessed using ROCs, calibration curve, decision curve, and clinical impact curve analysis. The strongest deep learning features were extracted and screened from mp-MRI data. Two independent predictive factors, namely Magnetic Resonance Imaging T (mrT) staging and differentiation degree, were identified through clinical feature selection. Three models were constructed: a deep learning (DL)-model, a clinical model, and a nomogram. The AUCs of clinical model in the training, internal validation, and external validation set were 0.69, 0.78, and 0.67, respectively. The AUCs of the deep model and nomogram ranged from 0.88 to 0.98. The prediction performance of the deep learning model and nomogram was significantly better than the clinical model (P < 0.001). The nomogram based on deep learning can help clinicians accurately and conveniently predict the expression status of Ki-67 in rectal cancer.