Feature Augmenting Networks for Improving Depression Severity Estimation From Speech Signals

Deep convolutional generative adversarial networks for the generation of numerous artificial spectrum‐compatible earthquake accelerograms using a limited number of ground motion records

Globally, wind energy if properly harnessed, could serve as a source of energy generation in Africa. This study compared the performance of two Machine Learning (ML) algorithms (Linear regression and Random Forest) in predicting wind speed in five major cities in Africa (Yaoundé, Pretoria, Nairobi, Cairo and Abuja). Wind data were collected between January 1, 2000, and December 31, 2022, using the Solar Radiation Data Archive. The data preprocessing was carried out with 80% of the data used for training and 20% for validation. The performance of these ML algorithms was evaluated using Mean Square Error (MSE), Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE) and coefficient of determination (R2). The result shows that Nairobi (3.814795 m/s) closely followed by Cairo (3.606453 m/s) has the highest mean wind speed while Yaoundé (1.090512 m/s) has the lowest. Based on the performance metrics used, the two Machine Learning algorithms were competitive. Still, the Linear Regression (LR) algorithm outperformed the Random Forest Algorithm in predicting wind speed in all the selected major African cities. In Yaoundé (RMSE = 0.3892, MAE= 0.3001, MAPE =0.5030), Pretoria (RMSE=1.2339, MAE=0.9480, MAPE=0.7450) Nairobi (RMSE= 0.4223, MAE =0.6499, MAPE =0.1872), Nairobi (RMSE=0.6499, MAE=0.5171, MAPE =0.1872), Cairo (RMSE =1.0909, MAE =0.8544, MAPE =0.3541) and Abuja (RMSE = 0.70245, MAE =0.5441, MAPE= 0.4515) the Linear regression algorithms was found to outperformed Random Forest Regression. Therefore, the Linear regression algorithm is more reliable in predicting wind speed compared with the Random Forest regression.

Generative models have been applied in many fields and can be evaluated with many methods. In the evaluation of generative models, the proper evaluation metric varies with the application field. Therefore, the evaluation of generative adversarial networks is inherently challenging. In this study, conditional deep convolutional generative adversarial networks were applied in mechanical fault diagnosis and then evaluated. We proposed three evaluation metrics of conditional deep convolutional generative adversarial networks: Jensen-Shannon divergence, kernel maximum mean discrepancy, and the 1-nearest neighbor classifier which were used to distinguish generated samples from real samples, test mode collapsing and detect overfitting based on the dataset of Electronic Engineering Laboratory of Case Western Reserve University and the planetary gearbox dataset measured in the laboratory. The Jensen-Shannon divergence could not well distinguish generated samples from real samples. However, the two metrics (maximum mean discrepancy and 1-nearest neighbor classifier) well-distinguished generated samples from real samples, thus verifying the applicability of conditional deep convolutional generative adversarial networks in the field of mechanical diagnosis.

The precise forecasting of groundwater levels significantly influences plant growth and the sustainable management of ecosystems. Nonetheless, the non-stationary characteristics of groundwater level data often hinder the current deep learning algorithms from precisely capturing variations in groundwater levels. We used Variational Mode Decomposition (VMD) and an enhanced Transformer model to address this issue. Our objective was to develop a deep learning model called VMD-iTransformer, which aims to forecast variations in the groundwater level. This research used nine groundwater level monitoring stations located in Hangjinqi Ecological Reserve in Kubuqi Desert, China, as case studies to forecast the groundwater level over four months. To enhance the predictive performance of VMD-iTransformer, we introduced a novel approach to model the fluctuations in groundwater levels in the Kubuqi Desert region. This technique aims to achieve precise predictions of the non-stationary groundwater level conditions. Compared with the classic Transformer model, our deep learning model more effectively captured the non-stationarity of groundwater level variations and enhanced the prediction accuracy by 70% in the test set. The novelty of this deep learning model lies in its initial decomposition of multimodal signals using an adaptive approach, followed by the reconfiguration of the conventional Transformer model’s structure (via self-attention and inversion of a feed-forward neural network (FNN)) to effectively address the challenge of multivariate time prediction. Through the evaluation of the prediction results, we determined that the method had a mean absolute error (MAE) of 0.0251, a root mean square error (RMSE) of 0.0262, a mean absolute percentage error (MAPE) of 1.2811%, and a coefficient of determination (R2) of 0.9287. This study validated VMD and the iTransformer deep learning model, offering a novel modeling approach for precisely predicting fluctuations in groundwater levels in a non-stationary context, thereby aiding sustainable water resource management in ecological reserves. The VMD-iTransformer model enhances projections of the water level, facilitating the reasonable distribution of water resources and the long-term preservation of ecosystems, providing technical assistance for ecosystems’ vitality and sustainable regional development.

Inferring particle distributions in two-dimensional space with numerical features based on generative adversarial networks (GANs)

BackgroundMore than 79.2 million confirmed COVID-19 cases and 1.7 million deaths were caused by SARS-CoV-2; the disease was named COVID-19 by the World Health Organization. Control of the COVID-19 epidemic has become a crucial issue around the globe, but there are limited studies that investigate the global trend of the COVID-19 pandemic together with each country’s policy measures.ObjectiveWe aimed to develop an online artificial intelligence (AI) system to analyze the dynamic trend of the COVID-19 pandemic, facilitate forecasting and predictive modeling, and produce a heat map visualization of policy measures in 171 countries.MethodsThe COVID-19 Pandemic AI System (CPAIS) integrated two data sets: the data set from the Oxford COVID-19 Government Response Tracker from the Blavatnik School of Government, which is maintained by the University of Oxford, and the data set from the COVID-19 Data Repository, which was established by the Johns Hopkins University Center for Systems Science and Engineering. This study utilized four statistical and deep learning techniques for forecasting: autoregressive integrated moving average (ARIMA), feedforward neural network (FNN), multilayer perceptron (MLP) neural network, and long short-term memory (LSTM). With regard to 1-year records (ie, whole time series data), records from the last 14 days served as the validation set to evaluate the performance of the forecast, whereas earlier records served as the training set.ResultsA total of 171 countries that featured in both databases were included in the online system. The CPAIS was developed to explore variations, trends, and forecasts related to the COVID-19 pandemic across several counties. For instance, the number of confirmed monthly cases in the United States reached a local peak in July 2020 and another peak of 6,368,591 in December 2020. A dynamic heat map with policy measures depicts changes in COVID-19 measures for each country. A total of 19 measures were embedded within the three sections presented on the website, and only 4 of the 19 measures were continuous measures related to financial support or investment. Deep learning models were used to enable COVID-19 forecasting; the performances of ARIMA, FNN, and the MLP neural network were not stable because their forecast accuracy was only better than LSTM for a few countries. LSTM demonstrated the best forecast accuracy for Canada, as the root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) were 2272.551, 1501.248, and 0.2723075, respectively. ARIMA (RMSE=317.53169; MAPE=0.4641688) and FNN (RMSE=181.29894; MAPE=0.2708482) demonstrated better performance for South Korea.ConclusionsThe CPAIS collects and summarizes information about the COVID-19 pandemic and offers data visualization and deep learning–based prediction. It might be a useful reference for predicting a serious outbreak or epidemic. Moreover, the system undergoes daily updates and includes the latest information on vaccination, which may change the dynamics of the pandemic.

PurposeThe purpose of this study was to evaluate the accuracy and perceptual quality of red-green-blue (RGB) fundus images generated from red-green (RG) images using Pix2Pix-based generative adversarial network (GAN).MethodsRG images were extracted from original RGB images recorded by a newer model of the Optos system by turning off the blue laser source. A conditional GAN based on the Pix2Pix architecture was trained to convert this extracted RG image to an RGB image. The performance was evaluated quantitatively by using a five-fold cross-validation and assessments with structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR), learned perceptual image patch similarity (LPIPS), mean absolute error (MAE), and root mean square error (RMSE). To assess the perceptual accuracy, 39 ophthalmologists examined 60 randomly selected images, 30 true and 30 generated RGB images, using Google Form-based interface. They were instructed to classify each image as a true or an artificial intelligence (AI)-generated image.ResultsThe generated images had high similarity to the original RGB images (SSIM = 0.97 ± 0.00; PSNR = 35.74 ± 0.17 decibel [dB]; LPIPS = 0.09 ± 0.00; MAE = 1.76 ± 0.04; and RMSE = 4.25 ± 0.10). The overall correct classification rate was 57.1%. Certain lesion types, such as epiretinal membrane and optic disc cupping, had higher discrimination rates. The receiver operating characteristic (ROC) analysis across all evaluations yielded an area under the curve (AUC) of 0.497 (P = 0.314).ConclusionsPix2Pix-based GANs can generate perceptually and structurally consistent RGB images from RG images without lesion-specific attention mechanisms.Translational RelevanceThis method enables a reinterpretation of legacy RG fundus images and may support future AI diagnostic applications.

This study introduces the MSTA-GNet (Multi-Scale Spatiotemporal Attention Graph Network), a novel deep learning model which integrates spatiotemporal self-attention mechanisms to model heterogeneous dependencies in traffic networks. The primary objective of the study is to improve existing traffic flow prediction models to address the inadequacies of traditional models in complex big data environments. Key innovations of the MSTA-GNet model include positional encoding and global and local self-attention mechanisms to capture long-term and short-term dependencies. Using the PeMS (Performance Measurement System) dataset, the study conducted performance comparison experiments among various deep learning models, including LSTM (Long Short-Term Memory), GCN (Graph Convolutional Network), DCRNN (Diffusion Convolutional Recurrent Neural Network), STGCN (Spatiotemporal Graph Convolutional Network), STMetaNet (Spatiotemporal Meta Network), and MSTA-GNet. The results showed that MSTA-GNet significantly outperformed other models with improvements of 13.4%, 11.8%, and 9.7% in Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE) metrics, respectively. Ablation studies further validated the significance of attention mechanisms, feature extraction, convolutional layers, and graph networks, confirming the effectiveness and practical application of MSTA-GNet in traffic flow prediction. This research provides important insights for AI-based congestion management, support for low-carbon traffic networks, and optimization of local traffic operations, demonstrating its significant practical value in intelligent transportation systems.

Fractional-order models (FOMs) have been recognized as superior tools for capturing the complex electrochemical dynamics of lithium-ion batteries, outperforming integer-order models in accuracy, robustness, and adaptability. Parameter identification (PI) is essential for FOMs, as its accuracy directly affects the model’s ability to predict battery behavior and estimate critical states such as state of charge (SOC) and state of health (SOH). In this study, a hybrid deep learning approach has been introduced for FOM PI, representing the first application of deep learning in this domain. A simulation platform was developed to generate datasets using Sobol and Monte Carlo sampling methods. Five deep learning models were constructed: long short-term memory (LSTM), gated recurrent unit (GRU), one-dimensional convolutional neural network (1DCNN), and hybrid models combining 1DCNN with LSTM and GRU. Hyperparameters were optimized using Optuna, and enhancements such as Huber loss for robustness to outliers, stochastic weight averaging, and exponential moving average for training stability were incorporated. The primary contribution lies in the hybrid architectures, which integrate convolutional feature extraction with recurrent temporal modeling, outperforming standalone models. On a test set of 1000 samples, the improved 1DCNN + GRU model achieved an overall root mean square error (RMSE) of 0.2223 and a mean absolute percentage error (MAPE) of 0.27%, representing nearly a 50% reduction in RMSE compared to its baseline. This performance surpasses that of the improved LSTM model, which yielded a MAPE of 9.50%, as evidenced by tighter scatter plot alignments along the diagonal and reduced error dispersion in box plots. Terminal voltage prediction was validated with an average RMSE of 0.002059 and mean absolute error (MAE) of 0.001387, demonstrating high-fidelity dynamic reconstruction. By advancing data-driven PI, this framework is well-positioned to enable real-time integration into battery management systems.

Predictive maintenance has gained importance across various industries, including the automotive sector. It is very challenging to detect vehicle failures in advance due to the intricate composition of various components and sensors. The vehicle’s reliability is of utmost importance for ensuring the absence of fatalities or malfunctions to foster economic development. This study introduces an innovative method for developing a predictive framework for vehicle engines with faster and higher decision accuracy. The framework is specifically designed to recognize patterns and abnormalities that may suggest prospective engine problems in real-time and allow proactive maintenance. We assessed the performance of the developed vehicular engine health monitoring systems using a deep learning model based on essential measures like root mean square error, root mean square deviation, mean absolute error, accuracy, confusion matrix, and area under the curve. In this case, the deep learning models are developed by following ensemble techniques using the most prominently used machine learning techniques. Significantly, Stacked Model 1 outperformed other stacked models (Models 2 and 3) and achieved an impressive AUC value of 0.9702 with a low root mean square error (RMSE) of 0.3355, a high accuracy rate of 0.9470, and a precision of 0.9486. It happens due to the effective incorporation of different approaches into Stacked Model 1, which signifies a significant advancement in predicting vehicular engine failures. The model can be used in real-time monitoring systems to continuously monitor the health of vehicular engines and provide early warnings of potential failures, thereby reducing maintenance costs and improving safety.

<p>Accurate water level (WL) forecasting is important for water resources management and planning purposes in the Great Lakes. The objectives of this research are two-fold.  The first objective is to apply machine learning (ML) (i.e., random forest (RF) and support vector regression (SVR)) and hybrid convolutional neural network(CNN)-long-short term memory (LSTM) deep learning (DL) models for multi-step (i.e., one-, two- and three-monthly step ahead) WL forecasting in the Great Lakes (Michigan and Ontario). The second objective is to integrate the boundary corrected (BC) maximal overlap discrete wavelet transform (MODWT) with SVR, RF, and CNN-LSTM models to improve the performance of the individual models. By employing a BC-wavelet decomposition method, the ‘future data’ issue (i.e., data from the future that is not available), often overlooked in the literature and a major barrier to achieving realistic forecasting performance is overcome. </p><p>For Lakes Michigan and Ontario, 1212 monthly WL (m) records (spanning Jan 1918–Dec 2018) were used to develop the models. For the non-wavelet-based models (SVR, RF, and CNN-LSTM), candidate model inputs included the WL recorded over the previous 12 months.  For the BC-MODWT-based models (BC-MODWT-SVR, BC-MODWT-RF, and BC-MODWT-CNN-LSTM), the lagged input time series were decomposed into BC-wavelet and scaling coefficients by using different mother wavelets (Haar, Daubechies, Symlets, Fejer-Korovkin and Coiflets), filter lengths (from two up to 12) and decomposition levels (from one up to seven).  For each method (SVR, RF, and CNN-LSTM), mother wavelet, and decomposition level a model was generated.  For both wavelet- and non-wavelet-based models, the particle swarm optimization (PSO) method was used to select the most appropriate inputs to include in the proposed multi-step WL forecasting models.</p><p>The datasets were partitioned into calibration and validation subsets. After calibrating the models, various performance evaluation metrics, e.g., coefficient of determination (R<sup>2</sup>), root mean square error (RMSE), mean absolute error (MAE), root mean square percentage error (RMSPE), mean absolute percentage error (MAPE) and the Nash-Sutcliffe efficiency coefficient (NSC) were used to assess model accuracy.</p><p>Of the ML models, the SVR outperformed RF while the DL models outperformed the ML models for each forecast lead time (one-, two-, and three-step(s) ahead). Results from this case study indicate that not all wavelet families and decomposition levels perform equally and in some cases, the wavelet-based models do not improve performance over the non-wavelet-based models. However, the BC-MODWT-CNN-LSTM using suitable mother wavelets (e.g., Haar) outperforms the individual ML and BC-MODWT-ML-based models. More accurate forecasts were obtained for Lake Michigan although the performance in both Great Lakes was accurate. The outcomes of this research indicate that the BC-MODWT-CNN-LSTM model is a promising tool for generating accurate WL forecasts.</p>

Multi-attention Generative Adversarial Network for multi-step vegetation indices forecasting using multivariate time series

Nowadays , nonlinear time series and artificial neural networks (ANN) models are used for forecasting in the field of business, agriculture and soon. Recent studies have shown, ANN have been successfully used for forecasting of financial and agriculture data series The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. ANN have more advantages that can approximate to model both linear and nonlinear structures in time series, they are not able to handling both structures equally well. The autoregressive integrated moving average (ARIMA) model and two ANN models namely, Radial basis function neural networks (RBFNN), and Elman recurrent neural networks (ERNN) methods were applied to Hyderabad airport traffic data. The data obtained for 15 years from 2002–2003 to 2016–2017 about domestic and international passenger of International Airport of Hyderabad, India. In this research paper, we compared the performances of ARIMA, RBFNN and ERNN were based on three measures: mean absolute error (MAE), mean absolute percentage error (MAPE), and root mean square error (RMSE). The results showed that RBFNN obtained the smallest MAE, MAPE and RMSE in both the modeling and forecasting processes. The performances of the three models ranked in ascending order were: ARIMA, ERNN and the RBFNN model. Keywords: T ime series, forecasting, artificial neural networks, ARIMA models, radial basis function neural networks, and Elman recurrent neural networks Cite this Article R. Ramakrishna, Berhe Aregay, Tewodros Gebregergs. The Comparison in Time Series Forecasting of Air Traffic Data by Autoregressive Integrated Moving Average Model, Radial Basis Function and Elman Recurrent Neural Networks. Research & Reviews: Journal of Statistics . 2018; 7(3): 75–90p.

Due to the real working conditions, the collected mechanical fault datasets are actually limited and always highly imbalanced, which restricts the diagnosis accuracy and stability. To solve these problems, we present an imbalanced fault diagnosis method based on the generative model of conditional-deep convolutional generative adversarial network (C-DCGAN) and provide a study in detail. Deep convolutional generative adversarial network (DCGAN), based on traditional generative adversarial networks (GAN), introduces convolutional neural network into the training for unsupervised learning to improve the effect of generative networks. Conditional generative adversarial network (CGAN) is a conditional model obtained through introducing conditional extension into GAN. C-DCGAN is a combination of DCGAN and CGAN. In C-DCGAN, based on the feature extraction ability of convolutional networks, through the structural optimization, conditional auxiliary generative samples are used as augmented data and applied in machine fault diagnosis. Two datasets (Bearing dataset and Planetary gear box dataset) are carried out to validate. The simulation experiments showed that the improved performance is mainly due to the generated signals from C-DCGAN to balance the dataset. The proposed method can deal with imbalanced fault classification problem much more effectively. This model could improve the accuracy of fault diagnosis and the generalization ability of the classifier in the case of small samples and display better fault diagnosis performance.

Generative Adversarial Network is the topic of interest in today’s research in the field of image processing and computer vision. A basic GAN model was introduced by Ian Goodfellow et al. in 2014. After that advancement in the field of research in GAN models has been application specific. In computer vision and image to image translation GANs are playing very effective role either in the case of face detection and recognition or in image resolution enhancement and image augmentation. This paper represents a concise overview of various GAN models along with their features and applications. Pix2Pix and conditional GAN models work upon paired datasets while other models like cycle GAN, discover GAN, dual GAN, info GAN, deep convolutional GAN etc. work upon unpaired datasets. Various image datasets which are commonly used for training of generator and discriminator networks are also discussed in this paper. Since partial mode collapse is a common problem to occur during training process for all models, therefore various normalization techniques are also preferred during the training of generator and discriminator networks. As the advancements in GAN models are increasing at a very fast rate, soon these models will also be preferred in commercial applications.