Temperature Forecasting Based on LSTM in Coastal City

Since it is one of the world's most significant financial markets, the foreign exchange (Forex) market has attracted a large number of investors. Accurately anticipating the forex trend has remained a popular but difficult issue to aid Forex traders' trading decisions. It is always a question of how precise a Forex prediction can be because of the market's tremendous complexity. The fast advancement of machine learning in recent decades has allowed artificial neural networks to be effectively adapted to several areas, including the Forex market. As a result, a slew of research articles aimed at improving the accuracy of currency forecasting has been released. The Long Short-Term Memory (LSTM) neural network, which is a special kind of artificial neural network developed exclusively for time series data analysis, is frequently used. Due to its high learning capacity, the LSTM neural network is increasingly being utilized to predict advanced Forex trading based on previous data. This model, on the other hand, can be improved by stacking it. The goal of this study is to choose a dataset using the Hurst exponent, then use a two-layer stacked Long Short-Term Memory (TLS-LSTM) neural network to forecast the trend and conduct a correlation analysis. The Hurst exponent (h) was used to determine the predictability of the Australian Dollar and United States Dollar (AUD/USD) dataset. TLS-LSTM algorithm is presented to improve the accuracy of Forex trend prediction of Australian Dollar and United States Dollar (AUD/USD). A correlation study was performed between the AUD/USD, the Euro and the Australian Dollar (EUR/AUD), and the Australian Dollar and the Japanese Yen (AUD/JPY) to see how AUD/USD movement affects EUR/AUD and AUD/JPY. The model was compared with Single-Layer Long Short-Term (SL-LSTM), Multilayer Perceptron (MLP), and Complete Ensemble Empirical Mode Decomposition with Adaptive Noise–Improved Firefly Algorithm Long Short-Term Memory. Based on the evaluation metrics Mean Square Error (MSE), Root Mean Square Error, and Mean Absolute Error, the suggested TLS-LSTM, whose data selection is based on the Hurst exponent (h) value of 0.6026, outperforms SL-LSTM, MLP, and CEEMDAN-IFALSTM. The correlation analysis conducted shows both positive and negative relations between AUD/USD, EUR/AUD, and AUD/JPY which means that a change in AUD/USD will affect EUR/AUD and AUD/JPY as recorded depending on the magnitude of the correlation coefficient (r).

Human action recognition in videos is an important task with a broad range of applications. In this study, we improve the performance of recurrent attention convolutional neural network (RACNN) by proposing a novel model, “attention-again”. We consider the nature of video frames as sequences, which will cause the change of regions of interest in the frame, thus we cannot use an attention mechanism similar to that in images. “Attention-again” model is a variant from traditional attention model for recognizing human activities and is embedded in two long short-term memory (LSTM) layers. Different from hierarchal LSTM which change the LSTM structure to combine the hidden states from two LSTM layers, our proposals introduce “attention-again” model to avoid the change of LSTM structure. Furthermore, this model not only learns the relations in each frame, but also obtains the relations among all frames, and these relations instruct the next learning stage. Therefore, our proposed model outperform the baseline and is superior to methods with the same experimental conditions on three benchmark datasets: UCF-11, HMDB-51 and UCF-101. To understand how the model works, we also visualize the region of interest in the frame.

In this paper, we develop a new Hybrid method based on machine learning algorithms for jump detection in financial time series. Jump is an important behavior in financial time series, since it implies a change in volatility. Ones can buy the volatility instrument if ones expect the volatility will bloom up in the future. A jump detection model attempts to detect short-term market instability, since it could be jumping up or down, instead of a directional prediction. The directional prediction can be considered as a momentum or trend following, which is not the focus of this paper. A jump detection model is commonly applied in a systematic fast-moving strategy, which reallocates the assets automatically. Also, a systematic opening position protection strategy can be driven by a jump detection model. For example, for a tail risk protection strategy, a pair of long call and put option order could be placed in the same time, in order to protect the open position given a huge change in volatility. One of the key differentiations of the proposed model with the classical methods of time-series anomaly detection is that, jump threshold parameters are not required to be predefined in our proposed model. Also the model is a combination of a Long short-term memory (LSTM) neural network model and a machine learning pattern recognition model. The LSTM model is applied for time series prediction, which predicts the next data point. The historical prediction errors sequence can be used as the information source or input of the jump detection model/module. The machine learning pattern recognition model is applied for jump detection. The combined model attempts to determine whether the current data point is a jump or not. LSTM neural network is a type of Recurrent Neural Networks (RNNs). LSTM records not only the recent market, but also the historical status. A stacked RNN is trained on a dataset which is mixed with normal and anomalous data. We compare the performance of the proposed Hybrid jump detection model and different pattern classification algorithms, such as k-nearest neighbors algorithm identifier, Hampel identifier, and Lee Mykland test. The model is trained and tested using real financial market data, including 11 global stock market in both developed and emerging markets in US, China, Hong Kong, Taiwan, Japan, UK, German, and Israel. The experiment result shows that the proposed Hybrid jump detection model is effective to detect jumps in terms of accuracy, comparing to the other classical jump detection methods.

In recent years, supervised video summarization has achieved promising progress with various recurrent neural networks (RNNs) based methods, which treats video summarization as a sequence-to-sequence learning problem to exploit temporal dependency among video frames across variable ranges. However, RNN has limitations in modelling the long-term temporal dependency for summarizing videos with thousands of frames due to the restricted memory storage unit. Therefore, in this paper we propose a stacked memory network called SMN to explicitly model the long dependency among video frames so that redundancy could be minimized in the video summaries produced. Our proposed SMN consists of two key components: Long Short-Term Memory (LSTM) layer and memory layer, where each LSTM layer is augmented with an external memory layer. In particular, we stack multiple LSTM layers and memory layers hierarchically to integrate the learned representation from prior layers. By combining the hidden states of the LSTM layers and the read representations of the memory layers, our SMN is able to derive more accurate video summaries for individual video frames. Compared with the existing RNN based methods, our SMN is particularly good at capturing long temporal dependency among frames with few additional training parameters. Experimental results on two widely used public benchmark datasets: SumMe and TVsum, demonstrate that our proposed model is able to clearly outperform a number of state-of-the-art ones under various settings.

Surface Temperature (ST) is important in terms of surface energy and terrestrial water balances affecting urban ecosystems. In this study, to process the nonlinear changes of climatological variables by leveraging the distinct advantages of Long Short-Term Memory (LSTM) and Bidirectional Long Short-Term Memory (BiLSTM), we propose an LSTM-BiLSTM hybrid deep learning model which extracts multi-dimension features of inputs, i.e., backward (future to past) or forward (past to future) to predict ST. This study assessed the climatological variables, i.e., wind speed, wind direction, relative humidity, dew point temperature, and atmospheric pressure impact on ST using five major coastal cities of India: Chennai, Mangalore, Visakhapatnam, Cuddalore, and Cochin. The Recurrent Neural Networks (RNN) and hybrid LSTM-BiLSTM models have effectively predicted ST and outperformed the standalone Artificial Neural Networks (ANN), LSTM, and BiLSTM models. The RNN and LSTM-BiLSTM models have performed better in predicting ST for Mangalore (Nash-Sutcliffe efficiency (NSE)=0.91), followed by Cochin (NSE=0.89), Chennai (NSE=0.88), Cuddalore (NSE=0.88), and Vishakhapatnam (NSE=0.81). The hybrid data-driven modeling framework indicated that coupling the LSTM and BiLSTM models was proven effective in predicting the ST of coastal cities.

In this paper, two algorithms are proposed for short-term PV power forecasting using a long short-term memory (LSTM) neural network (NN). The first algorithm is designed to predict a single step ahead PV power, whereas the latter is capable of forecasting time horizons with variable starting points, which makes it very useful for rolling horizon based energy management algorithms. The effect of the input sequence length on the performance of the single-step model is investigated. The prediction accuracy of the multi-step model is examined with different lengths of rolling prediction horizons. It is shown that in the case of intraday rolling horizons, adding certain new predictors can effectively improve the machine performance. Hourly and half hourly data from different seasons are used to train and test the performance of the forecasting machine. Moreover, to demonstrate the superiority of the proposed LSTM based algorithms, the performance of other neural networks, namely the generalized recurrent neural network (GRNN) and the nonlinear autoregressive exogenous (NARX) neural network, is also explored.

(1) Background: This study is aimed at the development of a precise and inexpensive device for flow information measurement for external flow. This novel flowmeter uses an LSTM (long short-term memory) neural network algorithm to analyze the vibration responses of the gauge plate. (2) Methods: A signal processing method using an LSTM neural network is proposed for the development of mass flow rate estimation by sensing the vibration responses of a gauge plate. An FFT (fast Fourier transform) and an STFT (short-time Fourier transform) were used to analyze the vibration characteristics of the gauge plate depending on the mass flow rate. For precise measurements, the vibration level and roughness were computed and used as input features. The actual mass flow rate measured by using a weight transducer was employed as the output features for the LSTM prediction model. (3) Results: The estimated flow rate matched the actual measured mass flow rate very closely. The deviations in measurements for the total mass flow were less than 6%. (4) Conclusions: The estimation of the mass flow rate for external flow through the proposed flowmeter by use of vibration responses analyzed by the LSTM neural network was proposed and verified.

Artificial intelligence models have been widely applied for natural gas consumption forecasting over the past decades, especially for short-term consumption forecasting. This paper proposes a three-layer neural network forecasting model that can extract key information from input factors and improve the weight optimization mechanism of long short-term memory (LSTM) neural network to effectively forecast short-term consumption. In the proposed model, a convolutional neural network (CNN) layer is adopted to extract the features among various factors affecting natural gas consumption and improve computing efficiency. The LSTM layer is able to learn and save the long-distance state through the gating mechanism and overcomes the defects of gradient disappearance and explosion in the recurrent neural network. To solve the problem of encoding input sequences as fixed-length vectors, the layer of attention (ATT) is used to optimize the assignment of weights and highlight the key sequences. Apart from the comparisons with other popular forecasting models, the performance and robustness of the proposed model are validated on datasets with different fluctuations and complexities. Compared with traditional two-layer models (CNN-LSTM and LSTM-ATT), the mean absolute range normalized errors (MARNE) of the proposed model in Athens and Spata are improved by more than 16% and 11%, respectively. In comparison with single LSTM, back propagation neural network, support vector regression, and multiple linear regression methods, the improvement in MARNE exceeds 42% in Athens. The coefficient of determination is improved by more than 25%, even in the high-complexity dataset, Spata.

This paper develops a general framework for learning interpretable data representation via Long Short-Term Memory (LSTM) recurrent neural networks over hierarchal graph structures. Instead of learning LSTM models over the pre-fixed structures, we propose to further learn the intermediate interpretable multi-level graph structures in a progressive and stochastic way from data during the LSTM network optimization. We thus call this model the structure-evolving LSTM. In particular, starting with an initial element-level graph representation where each node is a small data element, the structure-evolving LSTM gradually evolves the multi-level graph representations by stochastically merging the graph nodes with high compatibilities along the stacked LSTM layers. In each LSTM layer, we estimate the compatibility of two connected nodes from their corresponding LSTM gate outputs, which is used to generate a merging probability. The candidate graph structures are accordingly generated where the nodes are grouped into cliques with their merging probabilities. We then produce the new graph structure with a Metropolis-Hasting algorithm, which alleviates the risk of getting stuck in local optimums by stochastic sampling with an acceptance probability. Once a graph structure is accepted, a higher-level graph is then constructed by taking the partitioned cliques as its nodes. During the evolving process, representation becomes more abstracted in higher-levels where redundant information is filtered out, allowing more efficient propagation of long-range data dependencies. We evaluate the effectiveness of structure-evolving LSTM in the application of semantic object parsing and demonstrate its advantage over state-of-the-art LSTM models on standard benchmarks.

Ocean surface currents (OSC), abiotic features of the environment, are continuous and directed movements of ocean water. Prediction to OSC is of significant interests in physical oceanography. Recently, deep learning technology has shown feasibility in mining the intrinsic change pattern of marine numerical values, such as SSS, SST and SSHA, but not been applied to OSC prediction yet. In this work, a deep learning method, named skipped dual path network (SDPNet), is proposed for OSC prediction. Specifically, SDPNet has a convolutional neural network (CNN) module with a one-dimensional convolution layer, and a recurrent neural network (RNN) module with a dual-path structure. Each path consists of a stack of three layers of long short-term memory (LSTM) and gated recurrent unit (GRU), respectively. As well, a skipped-connection structure is added in the both paths. It aims to gradually mine the intrinsic change pattern contained in OSC time series data itself. Experiments are conducted on the South China Sea OSC data set in REDOS. SDPNet achieves accuracy 80.83%, 75.9%, 74.9%, 73.9%, 72.58%, 70.35%, 69.93% in predicting the coming 7 days OSC values and directions. It performs better than state-of-the-art machine learning methods, include Artificial Neural Network, Simple RNN, LSTM and GRU.

Electrocardiography (ECG) is a technique for observing and recording the electrical activity of the human heart. The usage of an ECG signal is common among clinical professionals in the collection of time data for the examination of any rhythmic conditions associated with a subject. The investigation was carried out in order to computerize the assignment by exhibiting the issue using encoder-decoder techniques, creating the information that was simply typical of it, and utilising misfortune appropriation to anticipate standard or anomalous information. On a broad variety of applications such as voice recognition and prediction, the long short-term memory (LSTM) fully connected layer (FCL) and the two convolutional neural networks (CNNs) have shown superior performance over deep learning networks (DLNs). DNNs are suitable for making high points for a more divisible region and CNNs are suitable for reducing recurrence types, LSTMs are appropriate for temporary displays, in the same way as CNNs are appropriate for reducing recurrence types. The CNN, LSTM, and DNN algorithms are acceptable for viewing. The complementarity of DNNs, CNNs, and LSTMs was investigated in this research by bringing them all together under the single architectural company. The researchers got the ECG data from the MIT-BIH arrhythmia database as a result of the investigation. Our results demonstrate that the approach proposed may expressively describe ECG series and identify abnormalities via scores that outperform existing supervised and unsupervised methods in both the short term and long term. The LSTM network and FCL additionally demonstrated that the unbalanced datasets associated with the ECG beat detection problem could be consistently resolved and that they were not susceptible to the accuracy of ECG signals. It is recommended that cardiologists employ the unique technique to aid them in performing reliable and impartial interpretation of ECG data in telemedicine settings.

The analysis and prediction of industrial production plants are of great significance for reducing energy consumption, improving economic efficiency. Therefore, a production prediction method based on bidirectional long short-term memory (Bi-LSTM) is proposed to accurately analyze and evaluate the energy efficiency status of ethylene production plants in industrial processes. Bi-LSTM is a Indirection ally connected network with two layers of long short-term memory (LSTM), it gives full consideration to the relationship between the current data and the data before and after it. Bi-LSTM solves the gradient disappearance or gradient explosion problem in recurrent neural network (RNN), and overcomes the drawback that LSTM only consider the relationship between the current data and its previous data. The comparison results show that the prediction effect of the Bi-LSTM model is superior to that of the back propagation (BP) neural network model, and the average relative error is reduced by 70%, which proves that the Bi-LSTM can effectively raise the accuracy and stability of the ethylene production prediction.

This study constructs a model suitable for studying the performance of a Japanese speech recognition translation system based on a long short-term memory (LSTM) neural network. The impact of the matrix on the accuracy and recognition ratio of the speech recognition system is considered. This study provides a general introduction to the LSTM neural network, gives an overview of a Japanese speech recognition translation system, and presents experimental data to evaluate its performance. Then, the LSTM neural network is recommended for studying the Japanese speech translation recognition system, and a suitable model is established to conduct experiments on the system. By comparing example analyses, the experimental results show that the optimized PLSTM (Part-Aware Long Short-Term Memory) achieved an 8.09% improvement over an unoptimized LSTM network while maintaining recognition accuracy.

Prediction of the NOx emissions from thermal power plant using long-short term memory neural network

Lithium batteries are usually used to power wireless sensor nodes (WSNs). However, due to the nonlinearity of the battery, the prediction of its state of charge (SOC) has become a challenging task. In order to further improve the prediction accuracy, a node battery SOC prediction method based on attention mechanism and long short-term memory (LSTM) recurrent neural network is proposed, which maps the easily observed voltage and current to the target SOC. Firstly, one layer LSTM is used to make full use of the timing characteristics of lithium battery data, and then the attention mechanism is used to highlight the input characteristics that play a key role in SOC prediction. Finally, the full connection layer is used to output the prediction results. In addition, by comparing the performance of the model under different parameters, the optimal model setting is determined, and the proposed model is compared with other models. The results show that the proposed Attention-LSTM model has the best prediction performance, and the mean absolute error (MAE), mean square error (MSE) and determination coefficient (R <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ) reach 1.0250%, 0.0226% and 0.9027 respectively, which meets the requirements of node battery SOC prediction. In addition, a model-based node dynamic sleep scheduling algorithm is proposed to prolong the lifetime of nodes.