• Open Access IconOpen Access
  • Cite Icon31
  • https://doi.org/10.1109/ijcnn.2016.7727233Copy DOI Icon

Gated Recurrent Neural Tensor Network

  • Jul 1, 2016
  • Andros Tjandra +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information from inputs. For modeling long-term dependencies in a dataset, the gating mechanism concept can help RNNs remember and forget previous information. Representing the hidden layers of an RNN with more expressive operations (i.e., tensor products) helps it learn a more complex relationship between the current input and the previous hidden layer information. These ideas can generally improve RNN performances. In this paper, we proposed a novel RNN architecture that combine the concepts of gating mechanism and the tensor product into a single model. By combining these two concepts into a single RNN, our proposed models learn long-term dependencies by modeling with gating units and obtain more expressive and direct interaction between input and hidden layers using a tensor product on 3-dimensional array (tensor) weight parameters. We use Long Short Term Memory (LSTM) RNN and Gated Recurrent Unit (GRU) RNN and combine them with a tensor product inside their formulations. Our proposed RNNs, which are called a Long-Short Term Memory Recurrent Neural Tensor Network (LSTMRNTN) and Gated Recurrent Unit Recurrent Neural Tensor Network (GRURNTN), are made by combining the LSTM and GRU RNN models with the tensor product. We conducted experiments with our proposed models on word-level and character-level language modeling tasks and revealed that our proposed models significantly improved their performance compared to our baseline models.

Similar Papers
  • Research Article
  • Citations174

Prediction of dissolved oxygen in a fishery pond based on gated recurrent unit (GRU)

  • Feb 10, 2020
  • Information Processing in Agriculture
  • Wuyan Li +5
  • Research Article
  • Citations2

Forecasting Next-Time-Step Forex Market Stock Prices Using Neural Networks

  • May 16, 2024
  • Advances in Machine Learning & Artificial Intelligence
  • Mostafa Pahlevanzadeh +3
  • Book Chapter
  • Citations1

Comprehensive Deep Recurrent Artificial Neural Network (CDRANN): Evolutionary Model for Future Prediction

  • Jan 01, 2022
  • G Sundar +1
  • Conference Article
  • Citations20

Algorithms for the Development of Deep Learning Models for Classification and Prediction of Behaviour in MOOCS

  • Sep 29, 2020
  • Jose Edmond Meku Fotso +3
  • Conference Article
  • Citations75

Large scale recurrent neural network on GPU

  • Jul 01, 2014
  • Boxun Li +7
  • Book Chapter
  • Citations10

Forecasting Longevity for Financial Applications: A First Experiment with Deep Learning Methods

  • Jan 01, 2021
  • Jorge M Bravo
  • Conference Article

Performance Analysis of GRU, LSTM, and RNN for BISINDO Sign Language Recognition

  • Oct 09, 2025
  • Khodijah Hulliyah +3
  • Preprint Article

Estimating Gross Primary Production via Recurrent Neural Networks: A comparative analysis

  • Nov 27, 2024
  • David Montero +8
  • Book Chapter
  • Citations5

A Recurrent Neural Fuzzy Network

  • Sep 29, 2016
  • Iuliana F Iatan
  • Research Article
  • Citations333

Long short-term memory (LSTM) recurrent neural network for low-flow hydrological time series forecasting

  • Jul 20, 2019
  • Acta Geophysica
  • Bibhuti Bhusan Sahoo +3
  • PDF
  • Research Article
  • Citations43

Prediction of Wastewater Treatment Plant Effluent Water Quality Using Recurrent Neural Network (RNN) Models

  • Sep 22, 2023
  • Water
  • Praewa Wongburi +1
  • Supplementary Content
  • Citations58

Performance analysis of neural network architectures for time series forecasting: A comparative study of RNN, LSTM, GRU, and hybrid models

  • Jul 08, 2025
  • MethodsX
  • Ariana Yunita +6
  • Book Chapter
  • Citations162

A Comparison of LSTM and GRU Networks for Learning Symbolic Sequences

  • Jan 01, 2023
  • Roberto Cahuantzi +2
  • Conference Article
  • Citations10

Forecasting of Water Flow in a Hydroelectric Power Plant Using LSTM Recurrent Neural Network

  • Jun 01, 2020
  • Arlindo Rodrigues Galvao Filho +4
  • PDF
  • Research Article
  • Citations50

Automated Classification of Mental Arithmetic Tasks Using Recurrent Neural Network and Entropy Features Obtained from Multi-Channel EEG Signals

  • May 02, 2021
  • Electronics
  • Abhishek Varshney +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.