• Home
  • Search
  • Recommendation of deep reinforcement learning based on value function considering error reduction.
  • https://doi.org/10.1038/s41598-025-18926-7Copy DOI Icon

Recommendation of deep reinforcement learning based on value function considering error reduction.

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Deep reinforcement learning (DRL) algorithms have been widely applied in user cold-start recommender systems because they can gradually capture users' dynamic interest preferences. Deep Q-Networks (DQN) have become the most popular reinforcement learning (RL) method due to their simple update strategy and excellent performance. In many user cold-start scenarios, the action space is gradually reduced to avoid recommending duplicate items to users. However, current DQN-based RL recommender systems output the entire action space fixedly, inevitably leading to discrepancies with the gradually shrinking action space. This paper demonstrates that such discrepancies cause a decrement error in the action space corresponding to the temporal difference (TD) in the original RL, rendering standard DQN reinforcement learning methods inaccurate in Q-value estimation. Moreover, in long-term recommendation scenarios, the differences in the lengths of interactions recommended to different users are significant, making it difficult to ignore such errors, thereby challenging the applicability of these methods in scenarios where the action space gradually reduces. To address this issue, this paper introduces a new algorithm called Q-AD (Q-learning Action Decrease), which is based on DQN and aims to mitigate the reduction error in the action space by buffering the Q-value estimation error at each update. Q-AD augments the standard DQN with an error reduction term for TD updates. Through experiments, it was observed that the Q-AD algorithm significantly reduces value estimation errors and achieves better accuracy and efficiency compared to previous methods across different datasets.

Similar Papers
  • Research Article

The Role of Reinforcement Learning in Advancing Artificial Intelligence: An Experimental Study with Q-Learning and DQN

  • Aug 24, 2025
  • The Asian Bulletin of Big Data Management
  • Maryam Gul +5
  • Research Article
  • Citations1

DDPG Agent to Swing Up and Balance Cart- Pole System

  • Apr 09, 2021
  • International Journal of Advanced Research in Science, Communication and Technology
  • Buvanesh Pandian V
  • Research Article
  • Citations13

Reinforcement Learning for Clinical Applications.

  • Feb 08, 2023
  • Clinical Journal of the American Society of Nephrology
  • Kia Khezeli +5
  • Research Article
  • Citations6

Break through the limits of learning by machines

  • Sep 20, 2016
  • Chinese Science Bulletin
  • Zhongzhi Shi
  • Research Article
  • Citations23

Deep Reinforcement Learning With Modulated Hebbian Plus Q-Network Architecture.

  • May 01, 2022
  • IEEE Transactions on Neural Networks and Learning Systems
  • Pawel Ladosz +7
  • PDF
  • Research Article
  • Citations4

Feasibility Analysis and Application of Reinforcement Learning Algorithm Based on Dynamic Parameter Adjustment

  • Sep 22, 2020
  • Algorithms
  • Menglin Li +3
  • PDF
  • Research Article
  • Citations23

Efficient Deep Reinforcement Learning for Optimal Path Planning

  • Nov 07, 2022
  • Electronics
  • Jing Ren +2
  • Conference Article
  • Citations1

Research on AI-driven personalized learning path planning and effectiveness under dual-system teaching mode

  • Apr 18, 2025
  • Ling Chen
  • Research Article
  • Citations194

Deep reinforcement learning based energy management for a hybrid electric vehicle

  • Apr 14, 2020
  • Energy
  • Guodong Du +5
  • Conference Article
  • Citations16

Traffic Signal Control with Deep Reinforcement Learning

  • Dec 01, 2019
  • Tongyu Zhao +2
  • PDF
  • Research Article
  • Citations22

A Review of Mobile Robot Path Planning Based on Deep Reinforcement Learning Algorithm

  • Dec 01, 2021
  • Journal of Physics: Conference Series
  • Yanwei Zhao +2
  • Book Chapter
  • Citations2

Evaluation of DQN and Double DQN Algorithms in Flappy Bird Environment

  • Jan 01, 2024
  • Zhenyu Chen
  • Research Article

A New Efficient Method for Refining the Reinforcement Learning Algorithm to Train Deep Q Agents for Reaching a Consensus in P2P Networks

  • Jan 01, 2023
  • IEEE Access
  • Arafat Abu Mallouh +3
  • Research Article
  • Citations146

A multi-objective deep reinforcement learning framework

  • Sep 02, 2020
  • Engineering Applications of Artificial Intelligence
  • Thanh Thi Nguyen +5
  • PDF
  • Research Article
  • Citations38

Deep Reinforcement Learning Unleashing the Power of AI in Decision-Making

  • Feb 02, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN:3006-4023
  • Jeff Shuford
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.