• Home
  • Search
  • Maximizing Cumulative User Engagement in Sequential Recommendation
  • Cite Icon13
  • https://doi.org/10.1145/3394486.3403329Copy DOI Icon

Maximizing Cumulative User Engagement in Sequential Recommendation

  • Aug 20, 2020
  • Yifei Zhao +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To maximize cumulative user engagement (e.g. cumulative clicks) in sequential recommendation, it is often needed to tradeoff two potentially conflicting objectives, that is, pursuing higher immediate user engagement (e.g., click-through rate) and encouraging user browsing (i.e., more items exposured). Existing works often study these two tasks separately, thus tend to result in sub-optimal results. In this paper, we study this problem from an online optimization perspective, and propose a flexible and practical framework to explicitly tradeoff longer user browsing length and high immediate user engagement. Specifically, by considering items as actions, user's requests as states and user leaving as an absorbing state, we formulate each user's behavior as a personalized Markov decision process (MDP), and the problem of maximizing cumulative user engagement is reduced to a stochastic shortest path (SSP) problem. Meanwhile, with immediate user engagement and quit probability estimation, it is shown that the SSP problem can be efficiently solved via dynamic programming. Experiments on real-world datasets demonstrate the effectiveness of the proposed approach. Moreover, this approach is deployed at a large E-commerce platform, achieved over 7% improvement of cumulative clicks.

Similar Papers
  • Conference Article
  • Citations3

Finding objects through stochastic shortest path problems

  • May 06, 2013
  • Felipe W Trevizan +1
  • Conference Article
  • Citations1

Towards scalable mdp algorithms

  • Dec 24, 2016
  • Andrey Kolobov
  • Research Article
  • Citations23

On Boundedness of Q-Learning Iterates for Stochastic Shortest Path Problems

  • May 01, 2013
  • Mathematics of Operations Research
  • Huizhen Yu +1
  • Research Article
  • Citations19

Depth-based short-sighted stochastic shortest path problems

  • Jul 14, 2014
  • Artificial Intelligence
  • Felipe W Trevizan +1
  • PDF
  • Research Article
  • Citations37

Reinforcement Learning Based Stochastic Shortest Path Finding in Wireless Sensor Networks

  • Jan 01, 2019
  • IEEE Access
  • Wenwen Xia +3
  • Conference Article
  • Citations13

An Anytime Algorithm for Chance Constrained Stochastic Shortest Path Problems and Its Application to Aircraft Routing

  • May 30, 2021
  • Sungkweon Hong +5
  • Research Article
  • Citations218

Stochastic shortest path problems with recourse

  • Mar 01, 1996
  • Networks
  • George H Polychronopoulos +1
  • Conference Article
  • Citations4

Reachability analysis for uncertain SSPs

  • Jan 01, 2005
  • O Buffet
  • Conference Article
  • Citations5

Simplicial Label Correcting Algorithms for continuous stochastic shortest path problems

  • May 01, 2013
  • Dmitry S Yershov +1
  • Research Article
  • Citations20

Solving in real-time the dynamic and stochastic shortest path problem for electric vehicles by a prognostic decision making strategy

  • Jul 06, 2021
  • Expert Systems with Applications
  • Heraldo Rozas +3
  • Research Article
  • Citations18

Stochastic Recruitment Control of Large Ensemble Systems With Limited Feedback

  • Jun 17, 2010
  • Journal of Dynamic Systems, Measurement, and Control
  • Lael U Odhner +1
  • Conference Article
  • Citations8

Energy Optimisation through Path Selection for Underwater Wireless Sensor Networks

  • Aug 01, 2020
  • Kenechi G Omeke +4
  • Research Article
  • Citations60

Improving the Efficiency of Stochastic Vehicle Routing: A Partial Lagrange Multiplier Method

  • Jun 01, 2016
  • IEEE Transactions on Vehicular Technology
  • Zhiguang Cao +4
  • Research Article
  • Citations46

Extended dominance and a stochastic shortest path problem

  • Oct 18, 2007
  • Computers & Operations Research
  • Kevin R Hutson +1
  • Research Article
  • Citations4

Batch repair actions for automated troubleshooting

  • Mar 16, 2020
  • Artificial Intelligence
  • Hilla Shinitzky +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.