• Cite Icon1
  • https://doi.org/10.14778/3561261.3561269Copy DOI Icon

SIFTER

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Can we solve finite-horizon Markov decision processes (FHMDPs) while raising low memory requirements? Such models find application in many cases where a decision-making agent needs to act in a probabilistic environment, from resource management to medicine to service provisioning. However, computing optimal policies such an agent should follow by dynamic programming value iteration raises either prohibitive space complexity, or, in reverse, non-scalable time complexity requirements. This scalability question has been largely neglected. In this paper, we propose SIFTER (Space Efficient Finite Horizon MDPs), a suite of algorithms that achieve a golden middle between space and time requirements. Our former algorithm raises space complexity growing with the square root of the horizon's length without a time-complexity overhead, while the latter's space requirements depend only logarithmically in horizon length with a corresponding logarithmic time complexity overhead. A thorough experimental study under diverse settings confirms that SIFTER algorithms achieve the predicted gains, while approximation techniques do not achieve the same combination of time efficiency, space efficiency, and result quality.

Similar Papers
  • Conference Article
  • Citations6

Analysis of Time and Space Complexity of Array, Linked List and Linked Array(hybrid) in Linear Search Operation

  • Dec 08, 2022
  • B Lokeshwar +4
  • Research Article
  • Citations1

Sparse Circulant Binary Embedding: An Asymptotic Analysis

  • Mar 01, 2018
  • IEEE Signal Processing Letters
  • Saehoon Kim +1
  • Book Chapter

A Space Efficient Metadata Structure for Ranking Subset Sums

  • Jan 01, 2023
  • Biswajit Sanyal +2
  • Addendum

WITHDRAWN: Spearman rank correlation based bagging ensemble bayes optimal classification for genomic predictive pattern analytics

  • Nov 01, 2020
  • Materials Today: Proceedings
  • Marrynal S Eastaff +1
  • Conference Article
  • Citations32

Energy-Efficient Algorithms

  • Jan 14, 2016
  • Erik D Demaine +3
  • PDF
  • Research Article
  • Citations5

Hybrid Image Encryption Technique Using Genetic Algorithm and Lorenz Chaotic System

  • Jan 01, 2020
  • ITM Web of Conferences
  • Vishwanath Chikkareddi +4
  • Research Article
  • Citations75

A fast algorithm for optimal buffer insertion

  • Jun 01, 2005
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  • Weiping Shi +1
  • Research Article
  • Citations7

A Comparative Study of Three Heuristic Functions Used to Solve the 8-Puzzle

  • Jan 10, 2016
  • British Journal of Mathematics & Computer Science
  • Anca-Elena Iordan
  • Book Chapter
  • Citations53

Succinct Arguments from Multi-prover Interactive Proofs and Their Efficiency Benefits

  • Jan 01, 2012
  • Nir Bitansky +1
  • Research Article
  • Citations10

A faster FPTAS for knapsack problem with cardinality constraint

  • Apr 04, 2022
  • Discrete Applied Mathematics
  • Wenxin Li +2
  • Book Chapter
  • Citations36

Towards an Adaptive Approach for Mining Data Streams in Resource Constrained Environments

  • Jan 01, 2004
  • Mohamed Medhat Gaber +2
  • Book Chapter
  • Citations22

Randomized Locality Sensitive Vocabularies for Bag-of-Features Model

  • Jan 01, 2010
  • Yadong Mu +4
  • Research Article
  • Citations69

Improved algorithms for mapping pipelined and parallel computations

  • Mar 01, 1991
  • IEEE Transactions on Computers
  • D.M Nicol +1
  • Conference Article
  • Citations3

Saving Space in a Time Efficient Simulation Algorithm

  • Jul 01, 2009
  • Silvia Crafa +2
  • Conference Article
  • Citations5

Inter-frame Change Directing Online Clustering of Multiple Moving Objects for Video-Based Sensor Networks

  • Dec 01, 2008
  • Guangyan Huang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.