• Home
  • Search
  • Improving the Exploration in Upper Confidence Trees
  • Cite Icon7
  • https://doi.org/10.1007/978-3-642-34413-8_29Copy DOI Icon

Improving the Exploration in Upper Confidence Trees

  • Jan 1, 2012
  • Adrien Couëtoux +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In the standard version of the UCT algorithm, in the case of a continuous set of decisions, the exploration of new decisions is done through blind search. This can lead to very inefficient exploration, particularly in the case of large dimension problems, which often happens in energy management problems, for instance. In an attempt to use the information gathered through past simulations to better explore new decisions, we propose a method named Blind Value (BV). It only requires the access to a function that randomly draws feasible decisions. We also implement it and compare it to the original version of continuous UCT. Our results show that it gives a significant increase in convergence speed, in dimensions 12 and 80.

Similar Papers
  • Research Article
  • Citations37

An improved real-coded genetic algorithm with random walk based mutation for solving combined heat and power economic dispatch

  • Oct 15, 2020
  • Journal of Ambient Intelligence and Humanized Computing
  • A Haghrah +3
  • Research Article
  • Citations14

The evolution of purchasing power parity

  • Jul 11, 2020
  • Journal of International Money and Finance
  • Collin Rabe +1
  • Research Article
  • Citations17

FPGA implementation of hardware efficient adaptive filter robust to impulsive noise

  • Feb 21, 2017
  • IET Computers & Digital Techniques
  • Chintan A Parmar +2
  • Research Article
  • Citations18

An iterative reconstruction method based on monochromatic images for dual energy CT.

  • Sep 16, 2021
  • Medical Physics
  • Weibin Zhang +4
  • Research Article
  • Citations3

Self-Adaptive and Adaptive Parameter Control in Improved Artificial Bee Colony Algorithm

  • Jan 01, 2017
  • Informatica
  • Bekir Afşar +3
  • Research Article
  • Citations1

Subband echo canceler with an exponentially weighted stepsize NLMS adaptive filter

  • Mar 01, 1999
  • Electronics and Communications in Japan (Part III: Fundamental Electronic Science)
  • Shoji Makino +1
  • Conference Article

Improvement of Convergence Property on Adaptive Wiener Filter Using Stochastic Gradient Adaptive Algorithm

  • Nov 01, 2018
  • Ryota Saika +2
  • Research Article
  • Citations8

Linear‐combined multichannel adaptive digital filters

  • Apr 01, 1988
  • Electronics and Communications in Japan (Part I: Communications)
  • Tetsurou Fujii +1
  • Conference Article
  • Citations1

Convex Combination of Two Adaptive Filters with Normalized Median Wilcoxon Approach

  • Mar 01, 2019
  • Satyakam Baraha +2
  • Conference Article
  • Citations7

Convergence and correctness analysis of Monte-Carlo tree search algorithms: A case study of 2 by 4 Chinese dark chess

  • Aug 01, 2015
  • Hung-Jui Chang +2
  • Research Article
  • Citations6

Optimizing urban energy management: A strategic examination of smart grids and policy regulations

  • Apr 06, 2024
  • Sustainable Cities and Society
  • Tuhuo Jia +2
  • Book Chapter
  • Citations1

Autonomous Vehicle Path Planning Based on Improved Ant Colony Algorithm

  • Oct 28, 2022
  • Yan Xing +3
  • Conference Article
  • Citations10

Hardware efficient frequency domain equalization in few-mode fiber coherent transmission systems

  • Dec 24, 2013
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Z Pan +2
  • Research Article
  • Citations389

Varieties of learning automata: an overview

  • Dec 01, 2002
  • IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics)
  • M.A.L Thathachar +1
  • Conference Article
  • Citations6

Frequency domain equalizer in few-mode fiber space-division-multiplexing systems

  • May 01, 2014
  • Zhongqi Pan +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.