Authors
William G Macready, David H Wolpert
Publication date
1998/4
Journal
IEEE Transactions on evolutionary computation
Volume
2
Issue
1
Pages
2-22
Publisher
IEEE
Description
We explore the two-armed bandit with Gaussian payoffs as a theoretical model for optimization. The problem is formulated from a Bayesian perspective, and the optimal strategy for both one and two pulls is provided. We present regions of parameter space where a greedy strategy is provably optimal. We also compare the greedy and optimal strategies to one based on a genetic algorithm. In doing so, we correct a previous error in the literature concerning the Gaussian bandit problem and the supposed optimality of genetic algorithms for this problem. Finally, we provide an analytically simple bandit model that is more directly applicable to optimization theory than the traditional bandit problem and determine a near-optimal strategy for that model.
Total citations
1998199920002001200220032004200520062007200820092010201120122013201420152016201720182019202020212022202320242994513384613126578411108788764
Scholar articles
WG Macready, DH Wolpert - IEEE Transactions on evolutionary computation, 1998