Bandit Algorithms
By Csaba Szepesvari, Tor Lattimore
Language: English
Category: Ebook - Computer/Internet
Categories: Computer/Internet
Uploader: draino
Uploaded At: 2020-07-10 01:24:19
Cambridge University Press; 2020, Bandit Algorithms, Computer Algorithms, Pattern Recognition and Machine Learning, Control Systems and Optimisation
Description
Decision-making in the face of uncertainty is a significant challenge in machine learning, and the multi-armed bandit model is a commonly used framework to address it. This comprehensive and rigorous introduction to the multi-armed bandit problem examines all the major settings, including stochastic, adversarial, and Bayesian frameworks. A focus on both mathematical intuition and carefully worked proofs makes this an excellent reference for established researchers and a helpful resource for graduate students in computer science, engineering, statistics, applied mathematics and economics. Linear bandits receive special attention as one of the most useful models in applications, while other chapters are dedicated to combinatorial bandits, ranking, non-stationary problems, Thompson sampling and pure exploration. The book ends with a peek into the world beyond bandits with an introduction to partial monitoring and learning in Markov decision processes.
Table of Contents
Part I - Bandits, Probability and Concentration
1 - Introduction
Part II - Stochastic Bandits with Finitely Many Arms
6 - The Explore-Then-Commit Algorithm
Part III - Adversarial Bandits with Finitely Many Arms
11 - The Exp3 Algorithm
Part IV - Lower Bounds for Bandits with Finitely Many Arms
13 - Lower Bounds: Basic Ideas
Part V - Contextual and Linear Bandits
18 - Contextual Bandits
Part VI - Adversarial Linear Bandits
26 - Foundations of Convex Analysis
Part VII - Other Topics
30 - Combinatorial Bandits
Part VIII - Beyond Bandits
37 - Partial Monitoring