Algorithms for Decision Making

id: 847271 VIP Open in MaM

By Mykel J Kochenderfer, Tim A Wheeler, Kyle H Wray

Language: English

Category: Ebook - Computer/Internet

Categories: Computer/Internet

Size: 12.4 MiB pdf Files: 1

Uploader: draino

Uploaded At: 2022-06-27 10:16:44

The MIT Press; 2022, Algorithms & Data Structures, Decision Making Algorithms, Julia Programming

Description


A broad introduction to algorithms for decision making under uncertainty, introducing the underlying mathematical problem formulations and the algorithms for solving them.

Automated decision-making systems or decision-support systems—used in applications that range from aircraft collision avoidance to breast cancer screening—must be designed to account for various sources of uncertainty while carefully balancing multiple objectives. This textbook provides a broad introduction to algorithms for decision making under uncertainty, covering the underlying mathematical problem formulations and the algorithms for solving them.

The book first addresses the problem of reasoning about uncertainty and objectives in simple decisions at a single point in time, and then turns to sequential decision problems in stochastic environments where the outcomes of our actions are uncertain. It goes on to address model uncertainty, when we do not start with a known model and must learn how to act through interaction with the environment; state uncertainty, in which we do not know the current state of the environment due to imperfect perceptual information; and decision contexts involving multiple agents. The book focuses primarily on planning and reinforcement learning, although some of the techniques presented draw on elements of supervised learning and optimization. Algorithms are implemented in the Julia programming language. Figures, examples, and exercises convey the intuition behind the various approaches presented.


Table of Contents

1. Introduction

Part I. Probabilistic Reasoning


2. Representation
3. Inference
4. Parameter Learning
5. Structure Learning
6. Simple Decisions

Part II. Sequential Problems

7. Exact Solution Methods
8. Approximate Value Functions
9. Online Planning
10. Policy Search
11. Policy Gradient Estimation
12. Policy Gradient Optimization
13. Actor-Critic Methods
14. Policy Validation

Part III. Model Uncertainty

15. Exploration and Exploitation
16. Model-Based Methods
17. Model-Free Methods
18. Imitation Learning

Part IV. State Uncertainty

19. Beliefs
20. Exact Belief State Planning
21. Offline Belief State Planning
22. Online Belief State Planning
23. Controller Abstractions

Part V. Multiagent Systems

24. Multiagent Reasoning
25. Sequential Problems
26. State Uncertainty
27. Collaborative Agents

Appendices

A. Mathematical Concepts
B. Probability Distributions
C. Computational Complexity
D. Neural Representations
E. Search Algorithms
F. Problems
G. Julia

Other Torrents