Code and Results for Chapter 5:

Introduction:
These are results and code for the problems and examples found in Chapter 5 of this famous book.

Various Figures and Problems:
  1. Computing the State-Value function for the using the First-Visit Monte Carlo Method (for blackjack):
  2. Exploring Starts to compute the optimal policy for Blackjack:
  3. Soft Policy Evaluation to compute the optimal policy for Blackjack:
  4. Exercise 5.4 (The Race Track Example):

John Weatherwax