Code and Results for Chapter 4:

These are results and code for the problems and examples found in Chapter 4 of this famous book.

Various Figures and Problems:
  1. Policy Iteration for the Grid World Example:
  2. Exercise 4.2 (Adding a state to grid world):
  3. Policy Improvement for the Jacks Car Rental (JCR) Example:
  4. Exercise 4.5 (Modifications on the Jacks Car Rental Example):
  5. The Gambler's Problem:

John Weatherwax