Code and Results for Chapter 4:

These are results and code for the problems and examples found in Chapter 4 of this famous book.

Various Figures and Problems:
  1. Exercise 4.2 (Adding a state to grid world):
  2. Policy Improvement for the Jacks Car Rental (JCR) Example:
  3. Exercise 4.5 (Modifications on the Jacks Car Rental Example):
  4. The Gambler's Problem:

John Weatherwax