Code and Results for Chapter 6:

These are results and code for the problems and examples found in Chapter 6 of this famous book.

Various Figures and Problems:
  1. Comparing TD(0) and constant alpha MC learning on the Random Walk Example:
  2. The Windy Gridworld Example:
  3. The Cliff Walk example (Thanks to J. Rosado for spotting some bugs in these programs)
  4. The R learning example:
    John Weatherwax