Code and Results for Chapter 7:

These are results and code for the problems and examples found in Chapter 7 of this famous book.

Various Figures and Problems:
  1. Using TD(n) learning to learn random walks:
  2. Using TD(lambda) learning to learn random walks:
  3. Online TD(lambda) with eligability traces:
  4. Example 7.4 Implementing the Grid World example with eligability traces:
  5. Accumulating traces v.s. Replacing traces
  6. Example 7.5 Learning from a one directional Markov chain
    John Weatherwax