Code and Results for Chapter 8:

Introduction:
These are results and code for the problems and examples found in Chapter 8 of this famous book.

1. Using Coarse Coding to Approximate a Step Function
   • linAppFn.m (approximate a function with linear patches)
     
   • targetF.m (the target step function)
     
   • stp_fn_approx_Script.m (the driver function that will run everything)
     
   • sample output using the above codes
     
2. The Mountain Car Example:
   • GetTiles_Mex.C (code to make Dr. Sutton's tiling software GetTiles callable from Matlab)
     
   • GetTiles_Mex_Script.m (an example call to Dr. Sutton's tiling software GetTiles from Matlab)
     
   • tiles.C (Dr. Sutton's tiling software in double precision)
     
   • tiles.h (Dr. Sutton's tiling software in double precision)
     
   • mnt_car_learn.m (learns the mountaintop example)
     
   • get_ctg.m (extracts the cost to go function)
     
   • ret_q_in_st.m (returns the action-function for the given state)
     
   • next_state.m (returns the action-function for the given state)
     
   • mnt_car_learn_Script.m (runs the above program)
     
   • sample output using the above codes
     
3. Learning Rates for the Mountain Car Example:
   • do_mnt_car_Exps.m (does the alpha lambda experiments performed in the book)
     
   • sample output using the above codes