Code for the Chapter: Introduction to Approximate Dynamic Programming
chap_4_prob_5.py
(approximate dynamic programming for this problem)
chap_4_prob_6.py
(approximate dynamic programming for this problem)
chap_4_prob_8.py
(approximate dynamic programming for this problem)
chap_4_prob_10.py
(approximate dynamic programming for this problem)
chap_4_prob_13.R
(a Monte Carlo simulation of the various strategies)
chap_4_prob_14.R
(asynchronous ADP for selling an asset)
chap_4_prob_15.py
(the taxicab problem)
chap_4_prob_16.py
(initial conditions for the the taxicab problem)
The Nomadic Trucker Project:
chap_4_prob_17_utils.py
(general utilities)
chap_4_prob_17_part_a.py
(Part a)
chap_4_prob_17_part_b.py
(Part b)
chap_4_prob_18.py
(the connect-4 project)
As always, I am interested in hearing about any errors that might exist in this material.
John Weatherwax