Code for the Chapter: Introduction to Approximate Dynamic Programming

• chap_4_prob_5.py (approximate dynamic programming for this problem)
  
• chap_4_prob_6.py (approximate dynamic programming for this problem)
  
• chap_4_prob_8.py (approximate dynamic programming for this problem)
  
• chap_4_prob_10.py (approximate dynamic programming for this problem)
  
• chap_4_prob_13.R (a Monte Carlo simulation of the various strategies)
  
• chap_4_prob_14.R (asynchronous ADP for selling an asset)
  
• chap_4_prob_15.py (the taxicab problem)
  
• chap_4_prob_16.py (initial conditions for the the taxicab problem)
  
• The Nomadic Trucker Project:
  • chap_4_prob_17_utils.py (general utilities)
    
  • chap_4_prob_17_part_a.py (Part a)
    
  • chap_4_prob_17_part_b.py (Part b)
    
• chap_4_prob_18.py (the connect-4 project)