Code and Results for Chapter 5:

Introduction:
These are results and code for the problems and examples found in Chapter 5 of this famous book.

1. Computing the State-Value function for the given blackjack policy using the First-Visit Monte Carlo Method:
   • blackjack_mc_prediction.py (Monte-Carlo compuation of the state-value function)
     
2. Exploring Starts to compute the optimal policy for Blackjack:
   • blackjack_exploring_starts.py (Monte-Carlo compuation of the optimal policy)
     
   • sample output using the above code