TD

Overall Progress 0%

Dynamic programming, Monte Carlo vs TD, on-policy vs off-policy, and Q-learning — with explanations and examples.

Go to Tabular Methods →

5 quick questions after Chapters 11–15 of Volume 2. Check you're ready to continue.

Go to Checkpoint: Volume 2, Midpoint (After Chapter 15) →

TD(0) prediction for blackjack; compare with Monte Carlo.

Go to Chapter 12: Temporal Difference (TD) Learning →

15 short drill problems for Volume 2: Monte Carlo, TD(0), SARSA, Q-learning, and n-step methods.

Go to Volume 2 Drills — Tabular Model-Free Methods →