Volume 3

Overall Progress 0%

5 quick questions after Chapters 21–25 of Volume 3. Check you're ready to continue.

Go to Checkpoint: Volume 3, Midpoint (After Chapter 25) →

15 short drill problems for Volume 3: linear FA, semi-gradient TD, DQN, replay buffer, target network, Double DQN, and dueling networks.

Go to Volume 3 Drills — Function Approximation & DQN →

Review Volume 2 tabular methods and preview Volume 3. From Q-tables to neural network function approximation.

Go to Volume 2 Review & Bridge to Volume 3 →

Review Volume 3 (DQN and variants) and preview Volume 4 (Policy Gradients). From value-based to policy-based methods.

Go to Volume 3 Review & Bridge to Volume 4 →