SARSA

Overall Progress 0%

5 quick questions after Chapters 11–15 of Volume 2. Check you're ready to continue.

Go to Checkpoint: Volume 2, Midpoint (After Chapter 15) →

10–15 questions on MDPs, Bellman, MC vs TD, SARSA vs Q-learning. Solutions included.

Go to Phase 6 Assessment: RL Foundations →

SARSA on Cliff Walking; plot sum of rewards per episode.

Go to Chapter 13: SARSA (On-Policy TD Control) →

Code walkthrough for TD(0) prediction, SARSA, and Q-learning (tabular).

Go to TD, SARSA, and Q-Learning in Code →

n-step SARSA (n=4) on Cliff Walking.

Go to Chapter 16: N-Step Bootstrapping →

15 short drill problems for Volume 2: Monte Carlo, TD(0), SARSA, Q-learning, and n-step methods.

Go to Volume 2 Drills — Tabular Model-Free Methods →