Environment Design

Learning objectives Implement a simple PAIRED-style setup: an adversary that designs a maze (or environment) to minimize the agent’s return, and an agent that learns to solve mazes. Train both adversary and agent in a loop: adversary proposes a maze, agent attempts to solve it, update adversary to make the maze harder and agent to improve. Explain how unsupervised environment design can produce a curriculum of tasks without hand-designed levels. Compare agent performance on adversary-generated mazes vs fixed or random mazes. Relate PAIRED to game AI (procedural level generation) and robot navigation (training on diverse scenarios). Concept and real-world RL ...