UltraHorizon evaluates agents in long-horizon, partially observable environments that require sustained exploration, planning, memory and tool use. The benchmark exposes weaknesses that short tasks can miss and analyzes recurring failures in the resulting trajectories. It includes three exploration environments and compares the capabilities revealed by human and model behavior.