SCOUT separates inexpensive exploration from language-model learning. Small models first collect trajectories in unfamiliar environments; these experiences then support supervised finetuning and multi-turn reinforcement learning of the language agent. The method focuses on tasks such as symbolic and spatial environments, where language-only exploration can be costly despite substantial pretrained knowledge.

Publication record.