The study examines how data augmentation, network modules and training stages affect plasticity in visual RL. It identifies the critic as a key bottleneck and motivates Adaptive Replay Ratio: adjusting data reuse to the critic’s ability to learn. Read the paper summary.

Guozheng Ma and Lu Li contributed equally.

Watch the AI TIME talk in Chinese.

Read the Chinese coverage.