← Publications

ICML · International Conference on Machine Learning · 2025 · Oral · Top 1%

Network Sparsity Unlocks the Scaling Potential of Deep Reinforcement Learning

Guozheng Ma*, Lu Li*, Zilin Wang, Li Shen, Pierre-Luc Bacon, Dacheng Tao

Editorial illustration of this publication’s research theme
An illustration of the research theme. See the paper for methods and experimental results.
PDF ↗ Code ↗ BibTeX ↓

This work studies static sparsity as a way to scale deep reinforcement learning. A single random pruning step before training improves parameter efficiency and helps networks resist plasticity loss and gradient interference. The evaluation includes visual and streaming RL settings. Read the conference record.

Guozheng Ma and Lu Li contributed equally.

Related research

Why sparsify RL networks?

Static sparsity offers a surprisingly simple way to improve scaling in deep RL.