Why sparsify RL networks?
Static sparsity offers a surprisingly simple way to improve scaling in deep RL.
I’m Guozheng Ma, a PhD student at Nanyang Technological University, advised by Dacheng Tao. Previously, I completed my master’s studies at Tsinghua University and my bachelor’s degree at Hunan University.
My research focuses on deep reinforcement learning: how agents can learn efficiently, scale, and keep adapting in open-ended environments. I study optimization, network sparsity, plasticity, and the interplay between offline knowledge and online experience. More broadly, I’m interested in RL as a way to understand and develop intelligence.
Greatness cannot be planned, so I play with joyful explorations!
Static sparsity offers a surprisingly simple way to improve scaling in deep RL.
Data, the critic and the timing of updates all shape an agent's learning capacity.
Useful visual diversity depends on both the transformation and the way it enters training.
Let deployment evidence guide how online learners use and adapt their offline priors.
Helping residual RL critics learn from a pretrained policy and recognize small action corrections.
Randomly pruning a network before training improves how deep RL scales.