Expected Return Causes Outcome-Level Mode Collapse in Reinforcement Learning and How to Fix It with Inverse Probability Scaling
International Conference on Machine Learning, 2026
PhD researcher · NUS Singapore
I study how to make generative models explore. My work trains policies that find many good answers instead of collapsing onto one.
I am a PhD researcher in Machine Learning at the National University of Singapore, in the Artificial Scientific Intelligence Lab, supervised by Dr. Dianbo Liu. My research covers reinforcement learning, generative modeling, LLM post-training and alignment, diversity, creativity, and interpretable AI.
My current work studies outcome-level mode collapse in reinforcement learning and reward-proportional sampling. I develop methods that encourage diverse, high-reward generation while preserving alignment and task performance. I also work on interpretable generative systems, including reinforcement-learning agents that edit discrete latent representations.
Before NUS, I completed a dual Bachelor’s and Master’s degree in Biotechnology at IIT Madras, and worked on brain-inspired visual attention, neurological healthcare applications, document understanding, and enterprise AI systems.
Fig. 1
Fig. 2
International Conference on Machine Learning, 2026
CVPR Workshop on Explainable AI for Computer Vision (XAI4CV), 2026 Spotlight
Under review at ICLR 2027
International Conference on Neural Information Processing, 2023