Reinforcement learning · EvaluationOpen-source software
AgentCreditBench
Exact-oracle diagnostics that separate identifying helpful actions from inducing the intended policy gradient.
My contribution. Built a CPU benchmark for turn-level credit assignment and compared advantage computations across RL frameworks.
LLM post-training · Data selectionResearch study
Probe-guided prompt selection
Investigating whether lightweight probes can select informative prompts before spending compute on full rollouts.
My contribution. Contributed post-training experiments and coding evaluation on OctoThinker-1B, comparing probe-guided selection with GRPO, DAPO, and LILO baselines.
Multimodal learning · Distributed systemsEngineering case study
VLM training & FSDP scaling
Implementing a VLM and investigating suspicious scaling measurements across 2, 4, and 8 V100 GPUs.
My contribution. Built the image-token insertion and training pipeline using SigLIP-2, Qwen2.5, and a projector; profiled FSDP communication and tested forward prefetching.