Selected Publications
Delta-Matching: Closing the Final Gap of Native 8-bit Training for LLMs
Haozhan Tang, Hao Kang, Han Cai, Song Han, Chenyan Xiong
PithTrain: A Compact and Agent-Native MoE Training System
Ruihang Lai*, Hao Kang*, Haozhan Tang, Akaash R. Parthasarathy, Zichun Yu, Junru Shao, Todd C. Mowry, Chenyan Xiong, Tianqi Chen
Benchmark Test-Time Scaling of General LLM Agents
Xiaochuan Li, Ryan Ming, Pranav Setlur, Abhijay Paladugu, Andy Tang, Hao Kang, Shuai Shao, Rong Jin, Chenyan Xiong
FLAME-MoE: A Transparent End-to-End Research Platform for Mixture-of-Experts Language Models
Hao Kang*, Zichun Yu*, Chenyan Xiong
Interpret and Control Dense Retrieval with Sparse Latent Features
Hao Kang, Tevin Wang, Chenyan Xiong
* Equal contribution
