Huy Nguyen

My name is Huy Nguyen, and I am currently a fourth-year Ph.D student at the Department of Statistics and Data Sciecnes, University of Texas at Austin where I am fortunate to be advised by Professor Nhat Ho and Professor Alessandro Rinaldo. Before that, I graduated from Ho Chi Minh City University of Science with a Bachelor’s degree in Mathematics (Summa Cum Laude).

My research focuses on four important aspects of Mixture-of-Experts (MoE) models, including Scalability (effective sparse MoE in large language models), Heterogeneity (MoE in multi-modal learning), Efficiency (MoE in parameter-efficient fine-tuning, namely low-rank adaptation and prompt-based tuning), and Interpretability (theoretical understandings of different gating mechanisms and expert structures). Additionally, I am also interested in Optimal Transport problems.