Huy Nguyen

My name is Huy Nguyen, and I am currently a second-year Ph.D student at the Department of Statistics and Data Sciecnes, University of Texas at Austin where I am fortunate to be advised by Professor Nhat Ho and Professor Alessandro Rinaldo. Before that, I graduated from Ho Chi Minh City University of Science with a Bachelor’s degree in Mathematics (Summa Cum Laude).

My current research focuses on theoretical foundations for Mixture-of-Experts models. In particular, I try to comprehend the effects of various gating functions (namely softmax gate, top-K sparse softmax gate, dense-to-sparse gate, etc) on the convergence of expert estimation. Based on insights from these results, I aim to design novel gates which help improve the performance of Large Language Models (LLM) and other applications. Additionally, I am also interested in Optimal Transport theory.