Huy Nguyen

  • PhD Student
  • Statistics and Data Sciences

Admission year: 2022

Advisor(s): Nhat Ho and Alessandro Rinaldo

Profile image of Huy Nguyen

Biography

My name is Huy Nguyen, and I am currently a fourth-year Ph.D student at the Department of Statistics and Data Sciecnes, University of Texas at Austin where I am fortunate to be advised by Professor Nhat Ho and Professor Alessandro Rinaldo. Before that, I graduated from Ho Chi Minh City University of Science with a Bachelor’s degree in Mathematics (Summa Cum Laude).

Research

My research focuses on four important aspects of Mixture-of-Experts (MoE) models, including Scalability (effective sparse MoE in large language models), Heterogeneity (MoE in multi-modal learning), Efficiency (MoE in parameter-efficient fine-tuning, namely low-rank adaptation and prompt-based tuning), and Interpretability (theoretical understandings of different gating mechanisms and expert structures). Additionally, I am also interested in Optimal Transport problems.

Research Areas

  • Statistics, Big Data or Machine Learning

Fields of Interest

  • Statistical/Machine Learning
  • Statistical Computing