SDS Seminar Series – Richard Samworth, University of Cambridge
Apr
18
2025
Apr
18
2025
Description
The Spring 2025 SDS Seminar Series continues on April 18th from 2:00 p.m. to 3:00 p.m. with Dr. Richard Samworth (Professor, Department of Pure Mathematics and Mathematical Statistics and Director, Statistical Laboratory, University of Cambridge). This event is in-person in the Avaya Room (POB 2.302).
Title: How Should We Do Linear Regression?
Abstract: In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. Our semiparametric approach targets the best decreasing approximation of the derivative of the log-density of the noise distribution. At the population level, this fitting process is a nonparametric extension of score matching, corresponding to a log-concave projection of the noise distribution with respect to the Fisher divergence. The procedure is computationally efficient, and we prove that our procedure attains the minimal asymptotic covariance among all convex M-estimators. As an example of a non-log-concave setting, for Cauchy errors, the optimal convex loss function is Huber-like, and our procedure yields an asymptotic efficiency greater than 0.87 relative to the oracle maximum likelihood estimator of the regression coefficients that uses knowledge of this error distribution; in this sense, we obtain robustness without sacrificing much efficiency. Numerical experiments confirm the practical merits of our proposal.
Location
POB 2.302
Share
Other Events in This Series
Sep
8
2023
SDS Seminar Series – Dr. Emily Roberts
A Causal Inference Approach for Surrogate Marker Evaluation with Mixed Models
2:00 pm – 3:00 pm • In Person
Speaker(s): Emily Roberts
Sep
15
2023
SDS Seminar Series – Dr. Dimitris Korobilis
Monitoring Multicountry Macroeconomic Risk
2:00 pm – 3:00 pm • Virtual
Speaker(s): Dimitris Korobilis
Sep
22
2023
SDS Seminar Series – Dr. Will Fithian
Estimating the False Discovery Rate of Model Selection
2:00 pm – 3:00 pm • In Person
Speaker(s): Will Fithian
Sep
29
2023
SDS Seminar Series – Dr. David Moriarty
A Data Science Journey in Business
2:00 pm – 3:00 pm • In Person
Speaker(s): David Moriarty
Oct
6
2023
SDS Seminar Series – Dr. Amanda Ellis
Navigating the Future of Statistics Education: Leveraging ChatGPT's Advantages and Overcoming Challenges
2:00 pm – 3:00 pm • Virtual
Speaker(s): Amanda Ellis
Oct
20
2023
SDS Seminar Series – Dr. Amy Zhang
Bisimulation and Reinforcement Learning
2:00 pm – 3:00 pm • Virtual
Speaker(s): Amy Zhang
Oct
27
2023
SDS Seminar Series – Dr. Marcelo Medeiros
Global Inflation Forecasting: Benefits from Machine Learning Methods
2:00 pm – 3:00 pm • Virtual
Speaker(s): Marcelo Medeiros
Nov
3
2023
SDS Seminar Series - Dr. Steve Yadlowsky
Choosing a Proxy Metric from Past Experiments
2:00 pm – 3:00 pm • Virtual
Speaker(s): Steve Yadlowsky
Nov
10
2023
SDS Seminar Series – Drew Herren
Statistical Aspects of SHAP: Functional ANOVA for Model Interpretation
2:00 pm – 3:00 pm • In Person
Speaker(s): Drew Herren
Dec
1
2023
SDS Seminar Series – Dr. Dave Zhao
High-Dimensional Nonparametric Empirical Bayes Problems in Genomics
2:00 pm – 3:00 pm • In Person
Speaker(s): Dave Zhao
