SDS Seminar Series – Richard Samworth, University of Cambridge

Art by Susan Wilkinson
Event starts on this day

Apr

18

2025

Event starts at this time 2:00 pm – 3:00 pm
In Person (view details)
Featured Speaker(s): Richard Samworth
Cost: Free
How Should We Do Linear Regression?

Description

The Spring 2025 SDS Seminar Series continues on April 18th from 2:00 p.m. to 3:00 p.m. with Dr. Richard Samworth (Professor, Department of Pure Mathematics and Mathematical Statistics and Director, Statistical Laboratory, University of Cambridge). This event is in-person in the Avaya Room (POB 2.302).    

Title: How Should We Do Linear Regression?

Abstract: In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. Our semiparametric approach targets the best decreasing approximation of the derivative of the log-density of the noise distribution. At the population level, this fitting process is a nonparametric extension of score matching, corresponding to a log-concave projection of the noise distribution with respect to the Fisher divergence. The procedure is computationally efficient, and we prove that our procedure attains the minimal asymptotic covariance among all convex M-estimators. As an example of a non-log-concave setting, for Cauchy errors, the optimal convex loss function is Huber-like, and our procedure yields an asymptotic efficiency greater than 0.87 relative to the oracle maximum likelihood estimator of the regression coefficients that uses knowledge of this error distribution; in this sense, we obtain robustness without sacrificing much efficiency. Numerical experiments confirm the practical merits of our proposal.

Location

POB 2.302

Share


Audience

Other Events in This Series

Mar

1

2024

Seminar Series

SDS Seminar Series – Dr. Laura Hatfield

Predict, Correct, Select: A New General Identification Strategy for Controlled Pre-Post Designs

2:00 pm – 3:00 pm Virtual

Speaker(s): Laura Hatfield

Mar

22

2024

Seminar Series

SDS Seminar Series – Dr. Sivaraman Balakrishnan

Statistical Inference for Optimal Transport

2:00 pm – 3:00 pm In Person

Speaker(s): Sivaraman Balakrishnan

Mar

29

2024

Seminar Series

SDS Seminar Series – Dr. Purna Sarkar

Some New Results for Streaming Principal Component Analysis

2:00 pm – 3:00 pm In Person

Speaker(s): Purna Sarkar

Apr

12

2024

Seminar Series

SDS Seminar Series – Dr. Daniela Witten

Data Thinning and Its Applications

2:00 pm – 3:00 pm In Person

Apr

19

2024

Seminar Series

SDS Seminar Series – Dr. William Rosenberger

Design and Inference for Enrichment Trials with a Continuous Biomarker

2:00 pm – 3:00 pm In Person

Speaker(s): William Rosenberger

Apr

26

2024

Seminar Series

SDS Seminar Series – Dr. Bodhisattva Sen

Extending the Scope of Nonparametric Empirical Bayes

2:00 pm – 3:00 pm In Person

Speaker(s): Bodhisattva Sen

Sep

6

2024

Seminar Series

SDS Seminar Series – Christine Peterson, University of Texas MD Anderson Cancer Center

New Methods for Microbiome Data Integration

2:00 pm – 3:00 pm In Person

Speaker(s): Christine Peterson

Sep

13

2024

Seminar Series

SDS Seminar Series – Matthew Vanaman, University of Texas at Austin

Data Analysis from the Zoo to the Wild and Back

2:00 pm – 3:00 pm In Person

Speaker(s): Matthew Vanaman

Sep

20

2024

Seminar Series

SDS Seminar Series – Saptarshi Roy, University of Texas at Austin

On the Computational Complexity of Private High-dimensional Model Selection

2:00 pm – 3:00 pm In Person

Speaker(s): Saptarshi Roy

Sep

27

2024

Seminar Series

SDS Seminar Series – Abhra Sarkar, University of Texas at Austin

(Bayesian) Semiparametric Local Inference (and Other Stories)

2:00 pm – 3:00 pm In Person

Speaker(s): Abhra Sarkar