Events
FDS Colloquium
How should we do linear regression?
 |
Speaker: Richard Samworth (Cambridge) Professor of Statistical Science University of Cambridge Thursday, April 24, 2025 11:30AM - 1:00PM Lunch at 11:30am in room 1307
Talk at 12:00pm in room 1327 Location: Yale Institute for Foundations of Data Science, Kline Tower 13th Floor, Room 1327, New Haven, CT 06511 and via Webcast: https://yale.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=95b75ca5-0342-489a-a622-b27a0169757c |
Cohosted by Yale School of Public Health
Abstract: In the context of linear regression, we construct a data-driven convex loss function with respect to which empirical risk minimisation yields optimal asymptotic variance in the downstream estimation of the regression coefficients. Our semiparametric approach targets the best decreasing approximation of the derivative of the log-density of the noise distribution. At the population level, this fitting process is a nonparametric extension of score matching, corresponding to a log-concave projection of the noise distribution with respect to the Fisher divergence. The procedure is computationally efficient, and we prove that our procedure attains the minimal asymptotic covariance among all convex M-estimators. As an example of a non-log-concave setting, for Cauchy errors, the optimal convex loss function is Huber-like, and our procedure yields an asymptotic efficiency greater than 0.87 relative to the oracle maximum likelihood estimator of the regression coefficients that uses knowledge of this error distribution; in this sense, we obtain robustness without sacrificing much efficiency.
Speaker bio: Richard Samworth obtained his PhD in Statistics from the University of Cambridge in 2004, and has remained in Cambridge since, becoming a full professor in 2013 and the Professor of Statistical Science in 2017. His main research interests are in nonparametric and high-dimensional statistics; he has developed methods and theory for shape-constrained inference, missing data, subgroup selection, data perturbation techniques (random projections, subsampling, the bootstrap, knockoffs), changepoint estimation and independence testing. Richard currently holds a European Research Council Advanced Grant. He received the COPSS Presidents’ Award in 2018, was elected a Fellow of the Royal Society in 2021 and served as co-editor of the Annals of Statistics (2019-2021).
Add To: Google Calendar | Outlook | iCal File
Submit an Event
Interested in creating your own event, or have an event to share? Please fill the form if you’d like to send us an event you’d like to have added to the calendar.