Photo by Hunter Harritt at Unsplash
The Spring 2023 SDS Seminar Series continues on Friday, April 21st from 2:00 p.m. to 3:00 p.m. with Dr. Faming Liang (Distinguished Professor at Purdue University). This event is in-person, but a virtual option will be available as well.
Title: A Stochastic Neural Network Bridging from Linear Models to Deep Learning
Abstract: We develop a new type of stochastic neural network (StoNet), which is formulated as a composition of many simple linear/logistic regression models and includes the conventional deep neural network as a limiting case. The StoNet falls into the framework of statistical modeling, which does not only allow us to address many fundamental issues in deep learning, such as structure interpretability and uncertainty quantification, but also provides with us a platform for transferring the theory and methods developed for linear models to deep learning. With the StoNet, we demonstrate the transferability of sparse learning theory from linear models to deep neural networks. We also showcase the integration of reproducing kernel methods into deep neural networks to enhance their training and prediction performance. Additionally, we show how to use the Stonet to handle some special types of data, such as those with missing values or measurement errors. Lastly, we demonstrate how to use the StoNet to perform nonlinear sufficient dimension reduction for high-dimensional data. This talk is based on the joint works with Yan Sun and Siqi Liang.