SDS Seminar Series – Dr. Amy Zhang
Oct
20
2023
Oct
20
2023
Description
The Fall 2023 SDS Seminar Series continues on October 20th from 2:00 p.m. to 3:00 p.m. with Dr. Amy Zhang (Texas Instruments/Kilby Fellow in the Department of Electrical and Computer Engineering, University of Texas). This event is virtual.
Title: Bisimulation and Reinforcement Learning
Abstract: Most real world environments contain structure that would aid sample efficiency and generalization in control tasks if it were leveraged by algorithms. In this talk, we propose to incorporate different assumptions that better reflect the real world and allow the design of novel algorithms with theoretical guarantees to address this fundamental problem. We first present how state abstractions can accelerate reinforcement learning from rich observations, such as images, without relying either on domain knowledge or pixel-reconstruction. Our goal is to learn state abstractions that both provide for effective downstream control and invariance to task-irrelevant details. We use bisimulation metrics to quantify behavioral similarity between states, and learn robust latent representations which encode only the task-relevant information from observations. We provide theoretical guarantees for the learned approximate abstraction and extend this notion to multi-task settings.
Location
This virtual event requires software to participate. Get help with Zoom or Microsoft Teams.
Please contact Stat.admin@austin.utexas.edu for the zoom link.
Share
Other Events in This Series
Oct
11
2024
SDS Seminar Series – Mingyuan Zhou, University of Texas at Austin
Building Faster, Better, and Safer Deep Generative Models via Score Identity Distillation
2:00 pm – 3:00 pm • In Person
Speaker(s): Mingyuan Zhou
Oct
18
2024
SDS Seminar Series – Sherry Zhang, University of Texas at Austin
Pivoting between Space and Time: Spatio-Temporal Analysis with Cubble
2:00 pm – 3:00 pm • In Person
Speaker(s): Sherry Zhang
Oct
25
2024
SDS Seminar Series – Matt Koslovsky, Colorado State University
Sparse Dirichlet-Multinomial Models
2:00 pm – 3:00 pm • In Person
Speaker(s): Matt Koslovsky
Nov
1
2024
SDS Seminar Series – Aaditya Ramdas, Carnegie Mellon University
A Game-Theoretic Theory of Statistical Evidence
2:00 pm – 3:00 pm • In Person
Speaker(s): Aaditya Ramdas
Nov
8
2024
SDS Seminar Series – Myungsoo Yoo, University of Texas at Austin
Dynamic Spatio-Temporal Model Integrating Physics for Fire Front Propagation
2:00 pm – 3:00 pm • In Person
Speaker(s): Myungsoo Yoo
Nov
15
2024
SDS Seminar Series – Rafael Irizarry, Harvard University
Twenty-Five Years of Data Science: Music, Genomics, and Public Health Surveillance
2:00 pm – 3:00 pm • In Person
Speaker(s): Rafael Irizarry
