SDS Seminar Series – Dr. Amy Zhang
Oct
20
2023
Oct
20
2023
Description
The Fall 2023 SDS Seminar Series continues on October 20th from 2:00 p.m. to 3:00 p.m. with Dr. Amy Zhang (Texas Instruments/Kilby Fellow in the Department of Electrical and Computer Engineering, University of Texas). This event is virtual.
Title: Bisimulation and Reinforcement Learning
Abstract: Most real world environments contain structure that would aid sample efficiency and generalization in control tasks if it were leveraged by algorithms. In this talk, we propose to incorporate different assumptions that better reflect the real world and allow the design of novel algorithms with theoretical guarantees to address this fundamental problem. We first present how state abstractions can accelerate reinforcement learning from rich observations, such as images, without relying either on domain knowledge or pixel-reconstruction. Our goal is to learn state abstractions that both provide for effective downstream control and invariance to task-irrelevant details. We use bisimulation metrics to quantify behavioral similarity between states, and learn robust latent representations which encode only the task-relevant information from observations. We provide theoretical guarantees for the learned approximate abstraction and extend this notion to multi-task settings.
Location
This virtual event requires software to participate. Get help with Zoom or Microsoft Teams.
Please contact Stat.admin@austin.utexas.edu for the zoom link.
Share
Other Events in This Series
Sep
12
2025
SDS Seminar Series – Lydia Lucchesi, University of Texas at Austin
Visual Documentation for Data Preprocessing in R and Python
2:00 pm – 3:00 pm • In Person
Speaker(s): Lydia Lucchesi
Sep
19
2025
SDS Seminar Series – Tuan Pham, University of Texas at Austin
Time-uniform Bounds for Iterated Algorithms
2:00 pm – 3:00 pm • In Person
Speaker(s): Tuan Pham
Sep
26
2025
SDS Seminar Series - Ryan Giordano, University of California, Berkeley
TBA
2:00 pm – 3:00 pm • In Person
Speaker(s): Ryan Giordano
Oct
3
2025
SDS Seminar Series – Rafael Campello de Alcantara, University of Texas at Austin
Searching for Parallel Trends: A Decision Tree Algorithm for Discovering Conditional Diff-in-Diff Estimators
2:00 pm – 3:00 pm • In Person
Speaker(s): Rafael Campello de Alcantara
Oct
10
2025
SDS Seminar Series – Michele Guindani, University of California, Los Angeles
TBA
2:00 pm – 3:00 pm • In Person
Speaker(s): Michele Guindani
Oct
17
2025
SDS Seminar Series – Wenyi Wang, MD Anderson Cancer Center
TBA
2:00 pm – 3:00 pm • In Person
Speaker(s): Wenyi Wang
Oct
31
2025
SDS Seminar Series – Max Goplerud, University of Texas at Austin
TBA
2:00 pm – 3:00 pm • In Person
Speaker(s): Max Goplerud
Nov
7
2025
SDS Seminar Series – Jeffrey Miller, Harvard University
TBA
2:00 pm – 3:00 pm • In Person
Speaker(s): Jeffrey Miller
