How to tame and validate AI-based predictions
| Event Date: | December 4, 2025 |
|---|---|
| Time: | 1:30 - 2:30 PM |
| Location: | ARMS Atrium |
| Priority: | No |
| School or Program: | College of Engineering |
| College Calendar: | Show |
Register Here
Abstract (Lecture)
Statistical prediction is the engine powering dramatic advances in AI: diffusion denoising for generating images, token prediction for large language models, and look-ahead prediction in reinforcement learning. Complex predictive models can behave remarkably well, but can also fail in mysterious and dangerous ways, including biased and mis-calibrated outputs, poor performance under distribution shift, and high uncertainty associated with their predictive performance. This talk discusses these challenges, along with some new approaches for tackling them. We discuss a simple method for combining (potentially misleading) AI-generated data with clean data, and a fast and data-efficient refitting method for assessing predictive performance.
Biography
Martin Wainwright is the Ford Chair Professor in Electrical Engineering and Computer Science and Mathematics at MIT, and affiliated with the Laboratory for Information and Decision Systems and Statistics and the Data Science Center. He joined the MIT faculty in July 2022 after spending 20 years in Statistics and EECS at the University of California, Berkeley.
Martin is broadly interested in machine learning, statistics, information theory and optimization. His work has been recognized by various awards, among them a Guggenheim Foundation Fellowship; the COPSS Presidents’ Award from the Joint Statistical Societies; the David Blackwell Award from the Institute of Mathematical Statistics; selection as a Section Lecturer from the International Congress of Mathematicians; an Alfred P. Sloan Foundation Fellowship; and several best paper awards from the IEEE. He is a Fellow of the IEEE and of the Institute of Mathematical Statistics. He has co-authored several books, including on graphical models, sparse statistical models and high-dimensional statistics.
Abstract (Panel)
Generative AI is transforming how we collect, synthesize and interpret data, but it also blurs the line between evidence, simulation and modeling. This panel will examine how model-building and decision-making are changing in the age of generative models, probing when we should trust generative AI-assisted analysis, how to keep humans meaningfully “in the loop,” and what new methodological developments are needed to ensure that powerful generative tools improve, rather than erode, responsible model-building and decision-making.
Moderator
- Harsha Honnappa, Associate Professor Edwardson School of Industrial Engineering
Panelists
- Martin Wainwright, Cecil H. Green Professor in Electrical Engineering and Computer Science (EECS) and Mathematics, MIT
- Ana Maria Estrada Gomez, Assistant Professor Edwardson School of Industrial Engineering
- David Inouye, Assistant Professor of Electrical and Computer Engineering
- Guang Lin, Moses Cobb Stevens Professor in Mathematical Sciences; College of Science Associate Dean of Research and Innovation; Professor of Mechanical Engineering
- Mohit Tawarmalani, Executive Associate Dean of Strategy, Research, and Innovation, Allison & Nancy Schleicher Chair, Professor
2025-12-04 13:30:00 2025-12-04 14:30:00 America/Indiana/Indianapolis How to tame and validate AI-based predictions Join Martin Wainwright, Cecil H. Green Professor in Electrical Engineering and Computer Science (EECS) and Mathematics, MIT, for a lecture on taming and validating AI-based prediction. Following the lecture, a panel session will be held discussing data and decisions in the age of generative AI. ARMS Atrium