Causality in Explainable AI: Motivation and Methods

Event Date: April 21, 2023
Hosted By: Dr. Vineeth Venue
Time: 1:30 PM
Location: MSEE 180
Priority: No
School or Program: Graduate Program
College Calendar: Show
Lunch will be provided to all the attendees. Please RSVP to help us estimate food better. Read more about the talk here!

 

RSVP: https://forms.office.com/r/50XA2vQCFx

Abstract: The need for explainability of Deep Neural Network (DNN) models and the development of AI systems that can fundamentally reason has exponentially increased in recent years, especially with the increasing use of AI/ML models in risk-sensitive and safety-critical applications. Causal reasoning helps identify input variables that cause a certain prediction, rather than merely be correlated, and thus provide useful explanations in practice. Similarly, focusing on causal input-output relationships can help a DNN model generalize to out-of-distribution samples better, where spurious correlations in training data may otherwise mislead a model. This talk will introduce the growing field of explainable AI, summarize existing efforts and focus on one important aspect of causality in DNN models -- the notion of causal attributions between input and output variables of the model. We will do this from two perspectives -- firstly, we will study how one can "deduce" what causal input-output attributions an already-trained DNN model has learned, and provide an efficient mechanism to compute such causal attributions (based on our work published at ICML 2019). Secondly, we will explore the complementary side of this problem on how one can "induce" known prior causal information into DNN models during the training process itself  (based on our work published at ICML 2022) . Both of these efforts are derived by a first-principles approachto integrating causal principles into DNN models, and can have significant implications on practice in real-world applications.

Bio: Vineeth N Balasubramanian is an Associate Professor in the Department of Computer Science and Engineering at the Indian Institute of Technology, Hyderabad (IIT-H), India, and is currently a Fulbright-Nehru Visiting Faculty Fellow at Carnegie Mellon University. He is also the Founding Head of the Department of Artificial Intelligence at IIT-H from 2019-22. His research interests include deep learning, machine learning, and computer vision with a focus on explainability, continual learning and learning with limited labeled data. His research has been published are premier venues including ICML, CVPR, NeurIPS, ICCV, KDD, AAAI, and IEEE TPAMI, with Best Paper Awards at recent venues such as CODS-COMAD 2022, CVPR 2021 Workshop on Causality in Vision, etc. He served as a General Chair for ACML 2022, and serves as a Senior PC/Area Chair for conferences such as CVPR, ICCV, AAAI, IJCAI, ECCV with recent awards including Outstanding Reviewer at ICLR 2021, CVPR 2019, ECCV 2020, etc. He is also a recipient of the Teaching Excellence Award at IIT-H (2017 and 2021), Google Research Scholar Award (2021), NASSCOM AI Gamechanger Award (2022), Google exploreCSR award (2022), among others. For more details, please see https://iith.ac.in/~vineethnb/.