In this talk, I will present our group’s recent work toward a trustworthy framework for agent development, with a focus on building privacy-accountable LLM agents by design and by development. We outline principles and practical mechanisms for proactive privacy enhancement, runtime policy enforcement, and auditable accountability throughout the agent lifecycle, thereby setting the stage for deeper discussion on threat modeling and proactive defense strategies.
Continue reading
We will examine (1) new frameworks for evaluating and aligning model behavior with human intent (2) the security and reliability of watermarking techniques in foundation models, including their role in provenance tracking and their vulnerabilities to adversarial removal and evasion, and (3) novel approaches for detecting and mitigating high-risk model outputs before deployment. By synthesizing these findings, we will discuss the broader implications of foundation model security, trade-offs between robustness and control, and future directions for improving Al safety at scale.
Continue reading
The focus of the talk, however, will be a measurement study we performed of the University of Chicago’s vulnerability to credential-guessing attacks across twenty years. Given a list of university usernames, we searched for matches in data breaches from hundreds of websites. Ultimately, we successfully guessed passwords for thousands of UChicago affiliates. I will conclude my talk by discussing our parallel investigations of FIDO2 passwordless authentication, including analyzing why passkeys have not yet replaced passwords for web authentication.
Continue reading
In the first part of this talk, I will discuss our efforts to apply hardware-software co-design to help future heterogeneous systems overcome these challenges and improve performance, energy efficiency, and scalability. Then, in the second part I will discuss how the on-going transition to chiplet-based heterogeneous systems exacerbates these challenges and how we address these challenges in chiplet-based heterogeneous systems by rethinking the control plane.
Continue reading