Accelerator-Package Co-Design and Prototyping for Automotive Edge Computing with Foundation Models

Interdisciplinary Areas: Data and Engineering Applications, Autonomous and Connected Systems, Innovation and Making

Project Description

Efficient and reliable edge AI hardware holds great potential unlocking true on-vehicle intelligence for autonomous driving. Driven by unique challenges in energy efficiency, performance, and reliability, this project will develop first-of-its-kind, accelerator-package co-designed AI hardware prototype for edge transformers, exploiting the unique opportunities where chiplet architectures with scaled 3D interconnects through silicon vias (TSVs) meet thermal-friendly compute-in-memory (CIM) chip designs. The postdoc fellow will work with PIs to create first silicon-prototype-driven, systematic electrical-thermal co-design framework for CIM chiplets, with a novel heterogeneous-CIM chiplet (H-CIMlet) 2.5D silicon interposer test vehicle with scaled TSVs and hybrid bonding approaches. Enhanced heat extraction solutions along with new models will be developed to investigate thermal and mechanical reliability. The PIs have established in-house experiment/characterization capabilities as well as active foundry tapeouts with unique access to a specialized CIM device technology. The project holds great potential in evolving into a “Transformer SiP Metrology Platform” through closed-loop design-prototyping-testing. Driven by the “lab-to-fab” vision outlined in the CHIPS Act, the project team actively engage in industry collaborations (e.g., MediaTek, TSMC, IMEC, Samsung). The postdoc fellow is expected to lead the work towards flagship conference and high-impact journal publications with various modeling, fabrication, and chip measurement results.

Start Date

Early 2025

Postdoc Qualifications

1. PhD in Electrical and Computer Engineering, Mechanical Engineering, Materials Science, or a related field, completed by the start date of the position.
2. Proven research track record in the fields of artificial intelligence hardware, advanced packaging, and electrical-mechanical-thermal co-designs.
3. Experience in ASIC chip designs and experimental prototyping for advanced packaging and heterogeneous integration.
4. Team mindset and good communication skills.

Co-advisors

Haitong Li, haitongli@purdue.edu, School of Electrical and Computer Engineering, https://engineering.purdue.edu/NanoX/;

Tiwei Wei, wei427@purdue.edu, School of Mechanical Engineering, https://s-pack.org/

Bibliography

[1] L. Zheng and H. Li, “CMOS+X Technologies for Neuro-Vector-Symbolic Computing,” Device Research Conference (DRC), 2024.

[2] H. Li, “Emerging Hardware Technologies and 3D System Integration for Ubiquitous Machine Intelligence,” Design Automation Conference (DAC), July 2023.

[3] H. Li, W.-C. Chen, A. Levy, C.-H. Wang, H. Wang, P.-H. Chen, W. Wan, H.-S. P. Wong, and P. Raina, “One-shot learning with memory-augmented neural networks using a 64-kbit, 118 GOPS/W RRAM-based non-volatile associative memory,” Symposium on VLSI Technology (VLSI), June 2021.

[4] Wang, K.Y, Lyu, S.H., and Wei, T.W., A Novel Copper Microporous-Assisted Bonding Method for Fine-Pitch Cu/Sn Microbump 3D Interconnects, 2024 IEEE 74th Electronic Components and Technology Conference (ECTC), Denver, Colorado, May 28- May 31, 2024, pp. 563-570. IEEE, 2024.

[5] Lyu, S.H., Thomas B., and Wei, T.W., Thermo-Mechanical Reliability Analysis and Raman Spectroscopy Characterization of Sub-micron Through Silicon Vias (TSVs) for Backside Power Delivery in 3D Interconnects, 2024 IEEE 74th Electronic Components and Technology Conference (ECTC), Denver, Colorado, May 28- May 31, 2024, pp. 834-841.