ECE 50024: Lecture and Homework
(For Spring 2026 Lectures, please visit Brightspace)
25-Aug, 2025. Lecture 0. Course overview. Mathematics review.
Lecture Slides (TBD)
Homework
Additional resources
27-Aug, 2025. Lecture 1. Linear Regression Concept and Geometry
Lecture Slides PDF (574KB)
Homework
Additional resources
29-Aug, 2025. Lecture 2. Underdetermined and Overdetermined Systems
Lecture Slides PDF (846KB)
Homework
Additional resources
1-Sep, 2025. No Class. Labor Day
3-Sep, 2025. Lecture 3. L1 and L2 Regularization
Lecture Slides PDF (2.7MB)
Homework
Solution: Login to Brightspace
Additional resources
5-Sep, 2025. Lecture 4. Kernel Methods
Lecture Slides PDF (1.1MB)
Homework PDF (200 KB)
Solution: Login to Brightspace
8-Sep, 2025. Lecture 5. Optimization basics; optimality; convexity
Lecture Slides PDF (1.8MB)
Homework
Solution: Login to Brightspace
Additional resources
10-Sep, 2025. Lecture 6. Gadient descent
Lecture Slides PDF (939KB)
Homework
Solution: Login to Brightspace
Additional resources
12-Sep, 2025. Lecture 7. Linear Discriminant Analysis
Lecture Slides PDF (663KB)
Homework
Solution: Login to Brightspace
Additional resources
Read the references in reading list page of the slides
Python demo for linear separability (URL)
15-Sep, 2025. Lecture 8. Linearly Separable
Lecture Slides PDF (750KB)
Homework
Solution: Login to Brightspace
Additional resources
Read the references in reading list page of the slides
Python demo for linear separability (URL)
17-Sep, 2025. Lecture 9 Bayesian Decision
Lecture Slides PDF (896KB)
Homework
Solution: Login to Brightspace
Additional resources
Tutorial 2 Probability Review (PDF)
19-Sep, 2025. Monthly Test 1
22-Sep, 2025. Lecture 10 Probability of Error
Lecture Slides PDF (710KB)
Homework
Solution: Login to Brightspace
24-Sep, 2025. Lecture 11 Model parameter estimation
Lecture Slides PDF (779KB)
Homework
Solution: Login to Brightspace
26-Sep, 2025. Lecture 12 Connecting Bayesian with regression
Lecture Slides PDF (676KB)
Homework
TBD
Solution: Login to Brightspace
29-Sep, 2025. Lecture 13 Why are classifier vulnerable to attacks?
Lecture Slides PDF (5.7MB)
Homework
Solution: Login to Brightspace
1-Oct, 2025. Lecture 14 Min-norm perturbuation
Lecture Slides PDF (487KB)
Homework
Solution: Login to Brightspace
3-Oct, 2025. Lecture 15 Max-loss and regularized perturbation
Lecture Slides PDF (1.5MB)
Homework
Solution: Login to Brightspace
6-Oct, 2025. Lecture 16 Improving robustness
Lecture Slides PDF (2.3MB)
Homework
Solution: Login to Brightspace
8-Oct, 2025. Lecture 17 Variational autoencoder
Lecture Slides PDF (1.8MB)
Homework
Solution: Login to Brightspace
10-Oct, 2025. Monthly Test 2
13-Oct, 2025. No Class. Fall Break
15-Oct, 2025. No Class. Fall Break
17-Oct, 2025. Lecture 18 Evidence lower bound
Lecture Slides PDF (485KB)
Homework
Solution: Login to Brightspace
20-Oct, 2025. Lecture 19 Parameterization Trick
Lecture Slides PDF (859KB)
Homework
Solution: Login to Brightspace
22-Oct, 2025. Lecture 20 DDPM building blocks
Lecture Slides PDF (2.3MB)
Homework
Solution: Login to Brightspace
24-Oct, 2025. Lecture 21 DDPM evidence lower bound
Lecture Slides PDF (560KB)
Homework
Solution: Login to Brightspace
27-Oct, 2025. Lecture 22 DDPM: Denoising?
Lecture Slides PDF (591KB)
Homework
Solution: Login to Brightspace
29-Oct, 2025. Lecture 23 Training and Inference of DDPM
Lecture Slides PDF (1.7MB)
Homework
Solution: Login to Brightspace
31-Oct, 2025. Lecture 24 Score matching and Langevin Sampling
Lecture Slides PDF (1.7MB)
Homework
Solution: Login to Brightspace
3-Nov, 2025. Lecture 25 Score Matching Techniques
Lecture Slides PDF (573KB)
Homework
Solution: Login to Brightspace
5-Nov, 2025. Lecture 26 Stochastic Differential Equation
Lecture Slides PDF (1.8MB)
Homework
Solution: Login to Brightspace
7-Nov, 2025. Monthly Test 3
10-Nov, 2025. Lecture 27 Brownian Motion
Lecture Slides PDF (527KB)
Homework
Solution: Login to Brightspace
12-Nov, 2025. Lecture 28 Fokker-Planck Equation
Lecture Slides PDF (394KB)
Homework
Solution: Login to Brightspace
14-Nov, 2025. Lecture 30 Is learning always feasible?
Lecture Slides PDF (753KB)
Homework
Solution: Login to Brightspace
17-Nov, 2025. Lecture 29 Probability Inequality
Lecture Slides PDF (438KB)
Homework
Solution: Login to Brightspace
19-Nov, 2025. Lecture 31 Generalization bound
Lecture Slides PDF (394KB)
Homework
Solution: Login to Brightspace
21-Nov, 2025. Lecture 30 Is learning always feasible?
Lecture Slides PDF (753KB)
Homework
Solution: Login to Brightspace , 2025. Lecture 32 Growth function
Lecture Slides PDF (472KB)
Homework
Solution: Login to Brightspace
24-Nov, 2025. Thanksgiving
26-Nov, 2025. Thanksgiving
28-Nov, 2025. Thanksgiving
1-Dec, 2025. Lecture 33 VC dimension
Lecture Slides PDF (520KB)
Homework
Solution: Login to Brightspace
3-Dec, 2025. Lecture 34 Bias and Variance
Lecture Slides PDF (441KB)
Homework
Solution: Login to Brightspace
5-Dec, 2025. Lecture 35 Overfitting
Lecture Slides PDF (621KB)
Homework
Solution: Login to Brightspace
8-Dec, 2025. Lecture 36 Regularization
Lecture Slides PDF (770KB)
Homework
Solution: Login to Brightspace
10-Dec, 2025. Lecture 37 Conclusion
Lecture Slides PDF (546KB)
12-Dec, 2025. Monthly Test 4
Tutorials
Tutorial 0 Python Basics (PDF)
Tutorial 1 Linear Algebra Review (PDF)
Tutorial 2 Probability Review (PDF)
Tutorial 3 Linear Regression Examples (PDF)
Tutorial 4 Optimization Review (PDF)
Tutorial 5 Python for Image Processing (URL)
Tutorial 6 Python for Matrices (URL)
Tutorial 7 Python for Plotting (URL)