ECE 50024: Lecture and Homework

Professor Stanley H. Chan
Fall 2025

25-Aug, 2025. Lecture 0. Course overview. Mathematics review.
- Lecture Slides (TBD)
- Homework
  - PDF (198KB)
  - Solution (257KB)
- Additional resources
  - Tutorial Python Basics (PDF)
  - Tutorial Python for Image Processing (URL)
  - Tutorial Python for Matrices (URL)
  - Tutorial Python for Plotting (URL)

27-Aug, 2025. Lecture 1. Linear Regression Concept and Geometry
- Lecture Slides PDF (574KB)
- Homework
  - PDF (229 KB)
  - Solution (289KB)
- Additional resources
  - Tutorial Linear Algebra Review (PDF)
  - See Chapter 7.1 of my book (URL)
  - Python demo for linear regression (URL)

29-Aug, 2025. Lecture 2. Underdetermined and Overdetermined Systems
- Lecture Slides PDF (846KB)
- Homework
  - PDF (380 KB)
  - Solution (396KB)
- Additional resources
  - See Chapter 7.1 of my book (URL)
  - Tutorial Linear Regression Examples (PDF)
  - Python demo for linear regression with outliers (URL)

1-Sep, 2025. No Class. Labor Day

3-Sep, 2025. Lecture 3. L1 and L2 Regularization
- Lecture Slides PDF (2.7MB)
- Homework
  - PDF (259 KB)
  - Solution: Login to Brightspace
- Additional resources
  - See Chapter 7.4 of my book (URL)
  - Read the references in reading list page of the slides.
  - Python demo for Ridge and LASSO (URL)

5-Sep, 2025. Lecture 4. Kernel Methods
- Lecture Slides PDF (1.1MB)
- Homework PDF (200 KB)
  - Solution: Login to Brightspace

8-Sep, 2025. Lecture 5. Optimization basics; optimality; convexity
- Lecture Slides PDF (1.8MB)
- Homework
  - PDF (204 KB)
  - Solution: Login to Brightspace
- Additional resources
  - Tutorial 4 Optimization Review (PDF)
  - Read the references in reading list page of the slides.
  - Python demo for CVX (URL)

10-Sep, 2025. Lecture 6. Gadient descent
- Lecture Slides PDF (939KB)
- Homework
  - PDF (208 KB)
  - Solution: Login to Brightspace
- Additional resources
  - Read the references in reading list page of the slides.
  - Tutorial 4 Optimization Review (PDF)
  - Python demo for gradient descent (URL)

12-Sep, 2025. Lecture 7. Linear Discriminant Analysis
- Lecture Slides PDF (663KB)
- Homework
  - PDF (213 KB)
  - Solution: Login to Brightspace
- Additional resources
  - Read the references in reading list page of the slides
  - Python demo for linear separability (URL)

15-Sep, 2025. Lecture 8. Linearly Separable
- Lecture Slides PDF (750KB)
- Homework
  - PDF (120 KB)
  - Solution: Login to Brightspace
- Additional resources
  - Read the references in reading list page of the slides
  - Python demo for linear separability (URL)

17-Sep, 2025. Lecture 9 Bayesian Decision
- Lecture Slides PDF (896KB)
- Homework
  - PDF (234 KB)
  - Solution: Login to Brightspace
- Additional resources
  - Tutorial 2 Probability Review (PDF)

19-Sep, 2025. Monthly Test 1

22-Sep, 2025. Lecture 10 Probability of Error
- Lecture Slides PDF (710KB)
- Homework
  - PDF (247 KB)
  - Solution: Login to Brightspace

24-Sep, 2025. Lecture 11 Model parameter estimation
- Lecture Slides PDF (779KB)
- Homework
  - PDF (215 KB)
  - Solution: Login to Brightspace

26-Sep, 2025. Lecture 12 Connecting Bayesian with regression
- Lecture Slides PDF (676KB)
- Homework
  - TBD
  - Solution: Login to Brightspace

29-Sep, 2025. Lecture 13 Why are classifier vulnerable to attacks?
- Lecture Slides PDF (5.7MB)
- Homework
  - PDF (167 KB)
  - Solution: Login to Brightspace

1-Oct, 2025. Lecture 14 Min-norm perturbuation
- Lecture Slides PDF (487KB)
- Homework
  - PDF (184 KB)
  - Solution: Login to Brightspace

3-Oct, 2025. Lecture 15 Max-loss and regularized perturbation
- Lecture Slides PDF (1.5MB)
- Homework
  - PDF (196 KB)
  - Solution: Login to Brightspace

6-Oct, 2025. Lecture 16 Improving robustness
- Lecture Slides PDF (2.3MB)
- Homework
  - PDF (334 KB)
  - Solution: Login to Brightspace

8-Oct, 2025. Lecture 17 Variational autoencoder
- Lecture Slides PDF (1.8MB)
- Homework
  - PDF (206 KB)
  - Solution: Login to Brightspace

10-Oct, 2025. Monthly Test 2

13-Oct, 2025. No Class. Fall Break

15-Oct, 2025. No Class. Fall Break

17-Oct, 2025. Lecture 18 Evidence lower bound
- Lecture Slides PDF (485KB)
- Homework
  - PDF (261 KB)
  - Solution: Login to Brightspace

20-Oct, 2025. Lecture 19 Parameterization Trick
- Lecture Slides PDF (859KB)
- Homework
  - PDF (233 KB)
  - Solution: Login to Brightspace

22-Oct, 2025. Lecture 20 DDPM building blocks
- Lecture Slides PDF (2.3MB)
- Homework
  - PDF (380 KB)
  - Solution: Login to Brightspace

24-Oct, 2025. Lecture 21 DDPM evidence lower bound
- Lecture Slides PDF (560KB)
- Homework
  - PDF (394 KB)
  - Solution: Login to Brightspace

27-Oct, 2025. Lecture 22 DDPM: Denoising?
- Lecture Slides PDF (591KB)
- Homework
  - PDF (258 KB)
  - Solution: Login to Brightspace

29-Oct, 2025. Lecture 23 Training and Inference of DDPM
- Lecture Slides PDF (1.7MB)
- Homework
  - PDF (224 KB)
  - Solution: Login to Brightspace

31-Oct, 2025. Lecture 24 Score matching and Langevin Sampling
- Lecture Slides PDF (1.7MB)
- Homework
  - PDF (303 KB)
  - Solution: Login to Brightspace

3-Nov, 2025. Lecture 25 Score Matching Techniques
- Lecture Slides PDF (573KB)
- Homework
  - PDF (214 KB)
  - Solution: Login to Brightspace

5-Nov, 2025. Lecture 26 Stochastic Differential Equation
- Lecture Slides PDF (1.8MB)
- Homework
  - PDF (196 KB)
  - Solution: Login to Brightspace

7-Nov, 2025. Monthly Test 3

10-Nov, 2025. Lecture 27 Brownian Motion
- Lecture Slides PDF (527KB)
- Homework
  - PDF (203 KB)
  - Solution: Login to Brightspace

12-Nov, 2025. Lecture 28 Fokker-Planck Equation
- Lecture Slides PDF (394KB)
- Homework
  - PDF (177 KB)
  - Solution: Login to Brightspace

14-Nov, 2025. Lecture 30 Is learning always feasible?
- Lecture Slides PDF (753KB)
- Homework
  - PDF (209 KB)
  - Solution: Login to Brightspace

17-Nov, 2025. Lecture 29 Probability Inequality
- Lecture Slides PDF (438KB)
- Homework
  - PDF (190 KB)
  - Solution: Login to Brightspace

19-Nov, 2025. Lecture 31 Generalization bound
- Lecture Slides PDF (394KB)
- Homework
  - PDF (194 KB)
  - Solution: Login to Brightspace

21-Nov, 2025. Lecture 30 Is learning always feasible?
- Lecture Slides PDF (753KB)
- Homework
  - PDF (209 KB)
  - Solution: Login to Brightspace , 2025. Lecture 32 Growth function
- Lecture Slides PDF (472KB)
- Homework
  - PDF (170 KB)
  - Solution: Login to Brightspace

24-Nov, 2025. Thanksgiving

26-Nov, 2025. Thanksgiving

28-Nov, 2025. Thanksgiving

1-Dec, 2025. Lecture 33 VC dimension
- Lecture Slides PDF (520KB)
- Homework
  - PDF (186 KB)
  - Solution: Login to Brightspace

3-Dec, 2025. Lecture 34 Bias and Variance
- Lecture Slides PDF (441KB)
- Homework
  - PDF (228 KB)
  - Solution: Login to Brightspace

5-Dec, 2025. Lecture 35 Overfitting
- Lecture Slides PDF (621KB)
- Homework
  - PDF (164 KB)
  - Solution: Login to Brightspace

8-Dec, 2025. Lecture 36 Regularization
- Lecture Slides PDF (770KB)
- Homework
  - PDF (256 KB)
  - Solution: Login to Brightspace

10-Dec, 2025. Lecture 37 Conclusion
- Lecture Slides PDF (546KB)

12-Dec, 2025. Monthly Test 4

Tutorials

Tutorial 0 Python Basics (PDF)
Tutorial 1 Linear Algebra Review (PDF)
Tutorial 2 Probability Review (PDF)
Tutorial 3 Linear Regression Examples (PDF)
Tutorial 4 Optimization Review (PDF)
Tutorial 5 Python for Image Processing (URL)
Tutorial 6 Python for Matrices (URL)
Tutorial 7 Python for Plotting (URL)