ECE 50024: Lecture and Homework

(For Spring 2026 Lectures, please visit Brightspace)

• 25-Aug, 2025. Lecture 0. Course overview. Mathematics review.

  • Lecture Slides (TBD)

  • Homework

    • PDF (198KB)

    • Solution (257KB)

  • Additional resources

    • Tutorial Python Basics (PDF)

    • Tutorial Python for Image Processing (URL)

    • Tutorial Python for Matrices (URL)

    • Tutorial Python for Plotting (URL)

• 27-Aug, 2025. Lecture 1. Linear Regression Concept and Geometry

  • Lecture Slides PDF (574KB)

  • Homework

    • PDF (229 KB)

    • Solution (289KB)

  • Additional resources

    • Tutorial Linear Algebra Review (PDF)

    • See Chapter 7.1 of my book (URL)

    • Python demo for linear regression (URL)

• 29-Aug, 2025. Lecture 2. Underdetermined and Overdetermined Systems

  • Lecture Slides PDF (846KB)

  • Homework

    • PDF (380 KB)

    • Solution (396KB)

  • Additional resources

    • See Chapter 7.1 of my book (URL)

    • Tutorial Linear Regression Examples (PDF)

    • Python demo for linear regression with outliers (URL)

• 1-Sep, 2025. No Class. Labor Day

• 3-Sep, 2025. Lecture 3. L1 and L2 Regularization

  • Lecture Slides PDF (2.7MB)

  • Homework

    • PDF (259 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • See Chapter 7.4 of my book (URL)

    • Read the references in reading list page of the slides.

    • Python demo for Ridge and LASSO (URL)

• 5-Sep, 2025. Lecture 4. Kernel Methods

  • Lecture Slides PDF (1.1MB)

  • Homework PDF (200 KB)

    • Solution: Login to Brightspace

• 8-Sep, 2025. Lecture 5. Optimization basics; optimality; convexity

  • Lecture Slides PDF (1.8MB)

  • Homework

    • PDF (204 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • Tutorial 4 Optimization Review (PDF)

    • Read the references in reading list page of the slides.

    • Python demo for CVX (URL)

• 10-Sep, 2025. Lecture 6. Gadient descent

  • Lecture Slides PDF (939KB)

  • Homework

    • PDF (208 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • Read the references in reading list page of the slides.

    • Tutorial 4 Optimization Review (PDF)

    • Python demo for gradient descent (URL)

• 12-Sep, 2025. Lecture 7. Linear Discriminant Analysis

  • Lecture Slides PDF (663KB)

  • Homework

    • PDF (213 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • Read the references in reading list page of the slides

    • Python demo for linear separability (URL)

• 15-Sep, 2025. Lecture 8. Linearly Separable

  • Lecture Slides PDF (750KB)

  • Homework

    • PDF (120 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • Read the references in reading list page of the slides

    • Python demo for linear separability (URL)
      

• 17-Sep, 2025. Lecture 9 Bayesian Decision

  • Lecture Slides PDF (896KB)

  • Homework

    • PDF (234 KB)

    • Solution: Login to Brightspace

  • Additional resources

    • Tutorial 2 Probability Review (PDF)

• 19-Sep, 2025. Monthly Test 1

• 22-Sep, 2025. Lecture 10 Probability of Error

  • Lecture Slides PDF (710KB)

  • Homework

    • PDF (247 KB)

    • Solution: Login to Brightspace

• 24-Sep, 2025. Lecture 11 Model parameter estimation

  • Lecture Slides PDF (779KB)

  • Homework

    • PDF (215 KB)

    • Solution: Login to Brightspace

• 26-Sep, 2025. Lecture 12 Connecting Bayesian with regression

  • Lecture Slides PDF (676KB)

  • Homework

    • TBD

    • Solution: Login to Brightspace

• 29-Sep, 2025. Lecture 13 Why are classifier vulnerable to attacks?

  • Lecture Slides PDF (5.7MB)

  • Homework

    • PDF (167 KB)

    • Solution: Login to Brightspace

• 1-Oct, 2025. Lecture 14 Min-norm perturbuation

  • Lecture Slides PDF (487KB)

  • Homework

    • PDF (184 KB)

    • Solution: Login to Brightspace

• 3-Oct, 2025. Lecture 15 Max-loss and regularized perturbation

  • Lecture Slides PDF (1.5MB)

  • Homework

    • PDF (196 KB)

    • Solution: Login to Brightspace

• 6-Oct, 2025. Lecture 16 Improving robustness

  • Lecture Slides PDF (2.3MB)

  • Homework

    • PDF (334 KB)

    • Solution: Login to Brightspace

• 8-Oct, 2025. Lecture 17 Variational autoencoder

  • Lecture Slides PDF (1.8MB)

  • Homework

    • PDF (206 KB)

    • Solution: Login to Brightspace

• 10-Oct, 2025. Monthly Test 2

• 13-Oct, 2025. No Class. Fall Break

• 15-Oct, 2025. No Class. Fall Break

• 17-Oct, 2025. Lecture 18 Evidence lower bound

  • Lecture Slides PDF (485KB)

  • Homework

    • PDF (261 KB)

    • Solution: Login to Brightspace

• 20-Oct, 2025. Lecture 19 Parameterization Trick

  • Lecture Slides PDF (859KB)

  • Homework

    • PDF (233 KB)

    • Solution: Login to Brightspace

• 22-Oct, 2025. Lecture 20 DDPM building blocks

  • Lecture Slides PDF (2.3MB)

  • Homework

    • PDF (380 KB)

    • Solution: Login to Brightspace

• 24-Oct, 2025. Lecture 21 DDPM evidence lower bound

  • Lecture Slides PDF (560KB)

  • Homework

    • PDF (394 KB)

    • Solution: Login to Brightspace

• 27-Oct, 2025. Lecture 22 DDPM: Denoising?

  • Lecture Slides PDF (591KB)

  • Homework

    • PDF (258 KB)

    • Solution: Login to Brightspace

• 29-Oct, 2025. Lecture 23 Training and Inference of DDPM

  • Lecture Slides PDF (1.7MB)

  • Homework

    • PDF (224 KB)

    • Solution: Login to Brightspace

• 31-Oct, 2025. Lecture 24 Score matching and Langevin Sampling

  • Lecture Slides PDF (1.7MB)

  • Homework

    • PDF (303 KB)

    • Solution: Login to Brightspace

• 3-Nov, 2025. Lecture 25 Score Matching Techniques

  • Lecture Slides PDF (573KB)

  • Homework

    • PDF (214 KB)

    • Solution: Login to Brightspace

• 5-Nov, 2025. Lecture 26 Stochastic Differential Equation

  • Lecture Slides PDF (1.8MB)

  • Homework

    • PDF (196 KB)

    • Solution: Login to Brightspace

• 7-Nov, 2025. Monthly Test 3

• 10-Nov, 2025. Lecture 27 Brownian Motion

  • Lecture Slides PDF (527KB)

  • Homework

    • PDF (203 KB)

    • Solution: Login to Brightspace

• 12-Nov, 2025. Lecture 28 Fokker-Planck Equation

  • Lecture Slides PDF (394KB)

  • Homework

    • PDF (177 KB)

    • Solution: Login to Brightspace

• 14-Nov, 2025. Lecture 30 Is learning always feasible?

  • Lecture Slides PDF (753KB)

  • Homework

    • PDF (209 KB)

    • Solution: Login to Brightspace

• 17-Nov, 2025. Lecture 29 Probability Inequality

  • Lecture Slides PDF (438KB)

  • Homework

    • PDF (190 KB)

    • Solution: Login to Brightspace

• 19-Nov, 2025. Lecture 31 Generalization bound

  • Lecture Slides PDF (394KB)

  • Homework

    • PDF (194 KB)

    • Solution: Login to Brightspace

• 21-Nov, 2025. Lecture 30 Is learning always feasible?

  • Lecture Slides PDF (753KB)

  • Homework

    • PDF (209 KB)

    • Solution: Login to Brightspace , 2025. Lecture 32 Growth function

  • Lecture Slides PDF (472KB)

  • Homework

    • PDF (170 KB)

    • Solution: Login to Brightspace

• 24-Nov, 2025. Thanksgiving

• 26-Nov, 2025. Thanksgiving

• 28-Nov, 2025. Thanksgiving

• 1-Dec, 2025. Lecture 33 VC dimension

  • Lecture Slides PDF (520KB)

  • Homework

    • PDF (186 KB)

    • Solution: Login to Brightspace

• 3-Dec, 2025. Lecture 34 Bias and Variance

  • Lecture Slides PDF (441KB)

  • Homework

    • PDF (228 KB)

    • Solution: Login to Brightspace

• 5-Dec, 2025. Lecture 35 Overfitting

  • Lecture Slides PDF (621KB)

  • Homework

    • PDF (164 KB)

    • Solution: Login to Brightspace

• 8-Dec, 2025. Lecture 36 Regularization

  • Lecture Slides PDF (770KB)

  • Homework

    • PDF (256 KB)

    • Solution: Login to Brightspace

• 10-Dec, 2025. Lecture 37 Conclusion

  • Lecture Slides PDF (546KB)

• 12-Dec, 2025. Monthly Test 4

Tutorials

• Tutorial 0 Python Basics (PDF)

• Tutorial 1 Linear Algebra Review (PDF)

• Tutorial 2 Probability Review (PDF)

• Tutorial 3 Linear Regression Examples (PDF)

• Tutorial 4 Optimization Review (PDF)

• Tutorial 5 Python for Image Processing (URL)

• Tutorial 6 Python for Matrices (URL)

• Tutorial 7 Python for Plotting (URL)