Statistical Learning II
Welcome to the course page for Statistical Learning II. Here you’ll find all the course information and materials.
Course Information
- Instructors:
- Dr. Bruno Loureiro (main instructor)
- Leonardo Defilippis (TA)
- Email: bruno.loureiro@di.ens.fr
- Semester: Fall 2025
- Class Times: Wednesdays, 08:30 AM - 11:45 AM
- Location: Check at the Dauphine ENT.
Course Description
This course is a continuation of the “Statistical Learning I” course taught at the 2nd year (L2) of the Double Licence Intelligence Artificielle et Sciences des Organisations (IASO) undergraduate from Université Paris-Dauphine.
Our goal is to build a basic understanding of the mathematics behind some of the classical machine learning algorithms, such as:
- Least squares regression
- Ridge regression
- LASSO
- PCA
- Kernel methods
Recommended literature
The material in this course takes inspiration from the following excellent ressources:
- Bach, Francis. Learning theory from first principles. MIT press, 2024.
- Hastie, Trevor, et al. The elements of statistical learning: data mining, inference, and prediction. Vol. 2. New York: springer, 2009.
- Murphy, Kevin P. Machine learning: a probabilistic perspective. MIT press, 2012.
- Wasserman, Larry. All of statistics: a concise course in statistical inference. Springer Science & Business Media, 2013.
Course Schedule
| Date | Lecture Topic | Materials |
|---|---|---|
| Sept 10 | - Recap of maths | Slides |
| Sept 17 | - Introduction - Supervised Learning | Slides |
| Sept 24 | Supervised Learning (continued) | Slides |
| Oct 01 | Least squares | Slides |
| Oct 08 | Least squares (continued) | Slides |
| Oct 15 | Fixed design analysis of OLS | Slides |
| Oct 22 | Reading week | |
| Oct 29 | Mid-term exam | |
| Nov 05 | Bias-variance decomposition | Slides |
| Nov 12 | - Bias-variance decomposition (continued) - Ridge regression | Slides lecture 8 Slides lecture 9 |
| Nov 19 | Best subset selection | Slides |
| Nov 26 | No class (3h TD) | |
| Dec 03 | - LASSO - Feature maps | Slides |
| Dec 09 | - Kernel ridge regression | Slides |