Statistical Learning II

Welcome to the course page for Statistical Learning II. Here you’ll find all the course information and materials.

Course Information

  • Instructors:
    • Dr. Bruno Loureiro (main instructor)
    • Leonardo Defilippis (TA)
  • Email: bruno.loureiro@di.ens.fr
  • Semester: Fall 2025
  • Class Times: Wednesdays, 08:30 AM - 11:45 AM
  • Location: Check at the Dauphine ENT.

Course Description

This course is a continuation of the “Statistical Learning I” course taught at the 2nd year (L2) of the Double Licence Intelligence Artificielle et Sciences des Organisations (IASO) undergraduate from Université Paris-Dauphine.

Our goal is to build a basic understanding of the mathematics behind some of the classical machine learning algorithms, such as:

  • Least squares regression
  • Ridge regression
  • LASSO
  • PCA
  • Kernel methods

The material in this course takes inspiration from the following excellent ressources:

Course Schedule

Date Lecture Topic Materials
Sept 10 - Recap of maths Slides
Sept 17 - Introduction
- Supervised Learning
Slides
Sept 24 Supervised Learning (continued) Slides
Oct 01 Least squares Slides
Oct 08 Least squares (continued) Slides
Oct 15 Fixed design analysis of OLS Slides
Oct 22 Reading week  
Oct 29 Mid-term exam  
Nov 05 Bias-variance decomposition Slides
Nov 12 - Bias-variance decomposition (continued)
- Ridge regression
Slides lecture 8
Slides lecture 9
Nov 19 Best subset selection Slides
Nov 26 No class (3h TD)  
Dec 03 - LASSO
- Feature maps
Slides
Dec 09 - Kernel ridge regression Slides