Bruno Loureiro
  • about
  • bio
  • publications
  • group
  • jobs
  • teaching

Arxiv_dimfree_2023

February 02, 2023

2023

Our new paper titled From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks is now out! In this work, we derive different limits for the one-pass SGD dynamics of two-layer neural networks, including: a) the classical gradient flow limit; b) the high-dimensional limit studied by Savid Saad & Sara Solla in the 90s; c) and the more recent infinite width mean-field limit. Check it out!




    Enjoy Reading This Article?

    Here are some more articles you might like to read next:

  • a distill-style blog post
  • a post with images
  • displaying beautiful tables with Bootstrap Tables
  • a post with jupyter notebook
  • a post with videos
  • © Copyright 2025 Bruno Loureiro. Powered by Jekyll with al-folio theme. Hosted by GitHub Pages. Photos from Unsplash.