BEGIN:VCALENDAR VERSION:2.0 METHOD:PUBLISH BEGIN:VEVENT UID:20261015T114744-1696920693-northwestern.edu DTSTAMP:20261015T114744 DTSTART:20260929T110000 DTEND:20260929T120000 SUMMARY:IEMS Seminar | A Theory of Feature Learning in Kernel Models | Feng Ruan LOCATION:A230, Technological Institute DESCRIPTION:Abstract: A central phenomenon in modern machine learning is feature learning: rather than operating on a fixed representation of the data, successful models learn representations adapted to the prediction task. We study a tractable model of this phenomenon through a compositional variant of kernel ridge regression, where the kernel is applied after a learnable linear transformation. When the response depends on the input only through a low-dimensional predictive subspace, we show that optimizing the population objective automatically eliminates directions orthogonal to this subspace and, in certain regimes, exactly recovers it. Surprisingly, the same exact low-dimensional structure persists at finite sample sizes with high probability, even without explicitly penalizing the linear transformation to be low-dimensional.\n\n\nBio: Feng Ruan is currently an assistant professor in Department of Statistics and Data Science at Northwestern University. His research focuses on the foundations of feature learning and stochastic and nonsmooth optimization, and is supported by an NSF CAREER Award.\n\nPiP URL: https://planitpurple.northwestern.edu/event/645107 END:VEVENT END:VCALENDAR ORGANIZER:Department of Industrial Engineering and Management Sciences (IEMS)