research
∙
05/27/2023
Fine-Tuning Language Models with Just Forward Passes
Fine-tuning language models (LMs) has yielded success on diverse downstr...
share
research
∙
05/18/2023
Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models
We focus on the task of learning a single index model σ(w^⋆· x) with res...
research
∙
05/11/2023
Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
One of the central questions in the theory of deep learning is to unders...
research
∙
09/30/2022
Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability
Traditional analyses of gradient descent show that when the largest eige...
research
∙
08/28/2022
Metastable Mixing of Markov Chains: Efficiently Sampling Low Temperature Exponential Random Graphs
In this paper we consider the problem of sampling from the low-temperatu...
research
∙
07/04/2022
Causal Structure Discovery between Clusters of Nodes Induced by Latent Factors
We consider the problem of learning the structure of a causal directed a...
research
∙
06/08/2022
Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials
A recent goal in the theory of deep learning is to identify how neural n...
research
∙
10/19/2020
Do Deeper Convolutional Networks Perform Better?
Over-parameterization is a recent topic of much interest in the machine ...
research
∙
03/13/2020
