research
∙
06/10/2020
When is Particle Filtering Efficient for POMDP Sequential Planning?
Particle filtering is a popular method for inferring latent states in st...
share
research
∙
02/21/2020
Few-Shot Learning via Learning the Representation, Provably
This paper studies few-shot learning via representation learning, where ...
research
∙
01/16/2020
Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks
The selection of initial parameter values for gradient-based optimizatio...
research
∙
11/03/2019
Enhanced Convolutional Neural Tangent Kernels
Recent research shows that for training with â„“_2 loss, convolutional neu...
research
∙
06/14/2019
Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets
Mode connectivity is a surprising phenomenon in the loss landscape of de...
research
∙
05/31/2019
Implicit Regularization in Deep Matrix Factorization
Efforts to understand the generalization mystery in deep learning have l...
research
∙
05/27/2019
Understanding Generalization of Deep Neural Networks Trained with Noisy Labels
Over-parameterized deep neural networks trained by simple first-order me...
research
∙
04/26/2019
On Exact Computation with an Infinitely Wide Neural Net
How well does a classic deep net architecture like AlexNet or VGG19 clas...
research
∙
01/24/2019
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks
Recent works have cast some light on the mystery of why deep nets fit an...
research
∙
01/24/2019
Width Provably Matters in Optimization for Deep Linear Neural Networks
We prove that for an L-layer fully-connected linear neural network, if t...
research
∙
10/04/2018
A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks
We analyze speed of convergence to global optimum for gradient descent t...
research
∙
06/04/2018
Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced
We study the implicit regularization imposed by gradient descent for lea...
research
∙
04/20/2018
Online Improper Learning with an Approximation Oracle
We revisit the question of reducing online learning to approximate optim...
research
∙
03/05/2018
An Analysis of the t-SNE Algorithm for Data Visualization
A first line of attack in exploratory data analysis is data visualizatio...
research
∙
02/05/2018
Linear Convergence of the Primal-Dual Gradient Method for Convex-Concave Saddle Point Problems without Strong Convexity
We consider the convex-concave saddle point problem _x_y f(x)+y^ A x-g(y...
research
∙
08/07/2017
Linear Convergence of a Frank-Wolfe Type Algorithm over Trace-Norm Balls
We propose a rank-k variant of the classical Frank-Wolfe algorithm to so...
research
∙
10/20/2016
