research
∙
09/01/2023
Geometry-Informed Neural Operator for Large-Scale 3D PDEs
We propose the geometry-informed neural operator (GINO), a highly effici...
share
research
∙
08/17/2023
Tipping Point Forecasting in Non-Stationary Dynamics on Function Spaces
Tipping points are abrupt, drastic, and often irreversible changes in th...
research
∙
08/04/2023
FB-BEV: BEV Representation from Forward-Backward View Transformations
View Transformation Module (VTM), where transformations happen between m...
research
∙
07/27/2023
Speeding up Fourier Neural Operators via Mixed Precision
The Fourier neural operator (FNO) is a powerful technique for learning s...
research
∙
07/27/2023
Incrementally-Computable Neural Networks: Efficient Inference for Dynamic Inputs
Deep learning often faces the challenge of efficiently processing dynami...
research
∙
06/27/2023
LeanDojo: Theorem Proving with Retrieval-Augmented Language Models
Large language models (LLMs) have shown promise in proving formal theore...
research
∙
06/20/2023
InRank: Incremental Low-Rank Learning
The theory of greedy low-rank learning (GLRL) aims to explain the impres...
research
∙
06/15/2023
Fast Training of Diffusion Models with Masked Transformers
We propose an efficient approach to train large diffusion models with ma...
research
∙
06/14/2023
ClimSim: An open large-scale dataset for training high-resolution physics emulators in hybrid multi-scale climate simulators
Modern climate projections lack adequate spatial and temporal resolution...
research
∙
06/06/2023
Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere
Fourier Neural Operators (FNOs) have proven to be an efficient and effec...
research
∙
05/29/2023
Provable and Practical: Efficient Exploration in Reinforcement Learning via Langevin Monte Carlo
We present a scalable and effective exploration strategy based on Thomps...
research
∙
05/25/2023
Voyager: An Open-Ended Embodied Agent with Large Language Models
We introduce Voyager, the first LLM-powered embodied lifelong learning a...
research
∙
05/22/2023
Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids
Indoor scene reconstruction from monocular images has long been sought a...
research
∙
04/13/2023
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
Large decoder-only language models (LMs) can be largely improved in term...
research
∙
03/04/2023
Prismer: A Vision-Language Model with An Ensemble of Experts
Recent vision-language models have shown impressive multi-modal generati...
research
∙
02/23/2023
VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completion
Humans can easily imagine the complete 3D geometry of occluded objects a...
research
∙
02/14/2023
Score-based Diffusion Models in Function Space
Diffusion models have recently emerged as a powerful framework for gener...
research
∙
02/14/2023
AutoBiasTest: Controllable Sentence Generation for Automated and Open-Ended Social Bias Testing in Language Models
Social bias in Pretrained Language Models (PLMs) affects text generation...
research
∙
02/13/2023
PerAda: Parameter-Efficient and Generalizable Federated Learning Personalization with Guarantees
Personalized Federated Learning (pFL) has emerged as a promising solutio...
research
∙
02/12/2023
I^2SB: Image-to-Image Schrödinger Bridge
We propose Image-to-Image Schrödinger Bridge (I^2SB), a new class of con...
research
∙
02/09/2023
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
Augmenting pretrained language models (LMs) with a vision encoder (e.g.,...
research
∙
01/19/2023
Forecasting subcritical cylinder wakes with Fourier Neural Operators
We apply Fourier neural operators (FNOs), a state-of-the-art operator le...
research
∙
01/10/2023
Vision Transformers Are Good Mask Auto-Labelers
We propose Mask Auto-Labeler (MAL), a high-quality Transformer-based mas...
research
∙
12/21/2022
Towards Neural Variational Monte Carlo That Scales Linearly with System Size
Quantum many-body problems are some of the most challenging problems in ...
research
∙
11/30/2022
HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression
Transformers have attained superior performance in natural language proc...
research
∙
11/29/2022
Fourier Continuation for Exact Derivative Computation in Physics-Informed Neural Operators
The physics-informed neural operator (PINO) is a machine learning archit...
research
∙
11/28/2022
Incremental Fourier Neural Operator
Recently, neural networks have proven their impressive ability to solve ...
research
∙
11/28/2022
Machine Learning Accelerated PDE Backstepping Observers
State estimation is important for a variety of tasks, from forecasting t...
research
∙
11/24/2022
Fast Sampling of Diffusion Models via Operator Learning
Diffusion models have found widespread adoption in various areas. Howeve...
research
∙
11/21/2022
Can You Label Less by Using Out-of-Domain Data? Active Transfer Learning with Few-shot Instructions
Labeling social-media data for custom dimensions of toxicity and social ...
research
∙
11/01/2022
DensePure: Understanding Diffusion Models towards Adversarial Robustness
Diffusion models have been recently employed to improve certified robust...
research
∙
10/31/2022
Accelerating Carbon Capture and Storage Modeling using Fourier Neural Operators
Carbon capture and storage (CCS) is an important strategy for reducing c...
research
∙
10/27/2022
An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design
Lithography modeling is a crucial problem in chip design to ensure a chi...
research
∙
10/23/2022
1st Place Solution of The Robust Vision Challenge (RVC) 2022 Semantic Segmentation Track
This report describes the winning solution to the semantic segmentation ...
research
∙
10/12/2022
Context Generation Improves Open Domain Question Answering
Closed-book question answering (QA) requires a model to directly answer ...
research
∙
09/30/2022
Dynamic-Backbone Protein-Ligand Structure Prediction with Multiscale Generative Diffusion Models
Molecular complexes formed by proteins and small-molecule ligands are ub...
research
∙
09/19/2022
AdvDO: Realistic Adversarial Attacks for Trajectory Prediction
Trajectory prediction is essential for autonomous vehicles (AVs) to plan...
research
∙
09/15/2022
Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
Pre-trained vision-language models (e.g., CLIP) have shown promising zer...
research
∙
08/23/2022
Retrieval-based Controllable Molecule Generation
Generating new molecules with specified chemical and biological properti...
research
∙
08/03/2022
MinVIS: A Minimal Video Instance Segmentation Framework without Video-based Training
We propose MinVIS, a minimal video instance segmentation (VIS) framework...
research
∙
07/29/2022
Robust Trajectory Prediction against Adversarial Attacks
Trajectory prediction using deep neural networks (DNNs) is an essential ...
research
∙
07/11/2022
Fourier Neural Operator with Learned Deformations for PDEs on General Geometries
Deep learning surrogate models have shown promise in solving partial dif...
research
∙
07/08/2022
Large Scale Mask Optimization Via Convolutional Fourier Neural Operator and Litho-Guided Self Training
Machine learning techniques have been extensively studied for mask optim...
research
∙
06/22/2022
Langevin Monte Carlo for Contextual Bandits
We study the efficiency of Thompson sampling for contextual bandits. Exi...
research
∙
06/17/2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Autonomous agents have made great strides in specialist domains like Ata...
research
∙
06/17/2022
Thompson Sampling Achieves Õ(√(T)) Regret in Linear Quadratic Control
Thompson Sampling (TS) is an efficient method for decision-making under ...
research
∙
06/07/2022
Finite-Time Regret of Thompson Sampling Algorithms for Exponential Family Multi-Armed Bandits
We study the regret of Thompson sampling (TS) algorithms for exponential...
research
∙
06/03/2022
KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systems
Learning a dynamical system requires stabilizing the unknown dynamics to...
research
∙
05/27/2022
Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
A significant gap remains between today's visual pattern recognition mod...
research
∙
05/16/2022
