research
∙
05/18/2023
LIMA: Less Is More for Alignment
Large language models are trained in two stages: (1) unsupervised pretra...
share
research
∙
01/05/2023
CiT: Curation in Training for Effective Vision-Language Data
Large vision-language models are generally applicable to many downstream...
research
∙
12/16/2022
ALERT: Adapting Language Models to Reasoning Tasks
Current large language models can perform reasonably well on complex tas...
research
∙
12/15/2022
MAViL: Masked Audio-Video Learners
We present Masked Audio-Video Learners (MAViL) to train audio-visual rep...
research
∙
01/19/2022
CM3: A Causal Masked Multimodal Model of the Internet
We introduce CM3, a family of causally masked generative models trained ...
research
∙
09/28/2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
We present VideoCLIP, a contrastive approach to pre-train a unified mode...
research
∙
07/14/2021
HTLM: Hyper-Text Pre-Training and Prompting of Language Models
We introduce HTLM, a hyper-text language model trained on a large-scale ...
research
∙
05/20/2021
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding
We present a simplified, task-agnostic multi-modal pre-training approach...
research
∙
01/01/2021
Multi-task Retrieval for Knowledge-Intensive Tasks
Retrieving relevant contexts from a large corpus is a crucial step for t...
research
∙
06/26/2020
Pre-training via Paraphrasing
We introduce MARGE, a pre-trained sequence-to-sequence model learned wit...
research
∙
04/12/2018
