research
∙
07/08/2023
Toward Interactive Dictation
Voice dictation is an increasingly important text input modality. Existi...
share
research
∙
07/06/2023
Efficient Semiring-Weighted Earley Parsing
This paper provides a reference description, in the form of a deduction ...
research
∙
05/31/2023
Decision-Oriented Dialogue for Human-AI Collaboration
We describe a class of tasks called decision-oriented dialogues, in whic...
research
∙
05/20/2023
Autoregressive Modeling with Lookahead Attention
To predict the next token, autoregressive models ordinarily examine the ...
research
∙
01/17/2023
Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs
Weighted finite-state automata (WSFAs) are commonly used in NLP. Failure...
research
∙
12/20/2022
Privacy-Preserving Domain Adaptation of Semantic Parsers
Task-oriented dialogue systems often assist users with personal or confi...
research
∙
12/20/2022
A Measure-Theoretic Characterization of Tight Language Models
Language modeling, a central task in natural language processing, involv...
research
∙
10/27/2022
Contrastive Decoding: Open-ended Text Generation as Optimization
Likelihood, although useful as a training loss, is a poor search objecti...
research
∙
09/16/2022
The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained Decoding
In a real-world dialogue system, generated responses must satisfy severa...
research
∙
09/14/2022
On the Intersection of Context-Free and Regular Languages
The Bar-Hillel construction is a classic result in formal language theor...
research
∙
06/21/2022
BenchCLAMP: A Benchmark for Evaluating Language Models on Semantic Parsing
We introduce BenchCLAMP, a Benchmark to evaluate Constrained LAnguage Mo...
research
∙
05/25/2022
Active Programming by Example with a Natural Language Prior
We introduce APEL, a new framework that enables non-programmers to indir...
research
∙
05/24/2022
When More Data Hurts: A Troubling Quirk in Developing Broad-Coverage Natural Language Understanding Systems
In natural language understanding (NLU) production systems, users' evolv...
research
∙
12/31/2021
Transformer Embeddings of Irregularly Spaced Events and Their Participants
The neural Hawkes process (Mei Eisner, 2017) is a generative model o...
research
∙
09/14/2021
Searching for More Efficient Dynamic Programs
Computational models of human language often involve combinatorial probl...
research
∙
04/18/2021
Constrained Language Models Yield Few-Shot Semantic Parsers
We explore the use of large pretrained language models as few-shot seman...
research
∙
04/14/2021
Learning How to Ask: Querying LMs with Mixtures of Soft Prompts
Natural-language prompts have recently been used to coax pretrained lang...
research
∙
11/02/2020
Noise-Contrastive Estimation for Multivariate Point Processes
The log-likelihood of a generative model often involves both positive an...
research
∙
10/22/2020
Autoregressive Modeling is Misspecified for Some Sequence Distributions
Should sequences be modeled autoregressively—one symbol at a time? How m...
research
∙
10/20/2020
Evaluation of Logic Programs with Built-Ins and Aggregation: A Calculus for Bag Relations
We present a scheme for translating logic programs, which may use aggreg...
research
∙
09/24/2020
Task-Oriented Dialogue as Dataflow Synthesis
We describe an approach to task-oriented dialogue in which dialogue stat...
research
∙
06/30/2020
Neural Datalog Through Time: Informed Temporal Modeling via Logical Specification
Learning how to predict future events from patterns of past events is di...
research
∙
05/28/2020
A Corpus for Large-Scale Phonetic Typology
A major hurdle in data-driven research on typology is having sufficient ...
research
∙
10/01/2019
Specializing Word Embeddings (for Parsing) by Information Bottleneck
Pre-trained word embeddings like ELMo and BERT contain rich syntactic an...
research
∙
06/26/2019
A Generative Model for Punctuation in Dependency Trees
Treebanks traditionally treat punctuation marks as ordinary words, but l...
research
∙
06/11/2019
What Kind of Language Is Hard to Language-Model?
How language-agnostic are current state-of-the-art NLP tools? Are there ...
research
∙
05/14/2019
Imputing Missing Events in Continuous-Time Event Streams
Events in the world may be caused by other, unobserved events. We consid...
research
∙
05/04/2019
Contextualization of Morphological Inflection
Critical to natural language generation is the production of correctly i...
research
∙
10/25/2018
UniMorph 2.0: Universal Morphology
The Universal Morphology UniMorph project is a collaborative effort to i...
research
∙
10/16/2018
The CoNLL--SIGMORPHON 2018 Shared Task: Universal Morphological Reinflection
The CoNLL--SIGMORPHON 2018 shared task on supervised learning of morphol...
research
∙
07/08/2018
On the Complexity and Typology of Inflectional Morphological Systems
We quantify the linguistic complexity of different languages' morphologi...
research
∙
07/08/2018
A Deep Generative Model of Vowel Formant Typology
What makes some types of languages more probable than others? For instan...
research
∙
06/10/2018
Are All Languages Equally Hard to Language-Model?
For general modeling methods applied to diverse languages, a natural que...
research
∙
06/10/2018
Unsupervised Disambiguation of Syncretism in Inflected Lexicons
Lexical ambiguity makes it difficult to compute various useful statistic...
research
∙
04/28/2018
Neural Particle Smoothing for Sampling from Conditional Sequence Models
We introduce neural particle smoothing, a sequential Monte Carlo method ...
research
∙
04/23/2018
On the Diachronic Stability of Irregularity in Inflectional Morphology
Many languages' inflectional morphological systems are replete with irre...
research
∙
04/23/2018
Spell Once, Summon Anywhere: A Two-Level Open-Vocabulary Language Model
We show how to deploy recurrent neural networks within a hierarchical Ba...
research
∙
10/11/2017
Fine-Grained Prediction of Syntactic Typology: Discovering Latent Structure with Supervised Learning
We show how to predict the basic word-order facts of a novel language gi...
research
∙
10/10/2017
The Galactic Dependencies Treebanks: Getting More Data by Synthesizing New Languages
We release Galactic Dependencies 1.0---a large set of synthetic language...
research
∙
06/27/2017
CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection in 52 Languages
The CoNLL-SIGMORPHON 2017 shared task on supervised morphological genera...
research
∙
05/04/2017
Probabilistic Typology: Deep Generative Models of Vowel Inventories
Linguistic typology studies the range of structures present in human lan...
research
∙
12/29/2016
The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process
Many events occur in the world. Some event types are stochastically exci...
research
∙
08/10/2015
