research
∙
04/04/2023
Cross-Domain Image Captioning with Discriminative Finetuning
Neural captioners are typically trained to mimic human-generated referen...
share
research
∙
02/20/2023
Can discrete information extraction prompts generalize across language models?
We study whether automatically-induced prompts that effectively extract ...
research
∙
10/20/2022
Communication breakdown: On the low mutual intelligibility between human and neural captioning
We compare the 0-shot performance of a neural caption-based image retrie...
research
∙
10/06/2021
How BPE Affects Memorization in Transformers
Training data memorization in NLP can both be beneficial (e.g., closed-b...
research
∙
06/16/2021
On the proper role of linguistically-oriented deep net analysis in linguistic theorizing
A lively research field has recently emerged that uses experimental meth...
research
∙
06/08/2021
Interpretable agent communication from scratch (with a generic visual processor emerging on the side)
As deep networks begin to be deployed as autonomous agents, the issue of...
research
∙
06/19/2020
Exploring Processing of Nested Dependencies in Neural-Network Language Models and Humans
Recursive processing in sentence comprehension is considered a hallmark ...
research
∙
06/03/2020
Emergent Multi-Agent Communication in the Deep Learning Era
The ability to cooperate through language is a defining feature of human...
research
∙
04/22/2020
Syntactic Structure from Deep Learning
Modern deep neural networks achieve impressive performance in engineerin...
research
∙
04/20/2020
Compositionality and Generalization in Emergent Languages
Natural language allows us to refer to novel composite concepts by combi...
research
∙
04/07/2020
Emergent Language Generalization and Acquisition Speed are not tied to Compositionality
Studies of discrete languages emerging when neural agents communicate to...
research
∙
03/17/2020
Rat big, cat eaten! Ideas for a useful deep-agent protolanguage
Deep-agent communities developing their own language-like communication ...
research
∙
03/11/2020
A Benchmark for Systematic Generalization in Grounded Language Understanding
Human language users easily interpret expressions that describe unfamili...
research
∙
11/05/2019
Focus on What's Informative and Ignore What's not: Communication Strategies in a Referential Game
Research in multi-agent cooperation has shown that artificial agents are...
research
∙
07/01/2019
EGG: a toolkit for research on Emergence of lanGuage in Games
There is renewed interest in simulating language emergence among deep ne...
research
∙
06/17/2019
Tabula nearly rasa: Probing the Linguistic Knowledge of Character-Level Neural Language Models Trained on Unsegmented Text
Recurrent neural networks (RNNs) have reached striking performance in ma...
research
∙
05/31/2019
Information Minimization In Emergent Languages
There is a growing interest in studying the languages emerging when neur...
research
∙
05/29/2019
Anti-efficient encoding in emergent communication
Despite renewed interest in emergent language simulations with neural ne...
research
∙
05/29/2019
Word-order biases in deep-agent emergent communication
Sequence-processing neural networks led to remarkable progress on many N...
research
∙
05/28/2019
Miss Tools and Mr Fruit: Emergent communication in agents learning about object affordances
Recent research studies communication emergence in communities of deep n...
research
∙
05/21/2019
CNNs found to jump around more skillfully than RNNs: Compositional generalization in seq2seq convolutional networks
Lake and Baroni (2018) introduced the SCAN dataset probing the ability o...
research
∙
03/30/2019
Linguistic generalization and compositionality in modern artificial neural networks
In the last decade, deep artificial neural networks have achieved astoun...
research
∙
03/18/2019
The emergence of number and syntax units in LSTM language models
Recent work has shown that LSTMs trained on a generic language modeling ...
research
∙
01/14/2019
Human few-shot learning of compositional instructions
People learn in fast and flexible ways that have not been emulated by ma...
research
∙
09/12/2018
Jump to better conclusions: SCAN both left and right
Lake and Baroni (2018) recently introduced the SCAN data set, which cons...
research
∙
08/31/2018
How agents see things: On visual representations in an emergent language game
There is growing interest in the language developed by agents interactin...
research
∙
07/19/2018
Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networks
Systematic compositionality is the ability to recombine meaningful units...
research
∙
05/03/2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Although much effort has recently been devoted to training high-quality ...
research
∙
03/29/2018
Colorless green recurrent networks dream hierarchically
Recurrent neural networks (RNNs) have achieved impressive results in a v...
research
∙
02/18/2018
Memorize or generalize? Searching for a compositional RNN in a haystack
Neural networks are very powerful learning systems, but they do not read...
research
∙
10/31/2017
Still not systematic after all these years: On the compositional skills of sequence-to-sequence recurrent networks
Humans can understand and produce new utterances effortlessly, thanks to...
research
∙
07/20/2017
High-risk learning: acquiring new word vectors from tiny data
Distributional semantics models are known to struggle with small data. I...
research
∙
02/23/2017
Causal Discovery Using Proxy Variables
Discovering causal relations is fundamental to reasoning and intelligenc...
research
∙
02/06/2017
Living a discrete life in a continuous world: Reference with distributed representations
Reference is a crucial property of language that allows us to connect li...
research
∙
01/31/2017
CommAI: Evaluating the first steps towards a useful general AI
With machine learning successfully applied to new daunting problems almo...
research
∙
12/21/2016
Multi-Agent Cooperation and the Emergence of (Natural) Language
The current mainstream approach to train natural language systems is to ...
research
∙
06/28/2016
"Show me the cup": Reference with Continuous Representations
One of the most basic functions of language is to refer to objects in a ...
research
∙
06/20/2016
The LAMBADA dataset: Word prediction requiring a broad discourse context
We introduce LAMBADA, a dataset to evaluate the capabilities of computat...
research
∙
05/23/2016
Towards Multi-Agent Communication-Based Language Learning
We propose an interactive multimodal framework for language learning. In...
research
∙
03/08/2016
The red one!: On learning to refer to things based on their discriminative properties
As a first step towards agents learning to communicate about their visua...
research
∙
11/25/2015
A Roadmap towards Machine Intelligence
The development of intelligent machines is one of the biggest unsolved c...
research
∙
06/10/2015
Unveiling the Dreams of Word Embeddings: Towards Language-Driven Image Generation
We introduce language-driven image generation, the task of generating an...
research
∙
01/12/2015
From Visual Attributes to Adjectives through Decompositional Distributional Semantics
As automated image analysis progresses, there is increasing interest in ...
research
∙
01/12/2015
Combining Language and Vision with a Multimodal Skip-gram Model
We extend the SKIP-GRAM model of Mikolov et al. (2013a) by taking visual...
research
∙
12/20/2014
