research
∙
09/18/2023
Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions
In this work, we present a scalable reinforcement learning method for tr...
share
research
∙
09/06/2023
Gesture-Informed Robot Assistance via Foundation Models
Gestures serve as a fundamental and significant mode of non-verbal commu...
research
∙
07/28/2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
We study how vision-language models trained on Internet-scale data can b...
research
∙
07/17/2023
Deep Learning with Passive Optical Nonlinear Mapping
Deep learning has fundamentally transformed artificial intelligence, but...
research
∙
07/10/2023
Large Language Models as General Pattern Machines
We observe that pre-trained large language models (LLMs) are capable of ...
research
∙
06/29/2023
Principles and Guidelines for Evaluating Social Robot Navigation Algorithms
A major challenge to deploying robots widely is navigation in human-popu...
research
∙
06/14/2023
Language to Rewards for Robotic Skill Synthesis
Large language models (LLMs) have demonstrated exciting progress in acqu...
research
∙
05/22/2023
IMBUE: In-Memory Boolean-to-CUrrent Inference ArchitecturE for Tsetlin Machines
In-memory computing for Machine Learning (ML) applications remedies the ...
research
∙
05/09/2023
Large Language Models Need Holistically Thought in Medical Conversational QA
The medical conversational question answering (CQA) system aims at provi...
research
∙
04/04/2023
Neural Comprehension: Language Models with Compiled Neural Networks
Language models have achieved impressive results in natural language pro...
research
∙
03/06/2023
PaLM-E: An Embodied Multimodal Language Model
Large language models excel at a wide range of complex tasks. However, e...
research
∙
03/02/2023
Open-World Object Manipulation using Pre-trained Vision-Language Models
For robots to follow instructions from people, they must be able to conn...
research
∙
03/01/2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Robot Control
Recent progress in large language models (LLMs) has demonstrated the abi...
research
∙
02/22/2023
Scaling Robot Learning with Semantically Imagined Experience
Recent advances in robot learning have shown promise in enabling robots ...
research
∙
12/13/2022
RT-1: Robotics Transformer for Real-World Control at Scale
By transferring knowledge from large, diverse, task-agnostic datasets, m...
research
∙
11/29/2022
A Contextual Bandit Approach for Learning to Plan in Environments with Probabilistic Goal Configurations
Object-goal navigation (Object-nav) entails searching, recognizing and n...
research
∙
10/19/2022
Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization
We propose a framework to enable multipurpose assistive mobile robots to...
research
∙
10/13/2022
SWFormer: Sparse Window Transformer for 3D Object Detection in Point Clouds
3D object detection in point clouds is a core component for modern robot...
research
∙
09/22/2022
Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation
Despite decades of research, existing navigation systems still face real...
research
∙
09/16/2022
Code as Policies: Language Model Programs for Embodied Control
Large language models (LLMs) trained on code completion have been shown ...
research
∙
07/13/2022
6D Camera Relocalization in Visually Ambiguous Extreme Environments
We propose a novel method to reliably estimate the pose of a camera give...
research
∙
07/12/2022
Inner Monologue: Embodied Reasoning through Planning with Language Models
Recent works have shown how the reasoning capabilities of Large Language...
research
∙
04/20/2022
LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphs
The medical conversational system can relieve the burden of doctors and ...
research
∙
04/09/2022
Towards Better Chinese-centric Neural Machine Translation for Low-resource Languages
The last decade has witnessed enormous improvements in science and techn...
research
∙
04/04/2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
Large language models can encode a wealth of semantic knowledge about th...
research
∙
12/08/2021
ADBCMM : Acronym Disambiguation by Building Counterfactuals and Multilingual Mixing
Scientific documents often contain a large number of acronyms. Disambigu...
research
∙
11/29/2021
SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguation
Acronym disambiguation means finding the correct meaning of an ambiguous...
research
∙
11/29/2021
PSG: Prompt-based Sequence Generation for Acronym Extraction
Acronym extraction aims to find acronyms (i.e., short-forms) and their m...
research
∙
09/26/2021
Extracting and Inferring Personal Attributes from Dialogue
Personal attributes represent structured information about a person, suc...
research
∙
08/30/2021
Auto-Split: A General Framework of Collaborative Edge-Cloud AI
In many industry scale applications, large and resource consuming machin...
research
∙
08/06/2021
BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments
We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities i...
research
∙
08/06/2021
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks
Recent research in embodied AI has been boosted by the use of simulation...
research
∙
04/16/2021
A Masked Segmental Language Model for Unsupervised Natural Language Segmentation
Segmentation remains an important preprocessing step both in languages w...
research
∙
02/02/2021
QoS-Aware Power Minimization of Distributed Many-Core Servers using Transfer Q-Learning
Web servers scaled across distributed systems necessitate complex runtim...
research
∙
12/08/2020
Active Visual Localization in Partially Calibrated Environments
Humans can robustly localize themselves without a map after they get los...
research
∙
12/05/2020
iGibson, a Simulation Environment for Interactive Tasks in Large Realistic Scenes
We present iGibson, a novel simulation environment to develop robotic so...
research
∙
11/26/2020
NLPStatTest: A Toolkit for Comparing NLP System Performance
Statistical significance testing centered on p-values is commonly used t...
research
∙
10/13/2020
Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks
Supertagging is conventionally regarded as an important task for combina...
research
∙
08/18/2020
ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulation
Many Reinforcement Learning (RL) approaches use joint control signals (p...
research
∙
03/20/2020
Probabilistic Visual Navigation with Bidirectional Image Prediction
Humans can robustly follow a visual trajectory defined by a sequence of ...
research
∙
10/30/2019
Interactive Gibson: A Benchmark for Interactive Navigation in Cluttered Environments
We present Interactive Gibson, the first comprehensive benchmark for tra...
research
∙
10/24/2019
HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulators
Most common navigation tasks in human environments require auxiliary arm...
research
∙
10/15/2019
Neural Network Design for Energy-Autonomous AI Applications using Temporal Encoding
Neural Networks (NNs) are steering a new generation of artificial intell...
research
∙
05/22/2019
PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Tracking
Tracking 6D poses of objects from videos provides rich information to a ...
research
∙
03/07/2019
Deep Visual MPC-Policy Learning for Navigation
Humans can routinely follow a trajectory defined by a list of images/lan...
research
∙
03/01/2019
A Behavioral Approach to Visual Navigation with Graph Localization Networks
Inspired by research in psychology, we introduce a behavioral approach f...
research
∙
01/09/2019
Composite Shape Modeling via Latent Space Factorization
We present a novel neural network architecture, termed Decomposer-Compos...
research
∙
08/31/2018
Gibson Env: Real-World Perception for Embodied Agents
Developing visual perception models for active agents and sensorimotor c...
research
∙
06/22/2018
GONet++: Traversability Estimation via Dynamic Scene View Synthesis
Robots that interact with a dynamic environment, such as social robots a...
research
∙
11/03/2017
