Publications
Planning with an Embodied Learnable Memory .
ADAPT: Actively Discovering and Adapting to Preferences for any Task .
PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks .(alphabetical order) Matthew Chang, Gunjan Chhablani, Alexander Clegg, Mikael Dallaire Cote, Ruta Desai, Michal Hlavac, Vladimir Karashchuk, Jacob Krantz, Roozbeh Mottaghi, Priyam Parashar, Siddharth Patki, Ishita Prasad, Xavier Puig, Akshara Rai, Ram Ramrakhya, Daniel Tran, Joanne Truong, John M. Turner, Eric Undersander, Tsung-Yen Yang
From an Image to a Scene: Learning to Imagine the World from a Million 360° Videos .
Situated Instruction Following .
Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Robot Manipulation .
Controllable Human-Object Interaction Synthesis .Oral presentation
GOAT: GO to Any Thing .
GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation .
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots .
Neural Priming for Sample-Efficient Adaptation .
HomeRobot: Open-Vocabulary Mobile Manipulation .
ENTL: Embodied Navigation Trajectory Learner .
Navigating to Objects Specified by Images .
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second .
Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics .Oral presentation
Unified-IO: A Unified Model for Vision, Language, and Multi-modal Tasks .Spotlight presentation
Neural Radiance Field Codebooks .
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation .Outstanding Paper Award
Ask4Help: Learning to Leverage an Expert for Embodied Tasks .
Benchmarking Progress to Infant-Level Physical Reasoning in AI .
A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge .
Object Manipulation via Visual Target Localization .
Interactron: Embodied Adaptive Object Detection .
Continuous Scene Representations for Embodied AI .
What do navigation agents learn about their environment?
Simple but Effective: CLIP Embeddings for Embodied AI .
Multi-Modal Answer Validation for Knowledge-Based VQA .Oral presentation
Container: Context Aggregation Networks .
RobustNav : Towards Benchmarking Robustness in Embodied Navigation .Oral presentation
Contrasting Contrastive Self-Supervised Representation Learning Pipelines .
Factorizing Perception and Policy for Interactive Instruction Following .
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World .Oral presentation Project page ]
Visual Room Rearrangement .Oral presentation Room Rearrangement Code & Dataset ]
ManipulaTHOR: A Framework for Visual Object Manipulation .Oral presentation Project page ]
Pushing it out of the Way: Interactive Visual Navigation .Project page ]
Learning Generalizable Visual Representations via Interactive Gameplay .Oral presentation
What Can You Learn from Your Muscles? Learning Visual Representation from Human Interactions .Code & Dataset ]
Rearrangement: A Challenge for Embodied AI .
Learning About Objects by Learning to Interact with Them .
AllenAct: A Framework for Embodied AI Research .AllenAct webpage ]
Visual Commonsense Graphs: Reasoning about the Dynamic Context of a Still Image .Spotlight presentation Project page ]
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects .
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform .RoboTHOR webpage ]
Visual Reaction: Learning To Play Catch With Your Drone .Project page ]
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks .Project & Challenge page ]
Learning to Learn How to Learn: Self-Adaptive Visual Navigation using Meta-Learning .Oral presentation Project page ]
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge .Project page ]
Visual Semantic Navigation using Scene Priors .Project page ]
On Evaluation of Embodied Navigation Agents .
Who Let The Dogs Out? Modeling Dog Behavior From Visual Data .Project page ]
SeGAN: Segmenting and Generating the Invisible .Spotlight presentation Project page ]
AI2-THOR: An Interactive 3D Environment for Visual AI .http://ai2thor.allenai.org/ ]
Visual Semantic Planning using Deep Successor Representations .Project page ]
See the Glass Half Full: Reasoning about Liquid Containers, their Volume and Content .Project page ]
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning .Project page ]
"What happens if..." Learning to Predict the Effect of Forces in Images .Project page ]
ObjectNet3D: A Large Scale Database for 3D Object Recognition .Spotlight presentation Project page ]
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images .Project page ]
A Task-oriented Approach for Cost-sensitive Recognition .Project page ][Supplementary Material ]
Human-Machine CRFs for Identifying Bottlenecks in Scene Understanding .Supplementary Material ]
Complexity of Representation and Inference in Compositional Models with Part Sharing .
A Coarse-to-Fine Model for 3D Pose Estimation and Sub-category Recognition .Supplementary Material ][dataset ][CAD models ]
Monocular Multiview Object Tracking with 3D Aspect Parts .
Beyond PASCAL: A Benchmark for 3D Object Detection in the Wild .PASCAL 3D+ dataset ]
The Role of Context for Object Detection and Semantic Segmentation in the Wild .Errata ][PASCAL Context dataset ]
Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Parts .PASCAL Parts dataset ]
Complexity of Representation and Inference in Compositional Models with Part Sharing .Oral presentation
Analyzing Semantic Segmentation Using Hybrid Human-Machine CRFs .Supplementary material ]
Bottom-up Segmentation for Top-down Detection .Project page ]
Augmenting Deformable Part Models with Irregular-shaped Object Patches .Supplementary material ]
A Compositional Approach to Learning Part-based Models of Objects .Code ]
Graph-based Planning Using Local Information for Unknown Outdoor Environments .
Place Recognition-based Fixed-lag Smoothing for Environments with Unreliable GPS .Video ]
An Integrated Particle Filter and Potential Field Method Applied to Multi-Robot Target Tracking .clip 1 and clip 2 ]
An Integrated Particle Filter & Potential Field Method for Cooperative Robot Target Tracking .
An Overview of a Probabilistic Tracker for Multiple Cooperative Tracking Agents .
Coordination of Multiple Agents for Probabilistic Object Tracking .
SharifCESR Small Size Robocup Team .
Planning with an Embodied Learnable Memory.
ADAPT: Actively Discovering and Adapting to Preferences for any Task.
PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks.
From an Image to a Scene: Learning to Imagine the World from a Million 360° Videos.
Situated Instruction Following.
Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Robot Manipulation.
Controllable Human-Object Interaction Synthesis.
GOAT: GO to Any Thing.
GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation.
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots.
Neural Priming for Sample-Efficient Adaptation.
HomeRobot: Open-Vocabulary Mobile Manipulation.
ENTL: Embodied Navigation Trajectory Learner.
Navigating to Objects Specified by Images.
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second.
Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics.
Unified-IO: A Unified Model for Vision, Language, and Multi-modal Tasks.
Neural Radiance Field Codebooks.
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation.
Ask4Help: Learning to Leverage an Expert for Embodied Tasks.
Benchmarking Progress to Infant-Level Physical Reasoning in AI.
A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge.
Object Manipulation via Visual Target Localization.
Interactron: Embodied Adaptive Object Detection.
Continuous Scene Representations for Embodied AI.
What do navigation agents learn about their environment?
Simple but Effective: CLIP Embeddings for Embodied AI.
Multi-Modal Answer Validation for Knowledge-Based VQA.
Container: Context Aggregation Networks.
RobustNav : Towards Benchmarking Robustness in Embodied Navigation.
Contrasting Contrastive Self-Supervised Representation Learning Pipelines.
Factorizing Perception and Policy for Interactive Instruction Following.
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World.
Visual Room Rearrangement.
ManipulaTHOR: A Framework for Visual Object Manipulation.
Pushing it out of the Way: Interactive Visual Navigation.
Learning Generalizable Visual Representations via Interactive Gameplay.
What Can You Learn from Your Muscles? Learning Visual Representation from Human Interactions.
Rearrangement: A Challenge for Embodied AI.
Learning About Objects by Learning to Interact with Them.
AllenAct: A Framework for Embodied AI Research.
Visual Commonsense Graphs: Reasoning about the Dynamic Context of a Still Image.
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects.
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform.
Visual Reaction: Learning To Play Catch With Your Drone.
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks.
Learning to Learn How to Learn: Self-Adaptive Visual Navigation using Meta-Learning.
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge.
Visual Semantic Navigation using Scene Priors.
On Evaluation of Embodied Navigation Agents.
Who Let The Dogs Out? Modeling Dog Behavior From Visual Data.
SeGAN: Segmenting and Generating the Invisible.
AI2-THOR: An Interactive 3D Environment for Visual AI.
Visual Semantic Planning using Deep Successor Representations.
See the Glass Half Full: Reasoning about Liquid Containers, their Volume and Content.
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning.
"What happens if..." Learning to Predict the Effect of Forces in Images.
ObjectNet3D: A Large Scale Database for 3D Object Recognition.
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images.
A Task-oriented Approach for Cost-sensitive Recognition.
Human-Machine CRFs for Identifying Bottlenecks in Scene Understanding.
Complexity of Representation and Inference in Compositional Models with Part Sharing.
A Coarse-to-Fine Model for 3D Pose Estimation and Sub-category Recognition.
Monocular Multiview Object Tracking with 3D Aspect Parts.
Beyond PASCAL: A Benchmark for 3D Object Detection in the Wild.
The Role of Context for Object Detection and Semantic Segmentation in the Wild.
Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Parts.
Complexity of Representation and Inference in Compositional Models with Part Sharing.
Analyzing Semantic Segmentation Using Hybrid Human-Machine CRFs.
Bottom-up Segmentation for Top-down Detection.
Augmenting Deformable Part Models with Irregular-shaped Object Patches.
A Compositional Approach to Learning Part-based Models of Objects.
Graph-based Planning Using Local Information for Unknown Outdoor Environments.
Place Recognition-based Fixed-lag Smoothing for Environments with Unreliable GPS.
An Integrated Particle Filter and Potential Field Method Applied to Multi-Robot Target Tracking.
An Integrated Particle Filter & Potential Field Method for Cooperative Robot Target Tracking.
An Overview of a Probabilistic Tracker for Multiple Cooperative Tracking Agents.
Coordination of Multiple Agents for Probabilistic Object Tracking.
SharifCESR Small Size Robocup Team.