Research
I am interested in building actionable representations that enable embodied agents to physically reason about their environments and perform tasks for and alongside humans.
|
|
Scene Graph Contrastive Learning for Embodied Navigation
Kunal Pratap Singh,
Jordi Salvador,
Luca Weihs,
Aniruddha Kembhavi
ICCV, 2023
Paper
We propose the Scene Graph Contrastive Loss, an auxiliary objective that encourages the agent's belief to align its representation with a rich graphical encoding of its environments. We show results on Object Navigation, Multi-Object Navigation and ArmPointNavigation.
|
|
Ask4Help : Learning to Leverage an Expert for Embodied Tasks
Kunal Pratap Singh,
Luca Weihs,
Alvaro Herrasti,
Jonghyun Choi,
Aniruddha Kembhavi ,
Roozbeh Mottaghi
NeurIPS, 2022
Paper | Code
We propose Ask4Help, a framework that endows embodied agents with the ability to request expert help. We applying this framework to existing off-the-shelf Embodied-AI models and improve task performance on Object Navigation and Room Rearrangement.
|
|
Factorizing Policy and Perception for Interactive Instruction Following
Kunal Pratap Singh*,
Suvaansh Bhambri*,
Byeonghwi Kim*,
Roozbeh Mottaghi,
Jonghyun Choi
ICCV, 2021
Paper | Code
We factorize the policy and perception into separate streams to train effective instruction following agents on the ALFRED benchmark.
Also presented at Embodied Vision, Actions and Language Workshop, ECCV 2020 and Embodied-AI workshop, CVPR 2021.
|
|
Learning Architecture for Binary Networks
Kunal Pratap Singh*,
Dahyun Kim*,
Jonghyun Choi
ECCV, 2020
Paper | Code
We develop the first architecture search method for binary neural networks. We propose a new search space and cell design, and discover architectures that outperform floating point backbones.
|
|
A Fast, Scalable, and Reliable Deghosting Method for Extreme Exposure Fusion
K. Ram Prabhakar*,
Rajat Arora*,
Adhitya Swaminathan,
Kunal Pratap Singh,
R. Venkatesh Babu
ICCP, 2019
Paper | Code
Proposed a flexible Deep Learning based approach for exposure fusion and HDR Imaging from arbitrary number of exposure bracketed shots.
|
This template is stolen from here.
|
|