Research Scientist at Facebook AI Research. I work on Embodied AI and Computer vision. Past: Ph.D. @SCSatCMU, Intern @facebookai & @Apple, BTech @iitbombay CS.
Dec 3, 2021 • 6 tweets • 4 min read
Presenting SEAL: Self-supervised Embodied Active Learning! #NeurIPS2021
SEAL is a self-supervised framework to close the action-perception loop. It improves perception & action models by just moving in the physical world w/o any human supervision.
1/N
SEAL consists of two phases, Action, where we learn an active exploration policy, and Perception, where we train the Perception Model on data gathered using the exploration policy and labels obtained using spatio-temporal label propagation.
