D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding

Abstract

Listener discriminates" this is a black chair . it is against the wall and facing the door. " 4 " this chair is black . it is under the whiteboard facing the round table ."2 " … " 3 " … " 5 " … " 1 Dense captions Detections Figure 1. We introduce D 3 Net, an end-to-end neural speaker-listener architecture that can detect, describe and discriminate. D 3 Net also enables semi-supervised training on Scan-Net data with partially annotated descriptions.