Camera Relocalization using Deep Point Cloud Generation and Hand-crafted Feature Refinement

Wang, Junyi; Qi, Yue

doi:10.1109/icra48506.2021.9561289

Cited by 6 publications

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Multi-task learning and joint refinement between camera localization and object detection

Wang,

2024

Comp. Visual Media

View full text Add to dashboard Cite

Visual localization and object detection both play important roles in various tasks. In many indoor application scenarios where some detected objects have fixed positions, the two techniques work closely together. However, few researchers consider these two tasks simultaneously, because of a lack of datasets and the little attention paid to such environments. In this paper, we explore multi-task network design and joint refinement of detection and localization. To address the dataset problem, we construct a medium indoor scene of an aviation exhibition hall through a semi-automatic process. The dataset provides localization and detection information, and is publicly available at https://drive.google.com/drive/folders/1U28zkuN4_I0dbzkqyIAKlAl5k9oUK0jI?usp=sharing for benchmarking localization and object detection tasks. Targeting this dataset, we have designed a multi-task network, JLDNet, based on YOLO v3, that outputs a target point cloud and object bounding boxes. For dynamic environments, the detection branch also promotes the perception of dynamics. JLDNet includes image feature learning, point feature learning, feature fusion, detection construction, and point cloud regression. Moreover, object-level bundle adjustment is used to further improve localization and detection accuracy. To test JLDNet and compare it to other methods, we have conducted experiments on 7 static scenes, our constructed dataset, and the dynamic TUM RGB-D and Bonn datasets. Our results show state-of-the-art accuracy for both tasks, and the benefit of jointly working on both tasks is demonstrated.

show abstract

Multi-task learning and joint refinement between camera localization and object detection

Wang,

2024

Comp. Visual Media

View full text Add to dashboard Cite

show abstract

HEGN: Hierarchical Equivariant Graph Neural Network for 9DoF Point Cloud Registration

Misik,

Salihu,

et al. 2024

2024 IEEE International Conference on Robotics and Automation (ICRA)

View full text Add to dashboard Cite

Scene-independent Localization by Learning Residual Coordinate Map with Cascaded Localizers

Wang,

2023

2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

Camera Relocalization using Deep Point Cloud Generation and Hand-crafted Feature Refinement

Cited by 6 publications

References 36 publications

Multi-task learning and joint refinement between camera localization and object detection

Multi-task learning and joint refinement between camera localization and object detection

HEGN: Hierarchical Equivariant Graph Neural Network for 9DoF Point Cloud Registration

Scene-independent Localization by Learning Residual Coordinate Map with Cascaded Localizers

Contact Info

Product

Resources

About