2024
DOI: 10.1109/access.2023.3347192
|View full text |Cite
|
Sign up to set email alerts
|

Modeling Multimodal Uncertainties via Probability Distribution Encoders Included Vision-Language Models

Junjie Wang,
Yatai Ji,
Yuxiang Zhang
et al.

Abstract: In the field of multimodal understanding and generation, tackling inherent uncertainties is essential for mitigating ambiguous interpretations across multiple targets. We introduce the Probability Distribution Encoder (PDE), a versatile, plug-and-play module that utilizes sequence-level and featurelevel interactions to model these uncertainties as probabilistic distributions. Furthermore, we demonstrate its adaptability by seamlessly integrating PDE into established frameworks, culminating in models like SWINP… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

0
0
0

Publication Types

Select...

Relationship

0
0

Authors

Journals

citations
Cited by 0 publications
references
References 48 publications
(66 reference statements)
0
0
0
Order By: Relevance

No citations

Set email alert for when this publication receives citations?