BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI

Rajaram, Shwetha; Numan, Nels; Kumaravel, Balasaravanan Thoravi; Marquardt, Nicolai; Wilson, Andrew D

doi:10.1145/3654777.3676326

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 63 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

Numan,

Rajaram,

Kumaravel

et al. 2024

Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

show abstract

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

Numan,

Rajaram,

Kumaravel

et al. 2024

Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

show abstract

MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback

Chen,

Nguyen,

Groueix

et al. 2024

ACM Trans. Comput.-Hum. Interact.

View full text Add to dashboard Cite

Providing asynchronous feedback is a critical step in the 3D design workflow. A common approach to providing feedback is to pair textual comments with companion reference images, which helps illustrate the gist of text. Ideally, feedback providers should possess 3D and image editing skills to create reference images that can effectively describe what they have in mind. However, they often lack such skills, so they have to resort to sketches or online images that might not match well with the current 3D design. To address this, we introduce MemoVis , a text editor interface that assists feedback providers in creating reference images with generative AI driven by the feedback comments. First, a novel real-time viewpoint suggestion feature, based on a vision-language foundation model, helps feedback providers anchor a comment with a camera viewpoint. Second, given a camera viewpoint, we introduce three types of image modifiers based on pre-trained 2D generative models to turn a text comment into an updated version of the 3D scene from that viewpoint. We conducted a within-subjects study with \(14\) feedback providers, demonstrating the effectiveness of MemoVis. The quality and explicitness of the companion images were evaluated by another eight participants with prior 3D design experience.

show abstract

BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI

Cited by 2 publications

References 63 publications

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback

Contact Info

Product

Resources

About