Multi-HMR: Multi-person Whole-Body Human Mesh Recovery in a Single Shot

Baradel, Fabien; Armando, Matthieu; Galaaoui, Salma; Brégier, Romain; Weinzaepfel, Philippe; Rogez, Grégory; Lucas, Thomas

doi:10.1007/978-3-031-73337-6_12

Lecture Notes in Computer Science

2024

DOI: 10.1007/978-3-031-73337-6_12

|View full text |Cite

Multi-HMR: Multi-person Whole-Body Human Mesh Recovery in a Single Shot

Fabien Baradel,

Matthieu Armando,

Salma Galaaoui

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Look Ma, no markers: holistic performance capture without the hassle

Hewitt,

Saleh,

Aliakbarian

et al. 2024

ACM Trans. Graph.

View full text Add to dashboard Cite

We tackle the problem of highly-accurate, holistic performance capture for the face, body and hands simultaneously. Motion-capture technologies used in film and game production typically focus only on face, body or hand capture independently, involve complex and expensive hardware and a high degree of manual intervention from skilled operators. While machine-learning-based approaches exist to overcome these problems, they usually only support a single camera, often operate on a single part of the body, do not produce precise world-space results, and rarely generalize outside specific contexts. In this work, we introduce the first technique for markerfree, high-quality reconstruction of the complete human body, including eyes and tongue, without requiring any calibration, manual intervention or custom hardware. Our approach produces stable world-space results from arbitrary camera rigs as well as supporting varied capture environments and clothing. We achieve this through a hybrid approach that leverages machine learning models trained exclusively on synthetic data and powerful parametric models of human shape and motion. We evaluate our method on a number of body, face and hand reconstruction benchmarks and demonstrate state-of-the-art results that generalize on diverse datasets.

show abstract

Look Ma, no markers: holistic performance capture without the hassle

Hewitt,

Saleh,

Aliakbarian

et al. 2024

ACM Trans. Graph.

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Multi-HMR: Multi-person Whole-Body Human Mesh Recovery in a Single Shot

Cited by 1 publication

References 55 publications

Look Ma, no markers: holistic performance capture without the hassle

Look Ma, no markers: holistic performance capture without the hassle

Contact Info

Product

Resources

About