ARACAM: A RGB-D Multi-View Photogrammetry System for Lower Limb 3D Reconstruction Applications

Abstract

In the world, there is a growing need for lower limb prostheses due to a rising number of amputations caused primarily, by diabetic foot. Researchers enable functional and comfortable prostheses through prosthetic design by integrating new technologies applied to the traditional handcrafted method for prosthesis fabrication that is still current. That is why computer vision shows to be a promising tool for the integration of 3D reconstruction that may be useful for prosthetic design. This work has the objective to design, prototype, and test a functional system to scan plaster cast molds, which may serve as a platform for future technologies for lower limb reconstruction applications. The image capture system comprises 5 stereoscopic color and depth cameras, each with 4 DOF mountings on an enveloping frame, as well as algorithms for calibration, segmentation, registration, and surface reconstruction. The segmentation metrics of dice coefficient and Hausdorff distance (HD) show strong visual similarity with an average similarity of 87% and average error of 6.40 mm, respectively. Moving forward, the system was tested on a known 3D printed model obtained from a computer tomography scan to which comparison results via HD show an average error of ≤1.93 mm thereby making the system competitive against the systems reviewed from the state-of-the-art.

The use of conformal lattice metamaterials for relieving stress in lower limb sockets: A numerical and exploratory study

“…This cast is then removed and filled with plaster to obtain a positive mold as described by Chen et al 6 The prosthetist ensured that the mold was physically modified in shape and size and patient-specific information was de-identified prior to sharing both with this research team, this positive mold is shown in Figure 2(a). To obtain the computational model shown in Figure 2(b) a multi-view setup proposed by Barreto et al 15 was used to 3D-scan the plaster-cast mold. This system uses five multiple color and depth consumer-grade cameras arranged in a radial array.…”

“…The ARACAM system has proven to be useful in design and fabrication applications for transtibial or transfemoral lower limb prostheses. 15…”

“…The ARACAM system has proven to be useful in design and fabrication applications for transtibial or transfemoral lower limb prostheses. 15 Then, a digital socket was created using Meshmixer Ò by selecting a contour and extracting the surface. Later, the surface of the cast was imported into nTopology Ò .…”

MVS-T: A Coarse-to-Fine Multi-View Stereo Network with Transformer for Low-Resolution Images 3D Reconstruction

“…Multi-view stereo (MVS), a significant field in computer vision, intends to reconstruct 3D models with dense representations from multi-view images and related internal and external camera parameter matrices. The research results of 3D reconstruction have been frequently used in robot navigation [ 1 , 2 ], augmented reality [ 3 ], and photogrammetry [ 4 , 5 ]. High-resolution images allow for better reconstruction, but such large-size images consume a lot of processing resources and time.…”

Analysis of the Influence of the Geometrical Parameters of the Body Scanner on the Accuracy of Reconstruction of the Human Figure Using the Photogrammetry Technique

“…Scanning systems based on the photogrammetry technique are of interest to many industries. In the field of human scanning, it is possible to mention, among others, virtual fitting rooms [ 7 ], fitness and sport [ 8 ], education [ 9 ], as well as health and medicine [ 10 , 11 , 12 , 13 , 14 ]. Typically, as a result, the scanning of stationary models has been obtained, although attempts have also been made to create interactive models, which may be used, for example, in the education of anatomy [ 15 ].…”