Reconstruction of 3D objects by integration of multiple range data

Abstract

1-1 -4, U iiie zoii 0 , Ts II I ; 11 1 .) a , 111 a.ra k i 3 05, J ap a 11 E-in ai 1 : k a,iv a i Ge t8 1. go. j p Abstract A net0 (irpproach to integrrrte rongc dntu f r o n i niziltiple uitcupoints i s described. C'oni~ylicnttyl objrcts, J O I . e.rnln,plt f/o(i]crs, (ire obserz~ed b g (I. t~i n g e find(~i.frorn inirl/iplc viewpoints tuhosc relative position i.s i i n k 1 7 o c i~r~. .1,fter .si~nple segnientotioii,, correspondences of r~g i o i i s betiiicen two consecutive data are examined. This rncitchng process relies o n regions which (ire riot suppo,qed to bf: inJJcrenced by occlu . s io ra. Trcr n s f orni cri. ion pci r~i n r.5 G c l l o c~, r , /fL'O rlcrtrr (Ire calczrlnted by referrii,g t o the 171, azng rrsiilt. .-I t i iteryrtion p r0ce.s.s to ni r rzt ni 2ze difle re, ncr t s/,i in (I t t.s of cor^ spo ndiiag regions i s deuised so thnt o mort: cicc irrcrtc rc.sirlt 6.s obtc17r1,t.d. Duta observed froin ni,(r//fp/r u?rzupoints w e lr~rii,s,fcrr~td to stondord coordin,a.te.s u i i d inttgrcrterl. Re.sriltv o n sonie objects, f o r ezoniplt-f/owet.s, . s A o ( i~ / h i t s o f a r thnt / I t i s n?e/ltod is pr'o naiuirag. IiitroductioiiThe measuring inet,Iiocls for 3D ol>jccts arc. iriiportant. in indust.ria1 fields, a.iitl have I x y r i iiivestiga.ted \'er!' a.c ti vel y [ 1 -51. R eceii t,l y iii a 11 y resc ii rc 11 es i i si 11 g a r a ii ge fiiicler l i a~e beell 1Illtlert,iikeli. X rangr c1ilt.a wliicli is ohserved froin one viewpoint. has iiivisi1)IF part,s hecaiise of occlusioii ancl rest.rict.ion of t,lie inea.siiriii~~ tlevicc.. 111 order t.o iiieasure invisihle pa.rt.s, we i i i u s t ob. from mult,iple viewpoiiit,s aiitl ii1tegrat.e these c1at.a. 111 t,liis paper we describe a ~i e~v iipl)roacli to solve tlie a1101.e problenis. 111 order t.o observc, t,he wliole sliape. t,lie range data are olxerved from inultiple viewpoiiits. T h e relative posit,ions where t,he data a r e oht.aineti arc-assiinicd 1.0 be 11 11 kilo wii , and 1, iew p oiu t.s a re a ss ii in ecl s ii ffi cieii t I y close t,oget.lier. First,ly, t.lie data. is segineiitetl i1it.o regioiis. Nest,. some regions which a r e supposed not 1.0 be iiifliii.iiced 11y occlusion, a.re selected and their feiit.ure paraiiietcrs are calculated. Correspondeiices of regioiis I)et.wren t,\vo coiisecuti vv d a t a. a re ex a iiiiii ed . T 11 (2 1 ra II s Eo I' I 11 i1.t io 11 p a ra 111 et e 1,s are approxiiiiat,ely calciila.t.ecl t)), referencc (,o t h e inatcliiiLg result,. In order t,o iniprove accuracy, tlie d a t a a.re segineiit,ed int,o some new sniall regiolis wliicli are expected 1.0 s h o~v perfect inat.ches, a n c l (.lie p r o c e s is it,criit,etl to minimize their est.imated di-lferelices. In t.liis process these pa.raniet,ers can he ca1colat.etl acciirat.cly. 1)at.a oljservetl from 1n 01 t iple vieivp 0int.s a re t.r a 11 sfe r red t o s t, a 11 tI ii r d coorcliiiates by using traiisforiiiatioil p a r a . n i r t e r s . T11eii t.lie wliole slia.pe of oliject,s call I>e recoiist r i i c t e~l I)? iiitegrating t.lieiii. ...

Self-correction of 3D reconstruction from multi-view stereo images

“…Multi-view range image integration can be categorized into four major approaches: point based methods [4,10,18,23,37,40], direct surface merging [12,15,26,31,33,35,36,41], volumetric approaches employing implicit surfaces [1,2,7,8,9,21,22,25,27,28] and model based methods [24,32]. Volumetric diffusion [3] and volumetric graphcuts [30] have been proposed to build watertight 3D models from multi-views and especially focus on filling holes in the models.…”

“…Dyer [5] presented a review of reconstruction methods based on multiple views. There are also approaches [15,16,17,24,32] which combine range images and 2-D silhouette information [11] to assist the integration process.…”

“…The point based methods may fail if sample noise approaches sample density. In direct surface merging approaches [12,15,26,31,33,35,36] overlapping and nonoverlapping areas between range images need to be identified. The most accurate data is retained while inaccurate data is removed from the overlapping zone, before the remaining range data is zipped [35] into a single surface.…”

Integration of range images in a multi-view stereo system

“…Many researchers have investigated a variety of merging approaches to computing an integrated surface model from multiple range images. Mostly these are volumetric approaches employing implicit surfaces [1,3,4,5,9,12] and approaches involving direct surface merging [10,13,14,15,17,18]. Dyer [2] presented a review of reconstruction methods based on multiple views.…”

“…Dyer [2] presented a review of reconstruction methods based on multiple views. There are also approaches [8,11,13,16] which combine range images and 2-D silhouette information [6] to assist the integration process.…”