Video composition by optimized 3D mean‐value coordinates

Shen, Yang; Lin, Xiao; Gao, Yan; Sheng, Bin; Liu, Qisong

doi:10.1002/cav.1465

Cited by 9 publications

(11 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To create a seamless video composition, Shen et al (2012) has proposed a hybrid blending method which combines two video frames and generates a composite video. This technique is applied to the computer animation field where two different background images are merged.…”

Section: Related Workmentioning

confidence: 99%

“…Similarly, Shen et al (2012) have proposed mixed reality interaction using a real-time Natural User Interfaces (NUI) engine for interaction, using a human hand in mixed reality. They have focused on mixed reality-based games and touch-less application.…”

Section: Related Workmentioning

confidence: 99%

“…2). The model proposed by Shen et al (2012) was applied for combining videos using a hybrid video composition technique from the cinematography and computer animation field. The model provided a processing time of the video composition of 120 sec with a frame size of 1280*720 in 100 frames.…”

Section: State Of the Art Solutionmentioning

confidence: 99%

“…Hybrid blending method is used to refine the result and eliminates the sawtooth and discoloration effects. The Hybrid-Blending equation that blends and refines the composite videos in the state of art method is presented in Equation 1 (Shen et al, 2012):…”

Section: State Of the Art Solutionmentioning

confidence: 99%

“…A further aim is to implement an improved solution by merging virtual and augmented realities and bringing about improvements by removing occlusion and the noise caused by hand motions during surgery. The section called "Literature review" presents the collection of current solution and also describes the model of the stat of art method Shen et al (2012). The section followed by "Proposed Model" include the flowchart and pseudocode of the proposed formula.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Remote Surgeon Hand Motion and Occlusion Removal in Mixed Reality in Breast Surgical Telepresence: Rural and Remote Care

Shakya

Khanal

Alsadoon

et al. 2018

American Journal of Applied Sciences

View full text Add to dashboard Cite

Mixed reality in surgical telepresence has not been practically implemented as yet and research done, until now, is only theoretical. Aiming to implement a proposed new solution by merging virtual and augmented realities and bringing about improvements by removing occlusion and the noise caused by hand motions during surgery. The proposed system consists of an extended Camshift algorithm for the detection of the remote expert surgeon's hand during surgery and enhancement of an image synthesization algorithm to remove the occlusion by including two Red-Green-Blue-Depth (RGBD) cameras. The experimental results from 10 breast samples reduce the average accuracy error of the video frame image overlay from 1.44 mm to 1.28 mm with average processing time enhanced to 76 sec compared to the state-of-the-art method. The proposed system provides a satisfactory outcome in terms of accuracy and operating time, which allows surgeons in local and remote sites to collaborate more effectively.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: State Of the Art Solutionmentioning

confidence: 99%

Section: State Of the Art Solutionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Remote Surgeon Hand Motion and Occlusion Removal in Mixed Reality in Breast Surgical Telepresence: Rural and Remote Care

Shakya

Khanal

Alsadoon

et al. 2018

American Journal of Applied Sciences

View full text Add to dashboard Cite

show abstract

A Novel Solution of Using Mixed Reality in Bowel and Oral and Maxillofacial Surgical Telepresence: 3D Mean Value Cloning algorithm

Maharjan¹,

Alsadoon²,

Prasad³

et al. 2020

Robotics Computer Surgery

View full text Add to dashboard Cite

Background and aim: Most of the Mixed Reality models used in the surgical telepresence are suffering from discrepancies in the boundary area and spatial-temporal inconsistency due to the illumination variation in the video frames. The aim behind this work is to propose a new solution that helps produce the composite video by merging the augmented video of the surgery site and the virtual hand of the remote expertise surgeon. The purpose of the proposed solution is to decrease the processing time and enhance the accuracy of merged video by decreasing the overlay and visualization error and removing occlusion and artefacts. Methodology: The proposed system enhanced the mean value cloning algorithm that helps to maintain the spatial-temporal consistency of the final composite video. The enhanced algorithm includes the 3D mean value coordinates and improvised mean value interpolant in the image cloning process, which helps to reduce the sawtooth, smudging and discolouration artefacts around the blending region. Results: As compared to the state of the art solution, the accuracy in terms of overlay error of the proposed solution is improved from 1.01mm to 0.80mm whereas the accuracy in terms of visualization error is improved from 98.8% to 99.4%. The processing time is reduced to 0.173 seconds from 0.211 seconds. Conclusion: Our solution helps make the object of interest consistent with the light intensity of the target image by adding the space distance that helps maintain the spatial consistency in the final merged video.

show abstract

A novel solution of using mixed reality in bowel and oral and maxillofacial surgical telepresence: 3D mean value cloning algorithm

Maharjan

Alsadoon

Prasad

et al. 2021

Robotics Computer Surgery

View full text Add to dashboard Cite

Background and Aim Most of the mixed reality models used in the surgical telepresence are suffering from the discrepancies in the boundary area and spatial–temporal inconsistency due to the illumination variation in the video frames. The aim behind this work is to propose a new solution that helps produce the composite video by merging the augmented video of the surgery site and virtual hand of the remote expertise surgeon. The purpose of the proposed solution is to decrease the processing time and enhance the accuracy of merged video by decreasing the overlay and visualization error and removing occlusion and artefacts. Methodology The proposed system enhanced mean‐value cloning algorithm that helps to maintain the spatial–temporal consistency of the final composite video. The enhanced algorithm includes the three‐dimensional mean‐value coordinates and improvised mean‐value interpolant in the image cloning process, which helps to reduce the sawtooth, smudging and discolouration artefacts around the blending region. Results The accuracy in terms of overlay error of the proposed solution is improved from 1.01 to 0.80 mm, whereas the accuracy in terms of visualization error is improved from 98.8% to 99.4%. The processing time is reduced to 0.173 s from 0.211 s. The processing time and the accuracy of the proposed solution are enhanced as compared to the state‐of‐art solution. Conclusion Our solution helps make the object of interest consistent with the light intensity of the target image by adding the space distance that helps maintain the spatial consistency in the final merged video.

show abstract

Video composition by optimized 3D mean‐value coordinates

Cited by 9 publications

References 18 publications

Remote Surgeon Hand Motion and Occlusion Removal in Mixed Reality in Breast Surgical Telepresence: Rural and Remote Care

Remote Surgeon Hand Motion and Occlusion Removal in Mixed Reality in Breast Surgical Telepresence: Rural and Remote Care

A Novel Solution of Using Mixed Reality in Bowel and Oral and Maxillofacial Surgical Telepresence: 3D Mean Value Cloning algorithm

A novel solution of using mixed reality in bowel and oral and maxillofacial surgical telepresence: 3D mean value cloning algorithm

Contact Info

Product

Resources

About