Live mixed-reality 3D video in soccer stadium

Kitamura, Takayoshi; Kitahara, Itaru; Ohta, Yuichi

doi:10.1109/ismar.2003.1240701

Cited by 56 publications

(51 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…If partial 3D models of landmarks are available, Kameda et al [7] demonstrate how to synthesize a see-through composite image from multiple surveillance cameras. Moving objects are warped based with the same homography as nearby walls, although they discuss that approximating objects as 2D planes in 3D space as in [8], [6], and [12] could increase accuracy within the same framework.…”

Section: Related Workmentioning

confidence: 99%

Dynamic seethroughs: Synthesizing hidden views of moving objects

Barnum

Sheikh

Datta

et al. 2009

2009 8th IEEE International Symposium on Mixed and Augmented Reality

View full text Add to dashboard Cite

This paper presents a method to create an illusion of seeing moving objects through occluding surfaces in a video. This illusion is achieved by transferring information from a camera viewing the occluded area. In typical view interpolation approaches for 3D scenes, some form of correspondence across views is required. For occluded areas, establishing direct correspondence is impossible as information is missing in one of the views. Instead, we use a 2D projective invariant to capture information about occluded objects (which may be moving). Since invariants are quantities that do not change across views, a visually compelling rendering of hidden areas is achieved without the need for explicit correspondences. A piece-wise planar model of the scene allows the entire rendering process to take place without any 3D reconstruction, while still producing visual parallax. Because of the simplicity and robustness of the 2D invariant, we are able to transfer both static backgrounds and moving objects in real time. A complete working system has been implemented that runs live at 5Hz. Applications for this technology include the ability to look through corners at tight intersections for automobile safety, concurrent visualization of a surveillance camera network, and monitoring systems for patients/elderly/children.

show abstract

Section: Related Workmentioning

confidence: 99%

Dynamic seethroughs: Synthesizing hidden views of moving objects

Barnum

Sheikh

Datta

et al. 2009

2009 8th IEEE International Symposium on Mixed and Augmented Reality

View full text Add to dashboard Cite

show abstract

“…To create a video that enables such experience, a free viewpoint authoring application has been developed to render visual texture of the object of interest (i.e. the players, goalkeepers, and referee within the soccer field area) using a billboard model [2]- [4]. The authoring application extracts the texture of the soccer players from the original video and then merges the extracted pixels into a synthesized 3D environment that can be freely navigated by the users.…”

Section: Introductionmentioning

confidence: 99%

Automatic Soccer Player Tracking in Single Camera with Robust Occlusion Handling Using Attribute Matching

Sabirin

Suzuki

Naito

2015

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYThis paper presents an automatic method to track soccer players in soccer video recorded from a single camera where the occurrence of pan-tilt-zoom can take place. The automatic object tracking is intended to support texture extraction in a free viewpoint video authoring application for soccer video. To ensure that the identity of the tracked object can be correctly obtained, background segmentation is performed and automatically removes commercial billboards whenever it overlaps with the soccer player. Next, object tracking is performed by an attribute matching algorithm for all objects in the temporal domain to find and maintain the correlation of the detected objects. The attribute matching process finds the best match between two objects in different frames according to their pre-determined attributes: position, size, dominant color and motion information. Utilizing these attributes, the experimental results show that the tracking process can handle occlusion problems such as occlusion involving more than three objects and occluded objects with similar color and moving direction, as well as correctly identify objects in the presence of camera movements. key words: free viewpoint, attribute matching, automatic object tracking, soccer video

show abstract

“…Recently, generation of novel view images from images acquired by multiple cameras has been widely investigated [1,2,3,4]. The technique enables telepresence which presents a virtualized real scene to users staying in a remote site to provide a feeling of walking in the remote scene.…”

Section: Introductionmentioning

confidence: 99%

“…Saito's method is based on the assumption that the positions of objects are limited within the area covered by the cameras. Inamoto [2] and Koyama [3] have proposed methods for novel view image generation in a soccer scene. Inamoto's method [2] uses characteristics of soccer scenes.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Real-time generation of novel views of a dynamic scene using morphing and visual hull

Ishikawa

Yamazawa

Yokoya

2005

IEEE International Conference on Image Processing 2005

View full text Add to dashboard Cite

Abstract-Recently, generation of novel views from images acquired by multiple cameras has been investigated. It can be applied to telepresence effectively. Most conventional methods need some assumptions about the scene such as a static scene and limited positions of objects. In this paper, we propose a new method for generating novel view images of a dynamic scene with a wide view, which does not depend on the scene. The images acquired from omni-directional cameras are first divided into static regions and dynamic regions. The novel view images are then generated by applying a morphing technique to static regions and by computing visual hulls for dynamic regions in real-time. In experiments, we show that a prototype system can generate novel view images in real-time from live video streams.

show abstract

Live mixed-reality 3D video in soccer stadium

Cited by 56 publications

References 13 publications

Dynamic seethroughs: Synthesizing hidden views of moving objects

Dynamic seethroughs: Synthesizing hidden views of moving objects

Automatic Soccer Player Tracking in Single Camera with Robust Occlusion Handling Using Attribute Matching

Real-time generation of novel views of a dynamic scene using morphing and visual hull

Contact Info

Product

Resources

About