FPGA implementation for real-time Chroma-key effect using Coarse and Fine Filter

Sang, Nguyen Thanh; Vinh, Truong Quang

doi:10.1109/commantel.2013.6482383

Cited by 7 publications

(6 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In the case of the aforementioned Coen brothers movie the complete film was converted digitally ('di,' that is Digital Intermediary) into the orange & teal look. cinesite used a chroma-key algorithm (Sang and Vinh, 2013) to turn the Mississippi summer green into a light golden brown, caucasian skin turning orange.…”

Section: Discussionmentioning

confidence: 99%

Orange & Teal

Koenderink

Doorn

2021

Art Percept.

View full text Add to dashboard Cite

‘Orange & Teal’ has become the preferred ‘look’ of the Hollywood movie industry. Is this craze just another arbitrary fashion? Possibly not, because ‒ apart from the name ‒ this palette has been around for ages in the visual arts. It is variously known as ‘painting in cool and warm,’ drawing a trois croyons, use of a ‘limited palette,’ and so forth. This leaves open the question of whether there might be one or more fundamental reasons for the preference for this particular dichromatic pair. Why not yellow–blue, red–turquoise, or green–purple? Reasons might be sought in human anatomy/physiology, physics of surface scattering, or the ecology of the human Umwelt. An in-depth analysis reveals that all these factors cooperate to render the orange & teal complementary palette indeed special. It involves world, body and mind and has to be understood in a proper semiotical (biological) setting.

show abstract

Section: Discussionmentioning

confidence: 99%

Orange & Teal

Koenderink

Doorn

2021

Art Percept.

View full text Add to dashboard Cite

show abstract

“…The algorithm supposes pixel (1, 1) belong to background region, because main object of scene is usually put in middle frame. The problem of Nguyen Thanh Sang's algorithm [9] is selecting blue or green background by hand. So, we proposed one way to determine background blue or green.…”

Section: A Automatically Calculate Two Centroidsmentioning

confidence: 99%

“…Some researchers have proposed real-time Chroma-key method for online applications. In the paper [9], Nguyen Thanh Sang presented Chroma-key algorithm based on improved K-Means method. He used two filters: Croase Filter and Fine Filter to extract the foreground and background region.…”

Section: Introductionmentioning

confidence: 99%

Chroma-Key Algorithm Based on Combination of K-Means and Confident Coefficients

Tri¹,

Tai²,

Vinh³

2014

IJIEE

View full text Add to dashboard Cite

Chroma-key is an application which is used many in video industries, TV programs. In this paper, we present an efficient algorithm for Chroma-key and its FPGA implementation. In the proposed method, we firstly employ K-means to segment input frames in to a trimap including background, foreground, and unknown regions. In the next stage, we utilize comparison of confident neighborhood pixels to refine unknown region to separate background and foreground regions. In order to apply the proposed algorithm for real-time chroma-key effect, we implement its VLSI architecture on Bitec Cyclone III development board. Our design is able to perform Chroma-key process with pleasing quality HD video in real-time.

show abstract

“…4 Recent years have seen an increased interest in the use of dedicated hardware acceleration across the media processing pipeline, from sensors and image acquisition 5 to data-and compute-intensive post-production tasks. 6,7 In many application domains, dedicated hardware accelerators have been shown to achieve significant gains in performance and/or energy consumption, compared to commercial hardware. [8][9][10][11] Despite seeing increased adoption in video streaming applications, 11 dedicated hardware accelerators have seen limited usage in the motion picture industry.…”

Section: Introductionmentioning

confidence: 99%

A case for FPGA-based accelerators for energy-efficient motion picture video processing

Boyle,

Shanker

2023

Applications of Digital Image Processing XLVI

View full text Add to dashboard Cite

In recent years, computing-based video processing workflows have become an integral part of the motion picture industry. These workloads are highly data- and compute-intensive, requiring capable hardware to achieve the required performance. Currently, general-purpose CPUs and GPUs are used to accelerate video processing functions in motion picture workflows. While such devices are highly suited to software-driven video processing workflows, they consume large amounts of energy in these tasks. In this work, we present a case for deploying an FPGA-based accelerator as an energy-efficient alternative to general-purpose hardware in high-resolution motion picture video processing, using an ingest module as a case study. We show that an FPGA-based accelerator for decoding 8K OpenEXR B44 video frames, designed using a commercial high-level synthesis workflow and executing on a PCIe-connected Alveo U50 device, outperforms a highly parallel, CPU-optimised inbuilt B44 decoder implementation in terms of energy consumption per frame decoded. In our experiments, the FPGA-accelerated B44 was able to decode 8K frames with 47.9 ms latency while consuming 0.98 J of energy per frame, compared to the 58.3 ms achieved by a high-end Intel 11700-K CPU while consuming 4.5 J per frame, when averaged over 1000 runs. We further show that this offload can be seamlessly integrated into state-of-the-art motion picture tools such as NUKE with minimal effort. With FPGAs becoming mainstream in cloud servers, we envision that this work paves the way for more efficient integration and utilisation of custom hardware and FPGAs in compute-intensive motion picture workflows.

show abstract

FPGA implementation for real-time Chroma-key effect using Coarse and Fine Filter

Cited by 7 publications

References 8 publications

Orange & Teal

Orange & Teal

Chroma-Key Algorithm Based on Combination of K-Means and Confident Coefficients

A case for FPGA-based accelerators for energy-efficient motion picture video processing

Contact Info

Product

Resources

About