Ultra-Low-Latency Video Transmissions for Delay Sensitive Collaboration

Ubik, Sven; Halák, Jakub; Melnikov, Jiří; Kolbe, Martin

doi:10.1109/meco49872.2020.9134361

Cited by 8 publications

(3 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another approach reduces audio/visual latency transmission to less than 5 ms, but over distance up to 300 km [ 50 ]. This FPGA implementation combines a Tiny Codec (TICO) [ 51 ] with a Gigabit Ethernet interface to achieve these results.…”

Section: High Performance Networkmentioning

confidence: 99%

“…By moving codecs from the application layer in software closer to the networking layer in hardware for application specific designs, we can observe significant latency reductions in video transmissions. For example, in [ 50 ], TICO video compression was used over a fiber link, where the encoder and decoder were implemented on a Xilinx FPGA in conjunction with Block RAM (BRAM) to store incoming packets.…”

Section: Fpga Optimization Techniquesmentioning

confidence: 99%

See 1 more Smart Citation

Review of State-of-the-Art FPGA Applications in IoT Networks

Magyari

Chen

2022

Sensors

View full text Add to dashboard Cite

Modern networks used for integrating custom Internet of Things (IoT) systems and devices have restrictions and requirements unique to their individual applications. These application specific demands require custom designed hardware to maximize throughput, security and data integrity whilst minimizing latency, power consumption, and form factor. Within this paper, we describe current, state-of-the-art works that utilize FPGAs for IoT network developments. We analyze two categories of works: those that prioritize reducing power consumption, and those that prioritize networking features. Further, we describe how future works can improve upon these designs and therefore improve the efficiency of resource-constrained IoT networks.

show abstract

Section: High Performance Networkmentioning

confidence: 99%

Section: Fpga Optimization Techniquesmentioning

confidence: 99%

Review of State-of-the-Art FPGA Applications in IoT Networks

Magyari

Chen

2022

Sensors

View full text Add to dashboard Cite

show abstract

“…Despite these advances, the current systems can suffer from glitches, lags and poor video quality, especially under unreliable network conditions [2]. These issues are particularly problematic in certain delay-sensitive applications such as the performing arts [3]. Note that in many applications, it is not necessary to reconstruct an approximation of the original video as long as the semantically relevant features are preserved.…”

Section: Introductionmentioning

confidence: 99%

Reducing latency and bandwidth for video streaming using keypoint extraction and digital puppetry

Prabhakar¹,

Chandak²,

Chiu³

et al. 2020

Preprint

View full text Add to dashboard Cite

COVID-19 has made video communication one of the most important modes of information exchange. While extensive research has been conducted on the optimization of the video streaming pipeline, in particular the development of novel video codecs, further improvement in the video quality and latency is required, especially under poor network conditions. This paper proposes an alternative to the conventional codec through the implementation of a keypoint-centric encoder relying on the transmission of keypoint information from within a video feed. The decoder uses the streamed keypoints to generate a reconstruction preserving the semantic features in the input feed. Focusing on video calling applications, we detect and transmit the body pose and face mesh information through the network, which are displayed at the receiver in the form of animated puppets. Using efficient pose and face mesh detection in conjunction with skeleton-based animation, we demonstrate a prototype requiring lower than 35 kbps bandwidth, an order of magnitude reduction over typical video calling systems. The added computational latency due to the mesh extraction and animation is below 120ms on a standard laptop, showcasing the potential of this framework for real-time applications. The code for this work is available at https://github.com/shubhamchandak94/digital-puppetry/.

show abstract