Revisiting Lucas-Kanade and Horn-Schunck

Maykol, Andry; Pinto, Andry Maykol; Moreira, António Paulo; Costa, Paulo; Correia, Miguel Velhote; Tec, Inesc; Frias, Roberto

doi:10.5963/jcei0102001

Cited by 8 publications

(8 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, the algorithm was successfully used in various research projects [ 4 , 13 ] in our department. According to the Middlebury benchmark page [ 10 ], as well as paper [ 14 ] it is also slightly more accurate than the most widely used Lucas et al [ 15 ] method.…”

Section: Horn-schunck Optical Flow Calculationmentioning

confidence: 99%

See 1 more Smart Citation

Efficient Hardware Implementation of the Horn-Schunck Algorithm for High-Resolution Real-Time Dense Optical Flow Sensor

Komorkiewicz

Kryjak

Gorgon

2014

Sensors

View full text Add to dashboard Cite

This article presents an efficient hardware implementation of the Horn-Schunck algorithm that can be used in an embedded optical flow sensor. An architecture is proposed, that realises the iterative Horn-Schunck algorithm in a pipelined manner. This modification allows to achieve data throughput of 175 MPixels/s and makes processing of Full HD video stream (1, 920 × 1, 080 @ 60 fps) possible. The structure of the optical flow module as well as pre- and post-filtering blocks and a flow reliability computation unit is described in details. Three versions of optical flow modules, with different numerical precision, working frequency and obtained results accuracy are proposed. The errors caused by switching from floating- to fixed-point computations are also evaluated. The described architecture was tested on popular sequences from an optical flow dataset of the Middlebury University. It achieves state-of-the-art results among hardware implementations of single scale methods. The designed fixed-point architecture achieves performance of 418 GOPS with power efficiency of 34 GOPS/W. The proposed floating-point module achieves 103 GFLOPS, with power efficiency of 24 GFLOPS/W. Moreover, a 100 times speedup compared to a modern CPU with SIMD support is reported. A complete, working vision system realized on Xilinx VC707 evaluation board is also presented. It is able to compute optical flow for Full HD video stream received from an HDMI camera in real-time. The obtained results prove that FPGA devices are an ideal platform for embedded vision systems.

show abstract

Section: Horn-schunck Optical Flow Calculationmentioning

confidence: 99%

“…Initial research as well as results presented in the paper [ 14 ] indicate that the original Horn-Schunck method (without scaling) is not able to correctly determine the pixel flow if their displacement is too large. There are two solutions to this problem.…”

Section: Design Space Explorationmentioning

confidence: 99%

Efficient Hardware Implementation of the Horn-Schunck Algorithm for High-Resolution Real-Time Dense Optical Flow Sensor

Komorkiewicz

Kryjak

Gorgon

2014

Sensors

View full text Add to dashboard Cite

show abstract

“…A large part of the work on image interpolation is based on differential algorithms proposed by Lucas and Kanade [11] and Horn and Schunck [12]. These algorithms are based on several assumptions, such as brightness constancy and temporal consistency [13]. Lucas and Kanade assume that pixels surrounding a pixel being observed behave almost the same as the observed pixel (local variation), while Horn and Schunck consider the global variation in an image.…”

Section: Related Work a Image Interpolation Methodsmentioning

confidence: 99%

Generating In-Between Images Through Learned Latent Space Representation Using Variational Autoencoders

et al. 2020

View full text Add to dashboard Cite

Image interpolation is often implemented using one of two methods: optical flow or convolutional neural networks. These methods are typically pixel-based; they do not work well on objects between images far apart. Because they either rely on a simple frame average or pixel motion, they do not have the required knowledge of the semantic structure of the data. In this paper, we propose a method for image interpolation based on latent representations. We use a simple network structure based on a variational autoencoder and an adjustable hyperparameter that imposes the latent space distribution to generate accurate interpolation. To visualize the effects of the proposed approach, we evaluate a synthetic dataset. We demonstrate that our method outperforms both pixel-based methods and a conventional variational autoencoder, with particular improvements in nonsuccessive images.

show abstract

“…In our approach, the optical flow was most convenient and reliable because it takes into account some initial assumptions. The basic assumptions of the adopted method of optical flow are as follows [36,39]:…”

Section: Algorithm For Intruder Detection Vision Systemmentioning

confidence: 99%

In-Flight Tests of Intruder Detection Vision System

Rzucidło

Jaromi

Kapuściński

et al. 2021

Sensors

View full text Add to dashboard Cite

In the near future, the integration of manned and unmanned aerial vehicles into the common airspace will proceed. The changes taking place mean that the safety of light aircraft, ultralight aircraft and unmanned air vehicles (UAV) will become an increasing problem. The IDAAS project (Intruder Detection And collision Avoidance System) meets the new challenges as it aims to produce technically advanced detection and collision avoidance systems for light and unmanned aerial vehicles. The work discusses selected elements of research and practical tests of the intruder detection vision system, which is part the of IDAAS project. At the outset, the current formal requirements related to the necessity of installing anticollision systems on aircraft are presented. The concept of the IDAAS system and the structure of algorithms related to image processing are also discussed. The main part of the work presents the methodology developed for the needs of dedicated flight tests, its implementation and the results obtained. The initial tests of the IDAAS system carried out on an ultralight aircraft generally indicate the possibility of the effective detection of intruders in the airspace with the use of vision methods, although they also indicated the existence of conditions in which this detection may prove difficult or even impossible.

show abstract

Revisiting Lucas-Kanade and Horn-Schunck

Cited by 8 publications

References 10 publications

Efficient Hardware Implementation of the Horn-Schunck Algorithm for High-Resolution Real-Time Dense Optical Flow Sensor

Efficient Hardware Implementation of the Horn-Schunck Algorithm for High-Resolution Real-Time Dense Optical Flow Sensor

Generating In-Between Images Through Learned Latent Space Representation Using Variational Autoencoders

In-Flight Tests of Intruder Detection Vision System

Contact Info

Product

Resources

About