Dense Feature Matching Core for FPGA-based Smart Cameras

Abstract

International audienceSmart cameras are image/video acquisition devices that integrate image processing algorithms close to the image sensor, so they can deliver high-level information to a host computer or high-level decision process. In this context, a central issue is the implementation of complex and computationally intensive computer vision algorithms inside the camera fabric. For low-level processing, FPGA devices are excellent candidates because they support data paral-lelism with high data throughput. One computer vision algorithm highly promising for FPGA-based smart cameras is feature matching. Unfortunately, most previous feature matching formulations have inefficient FPGA implementations or deliver relatively poor information about the observed scene. In this work, we introduce a new feature-matching algorithm that aims for dense feature matching and at the same time straightforward FPGA implementation. We propose a new mathematical formulation that addressed the feature matching task as a feature tracking problem. We demonstrate that our algorithmic formulation delivers robust feature matching with low mathematical complexity and obtains accuracy superior to previous algorithmic formulations. An FPGA architecture is lay down and, hardware acceleration strategies are discussed. Finally , we applied our feature matching algorithm in a monocular-SLAM system. We show that our algorithmic formulation provides promising results under real world applications

An FPGA‐based smart camera for accurate chlorophyll estimations

“…Smart cameras are image/video acquisition devices with self‐contained image processing algorithms that simplify the formulation of a particular application . For example, algorithms for smart video surveillance could detect and track pedestrians, but for a robotic application, algorithms could be feature detection or feature tracking . In this work, the aim is for a fast/accurate solution for the chlorophyll estimation problem.…”