A spherical multi-camera system with real-time omnidirectional video acquisition capability

Design and Implementation of Real-Time Multi-Sensor Vision Systems

Seyid²,

Çoğal³

et al. 2017

Self Cite

The real-time development of multi-camera systems is a great challenge. Synchronization and large data rates of the cameras adds to the complexity of these systems as well. The complexity of such system also increases as the number of their incorporating cameras increases. The customary approach to implementation of such system is a central type, where all the raw stream from the camera are first stored then processed for their target application. An alternative approach is to embed smart cameras to these systems instead of ordinary cameras with limited or no processing capability. Smart cameras with intra and inter camera processing capability and programmability at the software and hardware level will offer the right platform for distributed and parallel processing for multicamera systems real-time application development. Inter camera processing requires the interconnection of smart cameras in a network arrangement. A novel hardware emulating platform is introduced for demonstrating the concept of the interconnected network of cameras. A methodology is demonstrated for the interconnection network of camera construction and analysis. A sample application is developed and demonstrated.

Section: Simulation Resultsmentioning

confidence: 96%

Interconnected Network of Cameras

Design and Implementation of Real-Time Multi-Sensor Vision Systems

Seyid²,

Çoğal³

et al. 2017

Self Cite

“…Earlier systems such as [22] was implemented with a centralized approach, where a single unit is responsible for data acquisition and data processing. However, in the centralized approach, because of the input-output (I/O) constraints, the number of cameras that can be connected to a single node is limited.…”

Section: Distributed and Parallel Implementation Of Omnidirectionmentioning

confidence: 99%

“…It is also a polydioptic system where each CMOS camera sensor has a distinct focal plane. The previously built Panoptic system is explained in detail in [22]. The system is implemented with a centralized approach, where data acquisition and data processing reside on the same unit.…”

mentioning

confidence: 99%

A Real-Time Multiaperture Omnidirectional Visual Sensor Based on an Interconnected Network of Smart Cameras

Seyid

IEEE Trans. Circuits Syst. Video Technol.

Çoğal

et al. 2015

Self Cite

Abstract-Centralized and multilevel implementations of the Panoptic omnidirectional multiaperture visual system were previously presented by us, relying on the transmission of all camera outputs to a single central processing node for omnidirectional image and video reconstruction. In this paper, a novel distributed and parallel implementation of the omnidirectional vision reconstruction algorithm of the Panoptic system is presented. The parallel approach aims to overcome the scalability problems and memory bandwidth limitations of the centralized approach. The real-time hardware implementation is presented for camera modules with image processing, memory, and interconnectivity features. A methodology is introduced for the arrangement of camera modules with interconnectivity feature into a target interconnection network topology. A unique custom-made multiple-field-programmable gate array hardware platform is introduced for the implementation of an interconnected network of 49 camera prototype Panoptic system. A hardware architecture based on presented hardware platform enabling the real-time implementation of the blending algorithms is presented, along with the imaging results and resource utilization. The realtime implementation results of the implemented omnivision application on the mentioned prototype are demonstrated.

“…The system presented in [28] is implemented using a centralized approach where a single unit is responsible for data acquisition and data processing from multiple image sensors. The real-time implementation of multi-camera systems applications with a high number of cameras, high image sensor resolutions and the current image sensor architectures demands a high amount of hardware resources, and depending on the target application it might also demand high computing performances.…”

Section: Distributed and Parallel Implementationmentioning

confidence: 99%

“…The proposed architecture in [28] performs the omnidirectional vision reconstruction in a pipeline flow for both the nearest neighbour and the linear interpolation techniques. Assuming that the memory used in the system can sustain consecutive access cycles, F clk for the presented real-time omnidirectional vision reconstruction architecture is derived from (3) as follows:…”

Section: Processing Demandsmentioning

confidence: 99%

Real-Time Omnidirectional Imaging System with Interconnected Network of Cameras

Seyid

Cogal

VLSI-SoC: Internet of Things Foundations

et al. 2015

Self Cite

International audienceThe Panoptic camera is an omnidirectional multi-aperture visual system which is realized by mounting multiple imaging sensors on a hemispherical frame. In this chapter, we will present a novel distributed and parallel implementation of the real-time omnidirectional vision reconstruction algorithm of the Panoptic Camera, for camera modules with processing, memory and interconnectivity features. A methodology for the arrangement of camera modules with interconnectivity feature into a target interconnection network topology will be introduced. A unique custom-made multiple-FPGA hardware platform designed for the implementation of an interconnected network of a 49 camera prototype Panoptic system will be explained. A novel way to represent the omnidirectional data obtained from the Panoptic Camera and real-time high dynamic range (HDR) video application which is realized by the system will be presented