A new biologically-inspired vision sensor made of one hundred "eyes" is presented, which is suitable for real-time acquisition and processing of 3-D image sequences. This device, named the Panoptic camera, consists of a layered arrangement of approximately 100 classical CMOS imagers, distributed over a hemisphere of 13cm in diameter. The Panoptic camera is a polydioptric system where all imagers have their own vision of the world, each with a distinct focal point, which is a specific feature of the Panoptic system. This enables 3-D information recording such as omnidirectional stereoscopy or depth estimation, applying specific signal processing. The algorithms dictating the image reconstruction of an omnidirectional observer located at any point inside the hemisphere are presented. A hardware architecture which has the capability of handling these algorithms, and the flexibility to support additional image processing in real time, has been developed as a two-layer system based on FPGAs. The detail of the hardware architecture, its internal blocks, the mapping of the algorithms onto the latter elements, and the device calibration procedure are presented, along with imaging results.

No abstract

A multi-camera system inspired from the visual system of flying insects is introduced which is referred to as the Panoptic camera. In the Panoptic system each camera is mounted over a hemispherical geometry and has its own vision of surrounding and distinct focal direction. The Panoptic device finds application in the area of omnidirectional vision and 3D imaging. A systematic approach is presented for the coverage analysis and design guidelines of the Panoptic device. The presented approach enables the construction of arbitrary multi-camera systems based on the Panoptic principle. An implemented hardware architecture based on FPGA is introduced which is capable of real-time omnidirectional vision reconstruction. The implemented hardware is capable of live video streaming at a rate of 6.25M pixels per second and a maximum image resolution of 32M pixels per FPGA board. 1

Panoptic is a custom spherical light field camera used as a polydioptric system where imagers are distributed over a hemispherical surface, each having its own vision of the surroundings and a distinct focal plane. The spherical light field camera records light information from any direction around its center. This paper revises previously developed Nearest Neighbor and Linear blending techniques. Novel Gaussian blending and Restricted Gaussian blending techniques for vision reconstruction of a virtual observer located inside the spherical geometry are presented. These new blending techniques improve the output quality of the reconstructed image with respect to the ordinary stitching techniques and simpler image blending algorithms. A comparison of the developed blending algorithms is also given in this paper. A hardware architecture based on Field Programmable Gate Arrays (FPGA) enabling the real-time implementation of the blending algorithms is presented, along with the imaging results and resource utilization comparison. A recorded omnidirectional video is attached as a supplementary material.

Abstract-Panoptic is a custom spherical light field camera used as a polydioptric system where imagers are distributed over a spherical geometry, each having its own vision of the surrounding and a distinct focal plane. The spherical light field camera records light information from any direction around its center. A novel Gaussian blending technique is presented for vision reconstruction of a virtual observer located inside the spherical geometry of this camera. This blending technique improves the output quality of the reconstructed image with respect to ordinary stitching techniques and simpler image blending algorithms. A hardware architecture based on Field Programmable Gate Arrays (FPGA) with the real-time implementation of the Gaussian blending algorithm using the spherical light field camera is presented, along with the imaging results.