On the Bandwidth of the Plenoptic Function

Abstract

Abstract-The plenoptic function (POF) provides a powerful conceptual tool for describing a number of problems in image/video processing, vision, and graphics. For example, image-based rendering is shown as sampling and interpolation of the POF. In such applications, it is important to characterize the bandwidth of the POF. We study a simple but representative model of the scene where band-limited signals (e.g., texture images) are "painted" on smooth surfaces (e.g., of objects or walls). We show that, in general, the POF is not band limited unless the surfaces are flat. We then derive simple rules to estimate the essential bandwidth of the POF for this model. Our analysis reveals that, in addition to the maximum and minimum depths and the maximum frequency of painted signals, the bandwidth of the POF also depends on the maximum surface slope. With a unifying formalism based on multidimensional signal processing, we can verify several key results in POF processing, such as induced filtering in space and depth-corrected interpolation, and quantify the necessary sampling rates.

Image based rendering with depth cameras: How many are needed?

“…In that respect we continue the work of several researchers [1,2,3,4]. In particular we use the formalism developed in a previous paper of ours [6] and expand it to include the case of depth cameras.…”

“…Having defined the scene geometry, we use the functional framework outlined in [2] in order to relates a point on the scene at x, z(x)) to a camera location t and pixel location v,…”

“…The interplay between geometry and sampling rate (number and spacing of cameras) has been extensively studied in the recent past (e.g., [1,2,3,4,5]). While the actual estimation of depth and geometry has been normally achieved using passive stereo with multiple cameras [?…”

Reconstruction, Identification and Implementation Methods for Spiking Neural Circuits

“…For a function u ∈ PW Ω , the composition u • ψ is a time-warped function (Cochran and Clark, 1990), whose exact bandwidth formula is yet to be derived for the general case. A new bandwidth can be calculated for this type of function, called essential maximum frequency or the essential bandwidth, which is defined as the bandwidth where most of the signal energy resides (Bergner et al, 2006, Do et al, 2012 …”

Sampling and Reconstruction of Spatial Fields Using Mobile Sensors

“…We know that the Fourier transform of is given by (28) where denotes the Fourier transform of the field , and the operation denotes convolution with respect to . From the structure of the Fourier transform we can argue as in [30] that the effective bandwidth of is given by (29) We now study how the Fourier transform of the observed signal gets modified by a slight deviation from the piecewise affine trajectory. Suppose the trajectory is given by (30) Let denote the maximum low-pass bandwidth of all .…”