Design and Characterization of Enhanced Angle Sensitive Pixels

Sivaramakrishnan, Sriram; Wang, Albert; Gill, Patrick R.; Molnar, Alyosha

doi:10.1109/ted.2015.2432715

Cited by 17 publications

(23 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An angle-sensitive SPAD array able to conduct lens-less 3-D fluorescent lifetime imaging is presented in [ 72 , 73 ]. By the diffraction gratings, the incident angle of light is extracted and 3-D localization of the fluorescent sources at a micrometer scale is enabled.…”

Section: Recent Advances In Contact Sensingmentioning

confidence: 99%

Recent Advances in Fluorescence Lifetime Analytical Microsystems: Contact Optics and CMOS Time-Resolved Electronics

Wei

Yan

2017

Sensors

View full text Add to dashboard Cite

Fluorescence spectroscopy has become a prominent research tool with wide applications in medical diagnostics and bio-imaging. However, the realization of combined high-performance, portable, and low-cost spectroscopic sensors still remains a challenge, which has limited the technique to the laboratories. A fluorescence lifetime measurement seeks to obtain the characteristic lifetime from the fluorescence decay profile. Time-correlated single photon counting (TCSPC) and time-gated techniques are two key variations of time-resolved measurements. However, commercial time-resolved analysis systems typically contain complex optics and discrete electronic components, which lead to bulkiness and a high cost. These two limitations can be significantly mitigated using contact sensing and complementary metal-oxide-semiconductor (CMOS) implementation. Contact sensing simplifies the optics, whereas CMOS technology enables on-chip, arrayed detection and signal processing, significantly reducing size and power consumption. This paper examines recent advances in contact sensing and CMOS time-resolved circuits for the realization of fully integrated fluorescence lifetime measurement microsystems. The high level of performance from recently reported prototypes suggests that the CMOS-based contact sensing microsystems are emerging as sound technologies for application-specific, low-cost, and portable time-resolved diagnostic devices.

show abstract

Section: Recent Advances In Contact Sensingmentioning

confidence: 99%

Recent Advances in Fluorescence Lifetime Analytical Microsystems: Contact Optics and CMOS Time-Resolved Electronics

Wei

Yan

2017

Sensors

View full text Add to dashboard Cite

show abstract

“…This in part explains the noisy visual artifacts present in the hardware prototype, and the need for large amounts of light in the scene. However, recent work in phase gratings [46,47] have increased light efficiency up to 50% relative quantum efficiency.…”

Section: Limitations Of Asps For Visual Recognitionmentioning

confidence: 99%

ASP Vision: Optically Computing the First Layer of Convolutional Neural Networks Using Angle Sensitive Pixels

Chen

Jayasuriya

Yang

et al. 2016

2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Self Cite

View full text Add to dashboard Cite

Deep learning using convolutional neural networks (CNNs) is quickly becoming the state-of-the-art for challenging computer vision applications. However, deep learning's power consumption and bandwidth requirements currently limit its application in embedded and mobile systems with tight energy budgets. In this paper, we explore the energy savings of optically computing the first layer of CNNs. To do so, we utilize bio-inspired Angle Sensitive Pixels (ASPs), custom CMOS diffractive image sensors which act similar to Gabor filter banks in the V1 layer of the human visual cortex. ASPs replace both image sensing and the first layer of a conventional CNN by directly performing optical edge filtering, saving sensing energy, data bandwidth, and CNN FLOPS to compute. Our experimental results (both on synthetic data and a hardware prototype) for a variety of vision tasks such as digit recognition, object recognition, and face identification demonstrate a reduction in image sensor power consumption and data bandwidth from sensor to CPU, while achieving similar performance compared to traditional deep learning pipelines.

show abstract

“…The current trend in the research field of advanced image sensors is to focus on the development of pixel-level detectors for computational imaging [ 1 , 2 , 3 , 4 ]. A traditional camera forms an image by recording only a two-dimensional (2D) intensity map of a scene.…”

Section: Introductionmentioning

confidence: 99%

Angle-Sensitive Detector Based on Silicon-On-Insulator Photodiode Stacked with Surface Plasmon Antenna

Nagarajan

Hara

Satoh

et al. 2020

Sensors

View full text Add to dashboard Cite

We present a pixel-level angle sensitive detector composed of silicon-on-insulator (SOI) photodiode (PD) stacked with a gold surface plasmon (SP) antenna to affect the direction of the incoming light. The surface plasmons are excited in the grating-type SP antenna and enhance the diffraction efficiency of the grating. The diffracted light is coupled strongly with the propagation light in the SOI waveguide when the phase matching condition is satisfied. The phase matching takes place at a specific angle of light incidence, and the discrimination of the light based on the incident angle is achieved. As spatial patterns in the polar coordinate of the elevation-azimuth angles (θ, ϕ) of the incident light, we present the phase matching condition theoretically, the absorption efficiency in the SOI by simulation, and also the quantum efficiency of the SOI PD experimentally for different SP antennas of one-dimensional (1D) line-and-space (L/S) and two-dimensional (2D) hole array gratings under various polarization angles. 1D grating offers a polarization sensitive angle detection and 2D grating exhibits angle detection in two orthogonal directions, enabling a polarization independent angle sensitivity. A good agreement among the theory, simulation, and experiment are attained. The proposed device features relatively high quantum efficiency as an angle-sensitive pixel (ASP) and gives wider opportunities in applications such as three-dimensional (3D) imaging, depth-of-field extension, and lensless imaging.

show abstract

Design and Characterization of Enhanced Angle Sensitive Pixels

Cited by 17 publications

References 15 publications

Recent Advances in Fluorescence Lifetime Analytical Microsystems: Contact Optics and CMOS Time-Resolved Electronics

Recent Advances in Fluorescence Lifetime Analytical Microsystems: Contact Optics and CMOS Time-Resolved Electronics

ASP Vision: Optically Computing the First Layer of Convolutional Neural Networks Using Angle Sensitive Pixels

Angle-Sensitive Detector Based on Silicon-On-Insulator Photodiode Stacked with Surface Plasmon Antenna

Contact Info

Product

Resources

About