Event-Based Pixel Sensitive to Changes of Color and Brightness

Berner, Raphael; Delbrück, Tobi

doi:10.1109/tcsi.2011.2157770

Cited by 30 publications

(23 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Each one of these pixel modulation strategies can be performed synchronously by means of traditional frame acquisition times [56,65,[57][58][59][60][61][62] or the more recently introduced event-based approach [63]. This last scheme was, nonetheless, developed to allow an asynchronous event-driven readout [73,74,68,69,64,70,72] and is commonly exploited in this frame-free scenario. Synchronous frame-based readout DPSs usually implement in-pixel digital counters in order to integrate the output spikes.…”

Section: Fpa Architecturesmentioning

confidence: 99%

Low-Power CMOS Digital Pixel Imagers for High-Speed Uncooled PbSe IR Applications

Margarit¹

2017

Springer Theses

View full text Add to dashboard Cite

Certifiquen ResumLa present tesi doctoral descriu la recerca i el desenvolupament d'una nova tecnologia monolítica d'imatgeria infraroja de longitud d'ona mitja (MWIR), no refrigerada i de baix cost, per a usos industrials d'alta velocitat. El treball pren el relleu dels últims avenços assolits pel soci industrial NIT S.L. en el camp dels detectors MWIR de PbSe depositats en fase vapor (VPD), afegint-hi coneixement fonamental en la investigació de noves tècniques de disseny de circuits VLSI analògics i mixtes pel desenvolupament del dispositiu integrat de lectura unit al detector pixelat.Es parteix de la hipòtesi que, mitjançant l'ús de les esmentades tècniques de disseny, les tecnologies CMOS estàndard satisfan tots els requeriments operacionals del detector VPD PbSe respecte a connectivitat, fiabilitat, funcionalitat i escalabilitat per integrar de forma econòmica el dispositiu. La càmera PbSe-CMOS resultant ha de consumir molt baixa potència, operar a freqüències de kHz, exhibir bona uniformitat, i encabir els píxels actius CMOS de lectura en el pitch compacte del pla focal de la imatge, tot atenent a les particulars característiques del detector: altes relacions de corrent d'obscuritat a senyal, elevats valors de capacitat paràsita a l'entrada i dispersions importants en el procés de fabricació.Amb la finalitat de complir amb els requisits previs, es proposen arquitectures de sensors de visió de molt baix acoblament interpíxel basades en l'ús d'una matriu de pla focal (FPA) de píxels actius exclusivament digitals. Cada píxel sensor digital (DPS) està equipat amb mòduls de comunicació d'alta velocitat, autopolarització, cancel·lació de l'offset, conversió analògica-digital (ADC) i correcció del soroll de patró fixe (FPN). El consum en cada cel·la es minimitza fent un ús exhaustiu del MOSFET operant en subllindar.L'objectiu últim és potenciar la integració de les tecnologies de sensat d'imatge infraroja (IR) basades en PbSe per expandir-ne el seu ús, no només a diferents escenaris, sinó també en diferents estadis de maduresa de la integració PbSe-CMOS. En aquest sentit, es proposa investigar un conjunt complet de blocs funcionals distribuïts en dos enfocs paral·lels: viii• Dispositius d'imatgeria MWIR "Smart" basats en frames utilitzant noves topologies de circuit DPS amb correcció de l'FPN en guany i offset. Aquesta línia de recerca exprimeix el pitch del detector per oferir una programabilitat completament digital a nivell de píxel i plena funcionalitat amb compensació de la capacitat paràsita d'entrada i memòria interna de fotograma.• Dispositius de visió MWIR "Compact"-pitch "frame-free" en base a un novedós esquema d'integració analògica en el DPS i diferenciació temporal configurable, combinats amb protocols de comunicació asíncrons dins del pla focal. Aquesta estratègia es concep per permetre una alta compactació del pitch i un increment de la velocitat de lectura, mitjançant la supressió del filtrat digital intern i l'assignació dinàmica de l'ample de banda a cada píxel de l'FPA. Aquest treball ha cond...

show abstract

Section: Fpa Architecturesmentioning

confidence: 99%

Low-Power CMOS Digital Pixel Imagers for High-Speed Uncooled PbSe IR Applications

Margarit¹

2017

Springer Theses

View full text Add to dashboard Cite

show abstract

“…Table II compares the proposed sensor to CMOS filterless color sensors reported in the last five years. It is evident that the most popular topologies are the buried double and triple junctions [17], [18], [20]- [22]. A wide variety of CMOS process nodes have been used, with the latest development in a 0.11 technology [22].…”

Section: Simultaneous 2-color Quantum Dot Sensingmentioning

confidence: 99%

“…A wide variety of CMOS process nodes have been used, with the latest development in a 0.11 technology [22]. Also, various readout techniques have been employed such as time division multiplexing [22], event-based readout [17], [18], and current readout [20], for applications ranging from biology to machine vision. For a comprehensive evaluation of the proposed CPG prototype, additional discussions are provided below.…”

Section: Simultaneous 2-color Quantum Dot Sensingmentioning

confidence: 99%

See 1 more Smart Citation

CMOS Tunable-Wavelength Multi-Color Photogate Sensor

Noor

Krull

et al. 2013

IEEE Trans. Biomed. Circuits Syst.

View full text Add to dashboard Cite

A CMOS tunable-wavelength multi-color photogate (CPG) sensor is presented. Sensing of a small set of well-separated wavelengths (e.g., > 50 nm apart) is achieved by tuning the spectral response of the device with a bias voltage. The CPG employs the polysilicon gate as an optical filter, which eliminates the need for an external color filter. A prototype has been fabricated in a standard 0.35 μm digital CMOS technology and demonstrates intensity measurements of blue (450 nm), green (520 nm), and red (620 nm) illumination with peak signal-to-noise ratios (SNRs) of 34.7 dB , 29.2 dB, and 34.8 dB, respectively. The prototype is applied to fluorescence detection of green-emitting quantum dots (gQDs) and red-emitting quantum dots (rQDs). It spectrally differentiates among multiple emission bands, effectively implementing on-chip emission filtering. The prototype demonstrates single-color measurements of gQD and rQD concentrations to a detection limit of 24 nM, and multi-color measurements of solutions containing both colors of QDs to a detection limit of 90 nM and 120 nM of gQD and rQD, respectively.

show abstract

“…The colour-change DVS (cDVS) vision sensor [10] is aimed at dynamic colour vision applications. The cDVS pixels detect changes of mean colour wavelength by measuring DVS pixel architecture and operation.…”

Section: Emulation Of the Colour-change Cdvs Vision Sensormentioning

confidence: 99%

Live demonstration: Behavioural emulation of event-based vision sensors

Katz

Nikolić

Delbrück

2012

2012 IEEE International Symposium on Circuits and Systems

View full text Add to dashboard Cite

This demonstration shows how an inexpensive high frame-rate USB camera is used to emulate existing and proposed activity-driven event-based vision sensors. A PS3-Eye camera which runs at a maximum of 125 frames/second with colour QVGA (320×240) resolution is used to emulate several event-based vision sensors, including a Dynamic Vision Sensor (DVS), a colour-change sensitive DVS (cDVS), and a hybrid vision sensor with DVS+cDVS pixels. The emulator is integrated into the jAER software project for event-based real-time vision and is used to study use cases for future vision sensor designs. I. DEMONSTRATIONRecent developments in activity-driven, event-based vision sensors have opened up a promising alternative to conventional frame-based vision. By outputting a sparse and variable-rate stream of data originating asynchronously from pixels with local gain control, these sensors reduce processing cost and latency, while increasing dynamic range. Except for [1], these vision sensor developments have been preceded by silicon chip developments. We thought that it would be useful to develop a behavioural emulator of such chip architectures that would allow us or others to study how to use a proposed vision sensor in application scenarios, and to allow us to model, in software, non-idealities such as fixed pattern noise and temporal noise. In particular, we needed an emulator that is fully integrated into our host-side software infrastructure [3]. In this demonstration, we show how this emulation allows us to model several existing and proposed vision sensor architectures. II. DEMONSTRATION SETUPThe demonstration setup consists of a laptop, a webcam (Playstation PS3-Eye), and a DVS128 Dynamic Vision Sensor [4]. A large monitor or beamer shows the output. III. VISITOR EXPERIENCEVisitors see how the emulator models an existing DVS128, how the improved resolution of the QVGA emulation will benefit applications in wide-area surveillance, and how the emulation models the cDVS sensor we are developing to simultaneously detect colour change and brightness change [5] . By using a high speed rotating stimulus, visitors also see the limitations of the conventional camera in terms of time resolution (8ms for the PS3-Eye compared with 1us for the DVS128), and in terms of dynamic range (<50dB for the PS3-Eye, compared with 120dB for the DVS128). IV. DEMONSTRATION READINESSThe demonstration is fully functional (see Fig. 1). We can simultaneously run the emulation and a real event-based sensor, record data, and play it back. We can display data in a variety of formats such as the spatial histogram shown in Vision sensor emulation demonstration. The output of jAER simultaneously shows the emulated DVS+cDVS and the raw PS3-Eye camera. Left window shows output of jAER [3]. The emulated pixels respond both to brightness change (black and white pixels) and mean wavelength change (red and blue pixels). The right window shows the control panel which allows camera and emulation parameter control, and also shows the raw PS3-Eye came...

show abstract

Event-Based Pixel Sensitive to Changes of Color and Brightness

Cited by 30 publications

References 29 publications

Low-Power CMOS Digital Pixel Imagers for High-Speed Uncooled PbSe IR Applications

Low-Power CMOS Digital Pixel Imagers for High-Speed Uncooled PbSe IR Applications

CMOS Tunable-Wavelength Multi-Color Photogate Sensor

Live demonstration: Behavioural emulation of event-based vision sensors

Contact Info

Product

Resources

About