Track-Control, an automatic video-based real-time closed-loop behavioral control toolbox

Abstract

Approaches of optogenetic manipulation of neuronal activity have boosted our understanding of the functional architecture of brain circuits underlying various behaviors. In the meantime, rapid development in computer vision greatly accelerates the automation of behavioral analysis. Real-time and event-triggered interference is often necessary for establishing a tight correlation between neuronal activity and behavioral outcome. However, it is time consuming and easily causes variations when performed manually by experimenters. Here, we describe our Track-Control toolbox, a fully automated system with real-time object detection and low latency closed-loop hardware feedback. We demonstrate that the toolbox can be applied in a broad spectrum of behavioral assays commonly used in the neuroscience field, including open field, plus maze, Morris water maze, real-time place preference, social interaction, and sensory-induced defensive behavior tests. The Track-Control toolbox has proved an efficient and easy-to-use method with excellent flexibility for functional extension.Moreover, the toolbox is free, open source, graphic processing unit (GPU)-independent, and compatible across operating system (OS) platforms. Each lab can easily integrate Track-Control into their existing systems to achieve automation.

Cell-type-specific population dynamics of diverse reward computations

“…On the day prior to experimentation, mice were acclimated to the arena for 20 min while attached to the fiber optic rotary joint patch cord. The Track-Control toolkit, an open-source object detection and closed loop feedback toolbox run through Python ( Zhang et al, 2019 ) was used to manually assign the stimulated chamber at the start of each experiment, and track the centroid of the mouse. When the centroid of the mouse crossed into the stimulated chamber, an Arduino microcontroller ( www.arduino.cc ) drove continuous yellow laser stimulation at 15mW or blue light stimulation at 20Hz (20% duty cycle), measured at 15mW when continuous.…”