CoMo: A Novel Comoving 3D Camera System

Cavagna, Andrea; Xiao, Feng; Melillo, Stefania; Parisi, Leonardo; Postiglione, Lorena; Villegas, Pablo

doi:10.1109/tim.2021.3074388

Cited by 4 publications

(1 citation statement)

References 51 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, performing such an experiment with a large group of mutant fish is challenging, as mutants display a relatively high mortality rate. In addition, tracking larger groups requires better camera systems (see [65] for example), more optimised algorithms (see [66,67] for examples), and a very large space to avoid the interruption from the boundary. These requirements are beyond our current experimental capability.…”

Section: Discussionmentioning

confidence: 99%

Tuning Collective Behaviour in Zebrafish with Genetic Modification

Yang,

Kawafi,

Tong

et al. 2024

Preprint

View full text Add to dashboard Cite

Zebrafish collective behaviour is widely used to assess their physical and mental state, serving as a valuable tool to assess the impact of ageing, disease genetics, and the effect of drugs. The essence of these macroscopic phenomena can be represented by active matter models, where the individuals are abstracted as interactive self-propelling agents. The behaviour of these agents depends on a set of parameters in a manner reminiscent of those between the constituents of physical systems. In a few cases, the system may be controlled at the level of the individual constituents such as the interactions between colloidal particles, or the enzymatic behaviour of de novo proteins. Usually, however, while the collective behaviour may be influenced by environmental factors, it typically cannot be changed at will. Here, we challenge this scenario in a biological context by genetically modifying zebrafish. We thus demonstrate the potential of genetic modification in the context of controlling the collective behaviour of biological active matter systems at the level of the constituents, rather than externally. In particular, we probe the effect of the lack of col11a2 gene in zebrafish, which causes the early onset of osteoarthritis. The resulting col11a2 -/- zebrafish exhibited compromised vertebral column properties, bent their body less while swimming, and took longer to change their orientations. Surprisingly, a group of 25 mutant fish exhibited more orderly collective motion than the wildtype. We show that the collective behaviour of wildtype and col11a2 zebrafish are captured with a simple active matter model, in which the mutant fish are modelled by self–propelling agents with a higher orientational noise on average. In this way, we demonstrate the possibility of tuning a biological system, changing the state space it occupies when interpreted with a simple active matter model.

show abstract

Section: Discussionmentioning

confidence: 99%

Tuning Collective Behaviour in Zebrafish with Genetic Modification

Yang,

Kawafi,

Tong

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

Adaptive infrared patterns for microscopic surface reconstructions

Milosavljevic,

Bardosi,

Oezbek

et al. 2024

Int J CARS

View full text Add to dashboard Cite

Purpose Multi-zoom microscopic surface reconstructions of operating sites, especially in ENT surgeries, would allow multimodal image fusion for determining the amount of resected tissue, for recognizing critical structures, and novel tools for intraoperative quality assurance. State-of-the-art three-dimensional model creation of the surgical scene is challenged by the surgical environment, illumination, and the homogeneous structures of skin, muscle, bones, etc., that lack invariant features for stereo reconstruction. Methods An adaptive near-infrared pattern projector illuminates the surgical scene with optimized patterns to yield accurate dense multi-zoom stereoscopic surface reconstructions. The approach does not impact the clinical workflow. The new method is compared to state-of-the-art approaches and is validated by determining its reconstruction errors relative to a high-resolution 3D-reconstruction of CT data. Results 200 surface reconstructions were generated for 5 zoom levels with 10 reconstructions for each object illumination method (standard operating room light, microscope light, random pattern and adaptive NIR pattern). For the adaptive pattern, the surface reconstruction errors ranged from 0.5 to 0.7 mm, as compared to 1–1.9 mm for the other approaches. The local reconstruction differences are visualized in heat maps. Conclusion Adaptive near-infrared (NIR) pattern projection in microscopic surgery allows dense and accurate microscopic surface reconstructions for variable zoom levels of small and homogeneous surfaces. This could potentially aid in microscopic interventions at the lateral skull base and potentially open up new possibilities for combining quantitative intraoperative surface reconstructions with preoperative radiologic imagery.

show abstract

FlockSeer: A portable stereo vision observer for bird flocking

Ai,

Zhai,

Sun

et al. 2024

IET Cyber-Syst and Robotics

View full text Add to dashboard Cite

Bird flocking is a paradigmatic case of self‐organised collective behaviours in biology. Stereo camera systems are employed to observe flocks of starlings, jackdaws, and chimney swifts, mainly on a spot‐fixed basis. A portable non‐fixed stereo vision‐based flocking observation system, namely FlockSeer, is developed by the authors for observing more species of bird flocks within field scenarios. The portable flocking observer, FlockSeer, responds to the challenges in extrinsic calibration, camera synchronisation and field movability compared to existing spot‐fixed observing systems. A measurement and sensor fusion approach is utilised for rapid calibration, and a light‐based synchronisation approach is used to simplify hardware configuration. FlockSeer has been implemented and tested across six cities in three provinces and has accomplished diverse flock‐tracking tasks, accumulating behavioural data of four species, including egrets, with up to 300 resolvable trajectories. The authors reconstructed the trajectories of a flock of egrets under disturbed conditions to verify the practicality and reliability. In addition, we analysed the accuracy of identifying nearest neighbours, and then examined the similarity between the trajectories and the Couzin model. Experimental results demonstrate that the developed flocking observing system is highly portable, more convenient and swift to deploy in wetland‐like or coast‐like fields. Its observation process is reliable and practical and can effectively support the study of understanding and modelling of bird flocking behaviours.

show abstract

CoMo: A Novel Comoving 3D Camera System

Cited by 4 publications

References 51 publications

Tuning Collective Behaviour in Zebrafish with Genetic Modification

Tuning Collective Behaviour in Zebrafish with Genetic Modification

Adaptive infrared patterns for microscopic surface reconstructions

FlockSeer: A portable stereo vision observer for bird flocking

Contact Info

Product

Resources

About