This paper describes an image-based agent's pose estimation method for supporting experiments on cricket-micro mobile robot interactions. Crickets modify their behavior selection tendency as a result of experience and the context based on the interaction with other crickets. Such a behavior selection mechanism with a tiny brain is a typical example to understand the adaptability of animals. Behavior observations in such interaction experiment sometime impose a burden on the experimenter. Therefore, in our previous works, we reported the development of a visual tracking method for two agents. However, it only tracked the positions of the agents. In this paper, utilizing our method, we also develop an image-processing algorithm for simultaneous pose estimation based on visual features related to the head part of each agent. We conducted estimation experiments based on video recordings of cricket-robot interactions and confirmed that our proposed method could estimate the pose of both agents. This method will help to efficiently analyze behavioral data during interaction experiments.Keywords: pose estimation, interaction behavior experiments, image processing, micro mobile robot, mobiligence
IntroductionThe results of the biological research often provide valuable and indispensable knowledge of how animals behave adaptively in real-time. They not only show the animals' flexibility, but also suggest how to design artifacts with adaptive functions. From this viewpoint, new biological findings are having a major impact on society. The ordinary biological approach usually involves the analysis of target animals and the behaviors at each organizational level of biological systems. Recently, a new trend in biological approaches has emerged that involves agent-based behavior experiments such as the introduction of an artificial agent into behavioral experimental setup. In contrast to ordinary biological experiments, this approach is novel in that experimental conditions are set and adjusted by operating the artificial agent such as a mobile robot. This kind of methodology has attracted attention in the field of experimental biology, as noted in a previous report on [1]. Behavioral experiments utilizing artificial agent are expected to provide new biological knowledge. To achieve this, experiments have to be conducted while sustaining objectivity and reproducibility. Such experiments can also contribute to a deeper understanding of the adaptive behavior selection mechanism of the cricket by expanding our approach to behavioral biology through the fusion of biology and engineering. Halloy et al. [2] conducted an experiment on the coexistence of cockroaches and autonomous micro mobile robots with a chemical substance on their cockroach-body surface. They showed that the number of individuals in a shelter affected the behavior of the cockroach group in an environment with no intervention of the operators. However, the interactions between individuals were controlled indirectly by adjusting the population density of i...