Portable Lumipen: Dynamic SAR in Your Hand

Miyashita, Leo; Yamazaki, Toshiaki; Uehara, Kenji; Watanabe, Yoshihiro; Ishikawa, Masatoshi

doi:10.1109/icme.2018.8486514

Cited by 11 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…When a target is spherical or can be regarded as a point, some DPM systems arrange a projector and camera in the optically same position with a splitter and use the target itself as a marker 6,7 since the 2D image coordinates of the target include enough information to fit a projection image to the target in this setup. When a target is a general rigid body, three or more retro-reflective markers are used [8][9][10] and derive the pose and position by solving a Perspective-n-Point (PnP) problem. 11,12 Besides, some DPM systems measure the 3D shape of a target and obtain the pose and position through a rigid-body registration method instead of markers and the PnP problem.…”

Section: Related Workmentioning

confidence: 99%

High-speed optical sensing of pose, position, and surface normal for dynamic projection mapping

Miyashita,

Ishikawa

2023

Automated Visual Inspection and Machine Vision V

View full text Add to dashboard Cite

In this paper, we propose a new optical system to simultaneously measure the pose, position, and surface normals of a target at high speed. In the computer vision field, it is a fundamental task to measure a motion of a target, and a high-speed motion measurement system has been researched for real-time applications. In most cases, a target is idealized as a rigid body, and the motion is described as 6-DoF pose and position. However, general objects are not entirely rigid, and a non-rigid motion component is significant in some applications. We focus on dynamic projection mapping as an application example and propose an integration system of rigid and non-rigid motion sensing. In order to measure the non-rigid motion, non-rigid registration between 3D point clouds is often used, but it requires high computation cost, especially in three-dimensional nearest neighbor searches. Then, we optically measure surface normal vectors of a target from 2D images as a non-rigid motion component. To achieve a high-speed and non-interference measurement, we introduce a 3-band infrared optical system and the lighting setup and evaluate the coupling efficiency by demonstrating the simultaneous measurement of a pose, position, and surface normals.

show abstract

Section: Related Workmentioning

confidence: 99%

High-speed optical sensing of pose, position, and surface normal for dynamic projection mapping

Miyashita,

Ishikawa

2023

Automated Visual Inspection and Machine Vision V

View full text Add to dashboard Cite

show abstract

“…Ladgraf et al [50] tested robotic models with different appearances and claimed that appearance was crucial for the acceptance of a robotic agent by real fish to study the social behavior of fish. We argue that dynamic projection mapping techniques [57,59] can be deployed to alter features of robotic stimuli. The projector can project different patterns on a robotic agent while maintaining the perspective of the real animal using real-time 3D tracking.…”

Section: Introducing New Concepts Of Xrmentioning

confidence: 99%

Animals in Virtual Environments

Naik

Bastien

Navab

et al. 2020

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

The core idea in an XR (VR/MR/AR) application is to digitally stimulate one or more sensory systems (e.g. visual, auditory, olfactory) of the human user in an interactive way to achieve an immersive experience. Since the early 2000s biologists have been using Virtual Environments (VE) to investigate the mechanisms of behavior in non-human animals including insects, fish, and mammals. VEs have become reliable tools for studying vision, cognition, and sensory-motor control in animals. In turn, the knowledge gained from studying such behaviors can be harnessed by researchers designing biologically inspired robots, smart sensors, and multi-agent artificial intelligence. VE for animals is becoming a widely used application of XR technology but such applications have not previously been reported in the technical literature related to XR. Biologists and computer scientists can benefit greatly from deepening interdisciplinary research in this emerging field and together we can develop new methods for conducting fundamental research in behavioral sciences and engineering. To support our argument we present this review which provides an overview of animal behavior experiments conducted in virtual environments.Index Terms-animal behavior, VR for animals, mechanism of behavior, interactive experiments, closed-loop

show abstract

Computational Imaging in Projection Mapping

Iwai¹

2019

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Portable Lumipen: Dynamic SAR in Your Hand

Cited by 11 publications

References 11 publications

High-speed optical sensing of pose, position, and surface normal for dynamic projection mapping

High-speed optical sensing of pose, position, and surface normal for dynamic projection mapping

Animals in Virtual Environments

Computational Imaging in Projection Mapping

Contact Info

Product

Resources

About