Who Takes What: Using RGB-D Camera and Inertial Sensor for Unmanned Monitor

Kao, Hsin-Wei; Ke, Ting-Yuan; Lin, Kate Ching-Ju; Tseng, Yu–Chee

doi:10.1109/icra.2019.8793858

Cited by 2 publications

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Reference [ 20 ] uses a depth camera to extract skeletons and pair them with the Inertial Measurement Unit (IMU) devices carried by users. Fusion-based human and object tracking is shown in [ 21 ]. In [ 22 ], they use a camera to capture human motion by OpenPose [ 3 ] and match the motion with an IMU device to address ID association.…”

Section: Related Workmentioning

confidence: 99%

The Device–Object Pairing Problem: Matching IoT Devices with Video Objects in a Multi-Camera Environment

Tong

Tseng

2021

Sensors

Self Cite

View full text Add to dashboard Cite

IoT technologies enable millions of devices to transmit their sensor data to the external world. The device–object pairing problem arises when a group of Internet of Things is concurrently tracked by cameras and sensors. While cameras view these things as visual “objects”, these things which are equipped with “sensing devices” also continuously report their status. The challenge is that when visualizing these things on videos, their status needs to be placed properly on the screen. This requires correctly pairing visual objects with their sensing devices. There are many real-life examples. Recognizing a vehicle in videos does not imply that we can read its pedometer and fuel meter inside. Recognizing a pet on screen does not mean that we can correctly read its necklace data. In more critical ICU environments, visualizing all patients and showing their physiological signals on screen would greatly relieve nurses’ burdens. The barrier behind this is that the camera may see an object but not be able to see its carried device, not to mention its sensor readings. This paper addresses the device–object pairing problem and presents a multi-camera, multi-IoT device system that enables visualizing a group of people together with their wearable devices’ data and demonstrating the ability to recover the missing bounding box.

show abstract