ArcIoT: Enabling Intuitive Device Control in the Internet of Things through Augmented Reality

Hua, Jie; Lee, Sangsu; Roman, Gruia-Catalin; Julien, Christine

doi:10.1109/percomworkshops51409.2021.9431115

Cited by 4 publications

(5 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…FTs use the situated visualisation as an entry point to interact with all systems that are connected to that particular point in the PT to provide access to the whole PT through the DT. In contrast, many situated visualisations focus on local applications such as smart switches for IoT devices [364]. However, at first sight, the situated visualisation is often indistinguishable from FTs for end users.…”

Section: The Fused Twins Conceptmentioning

confidence: 99%

“…Because the combination of technologies is only emergent now, most published material towards this end is either a prototype [17,101,364,425,426] or a proposal for future research directions [427][428][429][430]. The main reason is that applying AR on top of the already complex combination of SO, IoT, remote sensing, and DT stacks requires many software systems to run smoothly that are currently only being prototyped.…”

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

“…The fusion of the the digital representation and the physical entity lies at the core of the FTs paradigm [17] but also of the more general Situated Analytics [19]. Interestingly, other research on the topic of Situated Analytics has often implemented FTs to some degree but without the explicit mentioning of the DT aspect [364,425,426]. A notable exception is the "Corsican Twins" [101] implementation of an FTs platform with an explicit DT powering the Situated Analytics.…”

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

“…Some of the research explicitly mentions the DT approach or a Situated Analytics approach but often simply uses the available technology to demonstrate that their problem can be addressed [428,430,431], implicitly developing a DT and applying Situated Analytics. [18] 2009 * -History [431] 2013 * --City Information (concept) [433] 2014 * * * * * Shopping [434] 2015 * * -IoT device interaction [425] 2016 -* City Information [435] 2016 * * -Shopping [436] 2018 * * - Smart Campus [437] 2018 Evacuation [438] 2018 * ---Medicine [439] 2018 --Facility Management [440] 2018 -Rehabilitation [441] 2019 * -IoT device visualisation [426] 2019 ---Seat Selection [442] 2020 * * -Equipment Maintenance [443] 2020 * --In situ visualisation [101] 2020 * * * Education [444] 2020 * Training & Assistance [445] 2020 * * -* Firefighting [430] 2021 ---General [17] 2021 * IoT device interaction [364] 2021 -General [100] 2022 * Note: * Partially implemented or insufficient information.…”

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

“…Many approaches are available, and they commonly identify features in the physical world that can be used as anchors for the virtual world. These location services are based on different technologies such as Bluetoothbased [364], image-marker-based [101], vision-based [17,425], or signal-based [426]. Consequently, it is possible to display content in the Virtual Environment as an overlay in physical world.…”

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

See 4 more Smart Citations

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

et al. 2022

View full text Add to dashboard Cite

Smart Cities already surround us, and yet they are still incomprehensibly far from directly impacting everyday life. While current Smart Cities are often inaccessible, the experience of everyday citizens may be enhanced with a combination of the emerging technologies Digital Twins (DTs) and Situated Analytics. DTs represent their Physical Twin (PT) in the real world via models, simulations, (remotely) sensed data, context awareness, and interactions. However, interaction requires appropriate interfaces to address the complexity of the city. Ultimately, leveraging the potential of Smart Cities requires going beyond assembling the DT to be comprehensive and accessible. Situated Analytics allows for the anchoring of city information in its spatial context. We advance the concept of embedding the DT into the PT through Situated Analytics to form Fused Twins (FTs). This fusion allows access to data in the location that it is generated in in an embodied context that can make the data more understandable. Prototypes of FTs are rapidly emerging from different domains, but Smart Cities represent the context with the most potential for FTs in the future. This paper reviews DTs, Situated Analytics, and Smart Cities as the foundations of FTs. Regarding DTs, we define five components (physical, data, analytical, virtual, and Connection Environments) that we relate to several cognates (i.e., similar but different terms) from existing literature. Regarding Situated Analytics, we review the effects of user embodiment on cognition and cognitive load. Finally, we classify existing partial examples of FTs from the literature and address their construction from Augmented Reality, Geographic Information Systems, Building/City Information Models, and DTs and provide an overview of future directions.

show abstract

Section: The Fused Twins Conceptmentioning

confidence: 99%

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

Section: The Analytical Environment Of the Digital Twin-models And Se...mentioning

confidence: 99%

See 3 more Smart Citations

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

et al. 2022

View full text Add to dashboard Cite

show abstract

The space broker

Adal¹,

Milhaupt²,

Hua

et al. 2021

Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

View full text Add to dashboard Cite

BLEselect

Zhang

Lan

et al. 2022

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Spontaneous selection of IoT devices from the head-mounted device is key for user-centered pervasive interaction. BLEselect enables users to select an unmodified Bluetooth 5.1 compatible IoT device by nodding at, pointing at, or drawing a circle in the air around it. We designed a compact antenna array that fits on a pair of smart glasses to estimate the Angle of Arrival (AoA) of IoT and wrist-worn devices' advertising signals. We then developed a sensing pipeline that supports all three selection gestures with lightweight machine learning models, which are trained in real-time for both hand gestures. Extensive characterizations and evaluations show that our system is accurate, natural, low-power, and privacy-preserving. Despite the small effective size of the antenna array, our system achieves a higher than 90% selection accuracy within a 3 meters distance in front of the user. In a user study that mimics real-life usage cases, the overall selection accuracy is 96.7% for a diverse set of 22 participants in terms of age, technology savviness, and body structures.

show abstract

ArcIoT: Enabling Intuitive Device Control in the Internet of Things through Augmented Reality

Cited by 4 publications

References 23 publications

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

The space broker

BLEselect

Contact Info

Product

Resources

About