Mixed reality cyber-physical systems control and workflow composition

Seiger, Ronny; Korzetz, Mandy; Gohlke, Maria; Aßmann, Uwe

doi:10.1145/3152832.3157808

Cited by 4 publications

(4 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Users are able to put devices in their physical context and directly correlate them with others in the form of simple IoT processes without requiring deep IoT, process modelling or programming knowledge. Based on a preliminary study [89] and previous experience with MR applications [69], we designed and performed a user study to evaluate the HoloFlows approach including the process modelling notation and MR user interface artefacts. We let end-users model the same three exemplary IoT processes introduced in Sect.…”

Section: Discussionmentioning

confidence: 99%

“…We then demonstrate both artefacts via example IoT processes created following the HoloFlows approach. In the last part, we elaborate on the operation of and process execution in the HoloFlows application [89].…”

Section: Holoflows: Mixed Reality-based Iot Process Modellingmentioning

confidence: 99%

“…The aim of our user study was to answer the following questions that arose from the literature and a preliminary study [89] to evaluate the suitability of the three approaches for end-user development of IoT processes:…”

Section: End-user Study Setupmentioning

confidence: 99%

See 2 more Smart Citations

HoloFlows: modelling of processes for the Internet of Things in mixed reality

et al. 2021

Self Cite

View full text Add to dashboard Cite

Our everyday lives are increasingly pervaded by digital assistants and smart devices forming the Internet of Things (IoT). While user interfaces to directly monitor and control individual IoT devices are becoming more sophisticated and end-user friendly, applications to connect standalone IoT devices and create more complex IoT processes for automating and assisting users with repetitive tasks still require a high level of technical expertise and programming knowledge. Related approaches for process modelling in IoT mostly suggest extensions to complex modelling languages, require high levels of abstraction and technical knowledge, and rely on unintuitive tools. We present a novel approach for end-user oriented-no-code-IoT process modelling using Mixed Reality (MR) technology: HoloFlows. Users are able to explore the IoT environment and model processes among sensors and actuators as first-class citizens by simply “drawing” virtual wires among physical IoT devices. MR technology hereby facilitates the understanding of the physical contexts and relations among the IoT devices and provides a new and more intuitive way of modelling IoT processes. The results of a user study comparing HoloFlows with classical modelling approaches show an increased user experience and decrease in required modelling knowledge and technical expertise to create IoT processes.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Holoflows: Mixed Reality-based Iot Process Modellingmentioning

confidence: 99%

See 1 more Smart Citation

HoloFlows: modelling of processes for the Internet of Things in mixed reality

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Figure: [263] -Household Task authoring home automation [53,111,135,163,177,191,212,228,263,327,365,387,480], item movement and delivery [76,108,209,265], displaying cartoon-art while sweeping [481], multi-purpose table [430] Photography drone photography [114,171], Advertisement mid-air advertisement [317,382,418,475] Wearable Interactive Devices haptic interaction [443], fog screens [418], head-worn projector for sharable AR scenes [168] Assistance and companionship elder care [65], personal assistant [239,367,368] Tour and exhibition guide tour guide [58,295], museum exhibition guide [168,368], guiding crowds [475], indoor building guide [89], museum interactive display [112] Industry 166 Figure: [21] -Manufacturing and Assembly joint assembly and manufacturing [21, 30, 43, 44, 80, 138-140, 161, 194, 231, 274, 283, 289, 297, 327, 366, 376, 396, 397, 410, 435, 454, 456, 493], grasping and manipulation [24-27, ...…”

Section: Domestic and Everyday Use 35mentioning

confidence: 99%