Coupling AR with Object Detection Neural Networks for End-User Engagement

Katika, Konstantina; Bolierakis, Spyridon Nektarios; Vasilopoulos, Emmanuel; Αντωνόπουλος, Μάρκος; Tsimiklis, Georgios; Karaseitanidis, Ioannis; Amditis, Angelos

doi:10.1007/978-3-031-16234-3_8

Cited by 5 publications

(5 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The marker-based function requires a marker (QR) to activate an augmentation related to 2D or 3D items. Finally, the object detection AR functionality is a dynamic augmentation process based on trained Deep Learning Models that enable a more robust interaction with the environment [16].…”

Section: Methodsmentioning

confidence: 99%

“…The campaigns are later enhanced with various gamification aspects before being visualized by the mobile application end-users. The platform and the two components have been presented by Katika et al, [1] and [16]. The virtual agent (ARis) is present in most functionalities and offers helpful tips and comments upon execution.…”

Section: System Designmentioning

confidence: 99%

“…The app allows profile editing through the selection of an avatar and a username. As the end-users read their mission, they can go through a demo campaign that offers a guide on how to use all the features, including the selection of content, navigation to the nearest AR experience, interaction with the environment through the camera and object manipulation, object recognition, and the gamification and educative features [1,16]. Later, a map is available for exploration, as shown in Figure 3.…”

Section: System Modelmentioning

confidence: 99%

“…The user then can interact with their environment through different means. Figure 4 describes the options for enabling an AR experience through object detection, GPS activation, and QR scanning [16]. Upon enabling an AR experience through their smartphone's camera, the app gives access to digital content that can be manipulated using finger touches and gestures.…”

Section: System Modelmentioning

confidence: 99%

“…The software specifications have been described in Katika et al, [1]. The object detection algorithm has been described by Katika et al, [16]. For the treasure hunt game addressed to end-users, low-poly 3D models (three dimensional assets with few design polygons that are easier to visualize through smartphone AR technology) were designed to ensure real-time fast rendering, as shown in Figure 7.…”

Section: Development In Armentioning

confidence: 99%

See 4 more Smart Citations

AR Coupled With a Virtual Agent for Educating Towards a Sus-Tainable Way of Living

Katika¹,

Bolierakis²,

Papaioannou³

et al. 2023

Preprint

View full text Add to dashboard Cite

Augmented reality (AR) offers an accessible, inexpensive, and rich user experience that has the potential to engage end-users in an immersive environment. Along with vivid visualizations coupled with virtual agents, this technology further develops learning interest in end-users, guides them in various tasks, and boosts motivation and productivity. In this study, we leverage the deep penetration of mobile phones in daily lives and their advanced features to design, develop and demonstrate an AR application (CirculAR) that offers unique user-environment interaction in a gamified way. CirculAR combines learning with enjoyment to help end-users understand fundamental sustainability and circular economy principles. The application has been showcased in a controlled environment to heterogenous audiences and has been shown to improve end-user engagement and motivation. First, participants older than 18 were recruited to showcase the technology acceptance and engagement towards circular economy principles through AR. Then, students aged 5 to 15 years old, along with their parents and educators, were invited to a treasure hunt game where our virtual agent ARis guided them through a map full of virtual experiences. Assessment and evaluation were performed through a survey and a questionnaire. The outcome of their analysis showcased an increase in the dedication and enjoyment of the performed activities, engagement and learning attributes given the AR virtual agent supporting functionalities. Observations during showcasing reported a need for more commitment from the younger audience compared to the older one. This application contributes to the discourse on mobile AR as a tool for the education of novel concepts with a high impact on our daily lives and decisions and aims to shed light on the design principles of educative tools.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: System Designmentioning

confidence: 99%

Section: System Modelmentioning

confidence: 99%

Section: System Modelmentioning

confidence: 99%

Section: Development In Armentioning

confidence: 99%

See 3 more Smart Citations