Situated Analytics: Demonstrating immersive analytical tools with Augmented Reality

ElSayed, Neven A. M.; Thomas, Bruce H.; Marriott, Kim; Piantadosi, Julia; Smith, Ross

doi:10.1016/j.jvlc.2016.07.006

Cited by 84 publications

(50 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With these advantages, the display of product-related information or services can be achieved. For example, supporting consumers in finding the healthiest product within a shelf while remaining hands-free by simply viewing through a mixed-reality headset, as suggested by El Sayed [7] and Microsoft [16]. Also, inventory analysis could become more effective and efficient via automated robots or employees wearing head-sets that allow for detection of misplaced items, false labels or any other deviation from the current planogram.…”

Section: Motivationmentioning

confidence: 99%

Towards Identification of Packaged Products via Computer Vision

Fuchs

Grundmann

Fleisch

2019

Proceedings of the 9th International Conference on the Internet of Things

View full text Add to dashboard Cite

Identification of packaged products in retail environments still relies on barcodes, requiring active user input and limited to one product at a time. Computer vision (CV) has already enabled many applications, but has so far been under-discussed in the retail domain, albeit allowing for faster, hands-free, more natural humanobject interaction (e.g. via mixed reality headsets). To assess the potential of current convolutional neural network (CNN) architectures to reliably identify packaged products within a retail environment, we created and open-source a dataset of 300 images of vending machines with 15k labeled instances of 90 products. We assessed observed accuracies from transfer learning for imagebased product classification (IC) and multi-product object detection (OD) on multiple CNN architectures, and the number of images instances required per product to achieve meaningful predictions. Results show that as little as six images are enough for 90% IC accuracy, but around 30 images are needed for 95% IC accuracy. For simultaneous OD, 42 instances per product are necessary and far more than 100 instances to produce robust results. Thus, this study demonstrates that even in realistic, fast-paced retail environments, image-based product identification provides an alternative to barcodes, especially for use-cases that do not require perfect 100% accuracy.

show abstract

Section: Motivationmentioning

confidence: 99%

Towards Identification of Packaged Products via Computer Vision

Fuchs

Grundmann

Fleisch

2019

Proceedings of the 9th International Conference on the Internet of Things

View full text Add to dashboard Cite

show abstract

“…These two quantities have the following meaning: Equation (9) measures the presence of long runs and Equation (10) measures the presence of many small runs. Equation (9) and Equation (10) are normalized in the [0 . .…”

Section: Ridge Reconstructionmentioning

confidence: 99%

“…Another classical example is that of sequence alignment. Generally-speaking, computer vision applications are emerging trends for such a context, and, recently, the research community has devoted a lot of attention to this topic (e.g., [2,3,4,5,6,7,8,9,10,11]). DP has been applied to various tasks in pattern recognition and computer vision [12,13].…”

Section: Introductionmentioning

confidence: 99%

An effective and efficient approximate two-dimensional dynamic programming algorithm for supporting advanced computer vision applications

Cuzzocrea

Mumolo

Grasso

et al. 2017

Journal of Visual Languages & Computing

View full text Add to dashboard Cite

Dynamic programming is a popular optimization technique, developed in the 60's and still widely used today in several fields for its ability to find global optimum. Dynamic Programming Algorithms (DPAs) can be developed in many dimension. However, it is known that if the DPA dimension is greater or equal to two, the algorithm is an NP complete problem. In this paper we present an approximation of the fully two-dimensional DPA (2D-DPA) with polynomial complexity. Then, we describe an implementation of the algorithm on a recent parallel device based on CUDA architecture. We show that our parallel implementation presents a speed-up of about 25 with respect to a sequential implementation on an Intel I7 CPU. In particular, our system allows a speed of about ten 2D-DPA executions per second for 85 × 85 pixels images. Experiments and case studies support our thesis.

show abstract

“…Microsoft Hololens, Meta2 and Magic Leap, we can expect to see geographic visualisations such as OD flow maps used in mixed-reality (MR) applications. Such applications include situated analytics [20] • Yalong Yang is with Monash University and Data61, CSIRO where visualisations can be made available in almost any environment such as in the field, surgery or factory floor, and collaborative visualisation scenarios, where two or more people wearing HMDs can each see and interact with visualisations while still seeing each other [12].…”

Section: Introductionmentioning

confidence: 99%

Origin-Destination Flow Maps in Immersive Environments

Yang

Dwyer

Jenny

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Immersive virtual- and augmented-reality headsets can overlay a flat image against any surface or hang virtual objects in the space around the user. The technology is rapidly improving and may, in the long term, replace traditional flat panel displays in many situations. When displays are no longer intrinsically flat, how should we use the space around the user for abstract data visualisation? In this paper, we ask this question with respect to origin-destination flow data in a global geographic context. We report on the findings of three studies exploring different spatial encodings for flow maps. The first experiment focuses on different 2D and 3D encodings for flows on flat maps. We find that participants are significantly more accurate with raised flow paths whose height is proportional to flow distance but fastest with traditional straight line 2D flows. In our second and third experiment we compared flat maps, 3D globes and a novel interactive design we call MapsLink, involving a pair of linked flat maps. We find that participants took significantly more time with MapsLink than other flow maps while the 3D globe with raised flows was the fastest, most accurate, and most preferred method. Our work suggests that careful use of the third spatial dimension can resolve visual clutter in complex flow maps.

show abstract

Situated Analytics: Demonstrating immersive analytical tools with Augmented Reality

Cited by 84 publications

References 31 publications

Towards Identification of Packaged Products via Computer Vision

Towards Identification of Packaged Products via Computer Vision

An effective and efficient approximate two-dimensional dynamic programming algorithm for supporting advanced computer vision applications

Origin-Destination Flow Maps in Immersive Environments

Contact Info

Product

Resources

About