Designing for perceptual crossing

Abstract

Perceptual crossing is the reciprocal interplay of perceiving while being perceived. In this paper we discuss the last iteration of our ongoing research project on designing for perceptive qualities in systems of interactive products. We describe the design of explorative behavior in an artifact to enable the artifact and a person to engage in perceptual crossing. The explorative behavior is compared to the following and active behavior, the results of two earlier iterations. Through the iterations we formulated, applied and evaluated design relevant knowledge in the form of seven design notions. These notions inform designresearchers and design-practitioners on how to design for perceptive qualities in systems of interactive products. Here we specifically focus on how the artifact detects active perceptive behavior of a person, and how the artifact becomes aware of bygone perception and anticipates on future perception. An experiment shows how participants preferred the resulting explorative behavior that is closest to our theoretical framework based on phenomenology.

Design Vocabulary for Human--IoT Systems Communication

“…In our study, we identified five social vocabulary items ("Greeting, Hello, Thanks, Welcome, I see you seeing me") that were absent from Amazon Echo and Google Home. As the interactive device developed in [11] demonstrated, such social feedbacks could increase users' understanding and engagement.…”

“…The other interesting term I see you seeing me was mainly found in the human-robot interaction in Film #6 (e.g., 2:18-2:22). These designs help build perceptual crossing and engage users' involvement [11]. By utilizing this social vocabulary, designers can improve the design qualities of user-system interactions.…”

“…One possible approach is to imitate human behaviors in the artifact. For instance, Deckers et al [11], developed the PeP+, which simulated eye contact behavior ("I see you seeing me") to acknowledge the user's presence. It was found that this perceptive interaction not only facilitated users' engagement, but also expressed the device's intentionality and autonomy.…”

Using Shape-Change to Express Dynamic Affordances of Intelligent Systems

“…Such a lack of a prompt, or feedforward, represents a total decoupling of actions and functions. Deckers et al [10] proposed the concept of perceptual crossing to show the system's "face" and let users know their approach is acknowledged: a reciprocal interplay of perceiving while being perceived. With perceptual crossing, users can not only recognize the possibility to initiate interactions with machines but also engage in a more continuous way with something akin to an artificial living creature.…”