The Effects of Different Presentation Modalities on a Person Identification Task: A Study of Wireless Multimedia PDA Use in a Security Context

Abstract

The convergence of affordable multimedia capabilities with local and wide area wireless data networking on handheld devices is a particularly important trend. Using off-the-shelf technology, we conducted a simple experiment that required participants to engage in a person-identification task while posing as security agents in a field setting. Participants attempted to identify a target person in a public setting under different conditions with or without the aid of video information distributed to them via wireless-enabled multimedia PDAs. We developed a research framework and expectations based on previous research in the areas of the dual processing theory of working memory, information richness theory, and the role of video in grounding. Our findings suggest that dual modes of presentation (i.e., phonological and visuospatial information) simultaneously incorporated by a specific presentation significantly influence user perception and enhance task performance.

Communicating across age-groups: variance in consumer attitudes from tweenagers to adults

“…In research on communication cues, the differential impact of pictorial vs informative stimuli has been highlighted. Pictures are encoded as imaginary codes in the memory, whereas words are represented as verbal codes, resulting in differential impact on attitudes (Kim et al, 2009;Paivio, 2007Paivio, , 1971. The use of pictures/visual content has been shown to enhance advertisement and brand attitudes (Rossiter and Percy, 1997;Bone and Ellen, 1992;Mitchell, 1986;Mitchell and Olson, 1981), and the impact of visual cues, like models, graphics, caricatures and characters, on consumer responses to advertisements has also been demonstrated (Chevalier and Lichtlé, 2012;Bridges and Briesch, 2006;Day and Stafford, 1997;Callcott and Lee, 1994;Barcus, 1980).…”

Young audiences’ emotional experience on smartphone film: an application of dual-coding theory

“…Dual-coding theory, a framework developed by Paivio (1971), illustrates how text is represented in memory. According to this theory, two coding systems exist in memory: imagery coding and proposition (verbal) coding (Kim et al, 2009). These two systems are assumed to be composed of internal representational units, imagery coding and proposition (verbal) coding that are activated when one recognizes, manipulates or just thinks about words or things (Paivio, 1971).…”

“…In contrast, proposition coding is verbal coding that is used to symbolize the knowledge representation of an object. People use both coding systems simultaneously to transform text-based information into knowledge that can be manipulated, stored and acquired later, although one coding system may be more dominant or may kick in more quickly than the other (Kim et al, 2009;Sternberg, 2009). Imagery coding can be a sporadic process involving imagination, contrary information processing or analogous information processing.…”