Picture-word differences in decision latency: An analysis of single and dual memory models

Abstract

Semantic and perceptual size decision times for pictorial and verbal material were analyzed in the context of a unitary memory model and several dual memory models. Experiment 1 involved a same-different categorical judgment task. The results showed that picture-picture response latencies were 185 msec faster than the corresponding word-word latencies, and word-picture and picture-word latencies equaled the mean of these two extremes. Similarity of subcategory for "same" judgments led to faster decision latency for all presentation conditions. Additionally, a linear relationship was found between picture-picture and word-word latencies for individual item pairs. Experiment 2 involved a comparison of pictures and words across a categorical judgment and a size judgment task. Pictures produced faster decision latencies in both tasks, and the latency difference between pictures and words was comparable across tasks. These data fit the predictions of a unitary memory model. Several variants of a dual memory model are rejected and those which fit the data require assumptions about storage and/or transfer time values which result in a functional regression to the unitary memory model.

The picture superiority effect in a cross-modality recognition task

“…Extra assumptions concerning asymmetry of referential connections seem to be needed to explain the priming results in terms of dual-code theory. As discussed by Pellegrino et al (1977), the two types of models may be difficult to separate on empirical grounds alone. At their present stage of development, some aspects of the theories are insufficiently constrained, and additional assumptions may be needed to fit them to new data.…”

“…Common-code theories have drawn attention to observed differences in access to the semantic code from pictures and words (Carr et al, 1982;Glaser & Glaser, 1989;Nelson & Castano, 1984;Nelson et al, 1977;Pellegrino, Rosinski, Chiesi, & Siegel, 1977;Potter & Faulconer, 1975;Smith & Magee, 1980). Differential access is important to explain the memory results, because more processing at the semantic level can be expected to lead to better retention, especially when measured by direct memory tests.…”

Measuring icon complexity: An automated analysis

“…Pellegrino, Rosinski, Chiesi, and Siegel (1977) reported that when two objects belong to the same category, pictures depicting them are processed faster than words. Information is also conveyed more directly through the use of images; pictorial road signs are understood easily and accurately and are learned more easily than word signs (Walker, Nicolay, & Stearns, 1965).…”

Picture-word differences in a sentence verification task

“…The picture advantage seemed to be due to the nature of the input and how information is extracted from it. The findings are discussed within the context of text-processing theories (Glenberg & Langston, 1992;Larkin & Simon, 1987).Although format effects have been identified in previous research (Goolkasian & Park, 1980;Kroll & Corrigan, 1981;Pellegrino, Rosinski, Chiesi, & Siegel, 1977; Potter & Falconer, 1975; Smith & Magee, 1980), the results have varied with the kind of task, and there is a lingering debate regarding the nature of the representations that are developed from picture and word versions of stimuli. Dual-coding theory (Paivio, 1971(Paivio, , 1975(Paivio, , 1978 proposed separate but interconnected verbal and symbolic systems in which pictures have some processing advantage because they generate representations in both memory systems, whereas words have only verbal representations.…”