Messages as replications: Toward a message‐centered design strategy

English words and phrases in Dutch job advertisements

“…Jackson, O'Keefe, Jacobs, & Brashers, 1989), three different job ads were used in the experiment: one for a shop assistant, one for a porter, and one for a machine operator. There were two versions of each of the ads, one which was completely in Dutch, and one which contained a number of English words and phrases.…”

Statistical testing in treatment by replication designs: Three options reconsidered

“…As for the objections to the quasi F tests recommended by Clark, these tests do not figure among the choices confronted in treatment by replication designs, but if they did, it might be worth knowing that subsequent work has shown concerns about these tests to be grossly overblown (see, for example, Santa, Miller, & Shaw, 1979). Readers interested in keeping up-to-date on the language-as-fixed-effect fallacy, both pro and con, are advised to consult additional work by Coleman (1964Coleman ( ,1979, Fontanelle, Phillips, and Lane (1985), Forster and Dickinson (1976), Hunter, Hamilton, and Allen (1989), Jackson, O'Keefe, and Jacobs (1988), Jackson, O'Keefe, Jacobs, and Brashers (1989), Morley (1988), Richter and Seay (1987), Santa, Miller, and Shaw (1979), Slater (1991), Wickens and Keppel (1983), and Wike and Church (1976). 5 Subscripts denote effects as follows: "T" is treatments, "M" is messages, "T x M" is Treatment x Message interaction, "S/T" is subjects within treatments, and "S/TM" is subjects within Treatment x Message cells.…”

“…We will focus this review of the literature on studies that either report explicit tests of the Treatment x Message interaction or give other comparable evidence of uniformity or nonuniformity of effect. Jackson, O'Keefe, Jacobs, and Brashers (1989) pointed to seven studies reporting significant Treatment x Message interactions (Bradac, & Mulac, 1984, study 1;Doelger, Hewes, & Graham, 1986;Hample & Dallinger, 1987;Housel, 1985;Rogers & Mewborn, 1976;Tracy, 1982, experiment 2;and Tracy, 1983). Significant effects involving replications have since been reported by Zahn (1989) and by Villaume, Jackson, and Schouten (1989), and possibly others that we haven't noticed.…”

“…This is not the same as having data on the variability of effect sizes from message to message or from replication to replication, but if each experiment uses a different individual message or other replicate (not usually the case in the social influence literature), study to study variability could be said to "contain" message to message variability. We will set aside issues related to the appropriateness of interpreting study to study variability as containing message to message variability for now, but interested readers are referred to the discussion of this issue offered by Jackson, O'Keefe, Jacobs, and Brashers (1989).…”

“…Apparently, Burgoon, Hall, and Pfau see replications as desirable, but not essential, to well-designed message effects research. As our purpose is to discuss what to do with replications once they have been included, we will not extend the argument for within-study replications, but refer interested readers to the directly-relevant colloquy between Hunter, Hamilton, and Allen (1989) and Jackson, O'Keefe, Jacobs, and Brashers (1989). 3 In an unreplicated treatment comparison, the question of how to treat the replications does not arise, as there is no replications factor.…”