An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments

Eichstaedt, Jan

doi:10.3758/bf03195364

Cited by 40 publications

(38 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…When the IAT was successfully finished, the results were uploaded to the Web site. The JAVA applet used an inaccurate-timing filter (Eichstaedt, 2001) such that response time biases due to, for example, the parallel execution of other programs were minimal. Participants were prompted to reduce any sources of environmental disturbances during the study and asked to participate only if they had enough time and privacy.…”

Section: Method: Internet Iat Studymentioning

confidence: 99%

Single-Attribute Implicit Association Tests (SA-IAT) for the Assessment of Unipolar Constructs

Penke

Eichstaedt

Asendorpf

2006

Experimental Psychology

Self Cite

View full text Add to dashboard Cite

Abstract.A major problem with Implicit Association Tests (IATs) is that they require bipolar attributes (e.g., good-bad). Thus, IAT effects for an attribute category can be interpreted only relative to an opposite category. Problems arise if there is no clear opposite category; in this case, a neutral category can be used, although it induces systematic error variance and thus reduces validity. The present study suggests that this problem can be solved using single-attribute IATs (SA-IATs). Sociosexuality (the tendency to engage in uncommitted sex) was expected to be related at the implicit level to stronger stranger-sex associations relative to partner-sex associations. An IAT was constructed that used conversation as a neutral attribute; it showed satisfactory reliability but only low correlations with explicit sociosexuality. An alternative SA-IAT with sex as the only attribute showed a similar reliability but higher correlations with explicit sociosexuality.

show abstract

Section: Method: Internet Iat Studymentioning

confidence: 99%

Single-Attribute Implicit Association Tests (SA-IAT) for the Assessment of Unipolar Constructs

Penke

Eichstaedt

Asendorpf

2006

Experimental Psychology

Self Cite

View full text Add to dashboard Cite

show abstract

“…In order to reduce the effect of the diverse hardware and software used by participants, previous work has relied on platform independent client-side technology to deliver web experiments, in particular Flash (Reimers & Stewart, 2007) and Java (Eichstaedt, 2001). This approach can be expected to give the experimenter an increased amount of control over stimulus timing and response time measurements.…”

Section: Introductionmentioning

confidence: 99%

Timing accuracy of Web experiments: A case study using the WebExp software package

Keller

Gunasekharan

Mayo

et al. 2009

Behavior Research Methods

View full text Add to dashboard Cite

Although internet-based experiments are gaining in popularity, most studies rely on directly evaluating participants' responses, rather than reaction times. Here we present two experiments which demonstrate the feasibility of collecting response latency data over the world-wide web, using WebExp, a software package designed to run psychological experiments over the internet. Experiment 1 uses WebExp to collect measurements for known time intervals (generated using keyboard repetition). The resulting measurements are found to be accurate across platforms and load conditions. In Experiment 2, we use WebExp to replicate a lab-based selfpaced reading study from the psycholinguistic literature. The data of the web-based replication correlate significantly with the data of the original study and show the same main effects and interactions. We conclude that WebExp can be used to obtain reliable reaction time data, at least for the self-paced reading paradigm.

show abstract

“…That is, some technologies that are suitable for reaction time measurement-such as JAVA applets (Hecht, Oesker, Kaiser, Civelek, & Stecker, 1999) or Adobe Flash (Linnman et al, 2006;Reimers & Stewart, 2007-require special software or plugins that may not be available to all potential participants, and more problematically yet, their availability may vary systematically with the characteristics of the users, thus creating potential confounds (Reips & Krantz, 2010). Also, some technologies have been shown to provide inaccurate timing if no countermeasures are taken (Eichstaedt, 2001). The most widely applicable technology (in terms of availability on client machines) offering millisecond resolution is JavaScript (de Leeuw, 2015;Reips & Krantz, 2010).…”

mentioning

confidence: 99%

Reaction time effects in lab- versus Web-based research: Experimental evidence

2015

View full text Add to dashboard Cite

Although Web-based research is now commonplace, it continues to spur skepticism from reviewers and editors, especially whenever reaction times are of primary interest. Such persistent preconceptions are based on arguments referring to increased variation, the limits of certain software and technologies, and a noteworthy lack of comparisons (between Web and lab) in fully randomized experiments. To provide a critical test, participants were randomly assigned to complete a lexical decision task either (a) in the lab using standard experimental software (E-Prime), (b) in the lab using a browser-based version (written in HTML and JavaScript), or (c) via the Web using the same browser-based version. The classical word frequency effect was typical in size and corresponded to a very large effect in all three conditions. There was no indication that the Web-or browser-based data collection was in any way inferior. In fact, if anything, a larger effect was obtained in the browser-based conditions than in the condition relying on standard experimental software. No differences between Web and lab (within the browser-based conditions) could be observed, thus disconfirming any substantial influence of increased technical or situational variation. In summary, the present experiment contradicts the still common preconception that reaction time effects of only a few hundred milliseconds cannot be detected in Web experiments.Keywords Web . Internet . Response latency . Reaction time . Word frequency effect Over the past two decades, research conducted online via the Internet has become increasingly frequent. Today, Web-based research is common across the whole range of social and behavioral sciences. This trend is not surprising, given the well-documented advantages of Web-based research, especially the possibility to recruit large, heterogeneous (and more representative) samples in less time and with lower costs than in traditional lab-or paper/pencil-based research (for overviews, see

show abstract

An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments

Cited by 40 publications

References 14 publications

Single-Attribute Implicit Association Tests (SA-IAT) for the Assessment of Unipolar Constructs

Single-Attribute Implicit Association Tests (SA-IAT) for the Assessment of Unipolar Constructs

Timing accuracy of Web experiments: A case study using the WebExp software package

Reaction time effects in lab- versus Web-based research: Experimental evidence

Contact Info

Product

Resources

About