QRTEngine: An easy solution for running online reaction time experiments using Qualtrics

Barnhoorn, Jonathan; Haasnoot, Erwin; Bocanegra, Bruno R.; Steenbergen, Henk van

doi:10.3758/s13428-014-0530-7

Cited by 145 publications

(171 citation statements)

References 20 publications

Supporting

Mentioning

155

Contrasting

Order By: Relevance

“…Participants were randomly assigned to one of the two versions of the experiment. The experiment was created using version 15 of the Qualtrics Reaction Time Engine (QRTE; Barnhoorn, Haasnoot, Bocanegra, & Van Steenbergen, 2014). Due to Qualtrics updating their Survey Engine, QRTE version 15 stopped working after only 18 participants had been tested (8 in the standard version and 10 in the mixed version).…”

Section: Design and Proceduresmentioning

confidence: 99%

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

Poort

Rodd

2017

Acta Psychologica

View full text Add to dashboard Cite

Cognates share their form and meaning across languages: "winter" in English means the same as "winter" in Dutch. Research has shown that bilinguals process cognates more quickly than words that exist in one language only (e.g. "ant" in English). This finding is taken as strong evidence for the claim that bilinguals have one integrated lexicon and that lexical access is language nonselective. Two English lexical decision experiments with DutchEnglish bilinguals investigated whether the cognate facilitation effect is influenced by stimulus list composition. In Experiment 1, the 'standard' version, which included only cognates, English control words and regular nonwords, showed significant cognate facilitation (31 ms). In contrast, the 'mixed' version, which also included interlingual homographs, pseudohomophones (instead of regular non-words) and Dutchonly words, showed a significantly different profile: a non-significant disadvantage for the cognates (8 ms). Experiment 2 examined the specific impact of these three additional stimuli types and found that only the inclusion of Dutch words significantly reduced the cognate facilitation effect. Additional exploratory analyses revealed that, when the preceding trial was a Dutch word, cognates were recognised up to 50 ms more slowly than English controls. We suggest that when participants must respond 'no' to non-target language words, competition arises between the 'yes'-and 'no'-responses associated with the two interpretations of a cognate, which cancels out the facilitation that is a result of the cognate's shared form and meaning. We conclude that the cognate facilitation effect is a real effect that originates in the lexicon, but that cognates can be subject to competition effects outside the lexicon.

show abstract

Section: Design and Proceduresmentioning

confidence: 99%

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

Poort

Rodd

2017

Acta Psychologica

View full text Add to dashboard Cite

show abstract

“…Meaning, spelling and pronunciation similarity ratings were obtained through pre-tests and were given on a scale of 1 (not at all similar) to 7 (almost identical). Bocanegra, & Van Steenbergen, 2014). Due to Qualtrics updating their Survey Engine, QRTE version 15 stopped working after only 18 participants had been tested (8 in the standard version and 10 in the mixed version).…”

Section: Design and Proceduresmentioning

confidence: 99%

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

Poort¹,

Rodd²

2017

Preprint

View full text Add to dashboard Cite

A B S T R A C TCognates share their form and meaning across languages: "winter" in English means the same as "winter" in Dutch. Research has shown that bilinguals process cognates more quickly than words that exist in one language only (e.g. "ant" in English). This finding is taken as strong evidence for the claim that bilinguals have one integrated lexicon and that lexical access is language non-selective. Two English lexical decision experiments with Dutch-English bilinguals investigated whether the cognate facilitation effect is influenced by stimulus list composition. In Experiment 1, the 'standard' version, which included only cognates, English control words and regular non-words, showed significant cognate facilitation (31 ms). In contrast, the 'mixed' version, which also included interlingual homographs, pseudohomophones (instead of regular non-words) and Dutch-only words, showed a significantly different profile: a non-significant disadvantage for the cognates (8 ms). Experiment 2 examined the specific impact of these three additional stimuli types and found that only the inclusion of Dutch words significantly reduced the cognate facilitation effect. Additional exploratory analyses revealed that, when the preceding trial was a Dutch word, cognates were recognised up to 50 ms more slowly than English controls. We suggest that when participants must respond 'no' to non-target language words, competition arises between the 'yes'-and 'no'-responses associated with the two interpretations of a cognate, which (partially) cancels out the facilitation that is a result of the cognate's shared form and meaning. We conclude that the cognate facilitation effect is a real effect that originates in the lexicon, but that cognates can be subject to competition effects outside the lexicon. PsychINFO classification code (Cognitive Processes)

show abstract

“…Indeed, this is how the authors of QRTEngine, an online experiment generator and delivery system (Barnhoorn, Haasnoot, Bocanegra & Steenbergen, 2014), validated its efficacy rather than using external chronometry to check presentation and response timings. In no other field of science would this be viewed as acceptable.…”

mentioning

confidence: 99%

“…Furthermore that they employ the correct methodology and technology for a given study: if they are intent on webdelivery they should fully understand the limitations of the specific technology they are using. For example, the webbased experiment generator QRTEngine may not offer reliable presentations or ISI's due to the need to contact the server and download and run scripts live on each trial (Barnhoorn, Haasnoot, Bocanegra & Steenbergen, 2014). Simply put, in this example reliability may decrease as server load increases and the same experiment run at different times, or days of the week, may yield different results.…”

mentioning

confidence: 99%

A reminder on millisecond timing accuracy and potential replication failure in computer-based psychology experiments: An open letter

Plant¹

2015

Behav Res

View full text Add to dashboard Cite

There is an ongoing 'replication crisis' across the field of psychology in which researchers, funders, and members of the public are questioning the results of some scientific studies and the validity of the data they are based upon. However, few have considered that a growing proportion of research in modern psychology is conducted using a computer. Could it simply be that the hardware and software, or experiment generator, being used to run the experiment itself be a cause of millisecond timing error and subsequent replication failure? This article serves as a reminder that millisecond timing accuracy in psychology studies remains an important issue and that care needs to be taken to ensure that studies can be replicated on current computer hardware and software.

show abstract

QRTEngine: An easy solution for running online reaction time experiments using Qualtrics

Cited by 145 publications

References 20 publications

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition

A reminder on millisecond timing accuracy and potential replication failure in computer-based psychology experiments: An open letter

Contact Info

Product

Resources

About