Untitled

Moir, Robert

doi:10.1023/a:1009961917752

Cited by 42 publications

(5 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The theory of permutation testing is old and well established. Methods papers have specifically recommended it for experimental work (Moir, 1998 ). And examples of the use of permutation testing in published work, while not common, are available to cite as precedent if needed.…”

Section: Permutation Tests For K = 2 Independent S...mentioning

confidence: 99%

“…The Pitman test uses more of the sample information and is more sensitive to differences between measured observations. In a Monte Carlo comparison of the Pitman test against Student’s t -test and the Mann–Whitney test, Moir ( 1998 ) finds the Pitman test to match or outperform the more familiar tests in most applications. 10 Where data are interval as measured (prices, auction revenues, market efficiencies), and where policy interest concerns the magnitudes of treatment effects, it is hard to justify passing over the Pitman test in favor of an alternative that is less sensitive to these aspects of the data.…”

Section: Permutation Tests For K = 2 Independent S...mentioning

confidence: 99%

“… 10 Specifically, Moir ( 1998 ) finds the Pitman test (in that paper referred to as the “ER means test”) to perform about as well as the t-test when the underlying distribution is close to normal and to outperform the t -test in some non-normal settings. The Mann–Whitney test underperformed both the Pitman test and t -test in most settings considered.…”

mentioning

confidence: 99%

See 2 more Smart Citations

Permutation tests for experimental data

Holt

Sullivan

2023

Exp Econ

View full text Add to dashboard Cite

This article surveys the use of nonparametric permutation tests for analyzing experimental data. The permutation approach, which involves randomizing or permuting features of the observed data, is a flexible way to draw statistical inferences in common experimental settings. It is particularly valuable when few independent observations are available, a frequent occurrence in controlled experiments in economics and other social sciences. The permutation method constitutes a comprehensive approach to statistical inference. In two-treatment testing, permutation concepts underlie popular rank-based tests, like the Wilcoxon and Mann–Whitney tests. But permutation reasoning is not limited to ordinal contexts. Analogous tests can be constructed from the permutation of measured observations—as opposed to rank-transformed observations—and we argue that these tests should often be preferred. Permutation tests can also be used with multiple treatments, with ordered hypothesized effects, and with complex data-structures, such as hypothesis testing in the presence of nuisance variables. Drawing examples from the experimental economics literature, we illustrate how permutation testing solves common challenges. Our aim is to help experimenters move beyond the handful of overused tests in play today and to instead see permutation testing as a flexible framework for statistical inference.

show abstract

Section: Permutation Tests For K = 2 Independent S...mentioning

confidence: 99%

Section: Permutation Tests For K = 2 Independent S...mentioning

confidence: 99%

See 1 more Smart Citation

Permutation tests for experimental data

Holt

Sullivan

2023

Exp Econ

View full text Add to dashboard Cite

show abstract

“…Permutation testing, a well-established theory, has been emphasized for its relevance in experimental work in the methodological literature [32]. Despite not being prevalent, published research utilizing permutation testing can be cited as the precedent.…”

Section: Permutation Testsmentioning

confidence: 99%

Advanced Mathematical Approaches in Psycholinguistic Data Analysis: A Methodological Insight

Castro,

Leiva,

Lourenço-Gomes

et al. 2023

Fractal Fract

View full text Add to dashboard Cite

In the evolving landscape of psycholinguistic research, this study addresses the inherent complexities of data through advanced analytical methodologies, including permutation tests, bootstrap confidence intervals, and fractile or quantile regression. The methodology and philosophy of our approach deeply resonate with fractal and fractional concepts. Responding to the skewed distributions of data, which are observed in metrics such as reading times, time-to-response, and time-to-submit, our analysis highlights the nuanced interplay between time-to-response and variables like lists, conditions, and plausibility. A particular focus is placed on the implausible sentence response times, showcasing the precision of our chosen methods. The study underscores the profound influence of individual variability, advocating for meticulous analytical rigor in handling intricate and complex datasets. Drawing inspiration from fractal and fractional mathematics, our findings emphasize the broader potential of sophisticated mathematical tools in contemporary research, setting a benchmark for future investigations in psycholinguistics and related disciplines.

show abstract

“…These sample sizes are calculated for simple t tests. Instead, we will apply permutation t tests, which have much higher power and allow for valid inference for as few as eight observations per category (Moir, 1998;Schram et al 2019). We will base most of our (mean-comparison) tests on categories of 47 to 48 subjects; for others, some of the categories have N = 24.…”

Section: Participantsmentioning

confidence: 99%

Anticipating Peer Ranking Causes Hormonal Adaptations That Benefit Cognitive Performance

Dreu

Gërxhani

Schram

2021

American Behavioral Scientist

View full text Add to dashboard Cite

Performance ranking is common across a range of professional and recreational domains. Even when it has no economic consequences but does order people in terms of their social standing, anticipating such performance ranking may affect how people feel and perform. We examined this possibility by asking human subjects to execute a simple cognitive task while anticipating their performance being ranked by an outside evaluator. We measured baseline and postperformance levels of testosterone and cortisol. We find that (1) anticipating performance ranking reduces testosterone and increases cortisol, (2) both these hormonal responses benefit cognitive performance, which explains why (3) anticipation of being ranked by a peer increases cognitive performance.

show abstract

Untitled

Cited by 42 publications

References 0 publications

Permutation tests for experimental data

Permutation tests for experimental data

Advanced Mathematical Approaches in Psycholinguistic Data Analysis: A Methodological Insight

Anticipating Peer Ranking Causes Hormonal Adaptations That Benefit Cognitive Performance

Contact Info

Product

Resources

About