2019
DOI: 10.31234/osf.io/syp5a
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

Using Anchor-Based Methods to Determine the Smallest Effect Size of Interest

Abstract:

Effect sizes are an important outcome of quantitative research, but few guidelines exist that explain how researchers can determine which effect sizes are meaningful. Psychologists often want to study effects that are large enough to make a difference to people’s subjective experience. Thus, subjective experience is one way to gauge meaningfulness of an effect. We illustrate how to quantify the minimum subjectively experienced difference—the smallest change in an outcome measure that individuals consider to… Show more

Help me understand this report
View published versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

2
53
0
2

Year Published

2019
2019
2022
2022

Publication Types

Select...
5
4

Relationship

0
9

Authors

Journals

citations
Cited by 46 publications
(57 citation statements)
references
References 59 publications
2
53
0
2
Order By: Relevance
“…Interpretation of the size of the effect on the manipulation check can be particularly useful. Such interpretation can (and should) go beyond simple use of benchmarks for effect sizes (e.g., Cohen, 1988) and ideally should be grounded in substantive reasoning about the meaningfulness of effects (see, e.g., Anvari & Lakens, 2019). Consider, for example, a manipulation designed to increase anger.…”
Section: Use and Interpretationmentioning
confidence: 99%
“…Interpretation of the size of the effect on the manipulation check can be particularly useful. Such interpretation can (and should) go beyond simple use of benchmarks for effect sizes (e.g., Cohen, 1988) and ideally should be grounded in substantive reasoning about the meaningfulness of effects (see, e.g., Anvari & Lakens, 2019). Consider, for example, a manipulation designed to increase anger.…”
Section: Use and Interpretationmentioning
confidence: 99%
“…[4] the SESOI cannot be rejected, but the effect is not significant using NHST: not statistically equivalent and not significantly different. Figure 2 be appropriate for their research (see Anvari & Lakens, 2019;Lakens et al, 2018). Each of the outcomes presented in Figure 2 is more informative than using NHST alone, and outcome 4 may be of particular interest in the context of replication research.…”
Section: Equivalence Testingmentioning
confidence: 99%
“…A norming study regresses a measure of activation of the muscles responsible for smiling against rated positive effect. Using the Anvari and Lakens (2019) finding that 0.3 Likert units on a 1-5 scale is appreciated by people as a noticeable change, the change in muscle activation corresponding to a change of 0.3 units of rated affect can be read off from the raw regression line. This change in muscle activation may be taken as a minimally interesting effect in that it would correspond to a change in positive affect the client appreciated as a change.…”
Section: Figurementioning
confidence: 99%