Meta-analytic Decisions and Reliability: A Serendipitous Case of Three Independent Telecommuting Meta-analyses

Nieminen, Levi R. G.; Nicklin, Jessica M.; McClure, Tara K.; Chakrabarti, Madhura

doi:10.1007/s10869-010-9185-2

Cited by 23 publications

(12 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We also acknowledge the boundaries by which we defined the inclusion criteria of both motivational constructs and endocrine-related responses may be subject to interpretation. Nonetheless, although researchers may differ in their methodological approach to systematic review, it is unlikely the results will be affected by significant divergence ( Nieminen, Nicklin, McClure, & Chakrabarti, 2011 ).…”

Section: Discussionmentioning

confidence: 99%

The Relationship Between Multidimensional Motivation and Endocrine-Related Responses: A Systematic Review

Steel

Bishop

Taylor

2021

Perspect Psychol Sci

View full text Add to dashboard Cite

Multidimensional motivational theories postulate that the type of motivation is as important as the quantity of motivation, with implications for human functioning and well-being. An extensive amount of research has explored how constructs contained within these theories relate to the activation of the endocrine system. However, research is fragmented across several theories, and determining the current state of the science is complicated. In line with contemporary trends for theoretical integration, this systematic review aims to evaluate the association between multidimensional motivational constructs and endocrine-related responses to determine which theories are commonly used and what inferences can be made. Forty-one studies were identified incorporating five distinct motivation theories and multiple endocrine-related responses. There was evidence across several theories that high-quality motivation attenuated the cortisol response in evaluative environments. There was also evidence that motivational needs for power and affiliation were associated with lower and higher levels of salivary immunoglobulin A, respectively. The need for power may play a role in increasing testosterone when winning a contest; however, this evidence was not conclusive. Overall, this review can shape the future integration of motivational theories by characterizing the nature of physiological responses to motivational processes and examining the implications for well-being.

show abstract

Section: Discussionmentioning

confidence: 99%

The Relationship Between Multidimensional Motivation and Endocrine-Related Responses: A Systematic Review

Steel

Bishop

Taylor

2021

Perspect Psychol Sci

View full text Add to dashboard Cite

show abstract

“…The rules by which the testing professionals categorize the work and jobs studied, the selection procedures used, the job performance criteria used, and other study characteristics that are hypothesized to impact the study results should be fully reported (Appelbaum et al, 2018;Aytug, Rothstein, Zhou, & Kern, 2012;Guion, 2011). Experts who meta-analyze the same domain of studies can reach somewhat different results and interpretations (see Nieminen, Nicklin, McClure, & Chakrabarti, 2011, who compare different experts' meta-analyses in a domain; see Van Iddekinge, Roth, Raymark, & Odle-Dusseau, 2012, who summarize an exchange on their meta-analysis in the integrity domain). Conversely, missing or unreported information relevant to a meta-analysis will compromise the quality and integrity of the results and, therefore, the inferences that can be made from them (e.g., when effect sizes are unobtainable from a testing professional, or when effect sizes are available, but critical study information may not be reported due to proprietary issues).…”

Section: Meta-analysismentioning

confidence: 99%

Principles for the Validation and Use of Personnel Selection Procedures

Tippins¹,

Sackett²,

Oswald³

2018

Ind. Organ. Psychol.

View full text Add to dashboard Cite

The Society for Industrial and Organizational Psychology (SIOP) is pleased to offer the fifth edition of the Principles for the Validation and Use of Personnel Selection Procedures, which was approved by the APA Council of Representatives in August 2018 as an authoritative guidelines document for employee selection testing and an official statement of the APA. Over a three-year period, the Principles Revision Committee updated this document from the fourth edition to be consistent with the 2014 Standards for Educational and Psychological Testing, invited commentary from SIOP and APA that informed subsequent revisions, and solicited a thorough legal review.

show abstract

“…We assessed the method section of a random sample of 120 systematic reviews and meta-analyses published in 10 different journals of I/O psychology, with the help of MARS. We chose this section because information about the methodology is the most useful for a researcher who wants to replicate the search and selection process and because different researchers stressed the importance of clear reporting in this section (Wanous et al, 1989 ; Dieckmann et al, 2009 ; Fehrmann and Thomas, 2011 ; Nieminen et al, 2011 ; Ada et al, 2012 ).…”

Section: Discussionmentioning

confidence: 99%

“…The current study focuses on the quality of reporting in the method section of published articles, which is regarded as the section were the majority of judgment calls are made (Wanous et al, 1989 ; Dieckmann et al, 2009 ), such as in the search, selection and coding of systematic reviews and meta-analyses. Most differences between meta-analyses are found in this section (Nieminen et al, 2011 ), and decisions in this stage, such as for inclusion criteria, seem to be most influential on the final results (Ada et al, 2012 ). Also the relevance of reporting in the method section, especially in the search, is stressed by several researchers, such as Fehrmann and Thomas ( 2011 ).…”

Section: Introductionmentioning

confidence: 99%

The Reporting Quality of Systematic Reviews and Meta-Analyses in Industrial and Organizational Psychology: A Systematic Review

Schalken

Rietbergen

2017

Front. Psychol.

View full text Add to dashboard Cite

Objective: The goal of this systematic review was to examine the reporting quality of the method section of quantitative systematic reviews and meta-analyses from 2009 to 2016 in the field of industrial and organizational psychology with the help of the Meta-Analysis Reporting Standards (MARS), and to update previous research, such as the study of Aytug et al. (2012) and Dieckmann et al. (2009).Methods: A systematic search for quantitative systematic reviews and meta-analyses was conducted in the top 10 journals in the field of industrial and organizational psychology between January 2009 and April 2016. Data were extracted on study characteristics and items of the method section of MARS. A cross-classified multilevel model was analyzed, to test whether publication year and journal impact factor (JIF) were associated with the reporting quality scores of articles.Results: Compliance with MARS in the method section was generally inadequate in the random sample of 120 articles. Variation existed in the reporting of items. There were no significant effects of publication year and journal impact factor (JIF) on the reporting quality scores of articles.Conclusions: The reporting quality in the method section of systematic reviews and meta-analyses was still insufficient, therefore we recommend researchers to improve the reporting in their articles by using reporting standards like MARS.

show abstract

Meta-analytic Decisions and Reliability: A Serendipitous Case of Three Independent Telecommuting Meta-analyses

Cited by 23 publications

References 38 publications

The Relationship Between Multidimensional Motivation and Endocrine-Related Responses: A Systematic Review

The Relationship Between Multidimensional Motivation and Endocrine-Related Responses: A Systematic Review

Principles for the Validation and Use of Personnel Selection Procedures

The Reporting Quality of Systematic Reviews and Meta-Analyses in Industrial and Organizational Psychology: A Systematic Review

Contact Info

Product

Resources

About