Insight Into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

Christie, Christina A.; Fleischer, Dreolin Nesbitt

doi:10.1177/1098214010369170

Cited by 35 publications

(35 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As with the policy sciences and implementation sciences discussed earlier, the evaluation field contains a wide range of frameworks, theories, approaches, paradigms, and controversies (266)(267)(268)(269)(270). Given this diversity, an early and pivotal stage in the process is matching the approaches and methods to the purpose of the evaluation.…”

Section: Evaluation Frameworkmentioning

confidence: 99%

Expanding the Frontiers of Population Nutrition Research: New Questions, New Methods, and New Approaches

Pelletier

Porter

Aarons

et al. 2013

Advances in Nutrition

View full text Add to dashboard Cite

Nutrition research, ranging from molecular to population levels and all points along this spectrum, is exploring new frontiers as new technologies and societal changes create new possibilities and demands. This paper defines a set of frontiers at the population level that are being created by the increased societal recognition of the importance of nutrition; its connection to urgent health, social, and environmental problems; and the need for effective and sustainable solutions at the population level. The frontiers are defined in terms of why, what, who, and how we study at the population level and the disciplinary foundations for that research. The paper provides illustrations of research along some of these frontiers, an overarching framework for population nutrition research, and access to some of the literature from outside of nutrition that can enhance the intellectual coherence, practical utility, and societal benefit of population nutrition research. The frontiers defined in this paper build on earlier forward-looking efforts by the American Society for Nutrition and extend these efforts in significant ways. The American Society for Nutrition and its members can play pivotal roles in advancing these frontiers by addressing a number of well-recognized challenges associated with transdisciplinary and engaged research.

show abstract

Section: Evaluation Frameworkmentioning

confidence: 99%

Expanding the Frontiers of Population Nutrition Research: New Questions, New Methods, and New Approaches

Pelletier

Porter

Aarons

et al. 2013

Advances in Nutrition

View full text Add to dashboard Cite

show abstract

“…Experimental, quasi‐experimental and non‐experimental study designs were coded for each of the 157 articles. In keeping with the definitions used by Christie and Fleischer, experimental designs were quantitative studies where random assignment of units to conditions occurred, whereas quasi‐experimental designs were quantitative studies involving between‐group comparisons without random assignment or within‐group pre‐ to post‐test comparisons 26 . Non‐experimental designs were those that were neither experimental nor quasi‐experimental, including quantitative cross‐sectional and qualitative studies.…”

Section: Resultsmentioning

confidence: 99%

Designs and methods used in published Australian health promotion evaluations 1992–2011

Chambers

Murphy

Kolbe

2015

Australian and New Zealand Journal of Public Health

View full text Add to dashboard Cite

Objective: To describe the designs and methods used in published Australian health promotion evaluation articles between 1992 and 2011. Methods: Using a content analysis approach, we reviewed 157 articles to analyse patterns and trends in designs and methods in Australian health promotion evaluation articles. The purpose was to provide empirical evidence about the types of designs and methods used. Results: The most common type of evaluation conducted was impact evaluation. Quantitative designs were used exclusively in more than half of the articles analysed. Almost half the evaluations utilised only one data collection method. Surveys were the most common data collection method used. Few articles referred explicitly to an intended evaluation outcome or benefit and references to published evaluation models or frameworks were rare. Conclusion: This is the first time Australian‐published health promotion evaluation articles have been empirically investigated in relation to designs and methods. There appears to be little change in the purposes, overall designs and methods of published evaluations since 1992. Implications: More methodologically transparent and sophisticated published evaluation articles might be instructional, and even motivational, for improving evaluation practice and result in better public health interventions and outcomes.

show abstract

“…or evaluation imaginary. We also acknowledge that there is much evaluation practice that does not find its way into journals, which is a limitation researchers of other studies on evaluation practice have acknowledged (e.g., Christie & Fleischer, 2010).…”

Section: The Evaluation Theory Treementioning

confidence: 97%

“…been explored in North American journals (Christie & Fleischer, 2010), the purpose of the current study was to explore empirically the similarities and differences between evaluation practice in North America and Europe, as evident within their respective professional communities. Our work was guided by the following research questions: Are there differences or similarities in the understandings of evaluation practice in published evaluation articles in Europe and North America?…”

mentioning

confidence: 99%

Cross-Continental Reflections on Evaluation Practice

Kallemeyn

Hall

Friche³

et al. 2015

American Journal of Evaluation

View full text Add to dashboard Cite

The evaluation theory tree typology reflects the following three components of evaluation practice: (a) methods, (b) use, and (c) valuing. The purpose of this study was to explore how evaluation practice is conceived as reflected in articles published in the American Journal of Evaluation (AJE) and Evaluation, a journal supported by the European Evaluation Society. A key finding from this international comparison suggests that evaluation practice as reflected in AJE and Evaluation both emphasize methods, in comparison to use and valuing. This article concludes using Peter DahlerLarsen's discussion on evaluation societies, among other sources, to examine the audit society, which might account for the trends in our findings. EvalPartners, a global community of evaluators, has declared 2015 as the international year of evaluation. These findings regarding cross-continental trends in evaluation are relevant for engaging in a global dialogue on evaluation practice.

show abstract

Insight Into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

Cited by 35 publications

References 20 publications

Expanding the Frontiers of Population Nutrition Research: New Questions, New Methods, and New Approaches

Expanding the Frontiers of Population Nutrition Research: New Questions, New Methods, and New Approaches

Designs and methods used in published Australian health promotion evaluations 1992–2011

Cross-Continental Reflections on Evaluation Practice

Contact Info

Product

Resources

About