An Analysis of Evaluation Methods Implemented in Studies Published in the Journal of International Agricultural and Extension Education from 1994 to 2018: A 25 Year Review

Abstract

Evaluation has been identified as a critical pathway to meet the grand challenges facing agriculture to feed the world. Understanding evaluation models and practices used in articles published in the Journal of International Agricultural and Extension Education (JIAEE) allowed us to identify areas of focus, need, and improvement. This content analysis assessed JIAEE articles published from 1994 to 2018 for evaluation methods implemented according to characteristics outlined by Stufflebeam and Coryn (2014). This study initially identified 384 possible articles for consideration. Upon further assessment, 81 articles were identified as maintaining characteristics appropriate for review. Of these articles, the majority (70%) did not specifically identify an evaluation approach, even though 21% of all feature articles published over the past 25 years can be considered an evaluation. Few published evaluation articles specifically identified an evaluation approach; rather, the majority merely described the methods without using evaluation terminology, and the majority of the examined articles did not substantially cite evaluation literature (53%). Additionally, the majority of published evaluation articles were quantitative (56%). Researchers publishing in JIAEE should be assured that qualitative and mixed method evaluation studies are also acceptable. Evaluation studies focused on Stufflebeam and Coryn's evaluation criteria of feasibility, safety, equity, and probity should be encouraged. Additionally, workshops or training opportunities to advance understanding in evaluation processes and procedures may be valuable.

Ex-post consequences of participatory foresight processes in agriculture. How to help dairy farmers to face outcomes of collective decisions planning?

“…The data collection is structured as proposed by the fourth level of New World Kirkpatrick's Model (NWKM), as shown in Figure 2 (Kirkpatrick and Kirkpatrick, 2016). Usually used in training and learning programs, Kirkpatrick's model is a recognized conceptual model to evaluate learning processes in agricultural education and extension (Murphrey et al, 2018), and lends itself particularly well to assessing the outcomes of foresight (Gary, 2019).…”