Strategies towards Evaluation beyond Scientific Impact. Pathways not only for Agricultural Research

Abstract

Various research fields, like organic agricultural research, are dedicated to solving real-world problems and contributing to sustainable development. Therefore, systems research and the application of interdisciplinary and transdisciplinary approaches are increasingly endorsed. However, research performance depends not only on self-conception, but also on framework conditions of the scientific system, which are not always of benefit to such research fields. Recently, science and its framework conditions have been under increasing scrutiny as regards their ability to serve societal benefit. This provides opportunities for (organic) agricultural research to engage in the development of a research system that will serve its needs. This article focuses on possible strategies for facilitating a balanced research evaluation that recognises scientific quality as well as societal relevance and applicability. These strategies are (a) to strengthen the general support for evaluation beyond scientific impact, and (b) to provide accessible data for such evaluations. Synergies of interest are found between open access movements and research communities focusing on global challenges and sustainability. As both are committed to increasing the societal benefit of science, they may support evaluation criteria such as knowledge production and dissemination tailored to societal needs, and the use of open access. Additional synergies exist between all those who scrutinise current research evaluation systems for their ability to serve scientific quality, which is also a precondition for societal benefit. Here, digital communication technologies provide opportunities to increase effectiveness, transparency, fairness and plurality in the dissemination of scientific results, quality assurance and reputation. Furthermore, funders may support transdisciplinary approaches and open access and improve data availability for evaluation beyond scientific impact. If they begin to use current research information systems that include societal impact

Changes in Knowledge Management Strategies Can Support Emerging Innovative Actors in Organic Agriculture: The Case of Participatory Plant Breeding in Europe

“…As stated by Wolf et al "the Impact Factor and other journal-based metrics are increasingly considered inappropriate for comparing the scientific output of individuals and institutions" [48]. Furthermore, "innovation" is becoming a synonym for "patent" and has no relationship at all with the actual uptake of a solution by end-users, especially farmers.…”

“…There are new developments on this subject [48], but "these are still confronted by incentive systems that favour the old style of evaluation and old method of producing research: mono-disciplinary, with a focus on publication in international journals" [49]. National and EU Agricultural policies which support novelties and bottom-up innovations with subsidies and niche market development, if integrated with innovation policies that encourage knowledge exchange using a multi-actor approach, could facilitate a more coherent scaling up of such innovations, as is already happening in some contexts.…”

Can the Adoption of Organic Farming Be Predicted by Biogeographic Factors? A French Case Study

“…Several studies have shown the essential role of agroecological approaches, and particularly organic agriculture, for sustainable development [32][33][34]. Ecological intensification enables an improvement of productivity while at the same time reducing adverse effects on the environment [35][36][37][38].…”

How Scientific Is Organic Farming Research?

“…One of them lies in the disincentives against organic research imbued in current research evaluation [6]. Systems investigated by organic farming researchers are typically highly complex meaning that research can take longer so that research output per unit time is lower than for simpler systems.…”

“…Further, the interdisciplinary nature of organic research is often not favoured by the gatekeepers of specialised disciplinary science. However, there are also various developments that are slowly bringing about significant changes in the practice of research evaluation, including the open access movement, which has particular relevance for organic agriculture [6].…”