Evaluating transdisciplinary research practices: insights from social network analysis

Abstract

Transdisciplinary researchers collaborate with diverse partners outside of academia to tackle sustainability problems. The patterns and practices of social interaction and the contextual nature of transdisciplinary research result in different performance expectations than traditional, curiosity-driven research. Documenting patterns of interaction can inform project success and affirm progress toward interim outcomes on the way to achieve sustainability impacts. Yet providing credible and robust indicators of research activity remains challenging. We provide quantitative and qualitative indicators for assessing transdisciplinary practices and patterns through social network analysis (SNA). Our assessment developed four criteria to reveal how SNA metrics provide insight into (1) diversity of participants; (2) whether and how integration and collaboration are occurring, (3) the relative degrees of network stability and fragility, and (4) how the network is structured to achieve its goals. These four key criteria can be used to help identify patterns of research activity and determine whether interim progress is occurring.

Evaluating the Evolution of Social Networks: A Ten-Year Longitudinal Analysis of an Agricultural, Fishing and Forestry Occupational Health Research Center

“…However, the growth of the NEC network has become more inclusive over time, by reaching each of the occupational sectors (agriculture, forestry and fishing) and by expanding the disciplines of network members. A highly cohesive network may not be realistic or desirable for the NEC structure, as high network clustering coefficients indicate the formation of small, tight groups [ 1 ]. Evolution toward more transdisciplinary OSH centers as recommended by Felknor et al [ 12 ] and Tamers et al [ 18 ] necessitates diversification and expanding networks, which the NEC SNA demonstrates.…”

“…The criteria for transdisciplinary network analyses [ 1 ] were applied to the NEC SNA to characterize its transdisciplinary work. Specifically, the concept of diversity was measured by examining the size and composition of the NEC network and demonstrated changes over time.…”

“…While smaller values of breadth are indicative of greater social cohesion (tighter groups), larger values of breadth are indicative of greater inclusion and expansion. Integration and collaboration are described by Steelman et al [ 1 ] to include measures of cohesion, i.e., the overall network clustering coefficient is a measure of how much nodes cluster. It is calculated as the number of closed triads (i.e., groups of three nodes that are all connected).…”

“…Research advancement depends on collaborative efforts among researchers. Prior studies have used social network analysis (SNA) to measure collaborative ties among researchers in order to understand the dynamics and characteristics of research productivity [ 1 ]. SNA allows visualization and quantitative measures of networks, specifically positions of intramural and extramural partners, their interconnectedness, and collaborative ties.…”

“…These ties “transcend long-standing disciplinary boundaries and engage investigators, clinicians, public health experts and policymakers in highly innovative, yet tightly integrated translational initiatives” [ 12 ]. Criteria for characterizing transdisciplinary networks have been developed and include measures of diversity (network size and composition), integration and collaboration (network density), stability (degree centrality) and efficiency (centralization) [ 1 ].…”