Measuring research in the big data era: The evolution of performance measurement systems in the Italian teaching hospitals

Horenberg, Frank; Lungu, Daniel Adrian; Nuti, Sabina

doi:10.1016/j.healthpol.2020.10.002

Cited by 7 publications

(6 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In more than 70% of the studies, hospital evaluation occurred at the department level, which can also be divided into three levels: administrative, clinical ward, and paramedical department. In addition, the administrative departments consist of 13 departments, including financial management [ 48 , 55 , 61 , 67 , 68 , 80 , 83 , 109 , 113 ], supply chain management and warehouse [ 15 , 43 , 84 ], value-based purchasing [ 33 , 85 ], human resource management [ 97 , 101 ], medical equipment [ 32 , 87 ], health information management department [ 90 ], information systems [ 106 ], nutritional assessment [ 93 ], energy management [ 30 , 45 , 92 ], facility management [ 52 , 53 ], building sustainability and resilience [ 35 ], research activities [ 44 ], and education [ 107 ].…”

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Hospital performance evaluation indicators: a scoping review

Hadian,

Rezayatmand,

Shaarbafchizadeh

et al. 2024

BMC Health Serv Res

View full text Add to dashboard Cite

Background Hospitals are the biggest consumers of health system budgets and hence measuring hospital performance by quantitative or qualitative accessible and reliable indicators is crucial. This review aimed to categorize and present a set of indicators for evaluating overall hospital performance. Methods We conducted a literature search across three databases, i.e., PubMed, Scopus, and Web of Science, using possible keyword combinations. We included studies that explored hospital performance evaluation indicators from different dimensions. Results We included 91 English language studies published in the past 10 years. In total, 1161 indicators were extracted from the included studies. We classified the extracted indicators into 3 categories, 14 subcategories, 21 performance dimensions, and 110 main indicators. Finally, we presented a comprehensive set of indicators with regard to different performance dimensions and classified them based on what they indicate in the production process, i.e., input, process, output, outcome and impact. Conclusion The findings provide a comprehensive set of indicators at different levels that can be used for hospital performance evaluation. Future studies can be conducted to validate and apply these indicators in different contexts. It seems that, depending on the specific conditions of each country, an appropriate set of indicators can be selected from this comprehensive list of indicators for use in the performance evaluation of hospitals in different settings.

show abstract

Section: Resultsmentioning

confidence: 99%

“…[ 16 , 30 , 31 , 33 , 38 , 39 , 43 , 44 , 46 , 50 , 51 , 53 , 54 , 56 , 60 , 61 , 68 , 76 , 76 , 78 , 84 , 85 , 89 , 92 , 94 , 97 , 98 , 100 – 104 , 107 , 109 , 110 , 113 , 118 – 120 ]…”

Section: Resultsunclassified

Hospital performance evaluation indicators: a scoping review

Hadian,

Rezayatmand,

Shaarbafchizadeh

et al. 2024

BMC Health Serv Res

View full text Add to dashboard Cite

show abstract

“…Again, from a strictly technical point of view, attributing an IF to an organization diverges from the standard definition of the indicator. However, the "IF points" 9 are included among the standard metrics used in Italy to evaluate the performance of hospitals and it is not uncommon for a hospital to showcase their IF on its web-site 10 (Horenberg et al, 2020). In this regard, journalists simply follow the common practices of hospital performance assessment in Italy.…”

Section: Overview Of the Main Functions And Contexts Of Use Of Biblio...mentioning

confidence: 99%

Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers

Petrovich

2022

Scientometrics

View full text Add to dashboard Cite

Scholars in science and technology studies and bibliometricians are increasingly revealing the performative nature of bibliometric indicators. Far from being neutral technical measures, indicators such as the Impact Factor and the h-index are deeply transforming the social and epistemic structures of contemporary science. At the same time, scholars have highlighted how bibliometric indicators are endowed with social meanings that go beyond their purely technical definitions. These social representations of bibliometric indicators are constructed and negotiated between different groups of actors within several arenas. This study aims to investigate how bibliometric indicators are used in a context, which, so far, has not yet been covered by researchers, that of daily newspapers. By a content analysis of a corpus of 583 articles that appeared in four major Italian newspapers between 1990 and 2020, we chronicle the main functions that bibliometrics and bibliometric indicators played in the Italian press. Our material shows, among other things, that the public discourse developed in newspapers creates a favorable environment for bibliometrics-centered science policies, that bibliometric indicators contribute to the social construction of scientific facts in the press, especially in science news related to medicine, and that professional bibliometric expertise struggles to be represented in newspapers and hence reach the general public.

show abstract

“… Evidence Based: Considering that all indicators of the evaluation system are computed by regions, the informative richness of the evaluation system is the result of the adoption of a wide range of data sources originating from a broad spectrum of administrative flows available at the national level: Hospital Discharge Records (Scheda di Dimissione Ospedaliera – SDO), balance sheets, the flow of Outpatient Services and Emergency Rooms, Birth Certificates, Pharmaceutical Flows and Home and Residential Care streams. Finally, the IRPES regularly performs ad hoc surveys to shed light on areas of interest (such as organisational climate), and specific analyses, such as assessing the research activities of university hospitals [ 27 ]. The first months of outbreak of the coronavirus pandemic have seen the growth of trust in the Italian National Health Service, but at the same time they have also offered the diffusion of different types of fake news and denialism: transparency on results, free circulation of data and information and comparison based on real world evidence are undoubtedly effective tools to stem certain drifts of public debate.…”

Section: Irpes Structure and Main Characteristicsmentioning

confidence: 99%

The Italian interregional performance evaluation system

Vola

Benedetto

Vainieri

et al. 2022

Res Health Serv Reg

Self Cite

View full text Add to dashboard Cite

This contribution describes the Interregional Performance Evaluation System (IRPES) designed by MeS Lab of Sant’Anna School of Advanced Studies (Pisa—Italy), by highlighting its main characteristics and its evolution. Context: Since its creation in 2008, the IRPES has been developed by researchers from different backgrounds, with the involvement of practitioners and managers, so as to offer support to local, regional and national healthcare management. The IRPES is currently adopted by 12 Italian regions, which share a common performance evaluation system to assess the respective regional healthcare systems’ performance. Structure: The IRPES is currently composed of about 400 indicators, which monitor different dimensions of the health systems. About half of them are benchmarked against shared standards, to assess the healthcare systems’ performance. Indicators are grouped into around thirty composite indicators. Data visualization: MeS Lab designed innovative tools to deliver a clear representation of the performance of health systems, which in turn facilitate policymakers to gain a dynamic understanding of weaknesses and strengths of the systems they manage. In particular, the more traditional representation tools (such as maps or histograms) are accompanied by new visualisation instruments, such as “the dartboard” and “the stave”. Covid-19: With the outburst of COVID-19 pandemic emergency, assessing the resilience of healthcare systems has become the new challenge posed to the IRPES. Thus, 63 novel resilience indicators tailored for the pandemic were introduced, starting from the second semester of 2020. Continuous monitoring of the performance of health systems was equally implemented, which has been essential to policymakers during such a difficult time.

show abstract

Measuring research in the big data era: The evolution of performance measurement systems in the Italian teaching hospitals

Cited by 7 publications

References 38 publications

Hospital performance evaluation indicators: a scoping review

Hospital performance evaluation indicators: a scoping review

Bibliometrics in Press. Representations and uses of bibliometric indicators in the Italian daily newspapers

The Italian interregional performance evaluation system

Contact Info

Product

Resources

About