Multicase Study of Evaluation of Results of Technological Innovations in the Public Sector: Mechanisms Used, Challenges and Gains

Abstract

In the era of digital transformation, more and more public organizations are adopting technological innovations to improve the delivery of public services. The objective was to analyze how public organizations carry out evaluations of technological innovations developed, as well as what are the challenges to carry out such evaluations and what are the gains obtained with technological innovations. The research is descriptive, transversal and qualitative, through 10 interviews with professionals responsible for the development and management of technological innovations in public organizations in five Brazilian States and different spheres of Power and Government. Content analysis was used. Six categories of reasons for the need to develop technological innovation were identified, mainly focusing on improving work processes. Ways of measuring results were identified with indicators and people's perception. Six categories of perceived gains with innovation and three of difficulties faced for evaluation were established. It is noticed that there is a problem of lack of a culture of structured evaluation of the results of technological innovations in the investigated experiences, which refers to the need to advance in organizations in the adoption of mechanisms to verify how much the investment in technological innovations is bringing return to the organization and for society. The research advances in the production of knowledge about evaluations of technological innovations, and allows guiding the definition of measurement methods and possible results with technological innovations, in addition to leading to reflection on the need to establish evaluation mechanisms during the design of the innovation.

Untitled

“…In international academia, although research on enterprise technological innovation is extensive, the concept of technological innovation performance has been relatively little explored, and existing research has mostly focused on influencing factors and improvement measures, and has yet to form a clear definition of technological innovation performance (Kang and Zhao, 2022). Scholars' understanding of technological innovation performance is mainly centered on input-output efficiency and output results, which are regarded as the outputs of technological innovation activities and the embodiment of their impact on enterprises (Mettang, 2023). Gao (2004), proposed the concept of technological innovation performance for the first time, defining it as the efficiency of an enterprise's technological innovation process, its output results, and its contribution to business success, covering both technological innovation output performance and technological innovation process performance.…”

“…Such a system should be able to identify and measure all aspects of technological innovation, including but not limited to resource inputs, outputs, market impacts, and the efficiency and quality of the innovation process. In addition, the system should be able to adapt to the actual situation in China, taking into account the special environment and market needs of Chinese enterprises, so as to more accurately assess and guide the technological innovation activities of enterprises (Mettang, 2023).…”

Digital Financial Development and Corporate Innovation

“…In international academia, although research on enterprise technological innovation is extensive, the concept of technological innovation performance has been relatively little explored, and existing research has mostly focused on influencing factors and improvement measures, and has yet to form a clear definition of technological innovation performance (Kang and Zhao, 2022). Scholars' understanding of technological innovation performance is mainly centered on input-output efficiency and output results, which are regarded as the outputs of technological innovation activities and the embodiment of their impact on enterprises (Mettang, 2023). Gao (2004), proposed the concept of technological innovation performance for the first time, defining it as the efficiency of an enterprise's technological innovation process, its output results, and its contribution to business success, covering both technological innovation output performance and technological innovation process performance.…”

“…Such a system should be able to identify and measure all aspects of technological innovation, including but not limited to resource inputs, outputs, market impacts, and the efficiency and quality of the innovation process. In addition, the system should be able to adapt to the actual situation in China, taking into account the special environment and market needs of Chinese enterprises, so as to more accurately assess and guide the technological innovation activities of enterprises (Mettang, 2023).…”