Evaluating how an Information Systems (IS) intervention in the workplace affects daily work and impacts on workers and organizations is a challenge that requires a very broad research approach. IS researchers have derived several models to explain and measure IS success, taking various perspectives and system types into account. This study presents an evaluation framework for measuring the impacts of an IS intervention especially at the shop floor in production environments. In this framework, we take a broad scope of examination and apply an integrated model that comprises elements from several methods for analyzing the acceptance and the impact of the new solutions. Thus, the aim is to further develop and enhance the existing methods and models for measuring the acceptance and the impacts of the sociotechnical interventions in production environments.

The introduction of innovative digital tools for supporting manufacturing processes has far-reaching effects at an organizational and individual level due to the development of Industry 4.0. The FACTS4WORKERS project funded by H2020, i.e., Worker-Centric Workplaces in Smart Factories, aims to develop user-centered assistance systems in order to demonstrate their impact and applicability at the shop floor. To achieve this, understanding how to develop such tools is as important as assessing if advantages can be derived from the ICT system created. This study introduces the technology of a workplace solution linked to the industrial challenge of self-learning manufacturing workplaces. Subsequently, a two-step approach to evaluate the presented system is discussed, consisting of the one used in FACTS4WORKERS and the one used in the “Heuristics for Industry 4.0” project. Both approaches and the use case are introduced as a base for presenting the comparison of the results collected in this paper. The comparison of the results for the presented use case is extended with the results for the rest of the FACTS4WORKERS use cases and with future work in the framework.

It is well-known that the introduction of innovative digital tools in manufacturing due to Industry 4.0 has far-reaching effects on an organizational and on an individual level. The H2020 funded project FACTS4WORKERS-Worker-Centric Workplaces in Smart Factories-aims to develop user-centered assistance systems in order to demonstrate their impact and applicability at the shop floor. To do so it is important to understand how to develop such tools and how to assess if advantages can be derived from the created ICT system. This study introduces the technology of a workplace solution that is linked to a specific industrial challenge. Subsequently, a 2-stepped approach to evaluate the presented system is discussed. Heuristics, which are an output of project "Heuristics for Industry 4.0" are used to test if the developed solution covers critical aspects of socio-technical system design. Insights into the design,

No abstract

No abstract