Recent technological advances, especially in the field of machine learning, provide astonishing progress on the road towards artificial general intelligence. However, tasks in current real-world business applications cannot yet be solved by machines alone. We, therefore, identify the need for developing socio-technological ensembles of humans and machines. Such systems possess the ability to accomplish complex goals by combining human and artificial intelligence to collectively achieve superior results and continuously improve by learning from each other. Thus, the need for structured design knowledge for those systems arises. Following a taxonomy development method, this article provides three main contributions: First, we present a structured overview of interdisciplinary research on the role of humans in the machine learning pipeline. Second, we envision hybrid intelligence systems and conceptualize the relevant dimensions for system design for the first time. Finally, we offer useful guidance for system developers during the implementation of such applications.

As more and more business processes are based on IT services the high availability of these processes is dependent on the IT-Support. Thus, making the IT-Support a critical success factor of companies. This paper presents how this department can be supported by providing the staff with domain-specific and high-quality solution material to help employees faster when errors occur. The solution material is based on previously solved tickets because these contain precise domain-specific solutions narrowed down to e.g., specific versions and configurations of hard-/software used in the company. To retrieve the solution material ontologies are used that contain the domain-specific vocabulary needed. Because not all previously solved tickets contain high-quality solution material that helps the staff to fix issues the de-signed IT-Support system separates lowfrom high-quality solution material. This paper presents (a) theory-and practicalmotivated design requirements that describe the need for automatically retrieved solution material, (b) develops two major design principles to retrieve domainspecific and high-quality solution material, and (c) evaluates the instantiations of them as a prototype with organic real-world data. The results show that previously solved tickets of a company can be pre-processed and retrieved to IT-Support staff based on their current queries.