The uComp Protégé Plugin: Crowdsourcing Enabled Ontology Engineering

Abstract

Abstract. Crowdsourcing techniques have been shown to provide effective means for solving a variety of ontology engineering problems. Yet, they are mainly being used as external means to ontology engineering, without being closely integrated into the work of ontology engineers. In this paper we investigate how to closely integrate crowdsourcing into ontology engineering practices. Firstly, we show that a set of basic crowdsourcing tasks are used recurrently to solve a range of ontology engineering problems. Secondly, we present the uComp Protégé plugin that facilitates the integration of such typical crowdsourcing tasks into ontology engineering work from within the Protégé ontology editing environment. An evaluation of the plugin in a typical ontology engineering scenario where ontologies are built from automatically learned semantic structures, shows that its use reduces the working times for the ontology engineers 11 times, lowers the overall task costs with 40% to 83% depending on the crowdsourcing settings used and leads to data quality comparable with that of tasks performed by ontology engineers.

Intelligent Collaborative Authoring of Place-Based, Cross-Cultural and Media-Rich Experiences

“…Building KB in a collaborative manner is supported by version control and consistency check mechanisms, as well as by a notification mechanism, towards making KB development transparent for users and integrating discussions seamlessly into the development process. Finally, most recent works in ontology engineering extend the capabilities of collaborative development environments with modern technological paradigms, such as crowdsourcing enabled ontology engineering [15]. What is missing is the development of a knowledge engineering environment using the most suitable, seamlessly integrated set of methods and tools that support human-centered and collaborative knowledge engineering, ensuring that an engineered 'live' knowledge base is commonly agreed, shared and continuously curated/maintained by all stakeholders (domain experts, knowledge engineers/workers).…”

Swift Linked Data Miner: Mining OWL 2 EL class expressions directly from online RDF datasets

“…Similar to the games with a purpose is the idea of using crowdsourcing services like CrowdFlower 2 or Amazon Mechanical Turk 3 . For example, Hanika et al present a Protégé plugin that enables a user to post microtasks related to her ontology development process directly to a crowdsourcing website [16].…”

Crowdsourcing and the Semantic Web: A Research Manifesto

“…Celino et al (2012a) developed a game to collect urban geo-spatial data. Noy et al (2013) investigated the use of microtask platforms in ontology engineering comparing crowd workers with students and experts, while Hanika et al (2014) proposed an extension of a popular ontology engineering environment with integrated GWAPs and microtask capabilities. Additionally, the crowd can become useful for understanding the different dimensions of culture, which is intrinsic to humans and needs to be reflected in semantic data.…”