How Useful Are Natural Language Interfaces to the Semantic Web for Casual End-Users?

Kaufmann, Esther; Bernstein, Abraham

doi:10.1007/978-3-540-76298-0_21

Cited by 110 publications

(88 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…There is an increasing number of question answering systems over semantic data, evaluated through usability studies such as the one presented by Kaufmann & Bernstein [22]. But despite growing interest, there is a lack of standardized evaluation benchmarks to evaluate and compare the quality and performance of ontology-based question answering approaches at large scale [28].…”

Section: Existing Evaluation Methods and Competitionsmentioning

confidence: 99%

“…Promising research directed towards supporting end users to profit from the expressive power of these standards, while at the same time hiding the complexity behind an intuitive and easy-to-use interface, $ The authors wish to thanks Chris Welty for his invited talk "Inside the mind of Watson" at the QALD-1 workshop, and all participants in the open challenges QALD-1 and QALD-2 for valuable feedback and contributions. * Corresponding author Email addresses: vanlopez@ie.ibm.com (Vanessa Lopez), cunger@cit-ec.uni-bielefeld.de (Christina Unger), cimiano@cit-ec.uni-bielefeld.de (Philipp Cimiano), e.motta@open.ac.uk (Enrico Motta) is offered by search and query paradigms based on natural language interfaces to semantic data [22,28]. For example, question answering (QA) systems based on natural language allow users to express arbitrarily complex information needs in an intuitive fashion.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Evaluating question answering over linked data

López¹,

Unger

Cimiano

et al. 2013

Journal of Web Semantics

156

View full text Add to dashboard Cite

The availability of large amounts of open, distributed and structured semantic data on the web has no precedent in the history of computer science. In recent years, there have been important advances in semantic search and question answering over RDF data. In particular, natural language interfaces to online semantic data have the advantage that they can exploit the expressive power of Semantic Web data models and query languages, while at the same time hiding their complexity from the user. However, despite the increasing interest in this area, there are no evaluations so far that systematically evaluate this kind of systems, in contrast to traditional question answering and search interfaces to document spaces. To address this gap, we have set up a series of evaluation challenges for question answering over linked data. The main goal of the challenge was to get insight into the strengths, capabilities and current shortcomings of question answering systems as interfaces to query linked data sources, as well as benchmarking how these interaction paradigms can deal with the fact that the amount of RDF data available on the web is very large and heterogeneous with respect to the vocabularies and schemas used. Here we report on the results from the first and second of such evaluation campaigns. We also discuss how the second evaluation addressed some of the issues and limitations which arose from the first one, as well as the open issues to be addressed in future competitions.

show abstract

Section: Existing Evaluation Methods and Competitionsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Evaluating question answering over linked data

López¹,

Unger

Cimiano

et al. 2013

Journal of Web Semantics

156

View full text Add to dashboard Cite

show abstract

“…While natural language question answering interfaces are judged preferable to other interfaces by users [21], they are not in common use today. Despite user training with regards to the capabilities and limitations of a natural language system, users quickly develop negative expectations about the system due to the relatively high error rates in parsing and interpreting natural language [34].…”

Section: Related Workmentioning

confidence: 99%

VisiNav: A system for visual search and navigation on web data

Harth

2010

Journal of Web Semantics

View full text Add to dashboard Cite

“…triples). Differently from previous literature [1,2,3,4,9], we consider the issue of working in a complex environment where metadata only partially covers the user information needs. We therefore propose to use a strategy (called Hybrid Search, (HS) where a mix of keyword-based and metadata-based strategies are used.…”

Section: Introductionmentioning

confidence: 99%

Hybrid Search: Effectively Combining Keywords and Semantic Searches

Bhagdev¹,

Chapman²,

Ciravegna³

et al.

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. This paper describes hybrid search, a search method supporting both document and knowledge retrieval via the flexible combination of ontologybased search and keyword-based matching. Hybrid search smoothly copes with lack of semantic coverage of document content, which is one of the main limitations of current semantic search methods. In this paper we define hybrid search formally, discuss its compatibility with the current semantic trends and present a reference implementation: K-Search. We then show how the method outperforms both keyword-based search and pure semantic search in terms of precision and recall in a set of experiments performed on a collection of about 18.000 technical documents. Experiments carried out with professional users show that users understand the paradigm and consider it very powerful and reliable. K-Search has been ported to two applications released at Rolls-Royce plc for searching technical documentation about jet engines.

show abstract

How Useful Are Natural Language Interfaces to the Semantic Web for Casual End-Users?

Cited by 110 publications

References 21 publications

Evaluating question answering over linked data

Evaluating question answering over linked data

VisiNav: A system for visual search and navigation on web data

Hybrid Search: Effectively Combining Keywords and Semantic Searches

Contact Info

Product

Resources

About