NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools

Abstract

NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pretrained models and open source systems from academia that provide semantic analysis functionalities, including but not limited to entity linking, sentiment analysis, semantic parsing, and relation extraction. Its extensible design enables researchers and developers to smoothly replace an existing model or integrate a new one. To improve efficiency, we employ a microservice architecture that facilitates allocation of acceleration hardware and parallelization of computation. This paper presents the architecture of NLP Workbench and discusses the challenges we faced in designing it. We also discuss diverse use cases of NLP Workbench and the benefits of using it over other approaches. The platform is under active development, with its source code released under the MIT license 1 . A website 2 and a short video 3 demonstrating our platform are also available.

Exploring corpus linguistics via computational tool analysis: key finding review

“…These advancements have been observed in areas such as natural language tasks, language modelling, syntactic parsing, machine translation, sentiment analysis, and question answering [53]. The NLP tool provides a broader and more sophisticated range of capabilities suitable for a wider array of complex and dynamic applications in today's data-driven world [54]. The types of corpus tools were reviewed on a one-on-one basis and their uses were explored in 28 articles as shown in Table 3.…”