A Web Service for Scholarly Big Data Information Extraction

Abstract

Abstract-The automatic extraction of metadata and other information from scholarly documents is a common task in academic digital libraries, search engines, and document management systems to allow for the management and categorization of documents and for search to take place. A Web-accessible API can simplify this extraction by providing a single point of operation for extraction that can be incorporated into multiple document workflows without the need for each workflow to implement and support its own extraction functionality. In this paper, we describe CiteSeerExtractor, a RESTful API for scholarly information extraction that exploits the fact that there is duplication in scholarly big data and makes use of a near duplicate matching backend. The backend stores previously extracted metadata and avoids extracting metadata from a document if it has already been extracted before. We describe the design, implementation, and functionality of CiteSeerExtractor and show how the duplicate document matching results in a difference of 8.46% in the time required to extract header and citation information from approximately 3.5 million documents compared to a baseline.

Academic Influence Aware and Multidimensional Network Analysis for Research Collaboration Navigation Based on Scholarly Big Data

“…Specifically, one kind of data published in various digital databases and shared on academic websites, has become increasingly popular, especially in academic and education institutions [1], which is called scholarly big data. Scholarly big data is defined as the vast quantity of data related to scholarly undertaking, and is produced from different scholarly sources with various formats, including journal articles, conference proceedings, theses, books, patents, presentation slides and experimental data [2][3][4]. Genernally, it contains large scale of academic information (such as authors, papers, and citations), technical data (such as algorithms, figures, and tables), and collaboration relations across scholarly networks and digital libraries [5].…”

Architecture and framework for data acquisition in cloud robotics

“…Those services are also capable of developing and operating in a big-data analysis environment for different application domains. For example, representational state transfer (REST) APIs or RESTful APIs provided by microservices can provide an architectural basis for both the internet of things (IoT) and document management system developments, as well as for hardware integration (for examples see Al-Masri, 2018;Williams et al, 2014;Ezzeddine et al, 2018).…”

Research on Web Character Information Extraction Based on Semantic Similarity

“…the main idea of the algorithm model was based on Maximum Entropy Model, combined with the Hidden Markov Model 13 . It not only solves the label bias of the Maximum Entropy Model, but also overcome the output independence assumption of strict requirements by HMM.…”