An Efficient Web-Based Wrapper and Annotator for Tabular Data

Abstract

In the last few years, several works in the literature have addressed the problem of data extraction from web pages. The importance of this problem derives from the fact that, once extracted, data can be handled in a way similar to instances of a traditional database, which in turn can facilitate application of web data integration and various other domain specific problems. In this paper, we propose a novel table extraction technique that works on web pages generated dynamically from a back-end database. The proposed system can automatically discover table structure by relevant pattern mining from web pages in an efficient way, and can generate regular expression for the extraction process. Moreover, the proposed system can assign intuitive column names to the columns of the extracted table by leveraging Wikipedia knowledge base for the purpose of table annotation. To improve accuracy of the assignment, we exploit the structural homogeneity of the column values and their co-location information to weed out less likely candidates. This approach requires no human intervention and experimental results have shown its accuracy to be promising. Moreover, the wrapper generation algorithm works in linear time.

Knowledge Rich Natural Language Queries over Structured Biological Databases

“…. , A k is the projection list, µ is the schema matcher (e.g., PruSM [57]), ω is the wrapper (e.g., FastWrap [7]), φ is the form filler (e.g., iForm [70]), and ϕ is the web form address or the form function. Note that this statement returns a table by submitting columns from each row in r to the deep web database at ϕ.…”

Specification and discovery of web patterns: a graph grammar approach

“…In order to minimize the effort of preparing a training set, Dalvi et al recently proposed a generic framework for supervised wrapper induction based on automatically obtained noisy training data [17]. Without requiring a training set, Amin and Jamil [4] extracted from a symbol list of an HTML page a commonly occurring pattern of the highest length and super-maximal repeats. The pattern is converted to a regular expression, which is subsequently used to extract the record level data items.…”

Improving Integration Effectiveness of ID Mapping Based Biological Record Linkage

“…In this statement, OntoMatch [51] and FastWrap [52] respectively are schema matcher and wrapper generator available in the BioFlow toolbox. EXTEND Statement.…”