MAVE: Multilevel wrApper Verification systEm

Viana, Iñaki Fernández de; Abad, Pedro J.; Álvarez, José Luis Domínguez; Arjona, José Luis

doi:10.1109/tkde.2016.2573302

Cited by 2 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Note that, even if the wrapper works properly, the extracted data may still be inconsistent with the schema. Thus, a data verification procedure is required to ensure that the wrapper produces valid extracted data [10], [11]. The procedure of verifying whether a wrapper is operating correctly and producing valid extracted data is called wrapper verification (see the dotted purple rectangle in Fig.…”

Section: Introductionmentioning

confidence: 99%

Full-Page Wrapper Generation for Unsupervised Deep Web Data Extraction

Chang¹

2021

Preprint

View full text Add to dashboard Cite

<div>Web data extraction is a key component in many business intelligence tasks, such as data transformation, exchange, and analysis. Many approaches have been proposed, with either labeled training examples (supervised) or annotation-free training pages (unsupervised). However, most research focuses on extraction effectiveness. Not much attention has been paid to extraction efficiency. In fact, most unsupervised web data extraction ignores wrapper generation because they could work alone without any supervision. </div><div>In this paper, we argue that wrapper generation for unsupervised web data extraction is as important as supervised wrapper induction because the generated wrappers could work more efficiently without sophisticated analysis during testing. We consider two approaches for wrapper generation: schema-guided finite-state machine (FSM) approaches and data-driven machine learning (ML) approaches. We exploit unique mandatory templates to improve the FSM-based wrapper, and proposed two convolutional neural network (CNN)-based models for sequence-labeling. The experimental results show that the FSM wrapper performs well even with small training data, while the CNN-based models require more training pages to achieve the same effectiveness but are more efficient with GPU support. Furthermore, FSM wrappers can work as a filter to reduce the number of training pages and advance the learning curve for wrapper generation.</div>

show abstract

Section: Introductionmentioning

confidence: 99%