Structured Data Extraction from the Web Based on Partial Tree Alignment

Zhai, Yanhong; Liu, B.

doi:10.1109/tkde.2006.197

Cited by 136 publications

(22 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Several automatic methods for web data extraction have been also proposed in the literature [3,7,9,30] (see Section 7), but they present several limitations. The main contributions of our approach are the followings:…”

Section: Discussionmentioning

confidence: 99%

“…Several methods have been proposed for this task [11,16]. We use a variation of the center star approximation algorithm [11], which is also similar to a variation used in [30] (although they use tree alignment). The algorithm works as follows:…”

Section: Extracting the Attributes Of The Data Recordsmentioning

confidence: 99%

“…It also requires receiving as input multiple pages. [30] presents DEPTA, a method that uses the visual layout of information in the page and tree edit-distance techniques to detect lists of records in a page and to extract the structured data records that form it. As well as in our method, DEPTA requires as input one single page containing a list of structured data records.…”

Section: Related Workmentioning

confidence: 99%

“…Several automatic methods for web data extraction have been also proposed in the literature [3,7,9,30], but they present several limitations. First, [3,9] require multiple pages generated using the same template as input.…”

Section: Introductionmentioning

confidence: 99%

“…Second, the proposed methods make some assumptions about the pages containing structured data which do not always hold. For instance, [30] assumes the visual space between two data records in a page is always greater than any gap inside a data record (we will provide more detail about these issues in the related work section).…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Finding and Extracting Data Records from Web Pages

Álvarez

Pan

Raposo

et al. 2008

J Sign Process Syst Sign Image Video Technol

View full text Add to dashboard Cite

Many HTML pages are generated by software programs by querying some underlying databases and then filling in a template with the data. In these situations the metainformation about the data structure is lost, so automated software programs cannot process these data in such powerful manners as information from databases. We propose a set of novel techniques for detecting structured records in a web page and extracting the data values that constitute them. Our method needs only an input page. It starts by identifying the data region of interest in the page. Then it is partitioned into records by using a clustering method that groups similar subtrees in the DOM tree of the page. Finally, the attributes of the data records are extracted by using a method based on multiple string alignment. We have tested our techniques with a high number of real web sources, obtaining high precision and recall values.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Extracting the Attributes Of The Data Recordsmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%