A Novel Method to Extract Informative Blocks from Web Pages

Li, Yuancheng; Yang, Jie

doi:10.1109/jcai.2009.156

Cited by 7 publications

(11 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Li et al use tags, such as <body>, <div> and <table>, as the standard of classification of the Web pages, as they believe that these tags fully reflect the visual effects of pages. So, different values are assigned to each tag and the total value is calculated which is used to decide whether a block is noise [3]. C. Kim and K. Shim propose a novel algorithm to extract template from numerous documents constructed by heterogeneous template [4].…”

Section: Content Extractionmentioning

confidence: 99%

Authoring of Personalized Web Page from Heterogeneous Web Pages by Content Extraction and Integration

Weigang¹,

Sun²,

Wang³

2017

Proceedings of the International Conference on Computer Networks and Communication Technology (CNCT 2016)

View full text Add to dashboard Cite

Abstract. Authoring of personalized Web page by integrating heterogeneous Web page elements from different sites is a challenging task in Web 2.0 applications. An approach to extract various of partitions or elements, which can be the basic HTML elements, CSS definitions, JavaScript source code, etc, from different Web sites, thus implementing authoring of new page from heterogeneous Web pages is proposed in this paper. A novel DOM tree model, CS-DOM tree, is introduced to retrieve the CSS definitions. In order to assure that the new Web pages keep updating synchronized with the source pages, a method based on the structure of DOM and the context of elements to relocate the elements that have been retrieved before is then presented. The similarity calculation algorithm used to judge whether the relocated elements and the elements retrieved before are from the same position is developed at last. The method proposed in this paper has been applied to develop a personalized portal.

show abstract

Section: Content Extractionmentioning

confidence: 99%

Authoring of Personalized Web Page from Heterogeneous Web Pages by Content Extraction and Integration

Weigang¹,

Sun²,

Wang³

2017

Proceedings of the International Conference on Computer Networks and Communication Technology (CNCT 2016)

View full text Add to dashboard Cite

show abstract

“…Then, the block with the highest blockimportance value is determined as the main/content block. Examples are approaches proposed by Tseng & Kao (2006) and Li & Yang (2009). Tseng & Kao (2006) proposed some features for measuring the importance of a block, i.e.…”

Section: Related Workmentioning

confidence: 99%

“…The importance of a block is defined as the product of the three measures. Different from Tseng & Kao (2006), Li & Yang (2009) employ the attenuation quotient and the importance of HTML item and content item. The attenuation quotient is used to decrease the node importance when a node is closer to the root.…”

Section: Related Workmentioning

confidence: 99%

“…The work presented in this paper adopts and modifies the CST approach proposed by Li & Yang (2009). Different from the approach (Li & Yang, 2009), our approach employs the following strategy: 1. Employing HTML cleaner before processing pages.…”

Section: Related Workmentioning

confidence: 99%

“…The CST approach (Li & Yang, 2009) consists of two steps: (1) building the CST of an HTML page, and (2) measuring the importance of nodes which represents nested blocks, and determining the block with the highest importance value as the main block of the page. The CST contains two types of nodes: HTML item node and content node types.…”

Section: Extended Cst Approachmentioning

confidence: 99%

See 2 more Smart Citations

Extracting Main Content-Blocks From Blog Posts

Akbar¹,

Slaughter²,

Nytrø³

2010

Proceedings of the International Conference on Knowledge Discovery and Information Retrieval

View full text Add to dashboard Cite

A blog post typically contains defined blocks containing different information such as the main content, a blogger profile, links to blog archives, comments, and even advertisements. Thus, identifying and extracting the main/content block of blog posts or web pages in general is important for information extraction purposes before further processing. This paper describes our approach for extracting main/content block from blog posts with disparate types of blog markup. Adapting the Content Structure Tree (CST)-based approach, our approach proposed a new consideration in calculating the importance of HTML content nodes and in definition of the attenuation quotient suffered by HTML item/block nodes. Performance using this approach is increased because posts published in the same domain tend to have similar page template, such that a general main content marker could be applied for them. The approach consists of two steps. In the first step, the approach employs the modified CST approach for detecting the primary and secondary markers for page cluster. In the next step, it uses HTMLFilter to extract the main block of a page, based on the detected markers. When HTMLFilter cannot find the main block, the modified CST is used as the second alternative. Some experiments showed that the approach can extract main block with an accuracy of more than 94%.

show abstract