Crawl Topical Vietnamese Web Pages Using Genetic Algorithm

Nhan, Nguyen Quoc; Son, Vu Tuan; Bình, Huỳnh Thị Thanh; Khanh, Tran Duc

doi:10.1109/kse.2010.25

Cited by 5 publications

(3 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…C# provides libraries to access data via computer networks and to develop multithreading architecture. To crawl Vietnamese webpages used word segmentation, and a genetic algorithm implemented in C#. A Linux‐based learnable topic‐specific Web crawler is implemented in C .…”

Section: Current Status Of Web Crawlermentioning

confidence: 99%

“…The News article contents are extracted from News‐related webpages to generate full‐text‐rich site summary (RSS) file. Nhan et al proposed a similar method based on genetic algorithm to crawl Vietnamese webpages. Putra and Akbar proposed a modification of WebSPHIX for Javanese and Sundanese corpus construction.…”

Section: Current Status Of Web Crawlermentioning

confidence: 99%

“…Most of the studies of topic‐oriented crawler use this category as a subject system. Ref uses diverse topics as world cup soccer, information visualization, and Titanic. Studies using more than one topics are also listed in Table .…”

Section: Current Status Of Web Crawlermentioning

confidence: 99%

See 2 more Smart Citations

A survey of Web crawlers for information retrieval

Kumar

Bhatia

Rattan

2017

WIREs Data Min & Knowl

View full text Add to dashboard Cite

Performance of any search engine relies heavily on its Web crawler. Web crawlers are the programs that get webpages from the Web by following hyperlinks. These webpages are indexed by a search engine and can be retrieved by a user query. In the area of Web crawling, we still lack an exhaustive study that covers all crawling techniques. This study follows the guidelines of systematic literature review and applies it to the field of Web crawling. We used the standard procedure of carrying out a systematic literature review on 248 studies from a total of 1488 articles published in 12 leading journals and other premier conferences and workshops. Existing literature about the Web crawler is classified into different key subareas. Each subarea is further divided according to the techniques being used. We analyzed the distribution of various articles using multiple criteria and depicted conclusions. Various studies that use open source Web crawlers are also reported. We have highlighted future areas of research. We call for an increased awareness in various fields of the Web crawler and identify how techniques from other domains can be used for crawling the Web. Limitations and recommendations for future are also discussed. WIREs Data Mining Knowl Discov 2017, 7:e1218. doi: 10.1002/widm.1218 This article is categorized under: Algorithmic Development > Web Mining Fundamental Concepts of Data and Knowledge > Information Repositories Fundamental Concepts of Data and Knowledge > Motivation and Emergence of Data Mining

show abstract

Section: Current Status Of Web Crawlermentioning

confidence: 99%

Section: Current Status Of Web Crawlermentioning

confidence: 99%