Efficient web crawling with proposed URL ordering

Sandhya,; Rafiq, M. Qasim; Farooq, Omar

doi:10.1109/mspct.2011.6150516

Search citation statements

Order By: Relevance

Paper Sections

Select...

Related Work1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2017

2019

Publication Types

Select...

Article1

Other1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

(2 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Determining the content relevancy of WP, page popularity among the servers and time frequency of updation of pages caused the authors of [13] to propose a method for it. So, they used URL Ordering mechanism considering the mining of web contents, usage of pages and structure of the WP.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

An Improved Crawler Based on Efficient Ranking Algorithm

Mor¹,

Kumar²,

Rai³

2019

IJATCSE

View full text Add to dashboard Cite

With the increase in number of pages being published every day, there is a need to design an efficient crawler mechanism which can result in appropriate and efficient search results for every query. Everyday people face the problem of inappropriate or incorrect answer among search results. So, there is strong need of enhance methods to provide precise search results for the user in acceptable time frame. So this paper proposes an effective approach of building a crawler considering factors of URL ranking, load on the network and number of pages retrieved. The main focus of the paper is on designing of a crawler to improve the effective ranking of URLs using a focused crawler.

show abstract

Section: Related Workmentioning

confidence: 99%

“…The authors of [13] did not work on improving the ordering of newly updated pages in URL queue. • While maximizing the relevant pages in search results, author of [14] didn't consider the speed of crawling.…”

mentioning

confidence: 99%