Capturing User Browsing Behaviour Indicators

Punj, Deepika; Dixit, Ashutosh

doi:10.14810/ecij.2015.4203

Cited by 2 publications

(2 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are many issues [6] related to design an efficient web crawler. User interest [14] can also be considered while designing a crawler but in this paper, more emphasis is on maximum coverage and freshness of database while keeping the network traffic low. As the size of web grows exponentially, it is very difficult to crawl to the whole web and maintained the freshness of search engines repository.…”

Section: Introductionmentioning

confidence: 99%

Design of an Efficient Migrating Crawler based on Sitemaps

Deepika¹,

Dixit²

2015

IJAST

View full text Add to dashboard Cite

As the size of web keep on growing, the job of a web crawler has become more cumbersome in covering maximum web. There are enormous numbers of web pages available over the web but out of them a smaller number is available to user. A sitemap is an XML file in which a list of URLs of that particular site is mentioned. The sitemap protocol may play a very important role in covering maximum web. In this paper, the information provided by sitemap protocol is used for the purpose of crawling the quality web pages. With the help of sitemap, web crawlers will maintain their repository up-todate. It also tries to make user to access maximum pages over the web by covering as maximum as possible while crawling. It also helps crawler to visit the pages based on their change frequency and downloads updated pages only, thereby reduces unnecessary network traffic.

show abstract

Section: Introductionmentioning

confidence: 99%

Design of an Efficient Migrating Crawler based on Sitemaps

Deepika¹,

Dixit²

2015

IJAST

View full text Add to dashboard Cite

show abstract

“…In the era of ICT, search engine plays a vital role for finding relevant information (Sharma & Sharma, 2011). For relevant information both the parameters namely Users' behaviour (Deepika and Dixit, 2015c) and rich database are significant. The focus of the present paper is on maintaining the database richer.…”

mentioning

confidence: 99%

Design of a Migrating Crawler Based on a Novel URL Scheduling Mechanism using AHP

Punj

Dixit

2017

International Journal of Rough Sets and Data Analysis

View full text Add to dashboard Cite

In order to manage the vast information available on web, crawler plays a significant role. The working of crawler should be optimized to get maximum and unique information from the World Wide Web. In this paper, architecture of migrating crawler is proposed which is based on URL ordering, URL scheduling and document redundancy elimination mechanism. The proposed ordering technique is based on URL structure, which plays a crucial role in utilizing the web efficiently. Scheduling ensures that URLs should go to optimum agent for downloading. To ensure this, characteristics of both agents and URLs are taken into consideration for scheduling. Duplicate documents are also removed to make the database unique. To reduce matching time, document matching is made on the basis of their Meta information only. The agents of proposed migrating crawler work more efficiently than traditional single crawler by providing ordering and scheduling of URLs.

show abstract

Capturing User Browsing Behaviour Indicators

Abstract: ABSTRACT

Cited by 2 publications

References 4 publications

Design of an Efficient Migrating Crawler based on Sitemaps

Design of an Efficient Migrating Crawler based on Sitemaps

Design of a Migrating Crawler Based on a Novel URL Scheduling Mechanism using AHP

Contact Info

Product

Resources

About