With the increase in number of pages being published every day, there is a need to design an efficient crawler mechanism which can result in appropriate and efficient search results for every query. Everyday people face the problem of inappropriate or incorrect answer among search results. So, there is strong need of enhance methods to provide precise search results for the user in acceptable time frame. So this paper proposes an effective approach of building a crawler considering factors of URL ranking, load on the network and number of pages retrieved. The main focus of the paper is on designing of a crawler to improve the effective ranking of URLs using a focused crawler.
In a large collection of web pages, it is difficult for search engines to keep their online repository updated. Major search engines have hundreds of web crawlers that crawl the WWW day and night and send the downloaded web pages via a network to be stored in the search engine’s database. These results in over utilization of network resources like bandwidth, CPU cycles and so on. This paper proposes an architecture that tries to reduce the utilization of shared network resources with the help of an advanced XML based approach. This focused crawling based architecture is trained to download only the high quality data from the internet leaving behind the web pages which are not relevant to the desired domain. Here, a detailed layout of the proposed system is described which is capable of reducing the load on network and reducing the problem arise in residency of mobile agent at the remote server.
Wireless and mobile devices and networks are an integral part of today’s life. With the advancement of technology, a large number of smart devices with advanced computational and communicational types of equipment are designed and developed. With these advancements, the availability
of services over these devices is required to be of high quality for ensuring better experiences day by day. Thus, network performance improvement with minimum path loss and optimized packet delivery without loops is a major concern to integrate the existing network infrastructure with advanced
and future networks. This work has designed a novel route deviation and optimization algorithm with simulation optimization and energy efficiency constraints. The simulation-optimization approach is considered to have minimum link losses and avoid the loop problem. Whereas, local and global
simulation optimization processes are followed to identify the best possibilities in route identification in consideration with local and network environment settings. The proposed approach is statistically found to have a minimum error rate and optimizes the performance with computational
and communicational overheads. In results, a minimum of 10 seconds and a maximum of 150 seconds are observed before a device using the proposed approach gets utilized fully. Thus, the proposed approach is very effective for link loss and loop problems in wireless sensor networks. Further,
an improvement of 135 (approx.) is observed in the proposed approach.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.