Classification of Web Pages Using the Machine Learning Algorithms with Web Page Recommendations

Abstract

The World Wide Web holds a huge source of a variety of information. Web users are provided with a lot of information with numerous options and choices because of which decision-making will be difficult for the users. The users must be provided with a recommendation system that makes it easy for making their decisions, one such system is the web page recommendation system. The problem faced by web users is they can't get the required web pages when they search the web. To provide the solution to this problem web page recommendation systems are proposed.Recommendation system provides the users with interesting Webpages or websites where they can be reduced their searching time or surfing time. The web user needs effective and some suggestions for accessing the website efficiently. Therefore, the web recommendation systems are very useful for the user by efficiently handling the website. In the proposed work Web page recommendation system is implemented based on web page classification and by determining the page rank, where the classification of the web pages is done based on the machine learning algorithms. The classification techniques are used with the various machine learning algorithms in our work which are k-nearest neighbor, support vector machine, ADABOOSTER, and entropy-based ensemble Random Forest. The proposed algorithm in our research work is an entropy-based ensemble random forest. The novelty of this research work is the use of the entropy-based ensemble random forest. The web scraping technique has been used to fetch images and text from various websites. The data collected of 3000 are pre-processed and applied to the various classifiers to classify the web pages. The web pages were classified with the highest accuracy of 99.55% using the entropy-based ensemble random forest. The comparison of the entropy based random forest and the Gini-based random forest is shown to achieve the novelty. We have taken the data from the web pages in the form of images of around 17034 are classified them using the convolution neural network and pre-trained convolution neural network known as Resnet50. Compared its results with our proposed ensemble entropy-based random forest. Based on the web classification the web page recommendation is done. The page ranks for the collected web pages are calculated and the web page which will be similar to the given web page will be given as output. The page rank algorithm is used for the calculation of page rank. For every source website, a similar target web page is calculated. This is going to form the recommendation system.