An intelligent offline filtering agent for website analysis and content rating

Abstract

The unregulated nature of the web means that anyone can make content available on the web, some of which could be harmful to children and unsuspecting adults. Content filtering is aimed at blocking out undesirable material from reaching the end user. Most existing software content filters make use an access control list which involves some sort of manual search, gathering and classification of undesirable web sites so that the software filter can block the access of these URLs. In this paper, we describe an Offline filtering Agent in terms of its two main modules: automated web page crawling and intelligent classification modules.Experimental results based on 1250 web pages are presented to show the effectiveness of our system. On the testing set, the agent was able to achieve a correct acceptance rate of 97% and a correct reject rate of 92.6%..

RSS Feeds Filtering from multiple sources using automated techniques of Natural Language Processing

“…The authors of (Fong et al, 2010) state that content filtering aims to keep undesirable content from getting to the user. Currently available software content filters typically use an access control list, which requires human search, collection, and classification of unwanted websites before the software filter may prevent access to these URLs.…”

Multi-Level Secure Architecture for Mobile Web Services using Intelligent Mobile Agents and Intelligent Content Filter

“…Fong et al [10] have developed an architecture for an intelligent offline content filtering agent. The Offline Filtering Agent includes two major modules such as WebCrawler and WebParser.…”

Distributed Agents for Web Content Filtering

“…To address the problem of web content filtering system some strategies have been used, some used packet filtering approach, this method concern about IP address, but the IP address represents a particular host and this host can contain more than one sites, some of these sites considered acceptable, when blocking this IP this cause to block all the acceptable sites [3], also the control access list of IP is generated manually and this required great human efforts, Other used white/black lists of resources, they classified the sites to white and black, respectively. Such classification is performed by rating agencies, where manual collection and classification is required [4].…”