A Systematic Review Web Content Mining Tools and its Applications

Abstract

In recent years, the emergence of WWW (World Wide Web) led to the accumulation of huge amount of information and data. Hence the web is found to consist of unstructured and structured information that impacts the day to day life of the society. Because of such availability of huge information, utilization of the required information becomes more challenging. This paper provided a comprehensive survey on the current situation and recent trends on web content mining (WCM) and its applications thereby contributing to the enhancement of the upcoming research in WCM. The paper focused mainly on the mining and retrieval techniques, various WCM approaches, challenges and process of information retrieval and information extraction. The paper describes the four major tasks of web content mining that is information retrieval, information extraction, generalization and validation in detail. WCM concentrates on orchestrating, sorting, classifying, collecting, congregating of web data and provide the improved data which can be easily accessed by the users. Web content mining tools were needed to scan text, images and HTML documents and provide results to the search engine. It guides the search engine to provide better productive results for every search based on their importance. The paper also analysed different web content mining tools for the extraction of relevant information from the corresponding web page.

Physiological Response to Cyber and Psychological Deception

“…Naturally, solutions should limit human-in-the-loop presence by, e.g., handling multi-domain data, and be flexible with regard to possible data sources. Specifically, considering that many systems have web interfaces, the concept of web content mining (mining information from web documents, often using NLP techniques) is applicable [3]. The solution, outlined in this work, extends web content mining, since it is applicable to screenshots that can originate from any system, supporting business analytics and process mining [4].…”

Information Retrieval Based on DOM Trees

“…The extension has several functionalities, such as creating a dataset, curating data, executing JavaScript/TypeScript extraction algorithms, and evaluating those algorithms using multiple measures. Additionally, we found in the literature several systematic reviews [98,89] and comparisons [106,115] of content extraction algorithms. We used the datasets and metrics proposed by those comparisons to evaluate our page-level content extraction algorithm so we could compare the obtained results with them.…”