EPLogCleaner: Improving Data Quality of Enterprise Proxy Logs for Efficient Web Usage Mining

Sha, Hongzhou; Liu, Tingwen; Qin, Peng; Sun, Yong; Liu, Qingyun

doi:10.1016/j.procs.2013.05.104

Cited by 10 publications

(2 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Without the data cleaning phase the user and session identification is useless. This phase removes all the data tracked in web logs that is irrelevant, useless or noisy and not needed for further web usage mining phases [4,5,6,7,8]. Generally the following steps are followed to clean the web log file.…”

Section: A Data Cleaningmentioning

confidence: 99%

See 1 more Smart Citation

A Novel Semantically-Time-Referrer based Approach of Web Usage Mining for Improved Sessionization in Pre-Processing of Web Log

Kaur¹,

Aggarwal²

2017

ijacsa

View full text Add to dashboard Cite

Abstract-Web usage mining(WUM) , also known as WebLog Mining is the application of Data Mining techniques, which are applied on large volume of data to extract useful and interesting user behaviour patterns from web logs, in order to improve web based applications. This paper aims to improve the data discovery by mining the usage data from log files. In this paper the work is done in three phases. First and second phase0 which are data cleaning and user identification respectively are completed using traditional methods. The third phase, session identification is done using three different methods. The main focus of this paper is on sessionization of log file which is a critical step for extracting usage patterns. The proposed referrertime and Semantically-time-referrer methods overcome the limitations of traditional methods. The main advantage of preprocessing model presented in this paper over other methods is that it can process text or excel log file of any format. The experiments are performed on three different log files which indicate that the proposed semantically-time-referrer based heuristic approach achieves better results than the traditional time and Referrer-time based methods. The proposed methods are not complex to use. Web log file is collected from different servers and contains the public information of visitors. In addition, this paper also discusses different types of web log formats.

show abstract

Section: A Data Cleaningmentioning

confidence: 99%

“…Proxy servers accepts HTTP request from user, gives them to the web server and then result passed by the web server is returned to the user [8]. Web proxy server"s construction is difficult.…”

Section: B Web Proxy Log Filesmentioning

confidence: 99%