Life span of web pages: A survey of 10 million pages collected in 2001

Agata, Teru; Miyata, Yosuke; Ishita, Emi; Ikeuchi, Atsushi; Ueda, Shuichi

doi:10.1109/jcdl.2014.6970226

Cited by 8 publications

(4 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…První z problémů týkajících se výzkumu internetového prostředí je celkem zřejmý, a to je stálost a stabilita takového prostředí, ve kterém se pohybuje nepřeberné množství subjektů/autorů, kteří mohou poměrně snadným způsobem obsah měnit nebo zcela zničit. O rychle se měnícím prostředí vypovídá například studie Agata et al [2014], kteří zkoumali převážně v japonské webové doméně dobu "přežití" webových stránek na vzorku 10 miliónů. Zjistili, že po dvanácti letech 91 % stránek na "živém webu" neexistuje (po dvou letech už nebylo dosažitelných 47 % z nich).…”

Section: Institucionalizace Webových Archivůunclassified

Web Archives and Social Sciences: Opportunities, Problems and Solutions

Pilnáček¹,

Tabery²,

Vávra³

2019

Naše Společnost

View full text Add to dashboard Cite

the Czech Republic and abroad. In the second section, we discuss issues of accessing web archive data. We distinguish technological access limitations, where the researcher is faced with large amounts of data and computing requirements, legal, and ethical limitations. Legal limitations break up to ones related to copyright and personal data protection. The article emphasises that there are ethical limitations in addition to technological and legal ones, which the researcher should always keep in mind and which should be respected in his/her approaching the data. As a partial solution to data access limitations, the article proposes creating and operating an analytical interface through which researchers could obtain aggregate web archive data without direct access to primary data.

show abstract

Section: Institucionalizace Webových Archivůunclassified

Web Archives and Social Sciences: Opportunities, Problems and Solutions

Pilnáček¹,

Tabery²,

Vávra³

2019

Naše Společnost

View full text Add to dashboard Cite

show abstract

“…With access to existing Web archives, more recent studies of the Web were conducted retrospectively on available data [29,30,31]. However, instead of analyzing the whole archive at once, all of them focus on a particular subset, such as national domains.…”

Section: Web Dynamics Analysismentioning

confidence: 99%

Accessing web archives from different perspectives with potential synergies

Holzmann¹,

Risse²

2017

Researchers, Practitioners and Their Use of the Archived Web

View full text Add to dashboard Cite

Abstract. Web archives constitute a valuable source for researchers from many disciplines. However, their sheer size, the typically broad scope and their temporal dimension make them difficult to work with. We have identified three approaches to access and explore Web archives from different perspectives: user-, data-and graph-centric. In this paper we present related works on these three views as well as discuss their relations and potential synergies. Finally, we propose a generic analysis schema that outlines a systematic way to study Web archives by approaching them from different zoom levels corresponding to the three presented views.

show abstract

“…As in our study their collection was also crawled and provided by the Internet Archive. Another recent work by Agata et al [9] analyzed a collection of 10 million mainly Japanese pages in 2001, which was collected by the Internet Archive as well and is also based on metadata. They report a webpage's average life span of a little more than three years.…”

Section: Related Workmentioning

confidence: 99%

The Dawn of Today's Popular Domains

Holzmann

Nejdl

Anand

2016

Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries

View full text Add to dashboard Cite

The Web has been around and maturing for 25 years. The popular websites of today have undergone vast changes during this period, with a few being there almost since the beginning and many new ones becoming popular over the years. This makes it worthwhile to take a look at how these sites have evolved and what they might tell us about the future of the Web. We therefore embarked on a longitudinal study spanning almost the whole period of the Web, based on data collected by the Internet Archive starting in 1996, to retrospectively analyze how the popular Web as of now has evolved over the past 18 years.For our study we focused on the German Web, specifically on the top 100 most popular websites in 17 categories. This paper presents a selection of the most interesting findings in terms of volume, size as well as age of the Web. While related work in the field of Web Dynamics has mainly focused on change rates and analyzed datasets spanning less than a year, we looked at the evolution of websites over 18 years. We found that around 70% of the pages we investigated are younger than a year, with an observed exponential growth in age as well as in size up to now. If this growth rate continues, the number of pages from the popular domains will almost double in the next two years. In addition, we give insights into our data set, provided by the Internet Archive, which hosts the largest and most complete Web archive as of today.

show abstract

Life span of web pages: A survey of 10 million pages collected in 2001

Cited by 8 publications

References 4 publications

Web Archives and Social Sciences: Opportunities, Problems and Solutions

Web Archives and Social Sciences: Opportunities, Problems and Solutions

Accessing web archives from different perspectives with potential synergies

The Dawn of Today's Popular Domains

Contact Info

Product

Resources

About