The evolution of web archiving

Costa, Miguel; Gomes, Daniel; Silva, Mário J.

doi:10.1007/s00799-016-0171-9

Cited by 58 publications

(37 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Several organizations began crawling the web in the mid‐1990s, and in 2003 the International Internet Preservation Consortium (IIPC) was formed, with founding members including the nonprofit Internet Archive as well as national libraries and archives (http://netpreserve.org/about-us). Currently, this approach has extended to an increasing number of institutional web archiving initiatives, especially in colleges and universities (Bailey, Grotke, McCain, Moffatt, & Taylor, ; Costa, Gomes, & Silva, ; Truman, ).…”

Section: Introductionmentioning

confidence: 99%

If these crawls could talk: Studying and documenting web archives provenance

Maemura

Worby

Milligan

et al. 2018

Asso for Info Science & Tech

View full text Add to dashboard Cite

The increasing use and prominence of web archives raises the urgency of establishing mechanisms for transparency in the making of web archives to facilitate the process of evaluating a web archive's provenance, scoping, and absences. Some choices and process events are captured automatically, but their interactions are not currently well understood or documented.This study examines the decision space of web archives and its role in shaping what is and what is not captured in the web archiving process. By comparing how three different web archives collections were created and documented, we investigate how curatorial decisions interact with technical and external factors and we compare commonalities and differences.The findings reveal the need to understand both the social and technical context that shapes those decisions and the ways in which these individual decisions interact. Based on the study, we propose a framework for documenting key dimensions of a collection that addresses the situated nature of the organizational context, technical specificities, and unique characteristics of web materials that are the focus of a collection. The framework enables future researchers to undertake empirical work studying the process of creating web archives collections in different contexts.

show abstract

Section: Introductionmentioning

confidence: 99%

If these crawls could talk: Studying and documenting web archives provenance

Maemura

Worby

Milligan

et al. 2018

Asso for Info Science & Tech

View full text Add to dashboard Cite

show abstract

“…(13) Archive the entrypoint in multiple web archives, which will implicitly archive the latest block as well due to the redirect. Although the number of public web archives is increasing [12,15], only a few of them support an on-demand web archiving service. However, a small number (greater than one) of independent on-demand archives can su ce for of the purpose of disseminating manifests.…”

Section: Block Disseminationmentioning

confidence: 99%

Archive Assisted Archival Fixity Verification Framework

Aturban

Alam

Nelson

et al. 2019

2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL)

View full text Add to dashboard Cite

e number of public and private web archives has increased, and we implicitly trust content delivered by these archives. Fixity is checked to ensure an archived resource has remained unaltered since the time it was captured. Some web archives do not allow users to access xity information and, more importantly, even if xity information is available, it is provided by the same archive from which the archived resources are requested. In this research, we propose two approaches, namely Atomic and Block, to establish and check xity of archived resources. In the Atomic approach, the xity information of each archived web page is stored in a JSON le (or a manifest), and published in a well-known web location (an Archival Fixity server) before it is disseminated to several on-demand web archives. In the Block approach, we rst batch together xity information of multiple archived pages in a single binary-searchable le (or a block) before it is published and disseminated to archives. In both approaches, the xity information is not obtained directly from archives. Instead, we compute the xity information (e.g., hash values) based on the playback of archived resources. One advantage of the Atomic approach is the ability to verify xity of archived pages even with the absence of the Archival Fixity server. e Block approach requires pushing fewer resources into archives, and it performs xity veri cation faster than the Atomic approach. On average, it takes about 1.25X, 4X, and 36X longer to disseminate a manifest to perma.cc, archive.org, and webcitation.org, respectively, than archive.is, while it takes 3.5X longer to disseminate a block to archive.org than perma.cc.e Block approach performs 4.46X faster than the Atomic approach on verifying the xity of archived pages. 3 wax.lib.harvard.edu/collections/home.do 4

show abstract

“…A velocidade em que perderemoso acesso às informações produzidas e disponibilizadas na web é um dos maiores fatores de preocupação. Emartigo publicado em 2016, revela-se que 80% das páginas web não estão disponíveis na sua forma original após 1 ano, 13% das referências da web em artigos acadêmicos desaparecem após 27 meses e 11% dos recursos de mídia social, como os postados no Twitter, são perdidos após 1 ano (COSTA, GOMES, SILVA, 2016).…”

Section: O Que é O Arquivamento Da Web E Como Funciona?unclassified

Arquivamento da web

Rockembach

2017

RDBCI rev. dig. Bibliotecon. e Ci. Info.

View full text Add to dashboard Cite

O objetivo deste estudo foi delimitar conceitualmente e teoricamente o tema arquivamento da web, além de verificar estudos de caso internacionais e a situação brasileira sobre este tema. Pesquisa de natureza exploratória-descritiva, utiliza abordagem qualitativa, com a aplicação de metodologia de seleção e análise de estudos de caso internacionais para exemplificar o funcionamento do arquivamento da web em vários países, além da análise do contexto brasileiro. São abordados os modelos de processo e ciclo de vida do arquivamento da web, bem como aspectos legais. Dos exemplos encontrados, foram selecionados seis estudos de caso internacionais, contemplando uma variedade de contextos (organizações sem fins lucrativos, arquivos nacionais, bibliotecas regionais, bibliotecas nacionais, universidades, provedores de serviços), não encontrando nenhum sistema específico de arquivamento da web brasileira documentado na literatura, com somente alguns assuntos arquivados de forma esparsa. A investigação diferencia-se por trazer um tópico de pesquisa ainda incipiente no país, mas com muitas possibilidades de estudo. Conclui que é preciso fomentar a discussão no panorama nacional e sugere que iniciativas sejam desenvolvidas para o arquivamento da web brasileira.

show abstract

The evolution of web archiving

Cited by 58 publications

References 27 publications

If these crawls could talk: Studying and documenting web archives provenance

If these crawls could talk: Studying and documenting web archives provenance

Archive Assisted Archival Fixity Verification Framework

Arquivamento da web

Contact Info

Product

Resources

About