The Ethics of Web Crawling and Web Scraping in Cybercrime Research: Navigating Issues of Consent, Privacy, and Other Potential Harms Associated with Automated Data Collection

Brewer, Russell; Westlake, Bryce Garreth; Hart, T. P.; Arauza, Omar

doi:10.1007/978-3-030-74837-1_22

Cited by 24 publications

(9 citation statements)

References 79 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The social sciences, including criminology, have published a number of articles on web scraping as they understand the benefits of this field, but also worry about the ethical implications. The field of web scraping is legally ambiguous as ethical guidelines are not directly applicable to online research (Luscombe et al 2021 ; Brewer et al 2021 ).…”

Section: Discussionmentioning

confidence: 99%

“…As Krotov and Silva ( 2018 ) propose in their article, it would be best if organisations had ‘terms of use’ around web scraping, as currently the decision of scraping material that may be sensitive or copyrighted is left to the user, rather than having a preventable action in place (Krotov and Silva 2018 ). This is echoed by the other articles which are written from the researcher’s perspective and recommends them to consult ‘terms of use’ before considering web scraping (Mitchell 2018 ; Luscombe et al 2021 ; Brewer et al 2021 ). However, for most GLAM institutions providing online accessible digital material these guidelines are currently lacking.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks

Talboom

Bell

2022

Arch Sci

View full text Add to dashboard Cite

The UK Government Web Archive (UKGWA) has been archiving government websites since 1996 and now holds regular snapshots of over 5000 sites. Currently, this material can be accessed through browsing or a simple keyword search interface on their website and has also been catalogued in The National Archives’ online catalogue, Discovery. However, the scale of the UKGWA exposes the limits of the current search interface, and there is no facility to understand the archive in aggregate. This article seeks to go beyond the simple keyword search by exploring the data sources available, from APIs to web crawling, for computational analysis of the UKGWA. The article is accompanied by two Python Notebooks which present examples of analysis using each data source. Notebooks lower the technical barriers for the reader to explore and interpret the UKGWA as data, while surfacing the challenges around making web material computationally accessible.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks

Talboom

Bell

2022

Arch Sci

View full text Add to dashboard Cite

show abstract

“…Organizations should use security measures, such as data encryption, that prevent the use of personal information without consent or anonymity tools. Finally, if researchers do not wish to seek consent from individuals, it is important that they can prove that the research, including the collection of data and reporting of results, will have virtually no negative impact on these individuals (Brewer et al, 2021).…”

Section: Area 2 and 3: Possible Solutionsmentioning

confidence: 99%

35 th Bled eConference Digital Restructuring and Human (Re)action

2022

View full text Add to dashboard Cite

There is widespread recognition that, during the process of digitalisation, much greater care is necessary in relation to the needs of individuals and society. One key area in which tensions exist is identity management. People think that their identities are intrinsic to themselves. Yet organisations represent themselves as 'provisioning' people with their 'identities'. In addition, the model of identity that organisations typically use evidences some important deficiencies. A fresh approach is needed to the model that underpins organisations' management of their relationships with people. This needs to be based on a deeper appreciation by designers of the nature of the phenomena that they seek to document and to exercise control over. A model of those phenomena is needed that is pragmatic, in the sense of fulfilling the needs of information systems (IS) practitioners and organisations, but also of the people whose data the organisation handles. It also needs to reflect metatheoretic insights. This paper presents such a model. It commences by drawing on ontology, epistemology and axiology in order to establish an outline metatheoretic model. The model is articulated, at the conceptual level and at the data modelling level. Initially, a relatively simple model is established, sufficient for inanimate objects and artefacts. The more complex requirements of humans are then addressed. It is contended that the resulting model provides a robust framework for identification and authentication in IS. 2 35 TH BLED ECONFERENCE DIGITAL RESTRUCTURING AND HUMAN (RE)ACTION R. Clarke: A Reconsideration of the Foundations of Identity Management 3 6 35 TH BLED ECONFERENCE DIGITAL RESTRUCTURING AND HUMAN (RE)ACTION EpistemologyThis section summarises analysis in Clarke ( 2021). Epistemology is the study of knowledge. Two contrasting conceptions of knowledge exist. The proposition of the first, 'empiricism', is that knowledge is derived from sensory experience, and is a body of facts and principles accumulated by humankind over the course of time, that are capable of being stored in the equivalent of a warehouse. This works well in circumstances where the Things represented by Entities are real rather than imaginary, and are inanimate, and their handling is largely mechanical. Examples include aircraft guidance systems and robotic production-lines.The other, 'apriorist' view is that that knowledge is internal and personal, and the concept is not applicable outside the mind of an individual human. Within this school of thought, knowledge is the matrix of impressions within which an individual situates newly acquired information.In order to cater for these two extremes, the term 'Knowledge' is best avoided, except when qualified by one of two adjectives:

show abstract

“…All stages of Data Mining raise ethical concerns related to personal information, especially the collection of the data prior to the Data Mining process (Cary et al, 2003). In criminological articles, for example, ethical considerations around data collection are often not addressed by the researcher (Brewer et al, 2021).…”

Section: Area 2 and 3: Collection Of Personal Information And Consentmentioning

confidence: 99%

How to Use Data to Increase Bike Use by Travelers

Exalto-Sijbrands¹,

Baars²,

Wijers³

et al. 2022

35 Th Bled eConference Digital Restructuring and Human (Re)action

View full text Add to dashboard Cite

The Government of the Netherlands wants to be energy neutral by 2050 (Rijksoverheid, sd). A transition towards nonfossil energy sources also affects transport, which is one of the industries significantly contributing to CO2 emission (Centraal Bureau Statistiek, 2019). Road authorities at municipalities and provinces want a shift from fossil fuel-consuming to zero emission transport choices by their inhabitants. For this the Province of Utrecht has data available. However, they struggle how to deploy data to positively influence inhabitants’ mobility behavior. A problem analysis scoped the research towards data to stimulate cycling. Three interviews, desk research and a survey revealed the gap between the province’s current data-item approach that is infrastructure oriented and the required approach that adopts traveler’s personas to successfully stimulate cycling. For this more precisely defined captured data is needed and the focus should shift from already motivated cyclists to non-cyclers.

show abstract

The Ethics of Web Crawling and Web Scraping in Cybercrime Research: Navigating Issues of Consent, Privacy, and Other Potential Harms Associated with Automated Data Collection

Cited by 24 publications

References 79 publications

Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks

Keeping it under lock and keywords: exploring new ways to open up the web archives with notebooks

35 th Bled eConference Digital Restructuring and Human (Re)action

How to Use Data to Increase Bike Use by Travelers

Contact Info

Product

Resources

About