From Documents to Data: A Framework for Total Corpus Quality

Bodell, Miriam Hurtado; Magnusson, Måns; Mützel, Sophie

doi:10.1177/23780231221135523

Cited by 10 publications

(9 citation statements)

References 93 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The chapter suggests that as the toolbox of ML approaches expands, so will the need for methodological reflection on the datasets and algorithms used, analyzed, and interpreted. Research needs to consider the production, curation, and limitation of each dataset by considering each corpus as a product of social practices and decisions (Mützel, 2015a), and thus of a certain data quality (Hurtado Bodell et al, 2022). For sociological research, the growing toolbox also contains data sources other than text, like sounds and images.…”

Section: Conclusion: Generating Theoretical Insights and Methodologic...mentioning

confidence: 99%

“…The field has begun to systematically develop such guidelines and standards for ML research methods in general (Kapoor et al, 2023) and, separately, for data quality. Hurtado Bodell, Magnusson, & Mützel (2022) propose a framework for assessing total corpus quality that identifies all stages-study design, data collection, processing, and, finally, analysis-at which potential errors in working with a digitized dataset can occur. They use digitized Swedish newspapers to demonstrate the framework yet underscore its application to other projects that use sound, images, or digital data.…”

Section: Developing a Culture Of Datamentioning

confidence: 99%

See 1 more Smart Citation

Machine Learning and the Analysis of Culture

Mützel,

Ollion

2024

Preprint

View full text Add to dashboard Cite

The focus of this chapter is on how machine learning (ML) impacts the analysis of culture in sociology. It shows how ML has greatly advanced the analysis of culture, with new tools enabling a massive and fine-grained extraction of information from textual and audiovisual troves as well as data analysis, operationalizing long-standing cultural sociology concepts. It also indicates that this renewed interest is building on already fertile ground, as sociologists of culture have long used and reflected on formal models when analyzing culture. The chapter suggests that as the toolbox of ML approaches expands, so will the need for methodological reflection on the datasets and algorithms used, analyzed, and interpreted. The chapter also suggests that ML techniques can serve as catalysts to generate new theoretical insights. The chapter’s conclusion discusses the potential of ML research to generate new theoretical insights abductively and advocates for methodological reflexivity.

show abstract

Section: Conclusion: Generating Theoretical Insights and Methodologic...mentioning

confidence: 99%

Section: Developing a Culture Of Datamentioning

confidence: 99%

Machine Learning and the Analysis of Culture

Mützel,

Ollion

2024

Preprint

View full text Add to dashboard Cite

show abstract

“…Assessing the quality of curating work is pivotal (Hurtado Bodell et al, 2022). We evaluated the quality of the annotated Courier article corpus in two dimensions: the OCR quality, and the quality of our process of annotating and compiling the Courier articles.…”

Section: (42) Quality Assurancementioning

confidence: 99%

The Curated UNESCO Courier 1.0: Annotated Corpora for Digital Research in the Global Humanities

Martin,

Norén,

Mähler

et al. 2024

Journal of Open Humanities Data

View full text Add to dashboard Cite

The monthly magazine of the United Nations Educational, Scientific and Cultural Organization, founded in 1948 as The UNESCO Courier, represents an extraordinary resource for research on global themes in the humanities. We present the Curated Courier 1.0, a package of digital text corpora, text analysis tools, and supplementary material that aims to make the complete archive of this publication from 1948 to 2020 machine-readable, accessible, and reusable for digital text analysis. One corpus compiles the text of all articles, which we carefully reconstructed and linked to a comprehensive curated metadata index while excluding additional text (masthead, photo captions, letters to the editor, and so on). A second corpus brings together the complete text of all issues. This article first presents the value of Courier as a source for digital research in the global humanities. Second, it outlines how we created the curated corpus and discusses some challenges we met. Third, it offers examples of tools researchers might use to explore and utilize the annotated corpus and discusses a few approaches that we have developed and tested. (1.2) COURIER: A RESOURCE FOR RESEARCH IN THE GLOBAL HUMANITIESIf there has ever been such a thing as a global magazine, it may have been The UNESCO Courier. Founded in 1948, its mission was to "promote UNESCO's ideals, maintain a platform for the dialogue between cultures, and provide a forum for international debate." 2 Initially formatted like a newspaper, Courier served UNESCO first as a tool for informing readers worldwide about the organization and its activities. By the mid-1950s, in conjunction with its transition into a monthly illustrated magazine format, it became an "opinion journal tackling topics covered by UNESCO's mandate"-that is, education, science, culture and communications-"but with little reference to activities carried out or official points of view" (Defourny 2003: 428-429). 1 https://courier.unesco.org/en/archives (accessed 19 January 2024). 2 https://courier.unesco.org/en/about (accessed 19 January 2024).

show abstract

“…The second part details our exploratory work at KBLab, the library's data lab for digital research [8], in testing AI models to curate the digitized newspaper material. We have two key aims with such an account: providing orientation for researchers interested in using KB's newspaper data; and contributing towards a recent trend foregrounding an active approach to data readiness [7,9,10].…”

Section: Introductionmentioning

confidence: 99%

AI, Data Curation and the Data Readiness of Heritage Collections: Exploring the Swedish Newspaper Archive at KBLab

Sikora,

Haffenden

2024

Linköping Electronic Conference Proceedings

View full text Add to dashboard Cite

The increasing availability of digital material and tools for large-scale computational analysis has produced a growing interest in big data approaches in the humanities and social sciences. However, the vital role of data curation as a precondition for such projects remains underappreciated. This paper details the work of KBLab at the National Library of Sweden in testing AI tools to help curate the digitized newspaper archive and make it more amenable to quantitative, machine learning-based research. It provides a description of the library’s newspaper data to offer orientation to researchers interested in the material, before turning to recount the results of our exploration with automated data curation. It concludes by sketching possible next steps for these exploratory efforts, as well as situating this project within a broader recent turn to conceptualize and prioritize the notion of data readiness. Its principal argument is in drawing attention to data curation as an essential part of any digital research project, not something prior to or external from the research process.

show abstract

From Documents to Data: A Framework for Total Corpus Quality

Cited by 10 publications

References 93 publications

Machine Learning and the Analysis of Culture

Machine Learning and the Analysis of Culture

The Curated UNESCO Courier 1.0: Annotated Corpora for Digital Research in the Global Humanities

AI, Data Curation and the Data Readiness of Heritage Collections: Exploring the Swedish Newspaper Archive at KBLab

Contact Info

Product

Resources

About