Foreword to the Special Issue “A Shared Task for the Digital Humanities: Annotating Narrative Levels”

Gius, Evelyn; Reiter, Nils; Willand, Marcus

doi:10.22148/16.047

Cited by 4 publications

(3 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Once they had completed their annotations, whenever they were in agreement, that label was used as the label on that edge. Whenever they were in disagreement, an equally qualified arbitrator decided on which label to use as the label for that edge [97][98] [99]. We did not ask the annotators to add additional nodes or edges, although both of them decided independently to annotate the Edgar Welch episode described in the article, adding two additional nodes: "Edgar Welch" and "Police".…”

Section: Discussionmentioning

confidence: 99%

An automated pipeline for the discovery of conspiracy and conspiracy theory narrative frameworks: Bridgegate, Pizzagate and storytelling on the web

Tangherlini¹,

Shahsavari

Shahbazi

et al. 2020

PLoS ONE

View full text Add to dashboard Cite

Although a great deal of attention has been paid to how conspiracy theories circulate on social media, and the deleterious effect that they, and their factual counterpart conspiracies, have on political institutions, there has been little computational work done on describing their narrative structures. Predicating our work on narrative theory, we present an automated pipeline for the discovery and description of the generative narrative frameworks of conspiracy theories that circulate on social media, and actual conspiracies reported in the news media. We base this work on two separate comprehensive repositories of blog posts and news articles describing the well-known conspiracy theory Pizzagate from 2016, and the New Jersey political conspiracy Bridgegate from 2013. Inspired by the qualitative narrative theory of Greimas, we formulate a graphical generative machine learning model where nodes represent actors/actants, and multi-edges and self-loops among nodes capture context-specific relationships. Posts and news items are viewed as samples of subgraphs of the hidden narrative framework network. The problem of reconstructing the underlying narrative structure is then posed as a latent model estimation problem. To derive the narrative frameworks in our target corpora, we automatically extract and aggregate the actants (people, places, objects) and their relationships from the posts and articles. We capture context specific actants and interactant relationships by developing a system of supernodes and subnodes. We use these to construct an actant-relationship network, which constitutes the underlying generative narrative framework for each of the corpora. We show how the Pizzagate framework relies on the conspiracy theorists' interpretation of "hidden knowledge" to link otherwise unlinked domains of human interaction, and hypothesize that this multidomain focus is an important feature of conspiracy theories. We contrast this to the single domain focus of an actual conspiracy. While Pizzagate relies on the alignment of multiple domains, Bridgegate remains firmly rooted in the single domain of New Jersey politics. We hypothesize that the narrative framework of a conspiracy theory might stabilize quickly in contrast to the narrative framework of an actual conspiracy, which might develop more

show abstract

Section: Discussionmentioning

confidence: 99%

An automated pipeline for the discovery of conspiracy and conspiracy theory narrative frameworks: Bridgegate, Pizzagate and storytelling on the web

Tangherlini¹,

Shahsavari

Shahbazi

et al. 2020

PLoS ONE

View full text Add to dashboard Cite

show abstract

“…In the computational linguistics community, the most relevant of these setups is PAN (Plagiarism Analysis, Authorship Identification, and Near-Duplicate Detection), 14 a competition held each year in the context of the Conference and Labs of the Evaluation Forum (CLEF) conference, where teams of programmers are invited to write scripts to solve a series of shared tasks, generally focused on authorship attribution. This 'shared task' can be considered in general as a good research practice, as it implies a criticism of tools that are constantly rethought and improved through competition [Gius et al 2019].…”

Section: Word Frequencies In Stylometrymentioning

confidence: 99%

Anatomy of tools: A closer look at “textual DH” methodologies

Herrmann¹,

Frontini²,

Rebora³

2022

Preprint

View full text Add to dashboard Cite

Tool criticism has made us aware that the digital tools widely distributed in Digital Humanities have the power to reify. Therefore, the community needs a handle for gauging their validity, and a capacity for producing plausibility. But tools are not ‘just tools.’ The current panorama in Digital Literary Studies (DLS) presents a plethora of instruments, protocols and practices for processing, analyzing and visualizing data. On a general level, all of these are used to examine aspects of ‘literature’ by ways of digital representation and transformation, but a closer look reveals that the methodological ‘heirdom’ of DLS is a precarious patchwork.With this paper, it is our aim to instigate an explicit and detailed discussion about particular limitations – as well as potentials – of tools and methods in concrete scenarios of application. Taking up the current discussion around tools and research questions, our paper presents the gist from the ADHO SIG-DLS workshop “Anatomy of tools: A closer look at textual DH methodologies” that took place in Utrecht in July 2019.Having identified Textométrie, Stylometry, and Semantic Text Mining as three central types of ‘doing DLS’, we ask: What are our tools and methods-in-use? What are the implications of using a tool-oriented perspective as opposed to a methodology-oriented one? How do either relate to research questions and theory? With an eye to the imminent issue of replicability in DH, we enquire about the range of its potential incarnations in DLS. Addressing tool-adaption to specific research domains, we discuss one of these: poetry. And finally, we present one attempt at a practical solution for handling and gauging tools/methods in DLS, the SIG-DLS Tool Inventory, which may provide both a perspective of orientation and constructive criticism. The article reflects thus a rich array of perspectives on ‘tool criticism,’ including the complementary perspective of ‘tool defense’ – arguing that we need tools and methods as a basic common ground on how to carry out fundamental operations of analysis and interpretation within a community.

show abstract

“…Beispiele für Annotationsrichtlinien zum literarischen Phänomen der Erzählebene finden sich in der Cultural-Analytics-Sonderausgabe zum SANTA shared task (Gius, Reiter et al 2019). Mit Barth (2020) und Ketschik, Murr et al (2020) befinden sich zwei von ihnen auch in diesem Band ab Seite 423.…”

Section: Beispiele Für Annotationsrichtlinienunclassified

Anleitung zur Erstellung von Annotationsrichtlinien

Reiter¹

2020

Reflektierte Algorithmische Textanalyse

Self Cite

View full text Add to dashboard Cite

In diesem Kapitel wird eine kurze Anleitung in die Entwicklung von Annotationsrichtlinien gegeben, unter der Annahme dass die Richtlinien ein Phänomen abdecken sollen, das bereits theoretisch beschrieben wurde. Ziel des Prozesses ist dann, Annotationsrichtlinien sowohl so generisch wie möglich als auch so präzise wie möglich zu gestalten. Menschliche Annotatorinnen und Annotatoren sollen auf Basis der Richtlinien sicher und zuverlässig annotieren können.

show abstract

Foreword to the Special Issue “A Shared Task for the Digital Humanities: Annotating Narrative Levels”

Abstract: This volume is the first of two, and it documents activities that we have been conducting in the past years. They are best described as "organizing shared tasks with/in/for the digital humanities" and have evolved significantly since we started.

Cited by 4 publications

References 0 publications

An automated pipeline for the discovery of conspiracy and conspiracy theory narrative frameworks: Bridgegate, Pizzagate and storytelling on the web

An automated pipeline for the discovery of conspiracy and conspiracy theory narrative frameworks: Bridgegate, Pizzagate and storytelling on the web

Anatomy of tools: A closer look at “textual DH” methodologies

Anleitung zur Erstellung von Annotationsrichtlinien

Contact Info

Product

Resources

About