CensusIRL: Historical census data preparation with MDD support

Doherty, Adam J.; Murphy, Rachel; Schieweck, Alexander; Clancy, Stuart; Breathnach, Ciara; Margaria, Tiziana

doi:10.1109/bigdata55660.2022.10021106

2022 IEEE International Conference on Big Data (Big Data) 2022

DOI: 10.1109/bigdata55660.2022.10021106

|View full text |Cite

CensusIRL: Historical census data preparation with MDD support

Adam J. Doherty

Rachel Murphy

Alexander Schieweck

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Book4

Relationship

Self Cite0

Independent4

Authors

Journals

Cited by 4 publications

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Interoperating Civil Registration of Death and Census Data: Old Age and Marriage as Categories of Analysis

Breathnach,

Murphy,

Schieweck

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

As part of the project Death and Burial Data: Ireland 1864–1922 (DBDIrl), a web application was created in DIME, a low-code web application development environment. DIME is based on the popular IDE Eclipse and utilizes three distinct graphical model types (data model, process model and GUI model) as Domain Specific Language (DSL). Web applications are defined by means of these models in the DIME integrated modelling environment in a simple way, and these models are used to generate the web application code that is then deployed and made available to the users. This paper provides an overview of how we use a web application created in DIME, a low-code application development tool to establish interoperability between Irish historical civil registration of death data and Irish cross-sectional decennial census data from 1901 and 1911. The former data collections are complex and require manual interventions like transcription and considerable cleaning to render them machine readable, the latter are fully transcribed. Here we present a case study concerning the analysis of deaths in old age in Dublin City and how they correlate with census returns. We then turn our attention to a use case of marital status and the algorithmic problems caused by irregular replies in census data. Our objective was to test how DIME could replicate the decisions taken by domain experts using old age and marital status as the primary linkage criteria.

show abstract

Interoperating Civil Registration of Death and Census Data: Old Age and Marriage as Categories of Analysis

Breathnach,

Murphy,

Schieweck

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

From Data Science to Modular Workflows Changing Perspectives from Data to Platform: DBDIrl 1864-1922 Case Study

O’Shea,

Krumrey,

Mitwalli

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Many historical data collections foot on handwritten documents and registers, whose consultation is often very difficult due to the conservation state of the physical artefacts, and whose comprehension is also made difficult by the handwriting, difficult to interpret, and the language used, different from the modern terminology. Therefore significant research efforts by historians, demographers, population health scientists and others have been started in the past with the aim of making such data collections digitally available, first on the basis of images and then as readily available repositories of transcribed data in electronically queryable formats. For the purpose of extracting data from the Irish Civil registers of deaths in the DBDIrl 1864-1922 project (https://www.dbdirl.com), an AI-ML Data Analytics Pipeline was proposed as a working approach validated on a subset of the data. However, the pipeline requires manual steps and it is not applicable as is on similar datasets without significant modifications to its inner workings.We are currently transforming this prototyped, single purpose product to a modular, fully automated workflow, intended to be used and reconfigured for new data in a low-code/no-code fashion by domain experts like historians. We explain our adopted analysis and refactoring process, illustrate it on part of the pipeline, including how we faced obstacles and handled pitfalls. We also evaluate its potential to become a methodical approach to transforming an interactive program to a fully automated process, in a low-code/no-code workflow style, that can be easily reused, reconfigured and extended to be able to tailor it to other datasets as needed.

show abstract

A Case-Study on Structured Modeling with Internal Domain-Specific Languages

Smyth,

Tegeler,

Busch

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

CensusIRL: Historical census data preparation with MDD support

Cited by 4 publications

References 26 publications

Interoperating Civil Registration of Death and Census Data: Old Age and Marriage as Categories of Analysis

Interoperating Civil Registration of Death and Census Data: Old Age and Marriage as Categories of Analysis

From Data Science to Modular Workflows Changing Perspectives from Data to Platform: DBDIrl 1864-1922 Case Study

A Case-Study on Structured Modeling with Internal Domain-Specific Languages

Contact Info

Product

Resources

About