Data quality evaluation: a comparative analysis of company registers’ open data in four European countries

Abstract

This paper is devoted to the analysis of open data quality of the company registers in four different countries. The data quality evaluation was obtained using a methodology that involves the creation of three-part data quality model: (1) the definition of a data object to analyse its quality, (2) data object quality specification using DSL, (3) the implementation of an executable data quality model enabling the scanning of a data object and detecting its deficiencies. All three components of the data quality model are designed as graphical language families, which allow formulating data quality specification for non-IT professionals. Validation of an open data published by company registers in four different European countries shows deficiencies in the published data and demonstrates the applicability of the proposed methodology for data quality evaluation. Index Terms-data quality, executable models, Company registerCommunication

Towards Data Quality Runtime Verification

“…However, data object-driven model can be used by wide audience without need to make in-depth analysis of the basics of the approach as it usually happens with other approaches where at least an exploration of the list of dimensions, their meanings and criteria under each of them, needs a lot of time for every particular solution as criteria differentiate from case to case [3], [6], [7]. At the same time, the proposed approach already demonstrated its effectiveness by applying it to real datasets [4], [6] - [8].…”

“…Data object is defined in accordance with data needed to be analysed, the parameters that do not make sense for particular users and use-cases are ignored. Data objects of the same structure form data object class where each individual data object may contain parameter values fully or partially [4]. Similarly, data quality specification is defined by user depending on the use-case.…”

“…DSL for defining of data objects is discussed in detail in [4] and [6]. As more and more customers are using electric scooter renting services, this will serve as an example to explain the proposed solution.…”

Open Data Quality Evaluation: A Comparative Analysis of Open Data in Latvia

“…Overlapping of these two groups is possible. In previous papers (( Bicevska et al, 2017), (Bicevskis et al, 2018a(Bicevskis et al, , 2018b, (Nikiforova, 2018)) only "IT-expert" or "ITprofessional" concepts were used. Person was considered as IT-expert if he/she has ITbackground.…”

“…(3) codes doesn't correspond with the specified format or length; (4) specific fields or few records are filled with 'x' char or '0'. More detailed analysis of these data sets with description of more specific data quality problems for each analysed Company Register, is available in (Bicevskis et al, 2018b). These results show that processed data set has quality problems even in those fields, which have primary company informationname, registration number and registration date.…”