Data smells in public datasets

Arumoy, Shome,; Cruz, Luís; Deursen, Arie van

doi:10.1145/3522664.3528621

Cited by 15 publications

(1 citation statement)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interviewees had a desire for more guidance on what constitutes common practice for their workflows, which dovetails with previous work into frameworks/exemplars for checking common issues in data [34], [35] and narrative schema for the visualisation process [36]. That said, the need for flexibility -or rather not too much rigidity -was something our respondents cited as a reason not to overformalise and this too was echoed by the 2021 DVS survey where 38% respondents cited "lack of customisation, flexibility, or versatility" as the biggest challenge when working with tools selected by others in their organisation [33].…”

Section: Discussionmentioning

confidence: 95%

Tasks and Visualizations Used for Data Profiling: A Survey and Interview Study

Ruddle

Cheshire

Fernstad

2024

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

The use of good-quality data to inform decision making is entirely dependent on robust processes to ensure it is fit for purpose. Such processes vary between organisations, and between those tasked with designing and following them. In this paper we report on a survey of 53 data analysts from many industry sectors, 24 of whom also participated in in-depth interviews, about computational and visual methods for characterizing data and investigating data quality. The paper makes contributions in two key areas. The first is to data science fundamentals, because our lists of data profiling tasks and visualization techniques are more comprehensive than those published elsewhere. The second concerns the application question "what does good profiling look like to those who routinely perform it?", which we answer by highlighting the diversity of profiling tasks, unusual practice and exemplars of visualization, and recommendations about formalizing processes and creating rulebooks.

show abstract

Section: Discussionmentioning

confidence: 95%