Capturing and Visualizing Provenance from Data Wrangling

Author
Editor
Keywords
Abstract
Data quality management and assessment play a vital role for ensuring the trust in the data and its fitness-of-use for subsequent analysis. The transformation history of a data wrangling system is often insufficient for determining the usability of a dataset, lacking information how changes affected the dataset. Capturing workflow provenance along the wrangling process and combining it with descriptive information as data provenance can enable users to comprehend how these changes affected the dataset, and if they benefited data quality. We present DQProv Explorer, a system that captures and visualizes provenance from data wrangling operations. It features three visualization components, allowing the user to explore (1) the provenance graph of operations and the data stream, (2) the development of quality over time for a sequence of wrangling operations applied to the dataset, and (3) the distribution of issues across the entirety of the dataset to determine error patterns.
Year of Publication
2019
Journal
Computer Graphics & Applications
Issue
Special Issue on Provenance and Logging for Sense Making
Date Published
11/2019
DOI
10.1109/MCG.2019.2941856
Funding projects
Attachments