NADEEF: A generalized data cleaning system

Research output: Chapter in Book/Report/Conference proceedingChapter

22 Citations (Scopus)

Abstract

We present NADEEF, an extensible, generic and easy-to-deploy data cleaning system. NADEEF distinguishes between a programming interface and a core to achieve generality and extensibility. The programming interface allows users to specify data quality rules by writing code that implements predefined classes. These classes uniformly define what is wrong with the data and (possibly) how to fix it. We will demonstrate the following features provided by NADEEF. (1) Heterogeneity: The programming interface can be used to express many types of data quality rules beyond the well known CFDs (FDs), MDs and ETL rules. (2) Interdependency: The core algorithms can interleave multiple types of rules to detect and repair data errors. (3) Deployment and extensibility: Users can easily customize NADEEF by defining new types of rules, or by extending the core. (4) Metadata management and data custodians: We show a live data quality dashboard to effectively involve users in the data cleaning process.

Original languageEnglish
Title of host publicationProceedings of the VLDB Endowment
Pages1218-1221
Number of pages4
Volume6
Edition12
Publication statusPublished - Aug 2013

    Fingerprint

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

Ebaid, A., Elmagarmid, A., Ilyas, I. F., Ouzzani, M., Quiane Ruiz, J. A., Tang, N., & Yin, S. (2013). NADEEF: A generalized data cleaning system. In Proceedings of the VLDB Endowment (12 ed., Vol. 6, pp. 1218-1221)