Katara

A data cleaning system powered by knowledge bases and crowdsourcing

Xu Chu, John Morcos, Ihab F. Ilyas, Mourad Ouzzani, Paolo Papotti, Nan Tang, Yin Ye

Research output: Chapter in Book/Report/Conference proceedingConference contribution

75 Citations (Scopus)

Abstract

Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases (kbs), both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose Katara, a knowledge base and crowd powered data cleaning system that, given a table, a kb, and a crowd, interprets table semantics to align it with the kb, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that Katara can be applied to various datasets and kbs, and can efficiently annotate data and suggest possible repairs.

Original languageEnglish
Title of host publicationProceedings of the ACM SIGMOD International Conference on Management of Data
PublisherAssociation for Computing Machinery
Pages1247-1261
Number of pages15
Volume2015-May
ISBN (Print)9781450327589
DOIs
Publication statusPublished - 27 May 2015
EventACM SIGMOD International Conference on Management of Data, SIGMOD 2015 - Melbourne, Australia
Duration: 31 May 20154 Jun 2015

Other

OtherACM SIGMOD International Conference on Management of Data, SIGMOD 2015
CountryAustralia
CityMelbourne
Period31/5/154/6/15

Fingerprint

Cleaning
Repair
Learning systems
Semantics
Statistics
Industry
Experiments

ASJC Scopus subject areas

  • Software
  • Information Systems

Cite this

Chu, X., Morcos, J., Ilyas, I. F., Ouzzani, M., Papotti, P., Tang, N., & Ye, Y. (2015). Katara: A data cleaning system powered by knowledge bases and crowdsourcing. In Proceedings of the ACM SIGMOD International Conference on Management of Data (Vol. 2015-May, pp. 1247-1261). Association for Computing Machinery. https://doi.org/10.1145/2723372.2749431

Katara : A data cleaning system powered by knowledge bases and crowdsourcing. / Chu, Xu; Morcos, John; Ilyas, Ihab F.; Ouzzani, Mourad; Papotti, Paolo; Tang, Nan; Ye, Yin.

Proceedings of the ACM SIGMOD International Conference on Management of Data. Vol. 2015-May Association for Computing Machinery, 2015. p. 1247-1261.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chu, X, Morcos, J, Ilyas, IF, Ouzzani, M, Papotti, P, Tang, N & Ye, Y 2015, Katara: A data cleaning system powered by knowledge bases and crowdsourcing. in Proceedings of the ACM SIGMOD International Conference on Management of Data. vol. 2015-May, Association for Computing Machinery, pp. 1247-1261, ACM SIGMOD International Conference on Management of Data, SIGMOD 2015, Melbourne, Australia, 31/5/15. https://doi.org/10.1145/2723372.2749431
Chu X, Morcos J, Ilyas IF, Ouzzani M, Papotti P, Tang N et al. Katara: A data cleaning system powered by knowledge bases and crowdsourcing. In Proceedings of the ACM SIGMOD International Conference on Management of Data. Vol. 2015-May. Association for Computing Machinery. 2015. p. 1247-1261 https://doi.org/10.1145/2723372.2749431
Chu, Xu ; Morcos, John ; Ilyas, Ihab F. ; Ouzzani, Mourad ; Papotti, Paolo ; Tang, Nan ; Ye, Yin. / Katara : A data cleaning system powered by knowledge bases and crowdsourcing. Proceedings of the ACM SIGMOD International Conference on Management of Data. Vol. 2015-May Association for Computing Machinery, 2015. pp. 1247-1261
@inproceedings{cc1fa3c0c00d4b049b23326804158804,
title = "Katara: A data cleaning system powered by knowledge bases and crowdsourcing",
abstract = "Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases (kbs), both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose Katara, a knowledge base and crowd powered data cleaning system that, given a table, a kb, and a crowd, interprets table semantics to align it with the kb, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that Katara can be applied to various datasets and kbs, and can efficiently annotate data and suggest possible repairs.",
author = "Xu Chu and John Morcos and Ilyas, {Ihab F.} and Mourad Ouzzani and Paolo Papotti and Nan Tang and Yin Ye",
year = "2015",
month = "5",
day = "27",
doi = "10.1145/2723372.2749431",
language = "English",
isbn = "9781450327589",
volume = "2015-May",
pages = "1247--1261",
booktitle = "Proceedings of the ACM SIGMOD International Conference on Management of Data",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Katara

T2 - A data cleaning system powered by knowledge bases and crowdsourcing

AU - Chu, Xu

AU - Morcos, John

AU - Ilyas, Ihab F.

AU - Ouzzani, Mourad

AU - Papotti, Paolo

AU - Tang, Nan

AU - Ye, Yin

PY - 2015/5/27

Y1 - 2015/5/27

N2 - Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases (kbs), both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose Katara, a knowledge base and crowd powered data cleaning system that, given a table, a kb, and a crowd, interprets table semantics to align it with the kb, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that Katara can be applied to various datasets and kbs, and can efficiently annotate data and suggest possible repairs.

AB - Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases (kbs), both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose Katara, a knowledge base and crowd powered data cleaning system that, given a table, a kb, and a crowd, interprets table semantics to align it with the kb, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that Katara can be applied to various datasets and kbs, and can efficiently annotate data and suggest possible repairs.

UR - http://www.scopus.com/inward/record.url?scp=84957586399&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84957586399&partnerID=8YFLogxK

U2 - 10.1145/2723372.2749431

DO - 10.1145/2723372.2749431

M3 - Conference contribution

SN - 9781450327589

VL - 2015-May

SP - 1247

EP - 1261

BT - Proceedings of the ACM SIGMOD International Conference on Management of Data

PB - Association for Computing Machinery

ER -