Extraction and integration of partially overlapping web sources

Mirko Bronzi, Valter Crescenzi, Paolo Merialdo, Paolo Papotti

Research output: Chapter in Book/Report/Conference proceedingChapter

26 Citations (Scopus)

Abstract

We present an unsupervised approach for harvesting the data exposed by a set of structured and partially overlapping data-intensive web sources. Our proposal comes within a formal framework tackling two problems: the data extraction problem, to generate extraction rules based on the input websites, and the data integration problem, to integrate the extracted data in a unified schema. We introduce an original algorithm, WEIR, to solve the stated problems and formally prove its correctness. WEIR leverages the overlapping data among sources to make better decisions both in the data extraction (by pruning rules that do not lead to redundant information) and in the data integration (by reflecting local properties of a source over the mediated schema). Along the way, we characterize the amount of redundancy needed by our algorithm to produce a solution, and present experimental results to show the benefits of our approach with respect to existing solutions.

Original languageEnglish
Title of host publicationProceedings of the VLDB Endowment
Pages805-816
Number of pages12
Volume6
Edition10
Publication statusPublished - Aug 2013

Fingerprint

Data integration
Redundancy
Websites

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

Bronzi, M., Crescenzi, V., Merialdo, P., & Papotti, P. (2013). Extraction and integration of partially overlapping web sources. In Proceedings of the VLDB Endowment (10 ed., Vol. 6, pp. 805-816)

Extraction and integration of partially overlapping web sources. / Bronzi, Mirko; Crescenzi, Valter; Merialdo, Paolo; Papotti, Paolo.

Proceedings of the VLDB Endowment. Vol. 6 10. ed. 2013. p. 805-816.

Research output: Chapter in Book/Report/Conference proceedingChapter

Bronzi, M, Crescenzi, V, Merialdo, P & Papotti, P 2013, Extraction and integration of partially overlapping web sources. in Proceedings of the VLDB Endowment. 10 edn, vol. 6, pp. 805-816.
Bronzi M, Crescenzi V, Merialdo P, Papotti P. Extraction and integration of partially overlapping web sources. In Proceedings of the VLDB Endowment. 10 ed. Vol. 6. 2013. p. 805-816
Bronzi, Mirko ; Crescenzi, Valter ; Merialdo, Paolo ; Papotti, Paolo. / Extraction and integration of partially overlapping web sources. Proceedings of the VLDB Endowment. Vol. 6 10. ed. 2013. pp. 805-816
@inbook{069628d51fe1457981dad8d332e659ce,
title = "Extraction and integration of partially overlapping web sources",
abstract = "We present an unsupervised approach for harvesting the data exposed by a set of structured and partially overlapping data-intensive web sources. Our proposal comes within a formal framework tackling two problems: the data extraction problem, to generate extraction rules based on the input websites, and the data integration problem, to integrate the extracted data in a unified schema. We introduce an original algorithm, WEIR, to solve the stated problems and formally prove its correctness. WEIR leverages the overlapping data among sources to make better decisions both in the data extraction (by pruning rules that do not lead to redundant information) and in the data integration (by reflecting local properties of a source over the mediated schema). Along the way, we characterize the amount of redundancy needed by our algorithm to produce a solution, and present experimental results to show the benefits of our approach with respect to existing solutions.",
author = "Mirko Bronzi and Valter Crescenzi and Paolo Merialdo and Paolo Papotti",
year = "2013",
month = "8",
language = "English",
volume = "6",
pages = "805--816",
booktitle = "Proceedings of the VLDB Endowment",
edition = "10",

}

TY - CHAP

T1 - Extraction and integration of partially overlapping web sources

AU - Bronzi, Mirko

AU - Crescenzi, Valter

AU - Merialdo, Paolo

AU - Papotti, Paolo

PY - 2013/8

Y1 - 2013/8

N2 - We present an unsupervised approach for harvesting the data exposed by a set of structured and partially overlapping data-intensive web sources. Our proposal comes within a formal framework tackling two problems: the data extraction problem, to generate extraction rules based on the input websites, and the data integration problem, to integrate the extracted data in a unified schema. We introduce an original algorithm, WEIR, to solve the stated problems and formally prove its correctness. WEIR leverages the overlapping data among sources to make better decisions both in the data extraction (by pruning rules that do not lead to redundant information) and in the data integration (by reflecting local properties of a source over the mediated schema). Along the way, we characterize the amount of redundancy needed by our algorithm to produce a solution, and present experimental results to show the benefits of our approach with respect to existing solutions.

AB - We present an unsupervised approach for harvesting the data exposed by a set of structured and partially overlapping data-intensive web sources. Our proposal comes within a formal framework tackling two problems: the data extraction problem, to generate extraction rules based on the input websites, and the data integration problem, to integrate the extracted data in a unified schema. We introduce an original algorithm, WEIR, to solve the stated problems and formally prove its correctness. WEIR leverages the overlapping data among sources to make better decisions both in the data extraction (by pruning rules that do not lead to redundant information) and in the data integration (by reflecting local properties of a source over the mediated schema). Along the way, we characterize the amount of redundancy needed by our algorithm to produce a solution, and present experimental results to show the benefits of our approach with respect to existing solutions.

UR - http://www.scopus.com/inward/record.url?scp=84891126419&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84891126419&partnerID=8YFLogxK

M3 - Chapter

VL - 6

SP - 805

EP - 816

BT - Proceedings of the VLDB Endowment

ER -