Query-time record linkage and fusion over Web databases

El Kindi Rezig, Eduard C. Dragut, Mourad Ouzzani, Ahmed Elmagarmid

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)


Data-intensive Web applications usually require integrating data from Web sources at query time. The sources may refer to the same real-world entity in different ways and some may even provide outdated or erroneous data. An important task is to recognize and merge the records that refer to the same real world entity at query time. Most existing duplicate detection and fusion techniques work in the off-line setting and do not meet the online constraint. There are at least two aspects that differentiate online duplicate detection and fusion from its off-line counterpart. (i) The latter assumes that the entire data is available, while the former cannot make such an assumption. (ii) Several query submissions may be required to compute the 'ideal' representation of an entity in the online setting. This paper presents a general framework for the online setting based on an iterative record-based caching technique. A set of frequently requested records is deduplicated off-line and cached for future reference. Newly arriving records in response to a query are deduplicated jointly with the records in the cache, presented to the user and appended to the cache. Experiments with real and synthetic data show the benefit of our solution over traditional record linkage techniques applied to an online setting.

Original languageEnglish
Title of host publicationProceedings - International Conference on Data Engineering
PublisherIEEE Computer Society
Number of pages12
ISBN (Print)9781479979639
Publication statusPublished - 26 May 2015
Event2015 31st IEEE International Conference on Data Engineering, ICDE 2015 - Seoul, Korea, Republic of
Duration: 13 Apr 201517 Apr 2015


Other2015 31st IEEE International Conference on Data Engineering, ICDE 2015
CountryKorea, Republic of


ASJC Scopus subject areas

  • Information Systems
  • Signal Processing
  • Software

Cite this

Rezig, E. K., Dragut, E. C., Ouzzani, M., & Elmagarmid, A. (2015). Query-time record linkage and fusion over Web databases. In Proceedings - International Conference on Data Engineering (Vol. 2015-May, pp. 42-53). [7113271] IEEE Computer Society. https://doi.org/10.1109/ICDE.2015.7113271