Uninterpreted schema matching with embedded value mapping under opaque column names and data values

Anuj Jaiswal, David J. Miller, Prasenjit Mitra

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Schema matching and value mapping across two heterogenous information sources are critical tasks in applications involving data integration, data warehousing, and federation of databases. Before data can be integrated from multiple tables, the columns and the values appearing in the tables must be matched. The complexity of the problem grows quickly with the number of data attributes/columns to be matched and due to multiple semantics of data values. Traditional research has tackled schema matching and value mapping independently. We propose a novel method that optimizes embedded value mappings to enhance schema matching in the presence of opaque data values and column names. In this approach, the fitness objective for matching a pair of attributes from two schemas depends on the value mapping function for each of the two attributes. Suitable fitness objectives include the euclidean distance measure, which we use in our experimental study, as well as relative (cross) entropy. We propose a heuristic local descent optimization strategy that uses sorting and two-opt switching to jointly optimize value mappings and attribute matches. Our experiments show that our proposed technique outperforms earlier uninterpreted schema matching methods, and thus, should form a useful addition to a suite of (semi) automated tools for resolving structural heterogeneity.

Original languageEnglish
Article number4799783
Pages (from-to)291-304
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume22
Issue number2
DOIs
Publication statusPublished - Feb 2010
Externally publishedYes

    Fingerprint

Keywords

  • Embedded schema matching with value mapping
  • Opaque conditions
  • Schema matching

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Information Systems
  • Computer Science Applications

Cite this