Efficient algorithms for mining closed itemsets and their lattice structure

Mohammed J. Zaki, Ching Jui Hsiao

Research output: Contribution to journalArticle

339 Citations (Scopus)

Abstract

The set of frequent closed itemsets uniquely determines the exact frequency of all itemsets, yet it can be orders of magnitude smaller than the set of all frequent itemsets. In this paper, we present CHARM, an efficient algorithm for mining all frequent closed itemsets. It enumerates closed sets using a dual itemset-tidset search tree, using an efficient hybrid search that skips many levels. It also uses a technique called diffsets to reduce the memory footprint of intermediate computations. Finally, it uses a fast hash-based approach to remove any "nonclosed" sets found during computation. We also present CHARM-L, an algorithm that outputs the closed itemset lattice, which is very useful for rule generation and visualization. An extensive experimental evaluation on a number of real and synthetic databases shows that CHARM is a state-of-the-art algorithm that outperforms previous methods. Further, CHARM-L explicitly generates the frequent closed itemset lattice.

Original languageEnglish
Pages (from-to)462-478
Number of pages17
JournalIEEE Transactions on Knowledge and Data Engineering
Volume17
Issue number4
DOIs
Publication statusPublished - 1 Apr 2005

    Fingerprint

Keywords

  • Association rules
  • Closed itemset lattice
  • Closed itemsets
  • Data mining
  • Frequent itemsets

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this