Concerning the differentiability of the energy function in vector quantization algorithms

Dominique Lepetz, Max Némoz-Gaillard, Michaël Aupetit

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The adaptation rule of Vector Quantization algorithms, and consequently the convergence of the generated sequence, depends on the existence and properties of a function called the energy function, defined on a topological manifold. Our aim is to investigate the conditions of existence of such a function for a class of algorithms including the well-known 'K-means' and 'Self-Organizing Map' algorithms. The results presented here extend several previous studies and show that the energy function is not always a potential but at least the uniform limit of a series of potential functions which we call a pseudo-potential. It also shows that a large number of existing vector quantization algorithms developed by the Artificial Neural Networks community fall into this class. The framework we define opens the way to studying the convergence of all the corresponding adaptation rules at once, and a theorem gives promising insights in that direction.

Original languageEnglish
Pages (from-to)621-630
Number of pages10
JournalNeural Networks
Volume20
Issue number5
DOIs
Publication statusPublished - 1 Jul 2007

    Fingerprint

Keywords

  • Energy function
  • K-means
  • Neural-gas
  • Potential function
  • Pseudo-potential
  • Self-organizing maps
  • Vector quantization

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Artificial Intelligence

Cite this