Non-negative matrix factorization via archetypal analysis

Non-negative matrix factorization via archetypal analysis

An approach to non-negative matrix factorization that does not require data to be separable and provides a generally unique decomposition.

Non-negative matrix factorization via archetypal analysis is named after two well-known techniques of statistics and unsupervised learning, non-negative matrix factorization (NMF) and archetypal analysis (AA).

Unlike the original archetypal analysis method developed by Cutler and Breiman, NMF via archetypal analysis does not require the data in a given data set to be separable. The method aims to optimize the trade-off between two objectives:

  • Minimizing the distance of the data points from the convex envelope of archetypes (which can be interpreted as an empirical risk); and
  • Minimizing the distance of the the archetypes from the convex envelope of data (which can be interpreted as a data-dependent regularization).

NMF via archetypal analysis introduces a 'uniqueness condition' on the data which is necessary for exactly recovering the archetypes from noiseless data. The approach requires solving a non-convex optimization problem, but early experiments showed that the standard optimization methods succeeded in finding good solutions.

Timeline

People

Name
Role
LinkedIn

Andrea Montanari

Creator

Hamid Javadi

Creator

Further reading

Title
Author
Link
Type
Date

A geometric approach to archetypal analysis and non-negative matrix factorization

Anil Damle, Yuekai Sun

PDF

Archetypal analysis for machine learning

Morten Morup, Lars Kai Hansen

PDF

Fast and Robust Archetypal Analysis for Representation Learning

Yuansi Chen, Julien Mairal, Zaid Harchaoui

PDF

Non-negative Matrix Factorization via Archetypal Analysis

Hamid Javadi, Andrea Montanari

PDF

Documentaries, videos and podcasts

Title
Date
Link

Companies

Company
CEO
Location
Products/Services

References

Golden logo
Text is available under the Creative Commons Attribution-ShareAlike 4.0; additional terms apply. By using this site, you agree to our Terms & Conditions.