A Principled Approach to Expectation Maximisation and Latent Dirichlet Allocation Using Jeffrey’s Update Rule

In Helle Hvid Hansen, Andre Scedrov & Ruy J. G. B. de Queiroz (eds.), Logic, Language, Information, and Computation: 29th International Workshop, WoLLIC 2023, Halifax, NS, Canada, July 11–14, 2023, Proceedings. Springer Nature Switzerland. pp. 256-273 (2023)
  Copy   BIBTEX

Abstract

Expectation Maximisation (EM) and Latent Dirichlet Allocation (LDA) are two frequently used inference algorithms, for finding an appropriate mixture of latent variables, and for finding an allocation of topics for a collection of documents. A recent insight in probabilistic learning is that Jeffrey’s update rule gives a decrease of Kullback-Leibler divergence. Its logic is error correction. It is shown that this same rule and divergence decrease logic is at the heart of EM and LDA, ensuring that successive iterations are decreasingly wrong.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 89,654

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Estimation and Model Selection in Dirichlet Regression.Julio Michael Stern - 2012 - AIP Conference Proceedings 1443:206-213.
Jeffrey's rule of conditioning.Glenn Shafer - 1981 - Philosophy of Science 48 (3):337-362.
Uncertain premises and Jeffrey's rule.David E. Over & Constantinos Hadjichristidis - 2009 - Behavioral and Brain Sciences 32 (1):97-98.
Suivre une règle. Wittgenstein entre Aristote et Lejeune-Dirichlet.Jean-Claude Dumoncel - 2011 - Revue Philosophique de la France Et de l'Etranger 136 (2):187.
Dirichlet problem with Lp-boundary data in contractible domains of Carnot groups.Andrea Bonfiglioli & Ermanno Lanconelli - 2006 - Annali della Scuola Normale Superiore di Pisa- Classe di Scienze 5 (4):579-610.

Analytics

Added to PP
2023-08-31

Downloads
2 (#1,620,791)

6 months
2 (#648,997)

Historical graph of downloads

Sorry, there are not enough data points to plot this chart.
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

No references found.

Add more references