17 papers · ranked by Valyu relevance
Hideitsu Hino, Shotaro Akaho, Noboru Murata
The Expectation–Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of observables and unobservables. Its general properties are well studied, and also…
Rebecca Bernemann, Barbara König, Matthias Schaffeld, Torben Weis
We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable ε-transitions (also called null transitions), allowing state changes of which the observer is unaware. Due to the presence of ε-loops this additional…
Andrea Bennett, Min Wang
> Abstract. The correlated binomial (CB) distribution was proposed by Luceño (Computational Statistics & Data Analysis 20, 1995, 511–520) as an alternative to the binomial distribution for the analysis of the data in the presence of correlations among events. Due to the complexity of the mixture likelihood of the…
Thomas Lartigue, Stanley Durrleman, Stéphanie Allassonnière
The Expectation Maximisation (EM) algorithm is widely used to optimise non-convex likelihood functions with latent variables. Many authors modified its simple design to fit more specific situations. For instance, the Expectation (E) step has been replaced by Monte Carlo (MC), Markov Chain Monte Carlo or tempered…
Guo-Liang Tian, Xuanyu Liu, Yuanfan Zhao
Although the $\textit{expectation-maximization}$ (EM) algorithm is a powerful optimization tool in statistics, it can only be applied to missing/incomplete data problems or to problems with a latent-variable structure. It is well known that the introduction of latent variables (or the data augmentation) is an art…
William Ruth
The EM algorithm is a powerful tool for maximum likelihood estimation with missing data. In practice, the calculations required for the EM algorithm are often intractable. We review numerous methods to circumvent this intractability, all of which are based on Monte Carlo simulation. We focus our attention on the Monte…
Dominikus Noll
The EM algorithm assures monotone decrease of the incomplete data negative log-likelihood [30], but convergence of the iterates may fail in various ways [78]. Without coercivity iterates may escape to infinity while values converge. Even when iterates stay bounded, they may still fail to converge, cycle [76], or…
Kimura Takeshi, Kato, Kohtaro, Hayashi + 1 more
Takeshi Kimura 1 , ∗ Kohtaro Kato 1 , † and Masahito Hayashi2,3,4‡ 1 Department of Mathematical Informatics, Graduate School of Informatics, Nagoya University, Nagoya 464-0814, Japan 2 School of Data Science, The Chinese University of Hong Kong, Shenzhen, Longgang District, Shenzhen, 518172, China 3 International…
Xiudi Li, Abolfazl Safikhani, Ali Shojaie
Regime shifts in high-dimensional time series arise naturally in many applications, from neuroimaging to finance. This problem has received considerable attention in low-dimensional settings, with both Bayesian and frequentist methods used extensively for parameter estimation. The EM algorithm is a particularly popular…
Rodrigo A. González, Angel L. Cedeño, Koen Tiels, Tom Oomen
— Within Bayesian state estimation, considerable effort has been devoted to incorporating constraints into state estimation for process optimization, state monitoring, fault detection and control. Nonetheless, in the domain of state-space system identification, the prevalent practice entails constructing models under…
Pierre Houdouin, Esa Ollila, Frédéric Pascal
Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian mixture model (GMM). Numerical instability and convergence problems may arise in…
Cabrera-Bean, Margarita, Vidal, Josep + 6 more
1 Dept. of Signal Theory and Communications Universitat Politecnica de Catalunya (UPC), Barcelona, Spain ` 2 Institut Universitari d'Investigacio en Atenci ´ o Prim ´ aria Jordi Gol, ` IDIAP Jordi Gol, Barcelona, Spain 3 Germans Trias i Pujol Research Institute (IGTP), Badalona, Spain 4 Red de Investigacion en…
Louis Sharrock, Daniel Dodd, Christopher Nemeth
We introduce two new particle-based algorithms for learning latent variable models via marginal maximum likelihood estimation, including one which is entirely tuning-free. Our methods are based on the perspective of marginal maximum likelihood estimation as an optimization problem: namely, as the minimization of a free…
Amirhossein Reisizadeh, Khashayar Gatmiry, Asuman Ozdaglar
Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning paradigms. In many settings however, heterogeneous data may be generated in…
Duc T. Nguyen, Anderson Y. Zhang
Mixture models of Plackett-Luce (PL) – one of the most fundamental ranking models – are an active research area of both theoretical and practical significance. Most previously proposed parameter estimation algorithms instantiate the EM algorithm, often with random initialization. However, such an initialization scheme…
Michael A. Kouritzin
Herein, the Hidden Markov Model is expanded to allow for Markov chain observations. In particular, the observations are assumed to be a Markov chain whose one step transition probabilities depend upon the hidden Markov chain. An Expectation-Maximization analog to the Baum-Welch algorithm is developed for this more…
Zhiyuan Lu
The use of dual system estimation (DSE) is heavily used in Census Bureau operations. With DSE methods, it is important to implement methods to infer the population size among those with missing data from one or both data sources. The use of log-linear models, calculated through EM algorithms, promises a way for…