Gibbs Sampling for Mixtures in Order of Appearance: The Ordered Allocation Sampler

References

• Blackwell, D., and MacQueen, J. B. (1973), “Ferguson Distributions via Polya Urn Schemes,” Annals of Statistics, 1, 353–355.
   Web of Science ®Google Scholar
• Chopin, N. (2007), “Inference and Model Choice for Sequentially Ordered Hidden Markov Models,” JRSSB, 69, 269–284.
   Google Scholar
• De Blasi, P., Favaro, S., A. Lijoi, Mena, R. H., Prünster, I., and Ruggiero, M. (2015), “Are Gibbs-Type Priors the Most Natural Generalization of the Dirichlet Process?,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 37, 212–229. DOI: 10.1109/TPAMI.2013.217.
   PubMed Web of Science ®Google Scholar
• Escobar, M. D., and West, M. (1995), “Bayesian Density Estimation and Inference Using Mixtures,” Journal of the American Statistical Association, 90, 577–588.
   Web of Science ®Google Scholar
• Favaro, S., Lijoi, A., Nava, C., Nipoti, B., Prünster, I., and The, Y. W. (2016), “On the Stick-Breaking Representation for Homogeneous NRMIs,” Bayesian Analysis, 11, 697–724.
   Web of Science ®Google Scholar
• Favaro, S., and The, Y. W. (2013), “MCMC for Normalized Random Measure Mixture Models,” Statistical Science, 28, 335–359.
   Web of Science ®Google Scholar
• Ferguson, T. (1973), “A Bayesian Analysis of Some Nonparametric Problems,” Annals of Statistics, 1, 209–230.
   Web of Science ®Google Scholar
• Frühwirth-Schnatter, S., and Malsiner-Walli, G. (2019), “From Here to Infinity: Sparse Finite versus Dirichlet Process Mixtures in Model-Based Clustering,” in Advances in Data Analysis and Classification, 13, 33–64. DOI: 10.1007/s11634-018-0329-y.
   PubMed Web of Science ®Google Scholar
• Fuentes-Garcí-a, R., Mena, R. H., and Walker, S. G. (2010), “A New Bayesian Nonparametric Mixture Model,” Communications in Statistics - Simulation and Computation, 39, 669–682.
   Web of Science ®Google Scholar
• Gil-Leyva, M. F., and Mena, R. H. (2021). “Stick-Breaking Processes with Exchangeable Length Variables,” Journal of the American Statistical Association, DOI: 10.1080/01621459.2021.1941054.
   Web of Science ®Google Scholar
• Gnedin, A. (2010), “A Species Sampling Model with Finitely Many Types,” Electronic Communications in Probability, 15, 79–88.
   Web of Science ®Google Scholar
• Green, P. J., and Richardson, S. (2001), “Modeling Heterogeneity with and without the Dirichlet Process,” Scandinavian Journal of Statistics, 28, 355–375.
   Web of Science ®Google Scholar
• Ishwaran, H., and James, L. F. (2001), “Gibbs Sampling Methods for Stick-Breaking Priors,” Journal of the American Statistical Association, 96, 161–173.
   Web of Science ®Google Scholar
• Kallenberg, O. (2005), Probabilistic Symmetries and Invariance Principles (1st ed.), New York, NY: Springer.
   Google Scholar
• Kalli, M., Griffin, J. E., and Walker, S. (2011), “Slice Sampling Mixtures Models,” Statistics and Computing, 21, 93–105.
   Web of Science ®Google Scholar
• Lijoi, A., Prünster, I., and Rigon, T. (2020), “The Pitman–Yor Multinomial Process for Mixture Modelling,” Biometrika, 107, 891–906.
   Web of Science ®Google Scholar
• Miller, J. W., and Harrison, M. T. (2018), “Mixture Models with a Prior on the Number of Components,” Journal of the American Statistical Association, 113, 340–356. DOI: 10.1080/01621459.2016.1255636.
   PubMed Web of Science ®Google Scholar
• Neal, R. M. (2000), “Markov Chain Sampling Methods for Dirichlet Process Mixture Models,” Journal of Computational and Graphical Statistics, 9, 249–265.
   Web of Science ®Google Scholar
• Papaspiliopoulos, O., and Roberts, G. O. (2008), “Retrospective Markov Chain Monte Carlo Methods for Dirichlet Process Hierarchical Models,” Biometrika, 95, 169–186.
   Web of Science ®Google Scholar
• Pitman, J. (1995), “Exchangeable and Partially Exchangeable Random Partitions,” Probability Theory and Related Fields, 102, 145–158.
   Web of Science ®Google Scholar
• Pitman, J. (1996a), “Random Discrete Distributions Invariant Under Size-Biased Permutation,” Advances in Applied Probability, 28, 525–539.
   Web of Science ®Google Scholar
• Pitman, J. (1996b), “Some Developments of the Blackwell-MacQueen Urn Scheme,” in Statistics, Probability and Game Theory; Papers in Honor of David Blackwell, eds. T. S. Ferguson, et al. (Vol. 30: Lecture Notes-Monograph Series, pp. 245–267), Hayward, CA: Institute of Mathematical Statistics.
   Google Scholar
• Pitman, J. (2006), Combinatorial Stochastic Processes (1st ed., Vol. 1875: École d’été de probabilités de Saint-Flour), New York: Springer-Verlag Berlin Heidelberg.
   Google Scholar
• Pitman, J., and Yor, M. (1997), “The Two-Parameter Poisson-Dirichlet Distribution Derived from a Stable Subordinator,” Annals of Probability, 25, 855–900.
   Web of Science ®Google Scholar
• Porteous, I., Ihler, A., Smyth, P., and Welling, M. (2006), “Gibbs Sampling for (Coupled) Infinite Mixture Models in the Stick Breaking Representation,” in Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence (UAI 2006), pp. 385–392.
   Google Scholar
• Regazzini, E., Lijoi, A., and Prünster, I. (2003), “Distributional Results for Means of Normalized Random Measures with Independent Increments,” Annals of Statistics, 31, 560–585.
   Web of Science ®Google Scholar
• Richardson, S., and Green, P. J. (1997), “On Bayesian Analysis of Mixtures with an Unknown Number of Components,” Journal of the Royal Statistical Society, Series B 59, 731–792.
   Google Scholar
• Rodríguez, A., and Dunson, D. B. (2011), “Nonparametric Bayesian Models through Probit Stick-Breaking Processes,” Bayesian Analysis, 6, 145–178.
   Web of Science ®Google Scholar
• Rousseau, J., and Mengersen, K. (2011), “Asymptotic Behaviour of the Posterior Distribution in Overfitted Mixture Models,” Journal of the Royal Statistical Society, Series B 73, 689–710.
   Google Scholar
• Sethuraman, J. (1994), “A Constructive Definition of Dirichlet Priors,” Statistica Sinica, 4, 639–650.
   Web of Science ®Google Scholar
• Shen, W., Tokdar, S. T., and Ghosal, S. (2013), “Adaptive Bayesian Multivariate Density Estimation with Dirichlet Mixtures,” Biometrika, 100, 623–640.
   Web of Science ®Google Scholar
• Sokal, A. (1997), “Monte Carlo Methods in Statistical Mechanics: Foundations and New Algorithms,” in Functional Integration: Basics and Applications, eds. C. DeWitt-Morette, P. Cartier, and A. Folacci (pp. 131–192), Boston, MA: Springer US.
   Google Scholar
• Walker, S. G. (2007), “Sampling the Dirichlet Mixture Model with Slices,” Communications in Statistics-Simulation and Computation, 36, 45–54.
   Web of Science ®Google Scholar
• Zanella, G. (2020), “Informed Proposals for Local MCMC in Discrete Spaces,” Journal of the American Statistical Association, 115, 852–865.
   Web of Science ®Google Scholar