389
Views
0
CrossRef citations to date
0
Altmetric
Statistical Learning

Model-Based Tensor Low-Rank Clustering

&
Pages 208-218 | Received 03 Jun 2022, Accepted 16 Apr 2023, Published online: 01 Jun 2023

References

  • Absil, P.-A., Mahony, R., and Sepulchre, R. (2009), Optimization Algorithms on Matrix Manifolds, Princeton: Princeton University Press.
  • Anandkumar, A., Ge, R., Hsu, D., Kakade, S. M., and Telgarsky, M. (2014), “Tensor Decompositions for Learning Latent Variable Models,” Journal of Machine Learning Research, 15, 2773–2832.
  • Bickel, P. J., and Levina, E. (2004), “Some Theory for Fisher’s Linear Discriminant Function, ‘Naive Bayes’, and Some Alternatives When There Are Many More Variables Than Observations,” Bernoulli, 10, 989–1010. DOI: 10.3150/bj/1106314847.
  • Cai, B., Zhang, J., and Sun, W. W. (2021), “Jointly Modeling and Clustering Tensors in High Dimensions,” arXiv preprint arXiv:2104.07773 .
  • Cai, T., and Liu, W. (2011), “A Direct Estimation Approach to Sparse Linear Discriminant Analysis,” Journal of the American Statistical Association, 106, 1566–1577. DOI: 10.1198/jasa.2011.tm11199.
  • Cai, T. T., Ma, J., and Zhang, L. (2019), “CHIME: Clustering of High-Dimensional Gaussian Mixtures with EM Algorithm and its Optimality,” The Annals of Statistics, 47, 1234–1267. DOI: 10.1214/18-AOS1711.
  • Cook, R. D. (2018), An Introduction to Envelopes: Dimension Reduction for Efficient Estimation in Multivariate Statistics, Hoboken: Wiley.
  • De Lathauwer, L., De Moor, B., and Vandewalle, J. (2000a), “A Multilinear Singular Value Decomposition,” SIAM Journal on Matrix Analysis and Applications, 21, 1253–1278. DOI: 10.1137/S0895479896305696.
  • De Lathauwer, L., De Moor, B., and Vandewalle, J. (2000b), “On the Best Rank-1 and Rank-(r1, r2,…, rn) Approximation of Higher-Order Tensors,” SIAM Journal on Matrix Analysis and Applications, 21, 1324–1342.
  • Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977), “Maximum Likelihood from Incomplete Data via the EM Algorithm,” Journal of the Royal Statistical Society, Series B, 39, 1–22. DOI: 10.1111/j.2517-6161.1977.tb01600.x.
  • Deng, K., and Zhang, X. (2021), “Tensor Envelope Mixture Model for Simultaneous Clustering and Multiway Dimension Reduction,” Biometrics, 78, 1067–1079. DOI: 10.1111/biom.13486.
  • Fan, J., and Fan, Y. (2008), “High Dimensional Classification Using Features Annealed Independence Rules,” Annals of Statistics, 36, 2605–2637. DOI: 10.1214/07-AOS504.
  • Gallaugher, M. P., and McNicholas, P. D. (2018), “Finite Mixtures of Skewed Matrix Variate Distributions,” Pattern Recognition, 80, 83–93. DOI: 10.1016/j.patcog.2018.02.025.
  • Gao, X., Shen, W., Zhang, L., Hu, J., Fortin, N. J., Frostig, R. D., and Ombao, H. (2021), “Regularized Matrix Data Clustering and its Application to Image Analysis,” Biometrics, 77, 890–902. DOI: 10.1111/biom.13354.
  • Hao, B., Sun, W. W., Liu, Y., and Cheng, G. (2018), “Simultaneous Clustering and Estimation of Heterogeneous Graphical Models,” Journal of Machine Learning Research, 18, 1–58.
  • Kolda, T. G., and Bader, B. W. (2009), “Tensor Decompositions and Applications,” SIAM Review, 51, 455–500. DOI: 10.1137/07070111X.
  • Li, J., Mai, Q., and Zhang, X. (2023+), “The Tucker Low-Rank Classification Model for Tensor Data,” manuscript.
  • Li, L., and Zhang, X. (2017), “Parsimonious Tensor Response Regression,” Journal of the American Statistical Association, 112, 1131–1146. DOI: 10.1080/01621459.2016.1193022.
  • Li, X., Xu, D., Zhou, H., and Li, L. (2018), “Tucker Tensor Regression and Neuroimaging Analysis,” Statistics in Biosciences, 10, 520–545. DOI: 10.1007/s12561-018-9215-6.
  • Lyu, T., Lock, E. F., and Eberly, L. E. (2017), “Discriminating Sample Groups with Multi-Way Data,” Biostatistics, 18, 434–450. DOI: 10.1093/biostatistics/kxw057.
  • Lyu, X., Sun, W. W., Wang, Z., Liu, H., Yang, J., and Cheng, G. (2019), “Tensor Graphical Model: Non-convex Optimization and Statistical Inference,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 2024–2037. DOI: 10.1109/TPAMI.2019.2907679.
  • Mai, Q., Yang, Y., and Zou, H. (2019), “Multiclass Sparse Discriminant Analysis,” Statistica Sinica, 29, 97–111.
  • Mai, Q., Zhang, X., Pan, Y., and Deng, K. (2021), “A Doubly Enhanced EM Algorithm for Model-based Tensor Clustering,” Journal of the American Statistical Association, 117, 2120–2134. DOI: 10.1080/01621459.2021.1904959.
  • Manceur, A. M., and Dutilleul, P. (2013), “Maximum Likelihood Estimation for the Tensor Normal Distribution: Algorithm, Minimum Sample Size, and Empirical Bias and Dispersion,” Journal of Computational and Applied Mathematics, 239, 37–49. DOI: 10.1016/j.cam.2012.09.017.
  • Min, K., Mai, Q., and Zhang, X. (2022), “Fast and Separable Estimation in High-Dimensional Tensor Gaussian Graphical Models,” Journal of Computational and Graphical Statistics, 31, 294–300. DOI: 10.1080/10618600.2021.1938086.
  • Pan, W., and Shen, X. (2007), “Penalized Model-based Clustering with Application to Variable Selection,” Journal of Machine Learning Research, 8, 1145–1164.
  • Pan, Y., Mai, Q., and Zhang, X. (2019), “Covariate-Adjusted Tensor Classification in High Dimensions,” Journal of the American Statistical Association, 114, 1305–1319. DOI: 10.1080/01621459.2018.1497500.
  • Sun, W. W., and Li, L. (2019), “Dynamic Tensor Clustering,” Journal of the American Statistical Association, 114, 1894–1907. DOI: 10.1080/01621459.2018.1527701.
  • Tait, P. A., McNicholas, P. D., and Obeid, J. (2020), “Clustering Higher Order Data: An Application to Pediatric Multi-variable Longitudinal Data,” arXiv preprint arXiv:1907.08566 .
  • Thompson, G. Z., Maitra, R., Meeker, W. Q., and Bastawros, A. F. (2020), “Classification with the Matrix-Variate-t Distribution,” Journal of Computational and Graphical Statistics, 29, 668–674. DOI: 10.1080/10618600.2019.1696208.
  • Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI: 10.1111/j.2517-6161.1996.tb02080.x.
  • Wen, Z., and Yin, W. (2013), “A Feasible Method for Optimization with Orthogonality Constraints,” Mathematical Programming, 142, 397–434. DOI: 10.1007/s10107-012-0584-1.
  • Witten, D. M., and Tibshirani, R. (2010), “A Framework for Feature Selection in Clustering,” Journal of the American Statistical Association, 105, 713–726. DOI: 10.1198/jasa.2010.tm09415.
  • Xia, D., Yuan, M., and Zhang, C.-H. (2021), “Statistically Optimal and Computationally Efficient Low Rank Tensor Completion from Noisy Entries,” The Annals of Statistics, 49, 76–99. DOI: 10.1214/20-AOS1942.
  • Yuan, M., and Lin, Y. (2006), “Model Selection and Estimation in Regression with Grouped Variables,” Journal of the Royal Statistical Society, Series B, 68, 49–67. DOI: 10.1111/j.1467-9868.2005.00532.x.
  • Zhang, A. (2019), “Cross: Efficient Low-Rank Tensor Completion,” The Annals of Statistics, 47, 936–964. DOI: 10.1214/18-AOS1694.
  • Zhang, A., and Han, R. (2019), “Optimal Sparse Singular Value Decomposition for High-Dimensional High-Order Data,” Journal of the American Statistical Association, 114, 1708–1725. DOI: 10.1080/01621459.2018.1527227.
  • Zhang, A., and Xia, D. (2018), “Tensor SVD: Statistical and Computational Limits,” IEEE Transactions on Information Theory, 64, 7311–7338. DOI: 10.1109/TIT.2018.2841377.
  • Zhang, A. R., Luo, Y., Raskutti, G., and Yuan, M. (2020), “ISLET: Fast and Optimal Low-Rank Tensor Regression via Importance Sketching,” SIAM Journal on Mathematics of Data Science, 2, 444–479. DOI: 10.1137/19M126476X.
  • Zhang, X. L., Begleiter, H., Porjesz, B., Wang, W., and Litke, A. (1995), “Event Related Potentials during Object Recognition Tasks,” Brain research bulletin, 38, 531–538. DOI: 10.1016/0361-9230(95)02023-5.
  • Zhou, H., Li, L., and Zhu, H. (2013), “Tensor Regression with Applications in Neuroimaging Data Analysis,” Journal of the American Statistical Association, 108, 540–552. DOI: 10.1080/01621459.2013.776499.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.