High-Dimensional Multivariate Linear Regression with Weighted Nuclear Norm Regularization

References

• Attouch, H., Bolte, J., and Svaiter, B. F. (2013), “Convergence of Descent Methods for Semi-Algebraic and Tame Problems: Proximal Algorithms, Forward–Backward Splitting, and Regularized Gauss–Seidel Methods,” Mathematical Programming, 137, 91–129. DOI: 10.1007/s10107-011-0484-9.
   Web of Science ®Google Scholar
• Bach, F. R. (2008), “Consistency of Trace Norm Minimization,” The Journal of Machine Learning Research, 9, 1019–1048.
   Web of Science ®Google Scholar
• Boyd, S., Parikh, N., and Chu, E. (2011), Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Delft: Now Publishers Inc.
   Google Scholar
• Brereton, R. G. (2003), Chemometrics: Data Analysis for the Laboratory and Chemical Plant, Chichester: Wiley.
   Google Scholar
• Bunea, F., She, Y., and Wegkamp, M. H. (2011), “Optimal Selection of Reduced Rank Estimators of High-Dimensional Matrices,” The Annals of Statistics, 39, 1282–1309. DOI: 10.1214/11-AOS876.
   Web of Science ®Google Scholar
• Candes, E. J., Wakin, M. B., and Boyd, S. P. (2008), “Enhancing Sparsity by Reweighted l1 Minimization,” Journal of Fourier Analysis and Applications, 14, 877–905.
   Web of Science ®Google Scholar
• Chen, K., Dong, H., and Chan, K.-S. (2013), “Reduced Rank Regression via Adaptive Nuclear Norm Penalization,” Biometrika, 100, 901–920. DOI: 10.1093/biomet/ast036.
   PubMed Web of Science ®Google Scholar
• Dong, W., Shi, G., Li, X., Ma, Y., and Huang, F. (2014), “Compressive Sensing via Nonlocal Low-Rank Regularization,” IEEE Transactions on Image Processing, 23, 3618–3632. DOI: 10.1109/TIP.2014.2329449.
   PubMed Web of Science ®Google Scholar
• Efron, B. (2004), “The Estimation of Prediction Error: Covariance Penalties and Cross-Validation,” Journal of the American Statistical Association, 99, 619–632. DOI: 10.1198/016214504000000692.
   Web of Science ®Google Scholar
• Fan, J., Gong, W., and Zhu, Z. (2019), “Generalized High-Dimensional Trace Regression via Nuclear Norm Regularization,” Journal of Econometrics, 212, 177–202. DOI: 10.1016/j.jeconom.2019.04.026.
   Web of Science ®Google Scholar
• Fan, J., Wang, W., and Zhu, Z. (2021), “A Shrinkage Principle for Heavy-Tailed Data: High-Dimensional Robust Low-Rank Matrix Recovery,” Annals of Statistics, 49, 1239.
   PubMed Web of Science ®Google Scholar
• Golub, G. H., Heath, M., and Wahba, G. (1979), “Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter,” Technometrics, 21, 215–223. DOI: 10.1080/00401706.1979.10489751.
   Web of Science ®Google Scholar
• Gu, S., Xie, Q., Meng, D., Zuo, W., Feng, X., and Zhang, L. (2017), “Weighted Nuclear Norm Minimization and its Applications to Low Level Vision,” International Journal of Computer Vision, 121, 183–208. DOI: 10.1007/s11263-016-0930-5.
   Web of Science ®Google Scholar
• Gu, S., Zhang, L., Zuo, W., and Feng, X. (2014), “Weighted Nuclear Norm Minimization with Application to Image Denoising,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862–2869.
   Google Scholar
• Isenmann, A. (2008), Modern Multivariate Statistical Techniques: Regression, Classification and Manifold Learning, New York: Springer.
   Google Scholar
• Kim, G., Cho, J., and Kang, M. (2020), “Cauchy Noise Removal by Weighted Nuclear Norm Minimization,” Journal of Scientific Computing, 83, 1–21. DOI: 10.1007/s10915-020-01203-2.
   Web of Science ®Google Scholar
• Koltchinskii, V., Lounici, K., and Tsybakov, A. B. (2011), “Nuclear-Norm Penalization and Optimal Rates for Noisy Low-Rank Matrix Completion,” The Annals of Statistics, 39, 2302–2329. DOI: 10.1214/11-AOS894.
   Web of Science ®Google Scholar
• Lee, J. D., Sun, Y., and Taylor, J. E. (2015), “On Model Selection Consistency of Regularized m-estimators,” Electronic Journal of Statistics, 9, 608–642. DOI: 10.1214/15-EJS1013.
   Web of Science ®Google Scholar
• Liu, S., Hu, Q., Li, P., Zhao, J., Liu, M., and Zhu, Z. (2018), “Speckle Suppression based on Weighted Nuclear Norm Minimization and Grey Theory,” IEEE Transactions on Geoscience and Remote Sensing, 57, 2700–2708. DOI: 10.1109/TGRS.2018.2876339.
   Web of Science ®Google Scholar
• Mukherjee, A., Chen, K., Wang, N., and Zhu, J. (2015), “On the Degrees of Freedom of Reduced-Rank Estimators in Multivariate Regression,” Biometrika, 102, 457–477. DOI: 10.1093/biomet/asu067.
   PubMed Web of Science ®Google Scholar
• Mukherjee, A., and Zhu, J. (2011), “Reduced Rank Ridge Regression and its Kernel Extensions,” Statistical Analysis and Data Mining: The ASA Data Science Journal, 4, 612–622. DOI: 10.1002/sam.10138.
   PubMedGoogle Scholar
• Negahban, S., and Wainwright, M. J. (2011), “Estimation of (near) Low-Rank Matrices with Noise and High-Dimensional Scaling,” The Annals of Statistics, 39, 1069–1097. DOI: 10.1214/10-AOS850.
   Web of Science ®Google Scholar
• Rohde, A., and Tsybakov, A. B. (2011), “Estimation of High-Dimensional Low-Rank Matrices,” The Annals of Statistics, 39, 887–930. DOI: 10.1214/10-AOS860.
   Web of Science ®Google Scholar
• Shang, P., and Kong, L. (2021), “Regularization Parameter Selection for the Low Rank Matrix Recovery,” Journal of Optimization Theory and Applications, 189, 772–792. DOI: 10.1007/s10957-021-01852-9.
   Web of Science ®Google Scholar
• Stein, C. M. (1981), “Estimation of the Mean of a Multivariate Normal Distribution,” The Annals of Statistics, 9, 1135–1151. DOI: 10.1214/aos/1176345632.
   Web of Science ®Google Scholar
• Wang, Y., Yin, W., and Zeng, J. (2019), “Global Convergence of ADMM in Nonconvex Nonsmooth Optimization,” Journal of Scientific Computing, 78, 29–63. DOI: 10.1007/s10915-018-0757-z.
   Web of Science ®Google Scholar
• Xu, J., Zhang, L., Zhang, D., and Feng, X. (2017), “Multi-Channel Weighted Nuclear Norm Minimization for Real Color Image Denoising,” in Proceedings of the IEEE International Conference on Computer Vision, pp. 1096–1104.
   Google Scholar
• Yair, N., and Michaeli, T. (2018), “Multi-Scale Weighted Nuclear Norm Image Restoration,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3165–3174.
   Google Scholar
• Yuan, M., Ekici, A., Lu, Z., and Monteiro, R. (2007), “Dimension Reduction and Coefficient Estimation in Multivariate Linear Regression,” Journal of the Royal Statistical Society, Series B, 69, 329–346. DOI: 10.1111/j.1467-9868.2007.00591.x.
   Google Scholar
• Zha, Z., Yuan, X., Li, B., Zhang, X., Liu, X., Tang, L., and Liang, Y.-C. (2017), “Analyzing the Weighted Nuclear Norm Minimization and Nuclear Norm Minimization based on Group Sparse Representation,” arXiv preprint arXiv:1702.04463.
   Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429. DOI: 10.1198/016214506000000735.
   Web of Science ®Google Scholar