Exactly Uncorrelated Sparse Principal Component Analysis

References

• Baden, T., Berens, P., Franke, K., Roseón, M., Bethge, M., and Euler, T. (2016), “The Functional Diversity of Retinal Ganglion Cells in the Mouse,” Nature, 529, 345–350. DOI: 10.1038/nature16468.
   PubMed Web of Science ®Google Scholar
• Baik, J., and Silverstein, J. W. (2006), “Eigenvalues of Large Sample Covariance Matrices of Spiked Population Models,” Journal of Multivariate Analysis, 97, 1382–1408. DOI: 10.1016/j.jmva.2005.08.003.
   Web of Science ®Google Scholar
• Baldi, P., and Hornik, K. (1989), “Neural Networks and Principal Component Analysis: Learning from Examples Without Local Minima,” Neural Networks, 2, 53–58. DOI: 10.1016/0893-6080(89)90014-2.
   Web of Science ®Google Scholar
• Barzilai, J., and Borwein, J. M. (1988), “Two Point Step Size Gradient Methods,” IMA Journal of Numerical Analysis, 8, 141–148. DOI: 10.1093/imanum/8.1.141.
   Web of Science ®Google Scholar
• Birnbaum, A., Johnstone, I. M., Nadler, B., and Paul, D. (2013), “Minimax Bounds for Sparse PCA with Noisy High-Dimensional Data,” The Annals of Statistics, 41, 1055–1084. DOI: 10.1214/12-AOS1014.
   PubMed Web of Science ®Google Scholar
• Cai, T. T., Ma, Z., and Wu, Y. (2013), “Sparse PCA: Optimal Rates and Adaptive Estimation,” The Annals of Statistics, 41, 3074–3110. DOI: 10.1214/13-AOS1178.
   Web of Science ®Google Scholar
• Candés, E., Li, X., Ma, Y., and Wright, J. (2009), “Robust Principal Component Analysis?” Journal of the ACM, 58, 1–37. DOI: 10.1145/1970392.1970395.
   Web of Science ®Google Scholar
• Chen, S., Ma, S., Xue, L., and Zou, H. (2020), “An Alternating Manifold Proximal Gradient Method for Sparse Principal Component Analysis and Sparse Canonical Correlation Analysis,” INFORMS Journal on Optimization, 2, 192–208. DOI: 10.1287/ijoo.2019.0032.
   Google Scholar
• Chin, K., DeVries, S., Fridlyand, J., Spellman, P. T., Roydasgupta, R., Kuo, W.-L., Lapuk, A., Neve, R. M., Qian, Z., Ryder, T., et al. (2006), “Genomic and Transcriptional Aberrations Linked to Breast Cancer Pathophysiologies,” Cancer Cell, 10, 529–541. DOI: 10.1016/j.ccr.2006.10.009.
   PubMed Web of Science ®Google Scholar
• d’Aspremont, A., El Ghaoui, L., Jordan, M. I., and Lanckriet, G. R. (2007), “A Direct Formulation for Sparse PCA Using Semidefinite Programming,” SIAM Review, 49, 434–448. DOI: 10.1137/050645506.
   Web of Science ®Google Scholar
• Franceschi, F., Cobo, M., and Figueredo, M. (2018), “Discovering Relationships and Forecasting PM10 and PM2. 5 Concentrations in Bogotá, Colombia, Using Artificial Neural Networks, Principal Component Analysis, and k-means Clustering,” Atmospheric Pollution Research, 9, 912–922. DOI: 10.1016/j.apr.2018.02.006.
   Web of Science ®Google Scholar
• Gravuer, K., Sullivan, J. J., Williams, P. A., and Duncan, R. P. (2008), “Strong Human Association with Plant Invasion Success for Trifolium Introductions to New Zealand,” Proceedings of the National Academy of Sciences, 105, 6344–6349. DOI: 10.1073/pnas.0712026105.
   PubMed Web of Science ®Google Scholar
• Hotelling, H. (1933), “Analysis of a Complex of Statistical Variables into Principal Components,” Journal of Educational Psychology, 24, 417–441. DOI: 10.1037/h0071325.
   Google Scholar
• Johnstone, I. M., and Lu, A. Y. (2009), “On Consistency and Sparsity for Principal Components Analysis in High Dimensions,” Journal of the American Statistical Association, 104, 682–693. DOI: 10.1198/jasa.2009.0121.
   PubMed Web of Science ®Google Scholar
• Jolliffe, I. T., Trendafilov, N. T., and Uddin, M. (2003), “A Modified Principal Component Technique based on the LASSO,” Journal of Computational and Graphical Statistics, 12, 531–547. DOI: 10.1198/1061860032148.
   Web of Science ®Google Scholar
• Journée, M., Nesterov, Y., Richtárik, P., and Sepulchre, R. (2010), “Generalized Power Method for Sparse Principal Component Analysis,” Journal of Machine Learning Research, 11, 517–533.
   Web of Science ®Google Scholar
• Lu, Z., and Zhang, Y. (2012), “An Augmented Lagrangian Approach for Sparse Principal Component Analysis,” Mathematical Programming, 135, 149–193. DOI: 10.1007/s10107-011-0452-4.
   Web of Science ®Google Scholar
• Malik, M. R., Isaac, B. J., Coussement, A., Smith, P. J., and Parente, A. (2018), “Principal Component Analysis Coupled with Nonlinear Regression for Chemistry Reduction,” Combustion and Flame, 187, 30–41. DOI: 10.1016/j.combustflame.2017.08.012.
   Web of Science ®Google Scholar
• Morais, C. L., and Lima, K. M. (2018), “Principal Component Analysis with Linear and Quadratic Discriminant Analysis for Identification of Cancer Samples based on Mass Spectrometry,” Journal of the Brazilian Chemical Society, 29, 472–481. DOI: 10.21577/0103-5053.20170159.
   Web of Science ®Google Scholar
• Nadler, B. (2008), “Finite Sample Approximation Results for Principal Component Analysis: A Matrix Perturbation Approach,” The Annals of Statistics, 36, 2791–2817. DOI: 10.1214/08-AOS618.
   Web of Science ®Google Scholar
• Paul, D. (2007), “Asymptotics of Sample Eigenstructure for a Large Dimensional Spiked Covariance Model,” Statistica Sinica, 45, 1617–1642.
   Google Scholar
• Pearson, K. (1901), “LIII. On Lines and Planes of Closest Fit to Systems of Points in Space,” The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 2, 559–572. DOI: 10.1080/14786440109462720.
   Google Scholar
• Ramaswamy, S., Tamayo, P., Rifkin, R., Mukherjee, S., Yeang, C.-H., Angelo, M., Ladd, C., Reich, M., Latulippe, E., Mesirov, J. P., et al. (2001), “Multiclass Cancer Diagnosis Using Tumor Gene Expression Signatures,” Proceedings of the National Academy of Sciences, 98, 15149–15154. DOI: 10.1073/pnas.211566398.
   PubMed Web of Science ®Google Scholar
• Ritchie, M. D., Holzinger, E. R., Li, R., Pendergrass, S. A., and Kim, D. (2015), “Methods of Integrating Data to Uncover Genotype-Phenotype Interactions,” Nature Reviews Genetics, 16, 85–97. DOI: 10.1038/nrg3868.
   PubMed Web of Science ®Google Scholar
• Rockafellar, R. T., and Wets, R. J.-B. (1998), Variational Analysis, Berlin: Springer.
   Google Scholar
• She, Y. (2017), “Selective Factor Extraction in High Dimensions,” Biometrika, 104, 97–110. DOI: 10.1093/biomet/asw059.
   Web of Science ®Google Scholar
• Shen, H., and Huang, J. Z. (2008), “Sparse Principal Component Analysis via Regularized Low Rank Matrix Approximation,” Journal of Multivariate Analysis, 99, 1015–1034. DOI: 10.1016/j.jmva.2007.06.007.
   Web of Science ®Google Scholar
• Sjöstrand, K., Rostrup, E., Ryberg, C., Larsen, R., Studholme, C., Baezner, H., Ferro, J., Fazekas, F., Pantoni, L., Inzitari, D., and Waldemar, G. (2007), “Sparse Decomposition and Modeling of Anatomical Shape Variation,” IEEE Transactions on Medical Imaging, 26, 1625–1635. DOI: 10.1109/tmi.2007.898808.
   PubMed Web of Science ®Google Scholar
• Vaswani, N., Chi, Y., and Bouwmans, T. (2018), “Rethinking PCA for Modern Datasets: Theory, Algorithms, and Applications,” Proceedings of the IEEE, 106, 1. DOI: 10.1109/JPROC.2018.2853498.
   Web of Science ®Google Scholar
• Vu, V. Q., Cho, J., Lei, J., and Rohe, K. (2013), “Fantope Projection and Selection: A Near-Optimal Convex Relaxation of Sparse PCA,” in Advances in Neural Information Processing Systems (Vol. 26).
   Google Scholar
• Witten, D. M., Tibshirani, R., and Hastie, T. (2009), “A Penalized Matrix Decomposition, with Applications to Sparse Principal Components and Canonical Correlation Analysis,” Biostatistics, 10, 515–534. DOI: 10.1093/biostatistics/kxp008.
   PubMed Web of Science ®Google Scholar
• Wright, J., Peng, Y., Ma, Y., Ganesh, A., and Rao, S. (2009a), “Robust Principal Component Analysis?” in Neural Information Processing Systems.
   Google Scholar
• Wright, S. J., Nowak, R. D., and Figueiredo, M. A. (2009b), “Sparse Reconstruction by Separable Approximation,” IEEE Transactions on Signal Processing, 57, 2479–2493. DOI: 10.1109/TSP.2009.2016892.
   Web of Science ®Google Scholar
• Zou, H., Hastie, T., and Tibshirani, R. (2006), “Sparse Principal Component Analysis,” Journal of computational and graphical statistics, 15, 265–286. DOI: 10.1198/106186006X113430.
   Web of Science ®Google Scholar
• Zou, H., and Xue, L. (2018), “A Selective Overview of Sparse Principal Component Analysis,” Proceedings of the IEEE, 106, 1311–1320. DOI: 10.1109/JPROC.2018.2846588.
   Web of Science ®Google Scholar