On the Use of Minimum Penalties in Statistical Learning

References

• Anderson, T. W. (1951), “Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions,” The Annals of Mathematical Statistics, 22, 327–351. DOI: 10.1214/aoms/1177729580.
   Google Scholar
• Bühlmann, P., Rütimann, P., van de Greer, S., and Zhang, C.-H. (2013), “Correlated Variables in Regression: Clustering and Sparse Estimation,” Journal of Statistical Planning and Inference, 143, 1835–1858. DOI: 10.1016/j.jspi.2013.05.019.
   Web of Science ®Google Scholar
• Chen, L., and Huang, J. Z. (2012), “Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable Selection,” Journal of the American Statistical Association, 107, 1533–1545. DOI: 10.1080/01621459.2012.734178.
   Web of Science ®Google Scholar
• Chen, L., and Huang, J. Z. (2016), “Sparse Reduced-Rank Regression with Covariance Estimation,” Statistics and Computing, 26, 461–470.
   Web of Science ®Google Scholar
• Chen, Y., Iyengar, R., and Iyengar, G. (2016), “Modeling Multimodal Continuous Heterogeneity in Conjoint Analysis—A Sparse Learning Approach,” Marketing Science, 36, 140–156. DOI: 10.1287/mksc.2016.0992.
   Web of Science ®Google Scholar
• Cook, R. D., Li, B., and Chiaromonte, F. (2010), “Envelope Models for Parsimonious and Efficient Multivariate Linear Regression,” (with Discussion), Statistica Sinica, 20, 927–1010.
   Web of Science ®Google Scholar
• Cook, R. D., and Zhang, X. (2015), “Foundations for Envelope Models and Methods,” Journal of the American Statistical Association, 110, 599–611. DOI: 10.1080/01621459.2014.983235.
   Web of Science ®Google Scholar
• Fan, J., and Lv, J. (2008), “Sure Independence Screening for Ultrahigh Dimensional Feature Space,” Journal of the Royal Statistical Society, Series B, 70, 849–911. DOI: 10.1111/j.1467-9868.2008.00674.x.
   PubMed Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2008), “Regularized Paths for Genearlized Linear Models via Coordinate Descent,” Journal of Statistial Softwawre, 33, 1–22.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22. https://www.jstatsoft.org/v33/i01/.
   PubMed Web of Science ®Google Scholar
• Fränti, P., and Sieranoja, S. (2019), “How much can k-means be Improved by Using Better Initialization and Repeats?” Pattern Recognition, 93, 95–112. http://www.sciencedirect.com/science/article/pii/S0031320319301608. DOI: 10.1016/j.patcog.2019.04.014.
   Web of Science ®Google Scholar
• Hebiri, M., and van de Geer, S. (2011), “The Smooth-Lasso and other l1+l2-penalized Methods,” Electronic Journal of Statistics, 5, 1184–1226.
   Web of Science ®Google Scholar
• Kim, S., and Xing, E. P. (2009), “Statistical Estimation of Correlated Genome Associations to a Quantitative Trait Network,” PLOS Genetics, 5, 1–18. DOI: 10.1371/journal.pgen.1000587.
   Web of Science ®Google Scholar
• Kim, S., and Xing, E. P. (2012), “Tree-Guided Group Lasso for Multi-Response Regression with Structured Sparsity, with an Application to eQTL Mapping,” The Annals of Applied Statistics, 6, 1095–1117.
   Web of Science ®Google Scholar
• Lee, J. D., Sun, D. L., Sun, Y., and Taylor, J. E. (2016), “Exact Post-Selection Inference, with Application to the Lasso,” The Annals of Statistics, 44, 907–927. DOI: 10.1214/15-AOS1371.
   Web of Science ®Google Scholar
• Lee, W., and Liu, Y. (2012), “Simultaneous Multiple Response Regression and Inverse Covariance Matrix Estimation via Penalized Gaussian Maximum Likelihood,” Journal of Multivariate Analysis, 111, 241–255. DOI: 10.1016/j.jmva.2012.03.013.
   PubMed Web of Science ®Google Scholar
• Li, C., and Li, H. (2008), “Network-Constrained Regularization and Variable Selection of Genomic Data,” Bioinformatics, 24, 1175–1182. DOI: 10.1093/bioinformatics/btn081.
   PubMed Web of Science ®Google Scholar
• Li, C., and Li, H. (2010), “Variable Selection and Regression Analysis for Graph-Structure Covariates with an Application to Genomics,” The Annals of Applied Statistics, 4, 1498–1516.
   PubMed Web of Science ®Google Scholar
• Li, Y., Nan, B., and Zhu, J. (2015), “Multivariate Sparse Group Lasso for Multivariate Multiple Linear Regression with Arbitrary Group Sparsity,” Biometrics, 71, 354–363. DOI: 10.1111/biom.12292.
   PubMed Web of Science ®Google Scholar
• Negahban, S. N., Ravikumar, P., Wainwright, M. J., and Yu, B. (2012), “A Unified Framework for High-Dimensional Analysis for M-Estimators with Decomposable Regularizers,” Statistical Science, 27, 538–557. DOI: 10.1214/12-STS400.
   Web of Science ®Google Scholar
• Price, B. S., Allenbrand, C., and Sherwood, B. (2021), “Dececting Clusters in Multivariate Regression,” WIREs Computational Statistics (to appear). DOI: 10.1002/wics.1551.
   Google Scholar
• Price, B. S., Molstad, A. J., and Sherwood, B. (2021), “Estimating Multiple Precision Matrices using Cluster Fusion Regularization,” Journal of Computational and Graphical Statistics, 30, 823–834, DOI: 10.1080/10618600.2021.1874963.
   Web of Science ®Google Scholar
• Price, B. S., and Sherwood, B. (2018), “A Cluster Elastic Net for Multivariate Regression,” Journal of Machine Learning Research, 19, 1–37.
   Google Scholar
• Rothman, A. J., Levina, E., and Zhu, J. (2010), “Sparse Multivariate Regression with Covariance Estimation,” Journal of Computational and Graphical Statistics, 19, 947–962. DOI: 10.1198/jcgs.2010.09188.
   PubMed Web of Science ®Google Scholar
• Shen, X., Pan, W., and Zhu, Y. (2012), “Likelihood-based Selection and Sharp Parameter Estimation,” Journal of the American Statistical Association, 107, 223–232. DOI: 10.1080/01621459.2011.645783.
   PubMed Web of Science ®Google Scholar
• Sun, Q., Zhu, H., Liu, Y., and Ibrahim, J. G. (2015), “SPReM: Sparse Projection Regression Model for High-Dimensional Linear Regression,” Journal of the American Statistical Association, 110, 289–302. DOI: 10.1080/01621459.2014.892008.
   PubMed Web of Science ®Google Scholar
• Sun, W., Wang, J., and Fang, Y. (2012), “Regularized k-means Clustering of High-Dimensional Data and its Asymptotic Consistency,” Electronic Journal of Statistics, 6, 148–167. DOI: 10.1214/12-EJS668.
   Web of Science ®Google Scholar
• Tibshirani, R. J. (2013), “The Lasso Problem and Uniqueness,” Electronic Journal of Statistics, 7, 1456–1490. DOI: 10.1214/13-EJS815.
   Web of Science ®Google Scholar
• Velu, R., and Reinsel, G. C. (2013), Multivariate Reduced-Rank Regression: Theory and Applications (Vol. 136), New York: Springer.
   Google Scholar
• Votavova, H., Merkerova, M. D., Fejglova, K., Vasikova, A., Krejcik, Z., Pastorkova, A., Tabashidze, N., Topinka, J., Jr., M. V., Sram, R., and Brdicka, R. (2011), “Transcriptome Alterations in Maternal and Fetal Cells Induced by Tobacco Smoke,” Placenta, 32, 763–770. DOI: 10.1016/j.placenta.2011.06.022.
   PubMed Web of Science ®Google Scholar
• Wang, N., Tikellis, G., Sun, C., Pezic, A., Wang, L., Wells, J., Cochrane, J., Ponsonby, A.-L., and Dwyer, T. (2014), “The Effect of Maternal Prenatal Smoking and Alcohol Consumption on the Placenta-to-Birth Weight Ratio,” Placenta, 35, 437–441. DOI: 10.1016/j.placenta.2014.04.006.
   PubMed Web of Science ®Google Scholar
• Witten, D., and Tibshirani, R. (2009), “Covariance Regularized Regression and Classification for High-Dimensional Problems,” Journal of Royal Statistical Society, Series B, 71, 615–636. DOI: 10.1111/j.1467-9868.2009.00699.x.
   Google Scholar
• Witten, D. M., Shojaie, A., and Zhang, F. (2014), “The Cluster Elastic Net for High-Dimensional Regression With Unknown Variable Grouping,” Technometrics, 56, 112–122. DOI: 10.1080/00401706.2013.810174.
   PubMed Web of Science ®Google Scholar
• Xu, L., Huang, A., Chen, J., and Chen, E. (2015), “Exploiting Task-Feature Co-clusters in Multi-Task Learning,” in Twenty-Ninth AAAI Conference on Artificial Intelligence. DOI: 10.1609/aaai.v29i1.9483.
   Google Scholar
• Yang, S., Yuan, L., Lai, Y.-C., Shen, X., Wronka, P., and Ye, J. (2012), “Feature Grouping and Selection Over an Undirected Graph,” KDD: Proceedings. International Conference on Knowledge and Discovery, pp. 922–930. DOI: 10.1145/2339530.2339675.
   Google Scholar
• Zhao, S., and Shojaie, A. (2016), “A SIgnificance Test for Graph Constrained Estimation,” Biometrics, 72, 484–493. DOI: 10.1111/biom.12418.
   PubMed Web of Science ®Google Scholar
• Zhou, W., Sherwood, B., Ji, Z., Xue, Y., Du, F., Bai, J., Ying, M., and Ji, H. (2017), “Genome-Wide Prediction of DNase I Hypersensitivity Using Gene Expression,” Nature Communications, 8, 1–17. DOI: 10.1038/s41467-017-01188-x.
   PubMedGoogle Scholar
• Zhu, Y., Shen, X., and Pan, W. (2013), “Simultaneous Grouping Pursuit and Feature Selection Over an Undirected Graph,” Journal of the American Statistical Association, 108, 713–725, DOI: 10.1080/01621459.2013.770704.
   PubMed Web of Science ®Google Scholar
• Zou, H., and Hastie, T. (2005), “Regularization and Variable Selection via the Elastic Net,” Journal of the Royal Statistical Society, Series B, 67, 301–320. DOI: 10.1111/j.1467-9868.2005.00503.x.
   Google Scholar