A Relaxation Approach to Feature Selection for Linear Mixed Effects Models

References

• Aravkin, A., Burke, J., Sholokhov, A., and Zheng, P. (2022), “Analysis of Relaxation Methods for Feature Selection in Mixed Effects Models,” https://arxiv.org/abs/2205.06925.
   Google Scholar
• Attouch, H., Bolte, J., and Svaiter, B. F. (2013), “Convergence of Descent Methods for Semi-Algebraic and Tame problems: Proximal Algorithms, Forward–Backward Splitting, and Regularized Gauss–Seidel Methods,” Mathematical Programming, 137, 91–129. DOI: 10.1007/s10107-011-0484-9.
   Web of Science ®Google Scholar
• Baraldi, R., Kumar, R., and Aravkin, A. (2019), “Basis Pursuit Denoise With Nonsmooth Constraints,” IEEE Transactions on Signal Processing, 67, 5811–5823. DOI: 10.1109/TSP.2019.2946029.
   Web of Science ®Google Scholar
• Beck, A. (2017), First-Order Methods in Optimization, MOS-SIAM Series on Optimization. Philadelphia, PA: SIAM.
   Google Scholar
• Bondell, H. D., Krishna, A., and Ghosh, S. K. (2010), “Joint Variable Selection for Fixed and Random Effects in Linear Mixed-Effects Models,” Biometrics, 66, 1069–1077. DOI: 10.1111/j.1541-0420.2010.01391.x.
   PubMed Web of Science ®Google Scholar
• Buscemi, S., and Plaia, A. (2019), “Model Selection in Linear Mixed-Effect Models,” AStA Advances in Statistical Analysis, 104, 529–575. DOI: 10.1007/s10182-019-00359-z.
   Web of Science ®Google Scholar
• Chen, F., Li, Z., Shi, L., and Zhu, L. (2015), “Inference for Mixed Models of Anova Type with High-Dimensional Data,” Journal of Multivariate Analysis, 133, 382–401. DOI: 10.1016/j.jmva.2014.09.013.
   Web of Science ®Google Scholar
• Chen, Z., and Dunson, D. B. (2003), “Random Effects Selection in Linear Mixed Models,” Biometrics, 59, 762–769. DOI: 10.1111/j.0006-341x.2003.00089.x.
   PubMed Web of Science ®Google Scholar
• Dai, X., Gil, G. F., Reitsma, M. B., Ahmad, N. S., Anderson, J. A., Bisignano, C., Carr, S., Feldman, R., Hay, S. I., He, J., et al. (2022), “Health Effects Associated with Smoking: A Burden of Proof Study,” Nature Medicine, 28, 2045–2055. DOI: 10.1038/s41591-022-01978-x.
   PubMed Web of Science ®Google Scholar
• DerSimonian, R., and Laird, N. (1986), “Meta-Analysis in Clinical Trials,” Controlled Clinical Trials, 7, 177–188. DOI: 10.1016/0197-2456(86)90046-2.
   PubMed Web of Science ®Google Scholar
• Fan, J. (1997), “Comments on “Wavelets in Statistics: A Review” by a. antoniadis,” Journal of the Italian Statistical Society, 6, 131. DOI: 10.1007/BF03178906.
   Google Scholar
• Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360. DOI: 10.1198/016214501753382273.
   Web of Science ®Google Scholar
• Fan, Y., and Li, R. (2012), “Variable Selection in Linear Mixed Effects Models,” The Annals of Statistics, 40, 2043–2068. DOI: 10.1214/12-AOS1028.
   PubMed Web of Science ®Google Scholar
• Fan, Y., Qin, G., and Zhu, Z. Y. (2014), “Robust Variable Selection in Linear Mixed Models,” Communications in Statistics-Theory and Methods, 43, 4566–4581. DOI: 10.1080/03610926.2012.724509.
   Web of Science ®Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
   PubMed Web of Science ®Google Scholar
• Ghosh, A., and Thoresen, M. (2018), “Non-Concave Penalization in Linear Mixed-Effect Models and Regularized Selection of Fixed Effects,” AStA Advances in Statistical Analysis, 102, 179–210. DOI: 10.1007/s10182-017-0298-z.
   Web of Science ®Google Scholar
• Grant, R. L. (2014), “Converting An Odds Ratio to a Range of Plausible Relative Risks for Better Communication of Research Findings,” BMJ, 348, f7450. DOI: 10.1136/bmj.f7450.
   PubMed Web of Science ®Google Scholar
• Groll, A., and Tutz, G. (2014), “Variable Selection for Generalized Linear Mixed Models by l1-penalized Estimation,” Statistics and Computing, 24, 137–154. DOI: 10.1007/s11222-012-9359-z.
   Web of Science ®Google Scholar
• Ibrahim, J. G., Zhu, H., Garcia, R. I., and Guo, R. (2011), “Fixed and Random Effects Selection in Mixed Effects Models,” Biometrics, 67, 495–503. DOI: 10.1111/j.1541-0420.2010.01463.x.
   PubMed Web of Science ®Google Scholar
• Jiang, J., Rao, J. S., Gu, Z., and Nguyen, T. (2008), “Fence Methods for Mixed Model Selection,” The Annals of Statistics, 36, 1669–1692. DOI: 10.1214/07-AOS517.
   Web of Science ®Google Scholar
• Jones, R. H. (2011), “Bayesian Information Criterion for Longitudinal and Clustered Data,” Statistics in Medicine, 30, 3050–3056. DOI: 10.1002/sim.4323.
   PubMed Web of Science ®Google Scholar
• Kojima, M., Megiddo, N., Noma, T., and Yoshise, A. (1991), “A Unified Approach to Interior Point Algorithms for Linear Complementarity Problems: A Summary,” Operations Research Letters, 10, 247–254. DOI: 10.1016/0167-6377(91)90010-M.
   Web of Science ®Google Scholar
• Lan, L. (2006), “Variable Selection in Linear Mixed Model for Longitudinal Data,” PhD thesis.
   Google Scholar
• Lescinsky, H., Afshin, A., Ashbaugh, C., Bisignano, C., Brauer, M., Ferrara, G., Hay, S. I., He, J., Iannucci, V., Marczak, L. B., et al. (2022), “Health Effects Associated with Consumption of Unprocessed Red Meat: A Burden of Proof Study,” Nature Medicine, 28, 2075–2082. DOI: 10.1038/s41591-022-01968-z.
   PubMed Web of Science ®Google Scholar
• Lin, B., Pang, Z., and Jiang, J. (2013), “Fixed and Random Effects Selection by REML and Pathwise Coordinate Optimization,” Journal of Computational and Graphical Statistics, 22, 341–355. DOI: 10.1080/10618600.2012.681219.
   PubMed Web of Science ®Google Scholar
• Müller, S., Scealy, J. L., and Welsh, A. H. (2013), “Model Selection in Linear Mixed Models,” Statistical Science, 28, 135–167. DOI: 10.1214/12-STS410.
   Web of Science ®Google Scholar
• Murray, C. J., and Acharya, A. K. (1997), “Understanding Dalys,” Journal of Health Economics, 16, 703–730. DOI: 10.1016/s0167-6296(97)00004-0.
   PubMed Web of Science ®Google Scholar
• Murray, C. J., Aravkin, A. Y., Zheng, P., Abbafati, C., Abbas, K. M., Abbasi-Kangevari, M., Abd-Allah, F., Abdelalim, A., Abdollahi, M., Abdollahpour, I., et al. (2020), “Global Burden of 87 Risk Factors in 204 Countries and Territories, 1990–2019: A Systematic Analysis for the Global Burden of Disease Study 2019,” The Lancet, 396, 1223–1249. DOI: 10.1016/S0140-6736(20)30752-2.
   PubMed Web of Science ®Google Scholar
• Nesterov, Y., and Nemirovskii, A. (1994), Interior-Point Polynomial Algorithms in Convex Programming, Philadelphia, PA: Society for Industrial and Applied Mathematics.
   Google Scholar
• Nocedal, J., and Wright, S. (2006), Numerical Optimization, New York: Springer.
   Google Scholar
• Pan, J., and Shang, J. (2018), “A Simultaneous Variable Selection Methodology for Linear Mixed Models,” Journal of Statistical Computation and Simulation, 88, 3323–3337. DOI: 10.1080/00949655.2018.1515948.
   Web of Science ®Google Scholar
• Patterson, H. D., and Thompson, R. (1971), “Recovery of Inter-Block Information when Block Sizes are Unequal,” Biometrika, 58, 545. DOI: 10.1093/biomet/58.3.545.
   Web of Science ®Google Scholar
• Pinheiro, J., and Bates, D. (2006), Mixed-Effects Models in S and S-PLUS, New York: Springer.
   Google Scholar
• Pinheiro, J. C., and Bates, D. M. (2000), “Mixed-Effects Models in Sand S-PLUS,” Journal of the American Statistical Association, 96, 1135–1136.
   Web of Science ®Google Scholar
• Razo, C., Welgan, C. A., Johnson, C. O., McLaughlin, S. A., Iannucci, V., Rodgers, A., Wang, N., LeGrand, K. E., Sorensen, R. J., He, J., et al. (2022), “Effects of Elevated Systolic Blood Pressure on Ischemic Heart Disease: A Burden of Proof Study,” Nature Medicine, 28, 2056–2065. DOI: 10.1038/s41591-022-01974-1.
   PubMed Web of Science ®Google Scholar
• Reiner, R. C., Barber, R. M., Collins, J. K., Zheng, P., Hay, S. I., Lim, S. S., Murray, C. J. L., and IHME COVID-19 Forecasting Team. (2020), “Modeling Covid-19 Scenarios for the United States,” Nature Medicine, 27, 94–105. DOI: 10.1038/s41591-020-1132-9.
   PubMed Web of Science ®Google Scholar
• Rockafellar, R. T., and Wets, R. J.-B. (2009), Variational Analysis (Vol. 317), Berlin: Springer.
   Google Scholar
• Schelldorfer, J., Bühlmann, P., and DE GEER, S. V. (2011), “Estimation for High-Dimensional Linear Mixed-Effects Models Using l1-penalization,” Scandinavian Journal of Statistics, 38, 197–214. DOI: 10.1111/j.1467-9469.2011.00740.x.
   Web of Science ®Google Scholar
• Stanaway, J. D., Afshin, A., Ashbaugh, C., Bisignano, C., Brauer, M., Ferrara, G., Garcia, V., Haile, D., Hay, S. I., He, J., et al. (2022), “Health Effects Associated with Vegetable Consumption: A Burden of Proof Study,” Nature Medicine, 28, 2066–2074. DOI: 10.1038/s41591-022-01970-5.
   PubMed Web of Science ®Google Scholar
• Sugiura, N. (1978), “Further Analysts of the Data by Akaike’ s Information Criterion and the Finite Corrections,” Communications in Statistics - Theory and Methods, 7, 13–26. DOI: 10.1080/03610927808827599.
   Web of Science ®Google Scholar
• Tibshirani, R. (1996), “Regression Shrinkage and Selection Via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288. DOI: 10.1111/j.2517-6161.1996.tb02080.x.
   Google Scholar
• Vaida, F., and Blanchard, S. (2005), “Conditional Akaike Information for Mixed-Effects Models,” Biometrika, 92, 351–370. DOI: 10.1093/biomet/92.2.351.
   Web of Science ®Google Scholar
• Vanderbei, R., and Shanno, D. (1999), “An Interior-Point Algorithm for Nonconvex Nonlinear Programming,” Computational Optimization and Applications, 13, 231–252. DOI: 10.1023/A:1008677427361.
   Web of Science ®Google Scholar
• Wang, Z. (2013), “Converting Odds Ratio to Relative Risk in Cohort Studies with Partial Data Information,” Journal of Statistical Software, 55, 1–11. DOI: 10.18637/jss.v055.i05.
   Web of Science ®Google Scholar
• Wright, S. J. (1997), Primal-Dual Interior-Point Methods, Philadelphia: Society for Industrial and Applied Mathematics.
   Google Scholar
• Xu, P., Wang, T., Zhu, H., and Zhu, L. (2015), “Double Penalized H-Likelihood for Selection of Fixed and Random Effects in Mixed Effects Models,” Statistics in Biosciences, 7, 108–128. DOI: 10.1007/s12561-013-9105-x.
   Web of Science ®Google Scholar
• Zheng, P., Afshin, A., Biryukov, S., Bisignano, C., Brauer, M., Bryazka, D., Burkart, K., Cercy, K. M., Cornaby, L., Dai, X., et al. (2022), “The Burden of Proof Studies: Assessing the Evidence of Risk,” Nature Medicine, 28, 2038–2044. DOI: 10.1038/s41591-022-01973-2.
   PubMed Web of Science ®Google Scholar
• Zheng, P., Askham, T., Brunton, S. L., Kutz, J. N., and Aravkin, A. Y. (2019), “A Unified Framework for Sparse Relaxed Regularized Regression: SR3,” IEEE Access, 7, 1404–1423. DOI: 10.1109/ACCESS.2018.2886528.
   Web of Science ®Google Scholar
• Zheng, P., Barber, R., Sorensen, R. J., Murray, C. J., and Aravkin, A. Y. (2021), “Trimmed Constrained Mixed Effects Models: Formulations and Algorithms,” Journal of Computational and Graphical Statistics, 30, 544–556. DOI: 10.1080/10618600.2020.1868303.
   Web of Science ®Google Scholar
• Zou, H. (2006), “The Adaptive Lasso and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429. DOI: 10.1198/016214506000000735.
   Web of Science ®Google Scholar
• Zuur, A., Ieno, E. N., Walker, N., Saveliev, A. A., and Smith, G. M. (2009), Mixed Effects Models and Extensions in Ecology with R, New York: Springer.
   Google Scholar