Accelerated and Interpretable Oblique Random Survival Forests

References

• ARIC Investigators (1989), “The Atherosclerosis Risk in Communities (ARIC) Study: Design and Objectives,” American Journal of Epidemiology, 129, 687–702.
   PubMed Web of Science ®Google Scholar
• Benavoli, A., Corani, G., Demšar, J., and Zaffalon, M. (2017), “Time for a Change: A Tutorial for Comparing Multiple Classifiers through Bayesian Analysis,” The Journal of Machine Learning Research, 18, 2653–2688.
   Web of Science ®Google Scholar
• Bild, D. E., Bluemke, D. A., Burke, G. L., Detrano, R., Diez Roux, A. V., Folsom, A. R., Greenland, P., JacobsJr, D. R., Kronmal, R., Liu, K., et al. (2002), “Multi-Ethnic Study of Atherosclerosis: Objectives and Design,” American Journal of Epidemiology, 156, 871–881. DOI: 10.1093/aje/kwf113.
   PubMed Web of Science ®Google Scholar
• Blanche, P., Dartigues, J.-F., and Jacqmin-Gadda, H. (2013), “Estimating and Comparing Time-Dependent Areas Under Receiver Operating Characteristic Curves for Censored Event Times with Competing Risks,” Statistics in Medicine, 32, 5381–5397. DOI: 10.1002/sim.5958.
   PubMed Web of Science ®Google Scholar
• Breiman, L. (2001), “Random Forests,” Machine Learning, 45, 5–32. DOI: 10.1023/A:1010933404324.
   Web of Science ®Google Scholar
• Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (2017), Classification and Regression Trees, New York: Routledge.
   Google Scholar
• Brilleman, S. (2018), simsurv: Simulate Survival Data. R package version 0.2.2, available at https://CRAN.R-project.org/package=simsurv.
   Google Scholar
• Brilleman, S. L., Wolfe, R., Moreno-Betancur, M., and Crowther, M. J. (2020), “Simulating Survival Data using the simsurv R package,” Journal of Statistical Software, 97, 1–27. DOI: 10.18637/jss.v097.i03.
   Web of Science ®Google Scholar
• Chen, T., He, T., Benesty, M., Khotilovich, V., Tang, Y., Cho, H., Chen, K., Mitchell, R., Cano, I., Zhou, T., Li, M., Xie, J., Lin, M., Geng, Y., Li, Y., and Yuan, J. (2022), xgboost: Extreme Gradient Boosting, R package version 1.5.2.1.
   Google Scholar
• Cui, Y., Zhu, R., Zhou, M., and Kosorok, M. (2017), “Consistency of Survival Tree and Forest Models: Splitting Bias and Correction,” arXiv preprint arXiv:1707.09631.
   Google Scholar
• Felker, G. M., Anstrom, K. J., Adams, K. F., Ezekowitz, J. A., Fiuzat, M., Houston-Miller, N., Januzzi, J. L., Mark, D. B., Piña, I. L., Passmore, G., et al. (2017), “Effect of Natriuretic Peptide–Guided Therapy on Hospitalization or Cardiovascular Mortality in High-Risk Patients with Heart Failure and Reduced Ejection Fraction: A Randomized Clinical Trial,” JAMA, 318, 713–720. DOI: 10.1001/jama.2017.10565.
   PubMed Web of Science ®Google Scholar
• Goodrich, B., Gabry, J., Ali, I., and Brilleman, S. (2022), rstanarm: Bayesian Applied Regression Modeling via Stan, R package version 2.21.3.
   Google Scholar
• Graf, E., Schmoor, C., Sauerbrei, W., and Schumacher, M. (1999), “Assessment and Comparison of Prognostic Classification Schemes for Survival Data,” Statistics in Medicine, 18, 2529–2545. DOI: 10.1002/(SICI)1097-0258(19990915/30)18:17/18<2529::AID-SIM274>3.0.CO;2-5.
   PubMed Web of Science ®Google Scholar
• Harrell, F. E., Califf, R. M., Pryor, D. B., Lee, K. L., and Rosati, R. A. (1982), “Evaluating the Yield of Medical Tests,” JAMA, 247, 2543–2546.
   PubMed Web of Science ®Google Scholar
• He, P., Eriksson, F., Scheike, T. H., and Zhang, M.-J. (2016), “A Proportional Hazards Regression Model for the Subdistribution with Covariates-Adjusted Censoring Weight for Competing Risks Data,” Scandinavian Journal of Statistics, 43, 103–122. DOI: 10.1111/sjos.12167.
   PubMed Web of Science ®Google Scholar
• Heath, D., Kasif, S., and Salzberg, S. (1993), “Induction of Oblique Decision Trees,” in IJCAI (Vol. 1993), pp. 1002–1007, Citeseer.
   Google Scholar
• Heller, G. (2012), “A Measure of Explained Risk in the Proportional Hazards Model,” Biostatistics, 13, 315–325. DOI: 10.1093/biostatistics/kxr047.
   PubMed Web of Science ®Google Scholar
• Hooker, G., Mentch, L., and Zhou, S. (2021), “Unrestricted Permutation Forces Extrapolation: Variable Importance Requires at Least One More Model, or There Is No Free Variable Importance,” Statistics and Computing, 31, 1–16. DOI: 10.1007/s11222-021-10057-z.
   Web of Science ®Google Scholar
• Horst, A. M., Hill, A. P., and Gorman, K. B. (2020), palmerpenguins: Palmer Archipelago (Antarctica) Penguin Data, R package version 0.1.0.
   Google Scholar
• Hothorn, T., Hornik, K., Strobl, C., and Zeileis, A. (2019), “Party: A Laboratory for Recursive Partytioning.” R package version 1.3.3, available at https://CRAN.R-project.org/package=party.
   Google Scholar
• Hothorn, T., Hornik, K., and Zeileis, A. (2006), “Unbiased Recursive Partitioning: A Conditional Inference Framework,” Journal of Computational and Graphical statistics, 15, 651–674. DOI: 10.1198/106186006X133933.
   Web of Science ®Google Scholar
• Hvitfeldt, E., and Frick, H. censored: ’parsnip’ Engines for Survival Models, R package version 0.1.0.9000.
   Google Scholar
• Ishwaran, H., and Kogalur, U. (2019), “Random Forests for Survival, Regression, and Classification (RF-SRC). R package version 2.8.0, available at https://cran.r-project.org/package=randomForestSRC.
   Google Scholar
• Ishwaran, H., and Kogalur, U. B. (2010), “Consistency of Random Survival Forests,” Statistics & Probability Letters, 80, 1056–1064. DOI: 10.1016/j.spl.2010.02.020.
   PubMed Web of Science ®Google Scholar
• Ishwaran, H., Kogalur, U. B., Blackstone, E. H., and Lauer, M. S. (2008), “Random Survival Forests,” The Annals of Applied Statistics, 2, 841–860. DOI: 10.1214/08-AOAS169.
   Web of Science ®Google Scholar
• Ishwaran, H., and Lu, M. (2019), “Standard Errors and Confidence Intervals for Variable Importance in Random Forest Regression, Classification, and Survival,” Statistics in Medicine, 38, 558–582. DOI: 10.1002/sim.7803.
   PubMed Web of Science ®Google Scholar
• Jaeger, B. C., Long, D. L., Long, D. M., Sims, M., Szychowski, J. M., Min, Y.-I., Mcclure, L. A., Howard, G., and Simon, N. (2019), “Oblique Random Survival Forests,” The Annals of Applied Statistics, 13, 1847–1883. DOI: 10.1214/19-aoas1261.
   PubMed Web of Science ®Google Scholar
• Jaeger, B. C., Welden, S., Lenoir, K., and Pajewski, N. M. (2022), “aorsf: An R Package for Supervised Learning Using the Oblique Random Survival Forest,” Journal of Open Source Software, 7, 4705. DOI: 10.21105/joss.04705.
   Google Scholar
• Kattan, M. W., and Gerds, T. A. (2018), “The Index of Prediction Accuracy: An Intuitive Measure Useful for Evaluating Risk Prediction Models,” Diagnostic and Prognostic Research, 2, 1–7. DOI: 10.1186/s41512-018-0029-2.
   PubMedGoogle Scholar
• Katuwal, R., Suganthan, P. N., and Zhang, L. (2020), “Heterogeneous Oblique Random Forest,” Pattern Recognition, 99, 107078. DOI: 10.1016/j.patcog.2019.107078.
   Web of Science ®Google Scholar
• Kuhn, M., and Wickham, H. (2020), “Tidymodels: A Collection of Packages for Modeling and Machine Learning Using Tidyverse Principles,” available at .
   Google Scholar
• Kyle, R. A., Therneau, T. M., Rajkumar, S. V., Offord, J. R., Larson, D. R., Plevak, M. F., and Melton III, L. J. (2002), “A Long-Term Study of Prognosis in Monoclonal Gammopathy of Undetermined Significance,” New England Journal of Medicine, 346, 564–569. DOI: 10.1056/NEJMoa01133202.
   PubMed Web of Science ®Google Scholar
• Landau, W. M. (2021), “The Targets r package: A Dynamic Make-Like Function-Oriented Pipeline Toolkit for Reproducibility and High-Performance Computing,” Journal of Open Source Software, 6, 2959. DOI: 10.21105/joss.02959.
   Google Scholar
• Li, H., Han, D., Hou, Y., Chen, H., and Chen, Z. (2015), “Statistical Inference Methods for Two Crossing Survival Curves: A Comparison of Methods,” PLoS One, 10, e0116774. DOI: 10.1371/journal.pone.0116774.
   PubMed Web of Science ®Google Scholar
• Lundberg, S., and Lee, S.-I. (2017), “A Unified Approach to Interpreting Model Predictions,” arXiv preprint arXiv:1705.07874.
   Google Scholar
• Lundberg, S. M., Erion, G. G., and Lee, S.-I. (2018), “Consistent Individualized Feature Attribution for Tree Ensembles,” arXiv preprint arXiv:1802.03888.
   Google Scholar
• Menze, B. H., Kelm, B. M., Splitthoff, D. N., Koethe, U., and Hamprecht, F. A. (2011), “On Oblique Random Forests,” in Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp. 453–469. Springer.
   Google Scholar
• Moons, K. G., Kengne, A. P., Woodward, M., Royston, P., Vergouwe, Y., Altman, D. G., and Grobbee, D. E. (2012), “Risk Prediction Models: I. Development, Internal Validation, and Assessing the Incremental Value of a New (Bio) Marker,” Heart, 98, 683–690. DOI: 10.1136/heartjnl-2011-301246.
   PubMed Web of Science ®Google Scholar
• Moss, L., Corsar, D., Shaw, M., Piper, I., and Hawthorne, C. (2022), “Demystifying the Black Box: The Importance of Interpretability of Predictive Models in Neurocritical Care,” Neurocritical Care, 37, 185–191. DOI: 10.1007/s12028-022-01504-4.
   PubMed Web of Science ®Google Scholar
• Murthy, S. K., Kasif, S., and Salzberg, S. (1994), “A System for Induction of Oblique Decision Trees,” Journal of Artificial Intelligence Research, 2, 1–32. DOI: 10.1613/jair.63.
   Web of Science ®Google Scholar
• Poona, N., Van Niekerk, A., and Ismail, R. (2016), “Investigating the Utility of Oblique Tree-based Ensembles for the Classification of Hyperspectral Data,” Sensors, 16, 1918. DOI: 10.3390/s16111918.
   PubMed Web of Science ®Google Scholar
• Qiu, X., Zhang, L., Suganthan, P. N., and Amaratunga, G. A. (2017), “Oblique Random Forest Ensemble via Least Square Estimation for Time Series Forecasting,” Information Sciences, 420, 249–262. DOI: 10.1016/j.ins.2017.08.060.
   Web of Science ®Google Scholar
• Rainforth, T., and Wood, F. (2015), “Canonical Correlation Forests,” arXiv preprint arXiv:1507.05444.
   Google Scholar
• SPRINT Research Group (2015), “A Randomized Trial of Intensive versus Standard Blood-Pressure Control,” New England Journal of Medicine, 373, 2103–2116.
   PubMed Web of Science ®Google Scholar
• Strobl, C., Boulesteix, A.-L., Zeileis, A., and Hothorn, T. (2007), “Bias in Random Forest Variable Importance Measures: Illustrations, Sources and a Solution,” BMC Bioinformatics, 8, 25. DOI: 10.1186/1471-2105-8-25.
   PubMed Web of Science ®Google Scholar
• Taylor Jr, H. A., Wilson, J. G., Jones, D. W., Sarpong, D. F., Srinivasan, A., Garrison, R. J., Nelson, C., and Wyatt, S. B. (2005), “Toward Resolution of Cardiovascular Health Disparities in African Americans: Design and Methods of the Jackson Heart Study,” Ethnicity & Disease, 15, S4–S6.
   Web of Science ®Google Scholar
• Therneau, T. M. (2022a), “Survival Package Source Code Documentation,” original-date: 2016-04-28.
   Google Scholar
• Therneau, T. M. (2022b), A Package for Survival Analysis in R, R package version 3.3-1.
   Google Scholar
• Therneau, T. M., and Grambsch, P. M. (2000), Modeling Survival Data: Extending the Cox Model, New York: Springer.
   Google Scholar
• Tomita, T. M., Browne, J., Shen, C., Chung, J., Patsolic, J. L., Falk, B., Priebe, C. E., Yim, J., Burns, R., Maggioni, M., et al. (2020), “Sparse Projection Oblique Randomer Forests,” Journal of Machine Learning Research, 21, 1–39.
   PubMed Web of Science ®Google Scholar
• Uno, H., Cai, T., Pencina, M. J., D’Agostino, R. B., and Wei, L.-J. (2011), “On the c-statistics for Evaluating Overall Adequacy of Risk Prediction Procedures with Censored Survival Data,” Statistics in Medicine, 30, 1105–1117. DOI: 10.1002/sim.4154.
   PubMed Web of Science ®Google Scholar
• Wang, H., and Li, G. (2017), “A Selective Review on Random Survival Forests for High Dimensional Data,” Quantitative Bio-science, 36, 85–96.
   PubMedGoogle Scholar
• Wang, H., and Zhou, L. (2017), “Random Survival Forest with Space Extensions for Censored Data,” Artificial Intelligence in Medicine, 79, 52–61. DOI: 10.1016/j.artmed.2017.06.005.
   PubMed Web of Science ®Google Scholar
• Wright, M. N., and Ziegler, A. (2017), “ranger: A Fast Implementation of Random Forests for High Dimensional Data in c++ and r,” Journal of Statistical Software, 77, 1–17. DOI: 10.18637/jss.v077.i01.
   Web of Science ®Google Scholar
• Zhang, L., and Suganthan, P. N. (2014), “Oblique Decision Tree Ensemble via Multisurface Proximal Support Vector Machine,” IEEE Transactions on Cybernetics, 45, 2165–2176. DOI: 10.1109/TCYB.2014.2366468.
   PubMed Web of Science ®Google Scholar
• Zhou, L., Wang, H., and Xu, Q. (2016), “Random Rotation Survival Forest for High Dimensional Censored Data,” SpringerPlus, 5, 1–10. DOI: 10.1186/s40064-016-3113-5.
   PubMedGoogle Scholar
• Zhu, R. (2013), “Tree-based Methods for Survival Analysis and High-dimensional Data,” Ph. D. thesis. The University of North Carolina at Chapel Hill.
   Google Scholar
• Zhu, R., Zeng, D., and Kosorok, M. R. (2015), “Reinforcement Learning Trees,” Journal of the American Statistical Association, 110, 1770–1784. DOI: 10.1080/01621459.2015.1036994.
   PubMed Web of Science ®Google Scholar