Approximating Partial Likelihood Estimators via Optimal Subsampling

References

• Ai, M., Yu, J., Zhang, H., and Wang, H. (2021), “Optimal Subsampling Algorithms for Big Data Regressions,” Statistica Sinica, 31, 749–772. DOI: 10.5705/ss.202018.0439.
   Web of Science ®Google Scholar
• Andersen, P. K., and Gill, R. D. (1982), “Cox’s Regression Model for Counting Processes: A Large Sample Study,” The Annals of Statistics, 10, 1100–1120. DOI: 10.1214/aos/1176345976.
   Web of Science ®Google Scholar
• Atkinson, A., Donev, A., and Tobias, R. (2007), Optimum Experimental Designs, with SAS, Oxford: Oxford University Press.
   Google Scholar
• Bai, Y., Li, C., Lin, Z., Wu, Y., Miao, Y., Liu, Y., and Xu, Y. (2021), “Efficient Data Loader for Fast Sampling-based gnn Training on Large Graphs,”. IEEE Transactions on Parallel and Distributed Systems. 32, 2541–2556. DOI: 10.1109/TPDS.2021.3065737.
   Web of Science ®Google Scholar
• Battey, H., Fan, J., Liu, H., Lu, J., and Zhu, Z. (2018), “Distributed Testing and Estimation Under Sparse High Dimensional Models,” The Annals of Statistics 46, 1352–1382. DOI: 10.1214/17-AOS1587.
   PubMed Web of Science ®Google Scholar
• Chen, X., Cheng, J. Q., and Xie, M. (2021), “Divide-and-Conquer Methods for Big Data Analysis,” arXiv:2102.10771v1.
   Google Scholar
• Chen, X., Liu, W., and Zhang, Y. (2022), “First-Order Newton-Type Estimator for Distributed Estimation and Inference,” Journal of the American Statistical Association, 117, 1858–1874. DOI: 10.1080/01621459.2021.1891925.
   Web of Science ®Google Scholar
• Cox, D. R. (1972), “Regression Models and Life-Tables,” (with Discussions), Journal of the Royal Statistical Society, Series B, 34, 187–220. DOI: 10.1111/j.2517-6161.1972.tb00899.x.
   Web of Science ®Google Scholar
• Cox, D. R. (1975), “Partial Likelihood,” Biometrika, 62, 269–276.
   Web of Science ®Google Scholar
• DVN. (2008), “Data Expo 2009: Airline on Time Data.”
   Google Scholar
• Fan, J., Guo, Y., and Wang, K. (2023), “Communication-Efficient Accurate Statistical Estimation,” Journal of the American Statistical Association, 118, 1000–1010. DOI: 10.1080/01621459.2021.1969238.
   PubMed Web of Science ®Google Scholar
• Fang, E. X., Ning, Y., and Liu, H. (2017), “Testing and Confidence Intervals for High Dimensional Proportional Hazards Models,” Journal of the Royal Statistical Society, Series B, 79, 1415–1437. DOI: 10.1111/rssb.12224.
   Google Scholar
• Fleming, T., and Harrington, D. (1991), Counting Processes and Survival Analysis, New York: Wiley.
   Google Scholar
• Han, L., Tan, K. M., Yang, T., and Zhang, T. (2020), “Local Uncertainty Sampling for Large-Scale Multiclass Logistic Regression,” The Annals of Statistics, 48, 1770–1788. DOI: 10.1214/19-AOS1867.
   Web of Science ®Google Scholar
• Hesterberg, T. (1995), “Weighted Average Importance Sampling and Defensive Mixture Distributions,” Technometrics, 37, 185–194. DOI: 10.1080/00401706.1995.10484303.
   Web of Science ®Google Scholar
• Huang, J., Sun, T., Ying, Z., Yu, Y., and Zhang, C.-H. (2013), “Oracle Inequalities for the Lasso in the Cox Model,” The Annals of Statistics, 41, 1142–1165. DOI: 10.1214/13-AOS1098.
   PubMed Web of Science ®Google Scholar
• Jordan, M. I., Lee, J. D., and Yang, Y. (2019), “Communication-Efficient Distributed Statistical Inference,” Journal of the American Statistical Association, 114, 668–681. DOI: 10.1080/01621459.2018.1429274.
   Web of Science ®Google Scholar
• Kalbfleisch, J. D., and Prentice, R. L. (2002), The Statistical Analysis of Failure Time Data, Hoboken, NJ: Wiley-Interscience.
   Google Scholar
• Keret, N., and Gorfine, M. (2020), “Optimal Cox Regression Subsampling Procedure with Rare Events,” arXiv:2012.02122v1. DOI: 10.1080/01621459.2023.2209349.
   Google Scholar
• Kiefer, J. (1959), “Optimum Experimental Designs,” Journal of the Royal Statistical Society, Series B, 21, 272–319. DOI: 10.1111/j.2517-6161.1959.tb00338.x.
   Google Scholar
• Kleinbaum, D. G., and Klein, M. (2005), Survival Analysis: A Self-Learning Text, New York: Springer.
   Google Scholar
• Lee, S., and Ng, S. (2020), “An Econometric Perspective on Algorithmic Subsampling,” Annual Review of Economics, 12, 45–80. DOI: 10.1146/annurev-economics-022720-114138.
   Web of Science ®Google Scholar
• Li, R., Chang, C., Justesen, J. M., Tanigawa, Y., Qiang, J., Hastie, T., Rivas, M. A., and Tibshirani, R. (2022), “Fast Lasso Method for Large-Scale and Ultrahigh-Dimensional Cox Model with Applications to UK Biobank,” Biostatistics, 23, 522–540. DOI: 10.1093/biostatistics/kxaa038.
   PubMed Web of Science ®Google Scholar
• Li, T., and Meng, C. (2021), “Modern Subsampling Methods for Large-Scale Least Squares Regression,” International Journal of Cyber-Physical Systems, 2, 1–28. DOI: 10.4018/IJCPS.2020070101.
   Google Scholar
• Lin, L., Li, W., and Lu, J. (2020), “Unified Rules of Renewable Weighted Sums for Various Online Updating Estimations,” arXiv:2008.08824v1.
   Google Scholar
• Liu, H., You, J., and Cao, J. (2021), “Functional L-optimality Subsampling for Massive Data,” arXiv:2104.03446v1.
   Google Scholar
• Luo, L., and Song, P. X. (2020), “Renewable Estimation and Incremental Inference in Generalized Linear Models with Streaming Data Sets,” Journal of The Royal Statistical Society, Series B, 82, 69–97. DOI: 10.1111/rssb.12352.
   Google Scholar
• Luo, L., Zhou, L., and Song, P. X.-K. (2022), “Real-Time Regression Analysis of Streaming Clustered Data with Possible Abnormal Data Batches,” Journal of the American Statistical Association. DOI: 10.1080/01621459.2022.2026778.
   PubMed Web of Science ®Google Scholar
• Ma, P., Mahoney, M. W., and Yu, B. (2015), “A Statistical Perspective on Algorithmic Leveraging,” Journal of Machine Learning Research, 16, 861–911.
   Web of Science ®Google Scholar
• Meng, C., Xie, R., Mandal, A., Zhang, X., Zhong, W., and Ma, P. (2021), “Lowcon: A Design Based Subsampling Approach in a Misspecified Linear Model,” Journal of Computational and Graphical Statistics, 30, 694–708. DOI: 10.1080/10618600.2020.1844215.
   Web of Science ®Google Scholar
• Owen, A., and Zhou, Y. (2000), “Safe and Effective Importance Sampling,” Journal of the American Statistical Association, 95, 135–143. DOI: 10.1080/01621459.2000.10473909.
   Web of Science ®Google Scholar
• R Core Team. (2021), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Schifano, E. D., Wu, J., Wang, C., Yan, J., and Chen, M.-H. (2016), “Online Updating of Statistical Inference in the Big Data Setting,” Technometrics, 58, 393–403. DOI: 10.1080/00401706.2016.1142900.
   PubMed Web of Science ®Google Scholar
• Shi, C., Lu, W., and Song, R. (2018), “A Massive Data Framework for m-estimators with Cubic-Rate,” Journal of the American Statistical Association, 113, 1698–1709. DOI: 10.1080/01621459.2017.1360779.
   PubMed Web of Science ®Google Scholar
• Simon, N., Friedman, J., Hastie, T., and Tibshirani, R. (2011), “Regularization Paths for Cox’s Proportional Hazards Model via Coordinate Descent,” Journal of Statistical Software, 39, 1–13. DOI: 10.18637/jss.v039.i05.
   PubMed Web of Science ®Google Scholar
• Tarkhan, A., and Simon, N. (2020), “Bigsurvsgd: Big Survival Data Analysis via Stochastic Gradient Descent,” arXiv:2003.00116v1.
   Google Scholar
• Therneau, T. M. (2021), A Package for Survival Analysis in R. R package version 3.2-13.
   Google Scholar
• Therneau, T. M., Grambsch, P. M., and Fleming, T. R. (1990), “Martingale-based Residuals for Survival Models,” Biometrika, 77, 147–160. DOI: 10.1093/biomet/77.1.147.
   Web of Science ®Google Scholar
• Volgushev, S., Chao, S.-K., and Cheng, G. (2019), “Distributed Inference for Quantile Regression Processes,” The Annals of Statistics, 47, 1634–1662. DOI: 10.1214/18-AOS1730.
   Web of Science ®Google Scholar
• Wang, C., Chen, M.-H., Schifano, E., Wu, J., and Yan, J. (2016), “Statistical Methods and Computing for Big Data,” Statistics and Its Interface, 9, 399–414. DOI: 10.4310/SII.2016.v9.n4.a1.
   PubMed Web of Science ®Google Scholar
• Wang, H. (2019), “More Efficient Estimation for Logistic Regression with Optimal Subsamples,” Journal of Machine Learning Research, 20, 1–59.
   Web of Science ®Google Scholar
• Wang, H., and Ma, Y. (2021), “Optimal Subsampling for Quantile Regression in Big Data,” Biometrika, 108, 99–112. DOI: 10.1093/biomet/asaa043.
   Web of Science ®Google Scholar
• Wang, H., Yang, M., and Stufken, J. (2019), “Information-based Optimal Subdata Selection for Big Data Linear Regression,” Journal of the American Statistical Association, 114, 393–405. DOI: 10.1080/01621459.2017.1408468.
   Web of Science ®Google Scholar
• Wang, H., Zhu, R., and Ma, P. (2018), “Optimal Subsampling for Large Sample Logistic Regression,” Journal of the American Statistical Association, 113, 829–844. DOI: 10.1080/01621459.2017.1292914.
   PubMed Web of Science ®Google Scholar
• Wang, J., Zou, J., and Wang, H. (2022), “Sampling with Replacement vs Poisson Sampling: A Comparative Study in Optimal Subsampling,” IEEE Transactions on Information Theory, 68, 6605–6630. DOI: 10.1109/TIT.2022.3176955.
   Web of Science ®Google Scholar
• Wang, K., Wang, H., and Li, S. (2022), “Renewable Quantile Regression for Streaming Datasets,” Knowledge-Based Systems, 235, 107675. DOI: 10.1016/j.knosys.2021.107675.
   Web of Science ®Google Scholar
• Wang, T., and Zhang, H. (2022), “Optimal Subsampling for Multiplicative Regression with Massive Data,” Statistica Neerlandica, 76, 418–449. DOI: 10.1111/stan.12266.
   Web of Science ®Google Scholar
• Wang, Y., Hong, C., Palmer, N., Di, Q., Schwartz, J., Kohane, I., and Cai, T. (2021), “A Fast Divide-and-Conquer Sparse Cox Regression,” Biostatistics, 22, 381–401. DOI: 10.1093/biostatistics/kxz036.
   PubMed Web of Science ®Google Scholar
• Wu, J., Chen, M. H., Schifano, E. D., and Yan, J. (2021), “Online Updating of Survival Analysis,” Journal of Computational and Graphical Statistics, 30, 1209–1223. DOI: 10.1080/10618600.2020.1870481.
   PubMed Web of Science ®Google Scholar
• Xiong, S., and Li, G. (2008), “Some Results on the Convergence of Conditional Distributions,” Statistics and Probability Letters, 78, 3249–3253. DOI: 10.1016/j.spl.2008.06.026.
   Web of Science ®Google Scholar
• Xu, J., Ying, Z., and Zhao, N. (2020), “Scalable Estimation and Inference with Large-Scale or Online Survival Data,” arXiv preprint arXiv:2001.01434.
   Google Scholar
• Xue, Y., Wang, H., Yan, J., and Schifano, E. D. (2019), “An Online Updating Approach for Testing the Proportional Hazards Assumption with Streams of Survival Data,” Biometrics, 76, 171–182. DOI: 10.1111/biom.13137.
   PubMed Web of Science ®Google Scholar
• Yang, Z., Wang, H., and Yan, J. (2022), “Optimal Subsampling for Parametric Accelerated Failure Time Models with Massive Survival Data,” Statistics in Medicine, 41, 5421–5431. DOI: 10.1002/sim.9576.
   PubMed Web of Science ®Google Scholar
• Yao, Y., and Wang, H. (2019), “Optimal Subsampling for Softmax Regression,” Statistical Papers, 60, 585–599. DOI: 10.1007/s00362-018-01068-6.
   Web of Science ®Google Scholar
• Yao, Y., and Wang, H. (2021), “A Review on Optimal Subsampling Methods for Massive Datasets,” Journal of Data Science, 19, 151–172.
   Google Scholar
• Yao, Y., Zou, J., and Wang, H. (2021), “Optimal Poisson Subsampling for Softmax Regression,” Journal of Systems Science and Complexity, accepted.
   Web of Science ®Google Scholar
• Yu, J., Ai, M., and Ye, Z. (2023), “A Review on Design Inspired Subsampling for Big Data,” Statistical Papers. DOI: 10.1007/s00362-022-01386-w.
   Web of Science ®Google Scholar
• Yu, J., Wang, H., Ai, M., and Zhang, H. (2022), “Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data,” Journal of the American Statistical Association, 117, 265–76. DOI: 10.1080/01621459.2020.1773832.
   Web of Science ®Google Scholar
• Zhang, A., Zhang, H., and Yin, G. (2020), “Adaptive Iterative Hessian Sketch via a-optimal Subsampling,” Statistics and Computing, 30, 1075–1090. DOI: 10.1007/s11222-020-09936-8.
   Web of Science ®Google Scholar
• Zhang, H., and Wang, H. (2021), “Distributed Subdata Selection for Big Data via Sampling-based Approach,” Computational Statistics & Data Analysis, 153, 107072. DOI: 10.1016/j.csda.2020.107072.
   Web of Science ®Google Scholar
• Zhang, T., Ning, Y., and Ruppert, D. (2021), “Optimal Sampling for Generalized Linear Models Under Measurement Constraints,” Journal of Computational and Graphical Statistics, 30, 106–114. DOI: 10.1080/10618600.2020.1778483.
   Web of Science ®Google Scholar
• Zhao, T., Cheng, G., and Liu, H. (2016), “A Partially Linear Framework for Massive Heterogeneous Data,” The Annals of Statistics, 44, 1400–1437. DOI: 10.1214/15-AOS1410.
   PubMed Web of Science ®Google Scholar
• Zuo, L., Zhang, H., Wang, H., and Liu, L. (2021a), “Sampling-based Estimation for Massive Survival Data with Additive Hazards Model,” Statistics in Medicine, 40, 441–450. DOI: 10.1002/sim.8783.
   PubMed Web of Science ®Google Scholar
• Zuo, L., Zhang, H., Wang, H., and Sun, L. (2021b), “Optimal Subsample Selection for Massive Logistic Regression with Distributed Data,” Computational Statistics, 36, 2535–2562. DOI: 10.1007/s00180-021-01089-0.
   Web of Science ®Google Scholar