Multicategory Angle-Based Learning for Estimating Optimal Dynamic Treatment Regimes With Censored Data

References

• Allwein, E. L., Schapire, R. E., and Singer, Y. (2000), “Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers,” Journal of Machine Learning Research, 1, 113–141.
   Web of Science ®Google Scholar
• Armitage, P. (1991), “Interim Analysis in Clinical Trials,” Statistics in Medicine, 10, 925–937. DOI: 10.1002/sim.4780100613.
   PubMed Web of Science ®Google Scholar
• Bai, X., Tsiatis, A. A., Lu, W., and Song, R. (2017), “Optimal Treatment Regimes for Survival Endpoints Using a Locally-Efficient Doubly-Robust Estimator From a Classification Perspective,” Lifetime Data Analysis, 23, 585–604. DOI: 10.1007/s10985-016-9376-x.
   PubMed Web of Science ®Google Scholar
• Bai, X., Tsiatis, A. A., and O’Brien, S. M. (2013), “Doubly-Robust Estimators of Treatment-Specific Survival Distributions in Observational Studies With Stratified Sampling,” Biometrics, 69, 830–839. DOI: 10.1111/biom.12076.
   PubMed Web of Science ®Google Scholar
• Cham, H. N. (2013), “Propensity Score Estimation With Random Forests,” Ph.D. thesis, Arizona State University.
   Google Scholar
• Chen, Y., Chi, Y., Fan, J., and Ma, C. (2018), “Gradient Descent With Random Initialization: Fast Global Convergence for Nonconvex Phase Retrieval,” Mathematical Programming, 176, 5–37. DOI: 10.1007/s10107-019-01363-6.
   Web of Science ®Google Scholar
• Crammer, K., and Singer, Y. (2001), “On the Algorithmic Implementation of Multiclass Kernel-Based Vector Machines,” Journal of Machine Learning Research, 2, 265–292.
   Web of Science ®Google Scholar
• de Luna, X., and Johansson, P. (2014), “Testing for the Unconfoundedness Assumption Using an Instrumental Assumption,” Journal of Causal Inference, 2, 187–199. DOI: 10.1515/jci-2013-0011.
   Google Scholar
• Diamond, S., Takapoui, R., and Boyd, S. (2018), “A General System for Heuristic Minimization of Convex Functions Over Non-Convex Sets,” Optimization Methods and Software, 33, 165–193. DOI: 10.1080/10556788.2017.1304548.
   Web of Science ®Google Scholar
• Fan, C., Lu, W., Song, R., and Zhou, Y. (2017), “Concordance-Assisted Learning for Estimating Optimal Individualized Treatment Regimes,” Journal of the Royal Statistical Society, Series B, 79, 1565–1582. DOI: 10.1111/rssb.12216.
   Google Scholar
• Fletcher, R. (1987), Practical Methods of Optimization (2nd ed.), New York: Wiley.
   Google Scholar
• Friedman, J., Hastie, T., and Tibshirani, R. (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22. DOI: 10.18637/jss.v033.i01.
   PubMed Web of Science ®Google Scholar
• Fu, S., He, Q., Zhang, S., and Liu, Y. (2019), “Robust Outcome Weighted Learning for Optimal Individualized Treatment Rules,” Journal of Biopharmaceutical Statistics, 29, 606–624. DOI: 10.1080/10543406.2019.1633657.
   PubMed Web of Science ®Google Scholar
• Geem, Z. W. (2006), “Parameter Estimation for the Nonlinear Muskingum Model Using the BFGS Technique,” Journal of Irrigation and Drainage Engineering, 132, 474–478. DOI: 10.1061/(ASCE)0733-9437(2006)132:5(474).
   Web of Science ®Google Scholar
• Goldberg, Y., and Kosorok, M. R. (2012), “Q-Learning With Censored Data,” The Annals of Statistics, 40, 529–560. DOI: 10.1214/12-AOS968.
   PubMed Web of Science ®Google Scholar
• Hager, R., Tsiatis, A. A., and Davidian, M. (2018), “Optimal Two-Stage Dynamic Treatment Regimes From a Classification Perspective With Censored Survival Data,” Biometrics, 74, 1180–1192. DOI: 10.1111/biom.12894.
   PubMed Web of Science ®Google Scholar
• Hammer, S. M., Katzenstein, D. A., Hughes, M. D., Gundacker, H., Schooley, R. T., Haubrich, R. H., Henry, W. K., Lederman, M. M., Phair, J. P., Niu, M., Hirsch, M. S., and Merigan, T. C. (1996), “A Trial Comparing Nucleoside Monotherapy With Combination Therapy in HIV-Infected Adults With CD4 Cell Counts From 200 to 500 Per Cubic Millimeter,” New England Journal of Medicine, 335, 1081–1090. DOI: 10.1056/NEJM199610103351501.
   PubMed Web of Science ®Google Scholar
• Hastie, T., Rosset, S., Zhu, J., and Zou, H. (2009), “Multi-Class Adaboost,” Statistics and Its Interface, 2, 349–360. DOI: 10.4310/SII.2009.v2.n3.a8.
   Web of Science ®Google Scholar
• Huling, J. D., and Yu, M. (2018), “Subgroup Identification Using the Personalized Package,” arXiv no. 1809.07905.
   Google Scholar
• Jiang, R., Lu, W., Song, R., and Davidian, M. (2017a), “On Estimation of Optimal Treatment Regimes for Maximizing t-Year Survival Probability,” Journal of the Royal Statistical Society, Series B, 79, 1165–1185. DOI: 10.1111/rssb.12201.
   Google Scholar
• Jiang, R., Lu, W., Song, R., Hudgens, M. G., and Naprvavnik, S. (2017b), “Doubly Robust Estimation of Optimal Treatment Regimes for Survival Data—With Application to an HIV/AIDS Study,” The Annals of Applied Statistics, 11, 1763–1786. DOI: 10.1214/17-AOAS1057.
   PubMed Web of Science ®Google Scholar
• Lan, N., Laohasiriwong, W., and Stewart, J. (2013), “Survival Probability and Prognostic Factors for Breast Cancer Patients in Vietnam,” Global Health Action, 6, 18860. DOI: 10.3402/gha.v6i0.18860.
   PubMed Web of Science ®Google Scholar
• Lee, Y., Lin, Y., and Wahba, G. (2004), “Multicategory Support Vector Machines: Theory and Application to the Classification of Microarray Data and Satellite Radiance Data,” Journal of the American Statistical Association, 99, 67–81. DOI: 10.1198/016214504000000098.
   Web of Science ®Google Scholar
• Li, D.-H., and Fukushima, M. (2001), “A Modified BFGS Method and Its Global Convergence in Nonconvex Minimization,” Journal of Computational and Applied Mathematics, 129, 15–35. DOI: 10.1016/S0377-0427(00)00540-9.
   Web of Science ®Google Scholar
• Liu, Y. (2007), “Fisher Consistency of Multicategory Support Vector Machines,” in Proceedings of the Eleventh International Workshop on Artificial Intelligence and Statistics, PMLR (Vol. 2), pp. 291–298.
   Google Scholar
• Liu, Y., and Shen, X. (2006), “Multicategory Psi-Learning,” Journal of the American Statistical Association, 101, 500–509. DOI: 10.1198/016214505000000781.
   Web of Science ®Google Scholar
• Liu, Y., Shen, X., and Doss, H. (2005), “Multicategory Psi-Learning and Support Vector Machine: Computational Tools,” Journal of Computational and Graphical Statistics, 14, 219–236. DOI: 10.1198/106186005X37238.
   Web of Science ®Google Scholar
• Liu, Y., and Yuan, M. (2011), “Reinforced Multicategory Support Vector Machines,” Journal of Computational and Graphical Statistics, 20, 901–919. DOI: 10.1198/jcgs.2010.09206.
   Web of Science ®Google Scholar
• McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., and Burgette, L. F. (2013), “A Tutorial on Propensity Score Estimation for Multiple Treatments Using Generalized Boosted Models,” Statistics in Medicine, 32, 3388–3414. DOI: 10.1002/sim.5753.
   PubMed Web of Science ®Google Scholar
• Murphy, S. A. (2003), “Optimal Dynamic Treatment Regimes,” Journal of the Royal Statistical Society, Series B, 65, 331–355. DOI: 10.1111/1467-9868.00389.
   Google Scholar
• Murphy, S. A. (2005), “An Experimental Design for the Development of Adaptive Treatment Strategies,” Statistics in Medicine, 24, 1455–1481.
   PubMed Web of Science ®Google Scholar
• Pan, W., and Bai, H. (2015), Propensity Score Analysis: Fundamentals and Developments, New York: Guilford Publications.
   Google Scholar
• Qi, Z., Liu, D., Fu, H., and Liu, Y. (2020), “Multi-Armed Angle-Based Direct Learning for Estimating Optimal Individualized Treatment Rules With Various Outcomes,” Journal of the American Statistical Association, 115, 678–691. DOI: 10.1080/01621459.2018.1529597.
   PubMed Web of Science ®Google Scholar
• Qi, Z., and Liu, Y. (2018), “D-Learning to Estimate Optimal Individual Treatment Rules,” Electronic Journal of Statistics, 12, 3601–3638. DOI: 10.1214/18-EJS1480.
   Web of Science ®Google Scholar
• Simoneau, G., Moodie, E. E., Nijjar, J. S., Platt, R. W., and Scottish Early Rheumatoid Arthritis Inception Cohort Investigators (2020), “Estimating Optimal Dynamic Treatment Regimes With Survival Outcomes,” Journal of the American Statistical Association, 115, 1531–1539. DOI: 10.1080/01621459.2019.1629939.
   Web of Science ®Google Scholar
• Stefanie, H., Martina, K., Christine, K., Monika, E., and Martin, S. (2015), “Conditional Survival: A Useful Concept to Provide Information on How Prognosis Evolves Over Time,” Clinical Cancer Research, 21, 1530–1536.
   PubMed Web of Science ®Google Scholar
• Tao, Y., and Wang, L. (2017), “Adaptive Contrast Weighted Learning for Multi-Stage Multi-Treatment Decision-Making,” Biometrics, 73, 145–155. DOI: 10.1111/biom.12539.
   PubMed Web of Science ®Google Scholar
• Tsao, C. W., and Vasan, R. S. (2015), “Cohort Profile: The Framingham Heart Study (FHS): Overview of Milestones in Cardiovascular Epidemiology,” International Journal of Epidemiology, 44, 1800–1813. DOI: 10.1093/ije/dyv337.
   PubMed Web of Science ®Google Scholar
• Vapnik, V., and Vapnik, V. (1998), Statistical Learning Theory, New York: Wiley, pp. 156–160.
   Google Scholar
• Zhang, C., Chen, J., Fu, H., He, X., Qi, Z. Y., and Liu, Y. (2020), “Multicategory Outcome Weighted Margin-Based Learning for Estimating Individualized Treatment Rules,” Statistica Sinica, 30, 1857. DOI: 10.5705/ss.202017.0527.
   PubMed Web of Science ®Google Scholar
• Zhang, C., and Liu, Y. (2013), “Multicategory Large-Margin Unified Machines,” The Journal of Machine Learning Research, 14, 1349–1386.
   PubMed Web of Science ®Google Scholar
• Zhang, C., and Liu, Y. (2014), “Multicategory Angle-Based Large-Margin Classification,” Biometrika, 101, 625–640.
   PubMed Web of Science ®Google Scholar
• Zhao, Y., Zeng, D., Socinski, M. A., and Kosorok, M. R. (2011), “Reinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung Cancer,” Biometrics, 67, 1422–1433. DOI: 10.1111/j.1541-0420.2011.01572.x.
   PubMed Web of Science ®Google Scholar
• Zhao, Y.-Q., Zeng, D., Laber, E. B., and Kosorok, M. R. (2015), “New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes,” Journal of the American Statistical Association, 110, 583–598. DOI: 10.1080/01621459.2014.937488.
   PubMed Web of Science ®Google Scholar
• Zhao, Y.-Q., Zeng, D., Laber, E. B., Song, R., Yuan, M., and Kosorok, M. R. (2014), “Doubly Robust Learning for Estimating Individualized Treatment With Censored Data,” Biometrika, 102, 151–168. DOI: 10.1093/biomet/asu050.
   Web of Science ®Google Scholar
• Zhao, Y.-Q., Zhu, R., Chen, G., and Zheng, Y. (2018), “Constructing Stabilized Dynamic Treatment Regimes,” arXiv no. 1808.01332.
   Google Scholar