The Win Ratio: On Interpretation and Handling of Ties

References

• Abdalla, S., Montez-Rath, M. E., Parfrey, P. S., and Chertow, G. M. (2016), “The Win Ratio Approach to Analyzing Composite Outcomes: An Application to the EVOLVE Trial,” Contemporary Clinical Trials, 48, 119–124. DOI: 10.1016/j.cct.2016.04.001.
   PubMed Web of Science ®Google Scholar
• Acion, L., Peterson, J. J., Temple, S., and Arndt, S. (2006), “Probabilistic Index: An Intuitive Non-parametric Approach to Measuring the Size of Treatment Effects,” Statistics in Medicine, 25, 591–602. DOI: 10.1002/sim.2256.
   PubMed Web of Science ®Google Scholar
• Agresti, A., and Min, Y. (2004), “Effects and Non-effects of Paired Identical Observations in Comparing Proportions With Binary Matched-Pairs Data,” Statistics in Medicine, 23, 65–75. DOI: 10.1002/sim.1589.
   PubMed Web of Science ®Google Scholar
• Akacha, M., Bretz, F., Ohlssen, D., Rosenkranz, G., and Schmidli. H. (2017), “Estimands and Their Role in Clinical Trials,” Statistics in Biopharmaceutical Research, 9, 268–271. DOI: 10.1080/19466315.2017.1302358.
   Web of Science ®Google Scholar
• Bakal, J. A., Roe, M. T., Ohman, E. M., Goodman, S. G., Fox, K. A., Zheng, Y., Westerhout, C. M., Hochman, J. S., Lokhnygina, Y., Brown, E. B., and Armstrong, P. W. (2015), “Applying Novel Methods to Assess Clinical Outcomes: Insights From the TRILOGY ACS Trial,” European Heart Journal, 36, 385–392. DOI: 10.1093/eurheartj/ehu262.
   PubMed Web of Science ®Google Scholar
• Bakal, J. A., Westerhout, C. M., and Armstrong, P. W. (2015), “Impact of Weighted Composite Compared to Traditional Composite Endpoints for the Design of Randomized Controlled Trials,” Statistical Methods in Medical Research, 24, 980–988. DOI: 10.1177/0962280211436004.
   PubMed Web of Science ®Google Scholar
• Bebu, I., and Lachin, J. M. (2016), “Large Sample Inference for a Win Ratio Analysis of a Composite Outcome Based on Prioritized Components,” Biostatistics, 17, 178–187.
   PubMed Web of Science ®Google Scholar
• Bretz, F., on behalf of ICH E9(R1) Expert Working Group (2017), “How the ICH E9 Addendum Around Estimands May Impact Our Clinical Trials,” in Danish Society for Biopharmaceutical Statistics Meeting on Estimands and Their Use in Clinical Trials, Copenhagen, available at http://www.dsbs.dk/moder/Estimands/FBretz.pdf.
   Google Scholar
• Buyse, M. (2008), “Reformulating the Hazard Ratio to Enhance Communication With Clinical Investigators,” Clinical Trials, 5, 641–642. DOI: 10.1177/1740774508098328.
   PubMedGoogle Scholar
• Buyse, M. (2010), “Generalized Pairwise Comparisons of Prioritized Outcomes in the Two-Sample Problem,” Statistics in Medicine, 29, 3245–3257.
   PubMed Web of Science ®Google Scholar
• Ceesay, T., Mt-Isa, S., and Heyse, J. F. (2018), “Application of the Win Ratio for Benefit-Risk Analysis,” in Joint Statistical Meetings, Vancouver, Canada, July 28–Aug 2, 2018, available at https://ww2.amstat.org/meetings/jsm/2018/onlineprogram/AbstractDetails.cfm?abstractid=329675.
   Google Scholar
• de Wreede, L. C., Fiocco, M., and Putter, H. (2011), “mstate: An R Package for the Analysis of Competing Risks and Multi-state Models,” Journal of Statistical Software, 38, 7.
   Web of Science ®Google Scholar
• Dong, G., Li, D., Ballerstedt, S., and Vandemeulebroecke, M. (2016a), “A Generalized Analytic Solution to the Win Ratio to Analyze a Composite Endpoint Considering the Clinical Importance Order Among Components,” Pharmaceutical Statistics, 15, 430–437. DOI: 10.1002/pst.1763.
   PubMed Web of Science ®Google Scholar
• Dong, G., Guo, M., Hoaglin, D. C., and Vandemeulebroecke, M. (2016b), “Is the Asymptotic Variance Estimator of the Logarithm of the Win Ratio Under the Null Hypothesis Sound?—A Note on the Generalized Analytic Solution to the Win Ratio by Dong et al. (2016a),” Pharmaceutical Statistics, 15, 430–437, Supporting information #7 (a post-publishing note) to Dong et al. (2016a) (https://onlinelibrary.wiley.com/action/downloadSupplement?doi=10.1002%2Fpst.1763&file=pst1763-sup-0007-supplementary.pdf).
   PubMed Web of Science ®Google Scholar
• Dong, G., Qiu, J., Wang, D., and Vandemeulebroecke, M. (2018), “The Stratified Win Ratio,” Journal of Biopharmaceutical Statistics, 28, 778–796. DOI: 10.1080/10543406.2017.1397007.
   PubMed Web of Science ®Google Scholar
• Duc, A. N., and Wolbers, M. (2017), “Weighted Analysis of Composite Endpoints With Simultaneous Inference for Flexible Weight Constraints,” Statistics in Medicine, 36, 442–454. DOI: 10.1002/sim.7147.
   PubMed Web of Science ®Google Scholar
• Fergusson, N. A., Ramsay, T., Chassé, M., English, S. W., and Knoll, G. A. (2018), “The Win Ratio Approach Did Not Alter Study Conclusions and May Mitigate Concerns Regarding Unequal Composite End Points in Kidney Transplant Trials,” Journal of Clinical Epidemiology, 98, 9–15. DOI: 10.1016/j.jclinepi.2018.02.001.
   PubMed Web of Science ®Google Scholar
• Finkelstein, D. M., and Schoenfeld, D. A. (1999), “Combining Mortality and Longitudinal Measures in Clinical Trials,” Statistics in Medicine, 18, 1341–1354. DOI: 10.1002/(SICI)1097-0258(19990615)18:11<1341::AID-SIM129>3.0.CO;2-7.
   PubMed Web of Science ®Google Scholar
• Finkelstein, D. M., and Schoenfeld, D. A. (2019), “Graphing the Win Ratio and Its Components Over Time,” Statistics in Medicine, 38, 53–61.
   PubMed Web of Science ®Google Scholar
• Food and Drug Administration (FDA) (2018), “Benefit-Risk Assessment in Drug Regulatory Decision-Making,” available at https://www.fda.gov/downloads/ForIndustry/UserFees/PrescriptionDrugUserFee/UCM602885.pdf.
   Google Scholar
• Gehan, E. A. (1965), “A Generalized Wilcoxon Test for Comparing Arbitrarily Singly-Censored Samples,” Biometrika, 52, 203–223. DOI: 10.1093/biomet/52.1-2.203.
   PubMed Web of Science ®Google Scholar
• Henry, T. D., Schaer, G. L., DeMaria, A., Recker, D., Remmers, A. E., Goodrich, J., and Patel, A. (2016), “The iXCELL-DCM Trial: Rationale and Design,” Cell Transplant, 25, 1689–1699. DOI: 10.3727/096368916X691295.
   PubMed Web of Science ®Google Scholar
• International Council for Harmonisation (ICH) (2017), “ICH Harmonised Guideline E9(R1): Estimands and Sensitivity Analysis in Clinical Trials,” available at www.ich.org.
   Google Scholar
• Lu, Y. (2010), “A Revised Version of McNemar’s Test for Paired Binary Data,” Communications in Statistics—Theory and Methods, 39, 3525–3539. DOI: 10.1080/03610920903289218.
   Web of Science ®Google Scholar
• Lu, Y., Wang, M., and Zhang, G. (2017), “A New Revised Version of McNemar’s Test for Paired Binary Data,” Communications in Statistics—Theory and Methods, 46, 10010–10024. DOI: 10.1080/03610926.2016.1228962.
   Web of Science ®Google Scholar
• Luo, X., Qiu, J., Bai, S., and Tian, H. (2017), “Weighted Win Loss Approach for Analyzing Prioritized Outcomes,” Statistics in Medicine, 36, 2452–2465. DOI: 10.1002/sim.7284.
   PubMed Web of Science ®Google Scholar
• Luo, X., Tian, H., Mohanty, S., and Tsai, W. Y. (2015), “An Alternative Approach to Confidence Interval Estimation for the Win Ratio Statistic,” Biometrics, 71, 139–145. DOI: 10.1111/biom.12225.
   PubMed Web of Science ®Google Scholar
• Mann, H., and Whitney, D. (1947), “On a Test of Whether One of Two Random Variables Is Stochastically Larger Than the Other,” Annals of Mathematical Statistics, 18, 50–60. DOI: 10.1214/aoms/1177730491.
   Google Scholar
• Mao, L. (2018), “On the Alternative Hypotheses for the Win Ratio,” Biometrics, DOI: 10.1111/biom.12954.
   PubMed Web of Science ®Google Scholar
• Mantel, N., and Haenszel, W. (1959), “Statistical Aspects of Analysis of Data From Retrospective Studies of Disease,” Journal of the National Cancer Institute, 22, 719–748. DOI: 10.1093/jnci/22.4.719.
   PubMed Web of Science ®Google Scholar
• Matsouaka, R. A., and Betensky, R. A. (2015), “Power and Sample Size Calculations for the Wilcoxon–Mann–Whitney Test in the Presence of Death-Censored Observations,” Statistics in Medicine, 34, 406–431. DOI: 10.1002/sim.6355.
   PubMed Web of Science ®Google Scholar
• Matsouaka, R. A., Singhal, A. B., and Betensky, R. A. (2018), “An Optimal Wilcoxon–Mann–Whitney Test of Mortality and a Continuous Outcome,” Statistical Methods in Medical Research, 27, 2384–2400. DOI: 10.1177/0962280216680524.
   PubMed Web of Science ®Google Scholar
• Maurer, M. S., Schwartz, J. H., Gundapaneni, B., Elliott, P. M., Merlini, G., Waddington-Cruz, M., Kristen A. V., Grogan, M., Witteles, R., Damy, T., Drachman, B. M., Shah, S. J., Hanna, M., Judge, D. P., Barsdorf, A. I., Huber, P., Patterson, T. A., Riley, S., Schumacher, J., Stewart, M., Sultan, M. B., Rapezzi, C., ATTR-ACT Study Investigators, (2018), “Tafamidis Treatment for Patients with Transthyretin Amyloid Cardiomyopathy,” New England Journal of Medicine, 379,1007–1016. DOI: 10.1056/NEJMoa1805689.
   PubMed Web of Science ®Google Scholar
• McNemar, Q. (1947), “Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages,” Psychometrika, 12, 153–157. DOI: 10.1007/BF02295996.
   PubMed Web of Science ®Google Scholar
• Milojevic, M., Head, S. J., Andrinopoulou, E. R., Serruys, P. W., Mohr, F. W., Tijssen, J. G., and Kappetein, A. P. (2017), “Hierarchical Testing of Composite Endpoints: Applying the Win Ratio to Percutaneous Coronary Intervention Versus Coronary Artery Bypass Grafting in the SYNTAX Trial,” EuroIntervention, 13, 106–114. DOI: 10.4244/EIJ-D-16-00745.
   PubMed Web of Science ®Google Scholar
• Montgomery, A., Abuan, T., and Kollef, M. (2014), “The Win Ratio Method: A Novel Hierarchical Endpoint for Pneumonia Trials in Patients on Mechanical Ventilation, Presented at the 34th International Symposium on Intensive Care and Emergency Medicine (18–21 March 2014, Brussels, Belgium),” Critical Care 18, P260. DOI: 10.1186/cc13450.
   Google Scholar
• Moser, B. K., and McCann, M. H. (2008), “Reformulating the Hazard Ratio to Enhance Communication With Clinical Investigators,” Clinical Trials, 5, 248–252. DOI: 10.1177/1740774508091452.
   PubMed Web of Science ®Google Scholar
• Moye, L. A., Davis, B. R., and Hawkins, C. M. (1992), “Analysis of a Clinical Trial Involving a Combined Mortality and Adherence Dependent Interval Censored Endpoint,” Statistics in Medicine, 11, 1705–1717. DOI: 10.1002/sim.4780111305.
   PubMed Web of Science ®Google Scholar
• Oakes, D. (2016), “On the Win-Ratio Statistic in Clinical Trials With Multiple Types of Event,” Biometrika, 103, 742–745. DOI: 10.1093/biomet/asw026.
   Web of Science ®Google Scholar
• O’Brien, R. G., and Castelloe, J. M. (2006), “Exploiting the Link Between the Wilcoxon–Mann–Whitney Test and a Simple Odds Statistic,” in Proceedings of the Thirty-First Annual SAS Users Group International Conference, Cary, NC: SAS Institute Inc., available at http://www2.sas.com/proceedings/sugi31/209-31.pdf.
   Google Scholar
• PEACE Trial Investigators (2004), “Angiotensin-Converting-Enzyme Inhibition in Stable Coronary Artery Disease,” New England Journal of Medicine, 351, 2058–2068.
   PubMed Web of Science ®Google Scholar
• Permutt, T. (2018), “Effects in Adherent Subjects,” Statistics in Biopharmaceutical Research, 10, 233–235. DOI: 10.1080/19466315.2018.1458650.
   Web of Science ®Google Scholar
• Péron, J., Buyse, M., Ozenne, B., Roche, L., and Roy, P. (2018), “An Extension of Generalized Pairwise Comparisons for Prioritized Outcomes in the Presence of Censoring,” Statistical Methods in Medical Research, 27, 1230–1239. DOI: 10.1177/0962280216658320.
   PubMed Web of Science ®Google Scholar
• Péron, J., Roy, P., Ozenne, B., Roche, L., and Buyse M. (2016), “The Net Chance of a Longer Survival as a Patient-Oriented Measure of Treatment Benefit in Randomized Clinical Trials,” JAMA Oncology, 2, 901–905. DOI: 10.1001/jamaoncol.2015.6359.
   PubMed Web of Science ®Google Scholar
• Pocock, S. J., Ariti, C. A., Collier, T. J., and Wang, D. (2012), “The Win Ratio: A New Approach to the Analysis of Composite Endpoints in Clinical Trials Based on Clinical Priorities,” European Heart Journal, 33, 176–182. DOI: 10.1093/eurheartj/ehr352.
   PubMed Web of Science ®Google Scholar
• Prakash, R., Horsfall, M., Markwick, A., Pumar, M., Lee, L., Sinhal, A., Joseph, M. X., and Chew, D. P. (2014), “Prognostic Impact of Moderate or Severe Mitral Regurgitation (MR) Irrespective of Concomitant Comorbidities: A Retrospective Matched Cohort Study,” BMJ Open, 4, e004984. DOI: 10.1136/bmjopen-2014-004984.
   PubMed Web of Science ®Google Scholar
• Pratt, J. W., and Gibbons, J. D. (1981), Concepts of Nonparametric Theory, New York: Springer-Verlag.
   Google Scholar
• Ramchandani, R., Schoenfeld, D. A., and Finkelstein, D. M. (2016), “Global Rank Tests for Multiple, Possibly Censored, Outcomes,” Biometrics, 72, 926–935. DOI: 10.1111/biom.12475.
   PubMed Web of Science ®Google Scholar
• Randles, R. H. (2001), “On Neutral Responses (Zeros) in the Sign Test and Ties in the Wilcoxon–Mann–Whitney Test,” The American Statistician, 55, 96–101. DOI: 10.1198/000313001750358554.
   Web of Science ®Google Scholar
• Rauch, G., Jahn-Eimermacher, A., Brannath, W., and Kieser, M. (2014), “Opportunities and Challenges of Combined Effect Measures Based on Prioritized Outcomes,” Statistics in Medicine, 33, 1104–1120. DOI: 10.1002/sim.6010.
   PubMed Web of Science ®Google Scholar
• Rauch, G., Kunzmann, K., Kieser, M., Wegscheider, K., König, J., and Eulenburg, C. (2018), “A Weighted Combined Effect Measure for the Analysis of a Composite Time-to-First-Event Endpoint With Components of Different Clinical Relevance,” Statistics in Medicine, 37, 749–767. DOI: 10.1002/sim.7531.
   PubMed Web of Science ®Google Scholar
• Rogers, J. K., Pocock, S. J., McMurray, J. J., Granger, C. B., Michelson, E. L., Östergren, J., Pfeffer, M. A., Solomon, S. D., Swedberg, K., and Yusuf, S. (2014), “Analysing Recurrent Hospitalizations in Heart Failure: A Review of Statistical Methodology, With Application to CHARM-Preserved,” European Journal of Heart Failure, 16, 33–40. DOI: 10.1002/ejhf.29.
   PubMed Web of Science ®Google Scholar
• Sun, H., Kawaguchi, A., and Koch, G. (2017), “Analyzing Multiple Endpoints in a Confirmatory Randomized Clinical Trial—An Approach That Addresses Stratification, Missing Values, Baseline Imbalance and Multiplicity for Strictly Ordinal Outcomes,” Pharmaceutical Statistics, 16, 157–166. DOI: 10.1002/pst.1799.
   PubMed Web of Science ®Google Scholar
• Wang, D., and Pocock, S. (2016), “A Win Ratio Approach to Comparing Continuous Non-normal Outcomes in Clinical Trials,” Pharmaceutical Statistics, 15, 238–245. DOI: 10.1002/pst.1743.
   PubMed Web of Science ®Google Scholar
• Wilcoxon, F. (1945), “Individual Comparisons by Ranking Methods,” Biometrics Bulletin, 1, 80–83. DOI: 10.2307/3001968.
   Google Scholar