Optimal Allocation of Gold Standard Testing Under Constrained Availability: Application to Assessment of HIV Treatment Failure

REFERENCES

• Abouyannis , M. , Menten , J. , Kiragga , A. , Lynen , L. , Robertson , G. , Castelnuovo , B. , Manabe , Y. C. , Reynolds , S. J. and Roberts , L. 2011 . “Development and Validation of Systems for Rational Use of Viral Load Testing in Adults Receiving First-Line ART in Sub-Saharan Africa,” . AIDS , 25 : 1627 – 1635 .
   PubMed Web of Science ®Google Scholar
• Anderson , A. M. and Bartlett , J. A. 2006 . “Changing Antiretroviral Therapy in the Setting of Virologic Relapse: Review of the Current Literature,” . Current HIV/AIDS Reports , 3 : 79 – 85 .
   PubMedGoogle Scholar
• Anderson , J. A. 1972 . “Separate Sample Logistic Discrimination,” . Biometrika , 59 : 19 – 35 .
   Web of Science ®Google Scholar
• Anderson , J. A. 1979 . “Multivariate Logistic Compounds,” . Biometrika , 66 : 17 – 26 .
   Web of Science ®Google Scholar
• Bagchi , S. , Kempf , M. , Westfall , A. , Maherya , A. , Willig , J. and Saag , M. 2007 . “Can Routine Clinical Markers Be Used Longitudinally to Monitor Antiretroviral Therapy Success in Resourcelimited Settings?” . Clinical Infectious Diseases , 44 : 135 – 138 .
   PubMed Web of Science ®Google Scholar
• Baker , S. 2009 . “Putting Risk Prediction in Perspective: Relative Utility Curves,” . Journal of the National Cancer Institute , 101 : 1538 – 1542 .
   PubMedGoogle Scholar
• Berger , J. O. 1985 . Statistical Decision Theory and Bayesian Analysis (2nd ed.) , New York : Springer-Verlag .
   Google Scholar
• Bisson , G. P. , Gross , R. , Bellamy , S. , Chittams , J. , Hislop , M. , Regensberg , L. , Frank , I. , Maartens , G. and Nachega , J. B. 2008 . “Pharmacy Refill Adherence Compared With CD4 Count Changes for Monitoring HIV-Infected Adults on Antiretroviral Therapy,” . PLoS Medicine , 5 : e109
   PubMed Web of Science ®Google Scholar
• Bisson , G. P. , Gross , R. , Strom , J. B. , Rollins , C. , Bellamy , S. , Weinstein , R. , Friedman , H. , Dickinson , D. , Frank , I. , Strom , B. L. , Gaolathe , T. and Ndwapi , N. 2006 . “Diagnostic Accuracy of CD4 Cell Count Increase for Virologic Response After Initiating Highly Active Antiretroviral Therapy,” . AIDS , 20 : 1613 – 1619 .
   PubMed Web of Science ®Google Scholar
• Breiman , L. , Friedman , J. , Stone , C. and Olshen , R. 1984 . Classification and Regression Trees , New York : Chapman & Hall/CRC .
   Google Scholar
• Buzas , J. , Tosteson , T. and Stefanski , L. 2003 . “Measurement Error,” . Institute of Statistics Mimeo Series , 4 ( 2544 ) : 1 – 92 .
   Google Scholar
• Calmy , A. , Ford , N. , Hirschel , B. , Reynolds , S. J. , Lynen , L. , Goemaere , E. , de la Vega , F. G. , Perrin , L. and Rodriguez , W. 2007 . “HIV Viral Load Monitoring in Resource-Limited Regions: Optional or Necessary?” . Clinical Infectious Diseases , 44 : 128 – 134 .
   PubMed Web of Science ®Google Scholar
• Carroll , R. , Ruppert , D. , Stefanski , L. and Crainiceanu , C. 2006 . Measurement Error in Nonlinear Models: A Modern Perspective (Vol. 105) , New York : Chapman & Hall/CRC .
   Google Scholar
• Carroll , R. and Stefanski , L. 1990 . “Approximate Quasi-Likelihood Estimation in Models With Surrogate Predictors,” . Journal of the American Statistical Association , 85 : 652 – 663 .
   Web of Science ®Google Scholar
• Carroll , R. J. , Spiegelman , C. H. , Lan , K. K. G. , Bailey , K. T. and Abbott , R. D. 1984 . “On Errors-in-Variables for Binary Regression Models,” . Biometrika , 71 : 19 – 25 .
   Web of Science ®Google Scholar
• Castelnuovo , B. , Kiragga , A. , Schaefer , P. , Kambugu , A. and Manabe , Y. 2009 . “High Rate of Misclassification of Treatment Failure Based on WHO Immunological Criteria in Resource Limited Settings in Uganda,” . AIDS , 23 : 1295 – 1296 .
   PubMed Web of Science ®Google Scholar
• Deeks , S. G. , Barbour , J. D. , Grant , R. M. and Martin , J. N. 2002 . “Duration and Predictors of CD4 T-Cell Gains in Patients Who Continue Combination Therapy Despite Detectable Plasma Viremia,” . AIDS , 16 : 201 – 207 .
   PubMed Web of Science ®Google Scholar
• Deeks , S. G. , Barbour , J. D. , Martin , J. N. , Swanson , M. S. and Grant , R. M. 2000 . “Sustained CD4+ T Cell Response After Virologic Failure of Protease Inhibitor-Based Regimens in Patients With Human Immunodeficiency Virus Infection,” . Journal of Infectious Diseases , 181 : 946 – 953 .
   PubMed Web of Science ®Google Scholar
• Efron , B. 1981 . “Nonparametric Standard Errors and Confidence Intervals,” . Canadian Journal of Statistics , 9 : 139 – 158 .
   Google Scholar
• Fiscus , S. , Cheng , B. , Growe , S. , Dementer , L. , Jennings , C. , Miller , V. , Respess , R. , Stevens , W. and Forum for Collaborative HIV Research Alternative Viral Load Assay Working Group . 2006 . “HIV-1 Viral Load Assays for Resource Limited Settings,” . PLoS Medicine , 3 : e417
   PubMed Web of Science ®Google Scholar
• Foulkes , A. S. , Azzoni , L. , Li , X. , Johnson , M. , Smith , C. , Mounzer , K. and Montaner , L. 2010 . “Prediction Based Classification for Longitudinal Biomarkers,” . The Annals of Applied Statistics , 4 : 1476 – 1497 .
   PubMed Web of Science ®Google Scholar
• Foulkes , A. S. and De Gruttola , V. 2002 . “Characterizing the Relationship Between HIV-1 Genotype and Phenotype: Prediction-Based Classification,” . Biometrics , 58 : 145 – 156 .
   PubMed Web of Science ®Google Scholar
• Freund , Y. , Schapire , R. and Abe , N. 1999 . “A Short Introduction to Boosting,” . Journal of Japanese Society for Artificial Intelligence , 14 : 1612
   Google Scholar
• Fuller , W. 2009 . Measurement Error Models (Vol. 305) , New York : Wiley .
   Google Scholar
• Gardner , E. , Burman , W. , Steiner , J. F. , Anderson , P. and Bangsberg , D. 2009 . “Antiretroviral Medication Adherence and the Development of Class-Specific Antiretroviral Resistance,” . AIDS , 23 : 1035 – 1046 .
   PubMed Web of Science ®Google Scholar
• Gatsonis , C. 2009 . “Receiver Operating Characteristic Analysis for the Evaluation of Diagnosis and Prediction,” . Radiology , 253 : 593 – 596 .
   PubMed Web of Science ®Google Scholar
• Gillani , F. S. 2009 . “The Miriam Hospital Immunology Center Database (ICDB) Annual Data Report,” . Technical Report. Available at http://www.rhodeislandhospital.org/cfar/ICDB-guidelines.htm
   Google Scholar
• Greengrass , V. , Lohman , B. , Morris , L. , Plate , M. , Steele , P. M. , Walson , J. L. and Crowe , S. M. 2009 . “Assessment of the Low-Cost Cavidi ExaVir Load Assay for Monitoring HIV Viral Load in Pediatric and Adult Patients,” . Journal of Acquired Immune Deficiency Syndromes , 52 : 387 – 390 .
   PubMed Web of Science ®Google Scholar
• Hagan , M. , Demuth , H. and Beale , M. 1996 . Neural Network Design , Stamford, CT : Thomson Learning .
   Google Scholar
• Hammer , S. , Saag , M. Schechter , M. 2006 . “Treatment for Adult HIV Infection: 2006 Recommendations of the Internatiional AIDS Society-US Panel,” . Journal of the American Medical Association , 296 : 827 – 843 .
   PubMed Web of Science ®Google Scholar
• Hastie , T. , Tibshirani , R. and Friedman , J. H. 2001 . The Elements of Statistical Learning: Data Mining, Inference, and Prediction , New York : Springer-Verlag .
   Google Scholar
• Hsieh , F. and Turnbull , B. W. 1996 . “Nonparametric and Semiparametric Estimation of the Receiver Operating Characteristic Curve,” . The Annals of Statistics , 24 : 25 – 40 .
   Web of Science ®Google Scholar
• Huang , Y. , Pepe , M. and Feng , Z. 2007 . “Evaluating the Predictiveness of a Continuous Marker,” . Biometrics , 63 : 1181 – 1188 .
   PubMed Web of Science ®Google Scholar
• Joska , J. , Westgarth-Taylor , J. , Hoare , J. , Thomas , K. , Paul , R. , Myer , L. and Stein , D. 2011 . “Validity of the International HIV Dementia Scale in South Africa,” . AIDS Patient Care STDS , 25 : 95 – 101 .
   PubMed Web of Science ®Google Scholar
• Justice , A. , McGinnis , K. , Skanderson , M. , Chang , C. , Gibert , C. , Goetz , M. , Rimland , D. , Rodriguez-Barradas , M. , Oursler , K. , Brown , S. , Braithwaite , R. S. , May , M. , Covinsky , K. E. , Roberts , M. S. , Fultz , S. L. , Bryant , K. J. and VACS Project Team . 2010 . “Towards a Combined Prognostic Index for Survival in HIV Infection: The Role of ‘non-HIV’ Biomarkers,” . HIV Medicine , 11 : 143 – 151 .
   PubMed Web of Science ®Google Scholar
• Kantor , R. , Diero , L. , DeLong , A. , Kamle , L. , Muyonga , S. , Mambo , F. , Walumbe , E. , Emonyi , W. , Chan , P. , Carter , E. J. , Hogan , J. and Buziba , N. 2009 . “Misclassification of First-Line Antiretroviral Treatment Failure Based on Immunological Monitoring of HIV Infection in Resource-Limited Settings,” . Clinical Infectious Diseases , 49 : 454 – 462 .
   PubMed Web of Science ®Google Scholar
• Keiser , O. , Macphail , P. , Boulle , A. , Wood , R. , Schechter , M. , Dabis , F. , Sprinz , E. , Egger , M. and ART-LINC Collaboration of the International Databases to Evaluate AIDS . 2009 . “Accuracy of WHO CD4 Cell Count Criteria for Virological Failure of Antiretroviral Therapy,” . Tropical Medicine and International Health , 14 : 1220 – 1225 .
   PubMed Web of Science ®Google Scholar
• Kenya Ministry of Health . 2005 . Guidelines to Antiretroviral Drug Therapy in Kenya. National AIDS and STD control Programme (3rd ed.) , Nairobi , Kenya : Kenya Ministry of Health .
   Google Scholar
• Kiragga , A. N. , Castelnuovo , B. , Kamya , M. R. , Moore , R. and Manabe , Y. C. 2012 . “Regional Differences in Predictive Accuracy of WHO Immunologic Failure Criteria,” . AIDS , 26 : 768 – 770 .
   PubMed Web of Science ®Google Scholar
• Kotsiantis , S. B. 2007 . “Supervised Machine Learning: A Review of Classification Techniques,” . Informatica , 31 : 249 – 268 .
   Google Scholar
• Lee , A. 1990 . U-Statistics: Theory and Practice , New York : Marcel Dekker .
   Google Scholar
• Lynen , L. , An , S. , Koole , O. , Thai , S. , Ros , S. , De Munter , P. , Sculier , D. , Arnould , L. , Fransen , K. , Menten , J. , Boelaert , M. , Van den Ende , J. and Colebunders , R. 2009 . “An Algorithm to Optimize Viral Load Testing in HIV-Positive Patients With Suspected First-Line Antiretroviral Therapy Failure in Cambodia,” . Journal of Acquired Immune Deficiency Syndromes , 52 : 40 – 48 .
   PubMed Web of Science ®Google Scholar
• Mabeya , H. , Khozaim , K. , Liu , T. , Orango , O. , Chumba , D. , Pisharodi , L. , Carter , J. and Cu-Uvin , S. 2012 . “Comparison of Conventional Cervical Cytology Versus Visual Inspection With Acetic Acid Among Human Immunodeficiency Virus–Infected Women in Western Kenya,” . Journal of Lower Genital Tract Disease , 16 : 92 – 97 .
   PubMed Web of Science ®Google Scholar
• Malawi Ministry of Health . 2003 . Treatment of AIDS, Guidelines for the use of Antiretroviral Therapy in Malawi (1st ed.) , Lilongwe , Malawi : Malawi Ministry of Health .
   Google Scholar
• Mee , P. , Fielding , K. , Charalambous , S. , Churchyard , G. and Grant , A.D. 2008 . “Evaluation of the WHO Criteria for Antiretroviral Treatment Failure Among Adults in South Africa,” . AIDS , 22 : 1971 – 1977 .
   PubMed Web of Science ®Google Scholar
• Metz , C. E. 1978 . “Basic Principles of ROC Analysis,” . Seminars in Nuclear Medicine , 8 : 283 – 298 .
   PubMed Web of Science ®Google Scholar
• Meya , D. , Spacek , L. , Tibenderana , H. , John , L. , Namugga , I. , Magero , S. , Dewar , R. , Quinn , T. C. , Colebunders , R. , Kambugu , A. and Reynolds , S. J. 2009 . “Development and Evaluation of a Clinical Algorithm to Monitoring Patients on Antiretrovirals in Resource-Limited Settings Using Adherence, Clinical and CD4 Cell Count Criteria,” . Journal of the International AIDS Society , 12 : 3
   PubMed Web of Science ®Google Scholar
• Moore , D. M. , Hogg , R. S. , Yip , B. , Wood , E. , Tyndall , M. , Braitstein , P. and Montaner , J. S. 2005 . “Discordant Immunologic and Virologic Responses to Highly Active Antiretroviral Therapy Are Associated With Increased Mortality and Poor Adherence to Therapy,” . Journal of Acquired Immune Deficiency Syndromes , 40 : 288 – 293 .
   PubMed Web of Science ®Google Scholar
• Pahwa , S. , Read , J. S. , Yin , W. , Matthews , Y. , Shearer , W. , Diaz , C. , Rich , K. , Mendez , H. , Thompson , B. and for the Women, and Study, I. T. 2008 . “CD4+/CD8+ T Cell Ratio for Diagnosis of HIV-1 Infection in Infants: Women and Infants Transmission Study,” . Pediatrics , 122 : 331 – 339 .
   PubMed Web of Science ®Google Scholar
• Panel on Antiretroviral Guidelines for Adults and Adolescents . 2011 . Guidelines for the Use and Antiretroviral Agents in HIV-1-Infected Adults and Adolescents , Geneva , Switzerland : Department of Health and Human Services (DHHS), WHO .
   Google Scholar
• Parmigiani , G. 2002 . Modeling in Medical Decision Making: A Bayesian Approach, Wiley Series in Statistics in Practice , New York : Wiley .
   Google Scholar
• Pepe , M. 2011 . “Problems With Risk Reclassification Methods for Evaluating Prediction Models,” . American Journal of Epidemiology , 173 : 1327 – 1335 .
   PubMed Web of Science ®Google Scholar
• Pepe , M. , Feng , Z. , Huang , Y. , Longton , G. , Prentice , R. L. , Thompson , I. and Zheng , Y. 2008 . “Inteprating the Predictiveness of a Marker With Its Performance as a Classifier,” . American Journal of Epidemiology , 167 : 362 – 368 .
   PubMed Web of Science ®Google Scholar
• Pepe , M. S. 2000 . “Receiver Operating Characteristic Methodology,” . Journal of the American Statistical Association , 95 : 308 – 311 .
   Web of Science ®Google Scholar
• Pepe , M. S. 2003 . The Statistical Evaluation of Medical Tests for Classification and Prediction , Oxford : Oxford University Press .
   Google Scholar
• Pepe , M. S. and Thompson , M. L. 2000 . “Combining Diagnostic Test Results to Increase Accuracy,” . Biostatistics , 1 : 123 – 140 .
   PubMedGoogle Scholar
• Prentice , R. L. and Pyke , R. 1979 . “Logistic Disease Incidence Models and Case-Control Studies,” . Biometrika , 66 : 403 – 11 .
   Web of Science ®Google Scholar
• Qin , J. 1999 . “Empirical Likelihood Ratio Based Confidence Intervals for Mixture Proportions,” . The Annals of Statistics , 27 : 1368 – 1384 .
   Web of Science ®Google Scholar
• Republic Zambia Ministry of Health . 2004 . National Guidelines on Management and Care of Patients With HIV/AIDS , Lusaka , the Republic of Zambia : Republic Zambia Ministry of Health .
   Google Scholar
• Reynolds , S. , Nakigozi , G. , Newell , K. , Ndyanabo , A. , Galiwongo , R. , Boaz , I. , Quinn , T. , Gray , R. , Wawer , M. and Serwadda , D. 2009 . “Failure of Immunologic Criteria to Appropriately Identify Antiretroviral Treatment Failure in Uganda,” . AIDS , 23 : 697 – 700 .
   PubMed Web of Science ®Google Scholar
• Rosner , B. , Spiegelman , D. and Willett , W. 1990 . “Correction of Logistic Regression Relative Risk Estimates and Confidence Intervals for Measurement Error: The Case of Multiple Covariates Measured With Error,” . American Journal of Epidemiology , 132 : 734 – 745 .
   PubMed Web of Science ®Google Scholar
• Sarle , W. (Ed.) . 1994 . “Neural Networks and Statistical Models,” . In Proceedings of the Nineteenth Annual SAS Users Group International Conference , 1538 – 1550 . Dallas , TX : SAS Institute .
   Google Scholar
• Schechter , M. and Tuboi , S. H. 2006 . “Discordant Immunological and Virologic Responses to Antiretroviral Therapy,” . Journal of Antimicrobial Chemotherapy , 58 : 506 – 510 .
   PubMed Web of Science ®Google Scholar
• Schooley , R. 2007 . “Viral Load Testing in Resource-Limited Settings,” . Clinical Infectious Diseases , 44 : 139 – 140 .
   PubMed Web of Science ®Google Scholar
• Sinisi , S. E. , Polley , E. C. , Petersen , M. L. , Rhee , S.-Y. and van der Laan , M. J. 2007 . “Super Learning: An Application to the Prediction of HIV-1 Drug Resistance,” . Statistical Applications in Genetics and Molecular Biology , 6 : 1 – 26 .
   Web of Science ®Google Scholar
• Stefanski , L. and Cook , J. 1995 . “Simulation-Extrapolation: The Measurement Error Jackknife,” . Journal of the American Statistical Association , 90 : 1247 – 1256 .
   Web of Science ®Google Scholar
• Steyerberg , E. , Vickers , A. , Cook , N. , Gerds , T. , Gonen , M. , Obuchowski , N. , Pencina , M. J. and Kattan , M. W. 2010 . “Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures,” . Epidemiology , 21 : 128 – 138 .
   PubMed Web of Science ®Google Scholar
• Thompson , M. A. , Aberg , J. A. , Cahn , P. , Montaner , J. S. G. , Rizzardini , G. , Telenti , A. , Gatell , J. M. , Günthard , H. F. , Hammer , S. M. , Hirsch , M. S. , Jacobsen , D. M. , Reiss , P. , Richman , D. D. , Volberding , P. A. , Yeni , P. and Schooley , R. T. 2010 . “Antiretroviral Treatment of Adult HIV Infection,” . Journal of the American Medical Association , 304 : 321 – 333 .
   PubMed Web of Science ®Google Scholar
• Tuboi , S. H. , Brinkhof , M. W. , Egger , M. , Stone , R. A. , Braitstein , P. , Nash , D. , Sprinz , E. , Dabis , F. , Harrison , L. H. and Schechter , M. 2007 . “Discordant Responses to Potent Antiretroviral Therapyin Previously Naive HIV-1-Infected Adults Initiating Therapy in Resource-Constrained Countries: The Antiretroviral Therapy in Low-Income Countries (ART-LINC) Collaboration,” . Journal of Acquired Immune Deficiency Syndromes , 45 : 52 – 59 .
   PubMed Web of Science ®Google Scholar
• Uganda Ministry of Health . 2003 . National Antiretroviral Treatment and Care Guidelines for Adults and Children (1st ed.) , Kampala , Uganda : Uganda Ministry of Health .
   Google Scholar
• Joint United Nations Programme on HIV/AIDS (UNAIDS) . 2009 . “2009 AIDS Epidemic Update,” . WHO http://data.unaids.org/pub/Report/2009/2009_epidemic_update_en.pdf
   Google Scholar
• Joint United Nations Programme on HIV/AIDS (UNAIDS) . 2010 . Report on the Global AIDS Epidemic , Geneva : WHO .
   Google Scholar
• van der Laan , M. and Rose , S. 2011 . Targeted Learning: Causal Inference for Observational and Experimental Data , New York : Springer .
   Google Scholar
• van der Vaart , A. 1998 . Asymptotic Statistics , Cambridge : Cambridge University Press .
   Google Scholar
• Vekemans , M. , John , L. and Colebunders , R. 2007 . “When to Switch for Antiretroviral Treatment Failure in Resource-Limited Settings?” . AIDS , 21 : 1205 – 1206 .
   PubMed Web of Science ®Google Scholar
• Vickers , A. and Elkin , E. 2006 . “Decision Curve Analysis: A Novel Method for Evaluating Prediction Models,” . Medical Decision Making , 26 : 565 – 574 .
   PubMed Web of Science ®Google Scholar
• WHO . 2010a . Antiretroviral Therapy for HIV Infection in Adults and Adolescents: 2010 Revision , Geneva : WHO .
   Google Scholar
• WHO . 2010b . Towards Universal Access: Scaling Up Priority HIV/AIDS Interventions in the Health Sector , Geneva : WHO .
   Google Scholar
• Zhou , X.-H. , McClish , D. K. and Obuchowski , N. A. 2002 . Statistical Methods in Diagnostic Medicine, Wiley Series in Probability and Statistics , Hoboken, , NJ : Wiley .
   Google Scholar