Modeling Site Effects in the Design and Analysis of Multi-site Trials

REFERENCES

• Nunes EV, Ball S, Booth R, Brigham G, Calsyn DA, Carroll K, Feaster DJ, Hien D, Hubbard RL, Ling W, Petry NM, Rotrosen J, Selzer J, Stitzer M, Tross S, Wakim P, Winhusen T, Woody G. Multisite effectiveness trials of treatments for substance abuse and co-occurring problems: Have we chosen the best designs? J Subst Abuse Treat 2010; 38(Suppl. 1):S97–S112.
   PubMed Web of Science ®Google Scholar
• Lewis JA. Discussion on the paper by Senn. J R Stat Soc Ser D 2000; 49:156–157.
   Google Scholar
• Kraemer HC. Pitfalls of multisite randomized clinical trials of efficacy and effectiveness. Schizophr Bull 2000; 26(3):533–541.
   PubMed Web of Science ®Google Scholar
• Locallo AR, Berlin JA, Ten Have TR, Kimmel SE. Adjustments for center in multicenter studies: An overview. Ann Intern Med 2001; 135:112–123.
   PubMed Web of Science ®Google Scholar
• Wampold BE, Serlin RC. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychol Methods 2000; 5(4):425–433.
   PubMed Web of Science ®Google Scholar
• Lee K, Thompson SG. Clustering by health professional in individually randomised trials. Br Med J 2005; 330(7483):142–144.
   PubMed Web of Science ®Google Scholar
• Hutchison D. Designing your sample efficiently: Clustering effects in education surveys. Educ Res 2009; 51(1):109–126.
   Web of Science ®Google Scholar
• McCoach DB, Adelson JL. Dealing with dependence (part I): Understanding the effects of clustered data. Gifted Child Q 2010; 54:152–155.
   Web of Science ®Google Scholar
• Kenny DA. The effect of nonindependence on significant testing in dyadic research. Pers Relationsh 1995; 2:67–75.
   Web of Science ®Google Scholar
• Petry NM, Peirce JM, Stitzer ML, Blaine J, Roll JM, Cohen A, Obert J, Killeen T, Saladin ME, Cowell M, Kirby KC, Sterling R, Royer-Malvestuto C, Hamilton J, Booth RE, Macdonald M, Lievert M, Rader L, Burns R, DiMaria J, Copersino M, Stabile PQ, Kolodner K, Li R. Effect of prize-based incentives on outcomes in stimulant abusers in outpatient psychosocial treatment programs: A National Drug Abuse Treatment Clinical Trials Network study. Arch Gen Psychiatry 2005; 62:1148–1156.
   PubMed Web of Science ®Google Scholar
• Peirce JM, Petry NM, Stitzer ML, Blaine J, Kellogg S, Satterfield F, Schwartz M, Krasnansky J, Pencer E, Silva-Vazquez L, Kirby KC, Royer-Malvestuto C, Roll JM, Cohen A, Copersino ML, Kolodner K, Rui L. Effects of lower-cost incentives on stimulant abstinence in methadone maintenance treatment: A National Drug Abuse Treatment Clinical Trials Network study. Arch Gen Psychiatry 2006; 63(2):201–208.
   PubMed Web of Science ®Google Scholar
• Ruvuna F. Unequal center sizes, sample size, and power in multicenter clinical trials. Drug Inf J 2004; 38(4):387–394.
   Google Scholar
• Maddala GS. Econometrics. NY, NY: McGraw-Hill, 1977; 326–327.
   Google Scholar
• Brown H, Prescott R. Applied Mixed Models in Medicine. New York, NY: Wiley, 1999.
   Google Scholar
• Carroll KM, Ball SA, Nich C, Martino S, Frankforter TL, Farentinos C, Kunkel LE, Mikulich-Gilbertson SK, Morgenstern J, Obert JL, Polcin D, Snead N, Woody GE. Motivational interviewing to improve treatment engagement and outcome in individuals seeking treatment for substance abuse: A multisite effectiveness study. Drug Alcohol Depend 2006; 81:301–312.
   PubMed Web of Science ®Google Scholar
• Reid MA, Fallon B, Sonne S, Flammino F, Nunes EV, Jaing H, Kourniotis E, Lima J, Brady R, Burgess C, Arfken C, Pihlgren E, Giordano L, Starosta A, Robinson J, Rotrosen J. Smoking cessation treatment in community-based substance abuse rehabilitation programs. J Subst Abuse Treat 2008; 35:68–77.
   PubMed Web of Science ®Google Scholar
• Tross S, Campbell ANC, Cohen LR, Calsyn D, Pavlicova M, Miele GM, Hu M, Haynes L, Nugent N, Gan W, Hatch-Maillette M, Mandler R, McLaughlin P, El-Bassel N, Crits-Christoph P, Nunes EV. Effectiveness of HIV/STD sexual risk reduction groups for women in substance abuse treatment programs: Results of NIDA clinical trials network trial. J Acquir Immun Def Syn 2008; 48(5The Clinical Trials Network: A Decade of Progress (Guest Editor: Edward Nunes)):581–589.
   PubMed Web of Science ®Google Scholar
• Snijders T, Bosker R. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. London: Sage Publications, 2000.
   Google Scholar
• Kraemer HC, Robinson TN. Are certain multicenter randomized clinical trial structures misleading clinical and policy decisions? Contemp Clin Trials 2005; 26(5The Clinical Trials Network: A Decade of Progress (Guest Editor: Edward Nunes)):518–529.
   PubMed Web of Science ®Google Scholar
• Ball SA, Martino S, Nich C, Frankforter TL, Van Horn D, Crits-Christoph P, Woody GE, Obert JL, Farentinos C, Carroll KM. Site matters: Multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. J Consult Clin Psychol 2007; 75(4):556–567.
   PubMed Web of Science ®Google Scholar
• Winhusen T, Kropp F, Babcock D, Hague D, Erickson SJ, Renz C, Rau L, Lewis D, Leimberger J, Somoza E. Motivational enhancement therapy to improve treatment utilization and outcome in pregnant substance users. J Subst Abuse Treat 2008; 35(2):161–173.
   PubMed Web of Science ®Google Scholar
• Kallen A. Treatment-by-center interaction: What is the issue? Drug Inf J 1997; 31:927–936.
   Google Scholar
• Fleiss JL. Analysis of data from multiclinic trials. Control Clin Trials 1986; 7(4):267–275.
   PubMedGoogle Scholar
• Lin Z. An issue of statistical analysis in controlled multi-centre studies: How shall we weight the centres? Stat Med 1999; 18(4):365–373.
   PubMed Web of Science ®Google Scholar
• Senn S. Some controversies in planning and analysing multi-centre trials. Stat Med 1998; 17(15–16):1753–1765.
   PubMed Web of Science ®Google Scholar
• Senn S. Consensus and controversy in pharmaceutical statistics. J R Stat Soc Ser D 2000; 49(2):135–176.
   Web of Science ®Google Scholar
• Carroll KM, Martino S, Ball SA, Nich C, Frankforter T, Anez LM, Paris M, Suarez-Morales L, Szpocznik J, Miller WR, Rosa C, Matthews J, Farentinos C. A multisite randomized effectiveness trial of motivational enhancement therapy for Spanish-speaking substance users. J Consult Clin Psychol 2009; 77(5The Clinical Trials Network: A Decade of Progress (Guest Editor: Edward Nunes)):993–999.
   PubMed Web of Science ®Google Scholar
• Woody GE, Poole SA, Subramaniam G, Dugosh K, Bogenschutz M, Abbott P, Patkar A, Publicker M, McCain K, Potter JS, Forman R, Vetter V, McNicholas L, Blaine J, Lynch KG, Fudala P. Extended versus short-term buprenorphine-naloxone for treatment of opioid-addicted youth: A randomized trial. J Am Med Assoc 2008; 300(17):2003–2011.
   PubMed Web of Science ®Google Scholar
• Hien DA, Wells EA, Jiang H, Suarez-Morales L, Campbell ANC, Cohen LR, Miele GM, Killeen T, Brigham GS, Zhang Y. Multi-site randomized trial of behavioral interventions for women with co-occurring PTSD and substance use disorders. J Consult Clin Psychol 2009; 77(4):607–619.
   PubMed Web of Science ®Google Scholar
• Carroll KM, Farentinos C, Ball SA, Crits-Christoph P, Libby B, Morgenstern J, Obert JL, Polcin D, Woody GE. MET meets the real world: Design issues and clinical strategies in the Clinical Trials Network. J Subst Abuse Treat 2002; 23:73–80.
   PubMed Web of Science ®Google Scholar
• Lin Z. The number of centers in a multicenter clinical study: Effects on statistical power. Drug Inf J 2000; 34(2):379–386.
   Google Scholar
• Raudenbush SW, Liu X. Statistical power and optimal design for multisite randomized trials. Psychol Methods 2000; 5(2):199–213.
   PubMed Web of Science ®Google Scholar
• Moerbeek M, van Breukelen GJ, Berger MP. A comparison between traditional methods and multilevel regression for the analysis of multicenter intervention studies. J Clin Epidemiol 2003; 56(4):341–350.
   PubMed Web of Science ®Google Scholar
• Feaster DJ, Robbins MS, Horigian V, Szapocznik J. Statistical issues in multi-site effectiveness trials: The case of brief strategic family therapy for adolescent drug abuse treatment. Clin Trials 2004; 1:428–439.
   PubMedGoogle Scholar
• Robbin MS, Szapocznik JS, Horigian VE, Feaster DJ, Puccinelli M, Jacobs P, Burlew K, Werstlein R, Bachrach K, Brigham G. Brief Strategic Family Therapy™ for adolescent drug abusers: A multi-site effectiveness study. Contemp Clin Trials 2009; 30(3):269–278.
   PubMed Web of Science ®Google Scholar
• Booth RE, Campbell BK, Mikulich-Gilbertson SK, Tillotson CJ, Choi D, Robinson J, Calsyn DA, Mandler RN, Jenkins LM, Thompson LL, Dempsey CL, Liepman MR, McCarty D. Reducing HIV-related risk behaviors among injection drug users in residential detoxification. AIDS Behav 2010; 15:30–44.
   Web of Science ®Google Scholar
• Singer JD. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. J Educ Behav Stat 1998; 23(4):323–355.
   Web of Science ®Google Scholar
• Cohen J. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.
   Google Scholar
• Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Anal 2006; 1(3):515–533.
   Web of Science ®Google Scholar
• Gould AL. Multi-centre trial analysis revisited. Stat Med 1998; 17(15–16):1779–1797.
   PubMed Web of Science ®Google Scholar
• Subbiah M, Kumar BK, Srinivasan MR. Bayesian approach to multicentre sparse data. Commun Stat Simul Comput 2008; 37(4):687–696.
   Web of Science ®Google Scholar
• Spybrook J, Raudenbush SW, Congdon R, Martinez A. Optimal design for longitudinal and multilevel research: Documentation for the “Optimal Design” software. W.T. Grant Foundation, 2009. Available at http://www.wtgrantfoundation.org/news/foundation_news/optimal-design. Accessed on July 24, 2011.
   Google Scholar
• Friedman LM, Furberg CD, DeMets DL. Fundamentals of Clinical Trials. New York, NY: Springer, 1998.
   Google Scholar
• Rosenberger WF, Lachin JM. Randomization in Clinical Trials: Theory and Practice. New York, NY: Wiley, 2002.
   Google Scholar
• Carroll KM, Rounsaville BJ. Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatr Serv 2003; 54(3):333–339.
   PubMed Web of Science ®Google Scholar
• Edgington ES. Randomization Test. New York, NY: Marcel Dekker, 1995.
   Google Scholar