1,323
Views
22
CrossRef citations to date
0
Altmetric
Original Articles

Measuring individual significant change on the Beck Depression Inventory-II through IRT-based statistics

, &
Pages 489-501 | Received 09 Sep 2012, Accepted 05 Apr 2013, Published online: 10 May 2013

References

  • Al-Turkait , F.A. and Ohaeri , J.U. 2010 . Dimensional and hierarchical models of depression using the Beck Depression Inventory-II in an Arab college student sample . BMC Psychiatry , 10 : 60 – 74 . doi: 10.1186/1471-244X-10-60
  • American Psychiatric Association . 2000 . Diagnostic and statistical manual of mental disorders () , 4th ed. TR . Washington , DC : Task Force .
  • Arnau , R.C. , Meagher , M.W. , Norris , M.P. and Bramson , R. 2001 . Psychometric evaluation of the Beck Depression Inventory–II with primary care medical patients . Health Psychology , 20 : 112 – 119 . doi: 10.1037/0278-6133.20.2.112
  • Atkins , D.C. , Bedics , J.D. , McGlinchey , J.B. and Beauchaine , T.P. 2005 . Assessing clinical significance: Does it matter which method we use? . Journal of Consulting and Clinical Psychology , 73 : 982 – 989 . doi: 10.1037/0022-006X.73.5.982
  • Bauer , S. , Lambert , M.J. and Nielsen , S.L. 2004 . Clinical significance methods: A comparison of statistical techniques . Journal of Personality Assessment , 82 : 60 – 70 . doi: 10.1207/s15327752jpa8201_11
  • Beck , A.T. , Steer , R.A. and Brown , G.K. 1996 . Manual for the Beck Depression Inventory–II , San Antonio , TX : Psychological Corporation .
  • Beck , A.T. , Steer , R.A. , Brown , G.K. and van der Does , A.J.W. 2002 . BDI–II–NL Handleiding [BDI–II–Dutch manual] , Lisse , , the Netherlands : Psychological Corporation .
  • Binder , P. , Holgersen , H. and Nielsen , G.H. 2010 . What is a “good outcome” in psychotherapy? A qualitative exploration of former patients’ point of view . Psychotherapy Research , 20 : 285 – 294 . doi: 10.1080/10503300903376338
  • Bock , R.D. and Mislevy , R.J. 1982 . Adaptive EAP estimation of ability in a microcomputer environment . Applied Psychological Measurement , 6 : 431 – 444 . doi: 10.1177/014662168200600405
  • Brouwer , D. , Meijer , R.R. , & Zevalkink , J. 2013 . On the factor structure of the Beck Depression Inventory–II: G is the key . Psychological Assessment , 25 , 136 – 145 . doi: 10.1037/a0029228 .
  • Buckley , T.C. , Parker , J.D. and Heggie , J. 2001 . A psychometric evaluation of the BDI–II in treatment seeking substance abusers . Journal of Substance Abuse Treatment , 20 : 197 – 204 . doi: 10.1016/S0740-5472(00)00169-0
  • Cai , L. , Thissen , D. and du Toit , S. 2011 . IRTPRO 2.1 for Windows , Chicago : Scientific Software International .
  • Cella , D. , Riley , W. , Stone , A. , Rothrock , N. , Reeve , B. , Yount , S. , … Hays , R.D. on behalf of the PROMIS Cooperative Group . 2010 . Initial item banks and first wave testing of the Patient–Reported Outcomes Measurement Information System (PROMIS) network: 2005–2008 . Journal of Clinical Epidemiology , 63 ( 11 ), 1179 – 1194 doi: 10.1016/j.jclinepi.2010.04.011
  • Christensen , L. and Mendoza , J.L. 1986 . A method of assessing change in a single subject: An alteration of the RC index . Behavior Therapy , 15 : 305 – 308 . doi: 10.1016/S0005-7894(86)80060-0
  • Cole , D.A. , Cai , L. , Martin , N.C. , Findling , R.L. , Youngstrom , E.A. , Garber , J. , & … Forehand , R. 2011 . Structure and measurement of depression in youths: Applying item response theory to clinical data . Psychological Assessment , 23 , 819 – 833 . doi: 10.1037/a0023518 .
  • Collins , L.M. 1996 . Is reliability obsolete? A commentary on ‘Are simple gain scores obsolete’ . Applied Psychological Measurement , 20 : 289 – 292 . doi: 10.1177/014662169602000308
  • Cronbach , L.J. and Furby , L. 1970 . How we should measure ‘change’ – or should we? . Psychological Bulletin , 74 : 68 – 80 . doi: 10.1037/h0029382
  • Doucette , A. and Wolf , A.W. 2009 . Questioning the measurement precision of psychotherapy research . Psychotherapy Research , 19 : 374 – 389 . doi: 10.1080/10503300902894422
  • Dozois , D.J.A. , Dobson , K.S. and Ahnberg , J.L. 1998 . A psychometric evaluation of the Beck Depression Inventory–II . Psychological Assessment , 10 : 83 – 89 . doi: 10.1037/1040-3590.10.2.83
  • Dumenci , L. and Achenbach , T.M. 2008 . Effects of estimation methods on making trait-level inferences from ordered categorical items for assessing psychopathology . Psychological Assessment , 20 : 55 – 62 . doi: 10.1037/1040-3590.20.1.55
  • Embretson , S.E. and Reise , S.P. 2000 . Item response theory for psychologists , Mahwah , NJ : Erlbaum .
  • Emons , W.H.M. , Meijer , R.R. and Denollet , J. 2007 . Negative affectivity and social inhibition in cardiovascular disease: Evaluating Type D personality and its assessment using item response theory . Journal of Psychosomatic Research , 63 : 27 – 39 . doi: 10.1016/j.jpsychores.2007.03.010
  • Finkelman , M. , Weiss , D. and Kim-Kang , G. 2010 . Item selection and hypothesis testing for the adaptive measurement of change . Applied Psychological Measurement , 34 : 238 – 254 . doi: 10.1177/0146621609344844
  • Gershon , R.C. , Rothrock , N.E. , Hanrahan , R.T. , Jansky , L.J. , Harniss , M. and Riley , W. 2010 . The development of a clinical outcomes survey research application: Assessment Center . Quality of Life Research , 19 : 677 – 85 . doi: 10.1007/s11136-010-9634-4
  • Guo , J. and Drasgow , F. 2010 . Identifying cheating on unproctored Internet tests: The z-test and the likelihood ratio test . International Journal of Selection and Assessment , 18 : 351 – 364 . doi: 10.1111/j.1468-2389.2010.00518.x
  • Hiller , W. , Schindler , A.C. and Lambert , M.J. 2012 . Defining response and remission in psychotherapy research: A comparison of the RCI and the method of percent improvement . Psychotherapy Research , 22 : 1 – 11 . doi: 10.1080/10503307.2011.616237
  • Jacobson , N.S. , Follette , W.C. and Revenstorf , D. 1984 . Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance . Behavior Therapy , 15 : 336 – 352 . doi: 10.1016/S0005-7894(84)80002-7
  • Jacobson , N.S. , Roberts , L.J. , Berns , S.B. and McGlinchey , J.B. 1999 . Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives . Journal of Consulting and Clinical Psychology , 67 : 300 – 307 . doi: 10.1037/0022-006X.67.3.300
  • Jacobson , N.S. and Truax , P. 1991 . Clinical significance: A statistical approach to defining meaningful change in psychotherapy research . Journal of Consulting and Clinical Psychology , 59 : 12 – 19 . doi: 10.1037/0022-006X.59.1.12
  • Kendall , P.C. , Marrs-Garcia , A. , Nath , S. and Sheldrick , R.C. 1999 . Normative comparisons for the evaluation of clinical significance . Journal of Consulting and Clinical Psychology , 67 : 285 – 299 . doi: 10.1037/0022-006X.67.3.285
  • Lambert , M.J. 2007 . Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care . Psychotherapy Research , 17 : 1 – 14 . doi: 10.1080/10503300601032506
  • Lambert , M.J. and Ogles , B.M. 2009 . Using clinical significance in psychotherapy outcome research: The need for a common procedure and validity data . Psychotherapy Research , 19 : 493 – 501 . doi: 10.1080/10503300902849483
  • Lambert , M.J. , Whipple , J.L. , Hawkins , E.J. , Vermeersch , D.A. , Nielsen , S.L. and Smart , D.W. 2003 . Is it time for clinicians to routinely track patient outcome? A meta-analysis . Clinical Psychology: Science and Practice , 10 : 288 – 301 . doi: 10.1093/clipsy.bpg025
  • Liu , H.H. , Cella , D. , Gershon , R. , Shen , J. , Morales , L.S. , Riley , W. and Hays , R.D. 2010 . Representativeness of the PROMIS Internet panel . Journal of Clinical Epidemiology , 63 : 1169 – 1178 . doi: 10.1016/j.jclinepi.2009.11.021
  • Maassen , G.H. 2001 . The unreliable change of reliable change indices . Behaviour Research and Therapy , 39 : 495 – 498 . doi: 10.1016/S0005-7967(00)00029-2
  • McGlinchey , J.B. , Atkins , D.C. and Jacobson , N.S. 2002 . Clinical significant methods: Which one to use and how useful are they? . Behavior Therapy , 33 : 529 – 550 . doi: 10.1016/S0005-7894(02)80015-6
  • Meijer , R.R. and Baneke , J.J. 2004 . Analyzing psychopathology items: A case for nonparametric item response theory . Psychological Methods , 9 : 354 – 368 . doi: 10.1037/1082-989X.9.3.354
  • Meijer , R.R. and Egberink , I.J.L. 2011 . An item response theory analysis of Harter's Self-Perception Profile for Children or why strong clinical scales should be distrusted . Assessment , 18 : 201 – 212 . doi: 10.1177/1073191110367778
  • Mellenbergh , G.J. 1999 . A note on simple gain score precision . Applied Psychological Measurement , 23 : 87 – 89 .
  • Mellenbergh , G.J. and Van den Brink , W.P. 1998 . The measurement of individual change . Pschychological Methods , 3 : 470 – 485 . doi: 10.1037/1082-989X.3.4.470
  • Molenaar , I.W. , & Sijtsma , K. 2000 . MSP5 for Windows . User's manual . Groningen , , the Netherlands : ProGAMMA .
  • Ogles , B.M. , Lunnen , K.M. and Bonesteel , K. 2001 . Clinical significance: History, application and current practice . Clinical Psychology Review , 21 : 421 – 446 . doi: 10.1016/S0272-7358(99)00058-6
  • Osman , A. , Barrios , F.X. , Gutierrez , P.M. , Williams , J.E. and Bailey , J. 2008 . Psychometric properties of the Beck Depression Inventory-II in nonclinical adolescent samples . Journal of Psychopathology and Behavioral Assessment , 64 : 83 – 102 .
  • Osman , A. , Downs , W.R. , Barrios , F.X. , Kopper , B.A. , Guttierrez , P.M. and Chiros , C.E. 1997 . Factor structure and psychometric characteristics of the Beck Depression Inventory–II . Journal of Psychopathology and Behavioral Assessment , 19 : 359 – 376 . doi: 10.1007/BF02229026
  • Percevic , R. , Lambert , M.J. and Kordy , H. 2006 . What is the predictive value of responses to psychotherapy for its future course? Empirical explorations and consequences for outcome monitoring . Psychotherapy Research , 16 : 364 – 373 . doi: 10.1080/10503300500485524
  • Purpura , D.J. , Wilson , S.B. , & Lonigan , C.J. 2010 . Attention-deficit/hyperactivity disorder symptoms in preschool children: Examining psychometric properties using item response theory . Psychological Assessment , 22 , 546 – 558 . doi: 10.1037/a0019581 .
  • Quilty , L.C. , Zhang , A.Z. and Bagby , R.M. 2010 . The latent symptom structure of the Beck Depression Inventory–II in outpatients with major depression . Psychological Assessment , 22 : 603 – 608 . doi: 10.1037/a0019698
  • Reise , S.P. and Haviland , M.G. 2005 . Item response theory and the measurement of clinical change . Journal of Personality Assessment , 84 : 228 – 238 . doi: 10.1207/s15327752jpa8403_02
  • Reise , S.P. and Henson , J. 2003 . A discussion of modern versus traditional psychometrics as applied to personality assessment scales . Journal of Personality Assessment , 81 : 93 – 103 . doi: 10.1207/S15327752JPA8102_01
  • Reise , S.P. and Waller , N.G. 2009 . Item response theory and clinical measurement . Annual Review of Clinical Psychology , 5 : 27 – 48 . doi: 10.1146/annurev.clinpsy.032408.153553
  • Reise , S.P. , and Yu , J. 1990 . Parameter recovery in the graded response model using MULTILOG . Journal of Educational Measurement , 27 , 133 – 144 . doi: 10.1111/j.1745–3984.1990.tb00738.x .
  • Rothrock , N.E. , Hays , R.D. , Spritzer , K. , Yount , S.E. , Riley , W. and Cella , D. 2010 . Relative to the general US population, chronic diseases are associated with poorer health-related quality of life as measured by the Patient-Reported Outcomes Measurement Information System (PROMIS) . Journal of Clinical Epidemiology , 63 : 1195 – 1204 . doi: 10.1016/j.jclinepi.2010.04.012
  • Samejima , F. 1969 . Estimation of latent ability using a response pattern of graded scores . Psychometrika , Monograph 17 .
  • Samejima , F. 1997 . “ Graded response model ” . In Handbook of modern item response theory , Edited by: van der Linden , W.J. and Hambleton , R.K. 85 – 100 . New York : Springer .
  • Santor , D.A. and Ramsay , J.O. 1998 . Progress in the technology of measurement: Applications of Item Response models . Psychological Assessment , 10 : 345 – 359 . doi: 10.1037/1040-3590.10.4.345
  • Sinharay , S. 2010 . How often do subscores have added value? Results from operational and simulated data . Journal of Educational Measurement , 47 : 150 – 174 . doi: 10.1111/j.1745-3984.2010.00106.x
  • Speer , D.C. and Greenbaum , P.E. 1995 . Five methods for computing significant individual client change and improvement rates: Support for an individual growth curve approach . Journal of Consulting and Clinical Psychology , 63 : 1043 – 1048 .
  • Steer , R.A. , Ball , R. , Ranieri , W.F. and Beck , A.T. 1999 . Dimensions of the Beck Depression Inventory–II in clinically depressed outpatients . Journal of Clinical Psychology , 55 : 117 – 128 . doi: 10.1002/(SICI)1097-4679(199901)55:1%3C117::AID-JCLP12%3E3.0.CO;2-A
  • Thissen , D. , Chen , W.H. and Bock , R.D. 2003 . MULTILOG (version 7) [computer software] , Lincolnwood , IL : Scientific Software International .
  • Thomas , M.L. 2011 . The value of item response theory in clinical assessment: A review . Assessment , 18 : 291 – 307 . doi: 10.1177/1073191110374797
  • Valkonen , J. , Hänninen , V. and Lindfors , O. 2011 . Outcomes of psychotherapy from the perspective of the users . Psychotherapy Research , 21 : 227 – 240 . doi: 10.1080/10503307.2010.548346
  • Walters , G.D. , Hagman , B.T. and Cohn , A.M. 2011 . Toward a hierarchical model of criminal thinking: Evidence from item response theory and confirmatory factor analysis . Psychological Assessment , 23 : 925 – 936 . doi: 10.1037/a0024017
  • Ward , L.C. 2006 . Comparison of factor structure models for the Beck Depression Inventory-II . Psychological Assessment , 18 : 81 – 88 . doi: 10.1037/1040-3590.18.1.81
  • Williams , R.H. and Zimmerman , D.W. 1996 . Are simple gain scores obsolete? . Applied Psychological Measurement , 20 : 59 – 69 . doi: 10.1177/014662169602000106
  • Wise , E.A. 2004 . Methods for analyzing psychotherapy outcomes: A review of clinical significance, reliable change, and recommendations for future directions . Journal of Personality Assessment , 82 : 50 – 59 . doi: 10.1207/s15327752jpa8201_10
  • Wu , J. , King , K.M. , Witkiewitz , K. , Racz , S.J. and McMahon , R.J. 2012 . Item analysis and differential item functioning of a brief conduct problem screen . Psychological Assessment , 24 : 444 – 454 . doi: 10.1037/a0025831

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.