1,263
Views
11
CrossRef citations to date
0
Altmetric
Research Articles

Operationalising treatment success in aphasia rehabilitation

ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon show all
Pages 1693-1732 | Received 07 Jul 2021, Accepted 07 Dec 2021, Published online: 01 Mar 2022

References

  • Aarnio, K., Rodriguez-Pardo, J., Siegerink, B., Hardt, J., Broman, J., Tulkki, L., Haapaniemi, E., Kaste, M., Tatlisumak, T., & Putaala, J. (2018). Return to work after ischemic stroke in young adults: A registry-based follow-up study. Neurology, 91(20), e1909–e1917. https://doi.org/10.1212/WNL.0000000000006510
  • Ali, M., Lyden, P., Brady, M., & Collaboration, V. (2015). Aphasia and dysarthria in acute stroke: Recovery and functional outcome. International Journal of Stroke, 10(3), 400–406. https://doi.org/10.1111/ijs.12067
  • Ashley, K. D., Lee, L. T., & Heaton, K. (2019). Return to work among stroke survivors. Workplace Health & Safety, 67(2), 87–94. https://doi.org/10.1177/2165079918812483
  • Babbitt, E. M., Worrall, L., & Cherney, L. R. (2016). Who benefits from an intensive comprehensive aphasia program? Topics in Language Disorders, 36(2), 168–184. https://doi.org/10.1097/TLD.0000000000000089
  • Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100(3), 603–617. https://doi.org/10.1348/000712608X377117
  • Bernhardt, J., Hayward, K. S., Kwakkel, G., Ward, N. S., Wolf, S. L., Borschmann, K., Krakauer, J. W., Boyd, L. A., Carmichael, S. T., Corbett, D., & Cramer, S. C. (2017). Agreed definitions and a shared vision for new standards in stroke recovery research: The stroke recovery and rehabilitation roundtable taskforce. International Journal of Stroke, 12(5), 444–450. https://doi.org/10.1177/1747493017711816
  • Black-Schaffer, R. M., & Osberg, J. S. (1990). Return to work after stroke: Development of a predictive model. Archives of Physical Medicine and Rehabilitation, 71 (5), 285–290.
  • Blomert, L., Kean, M. L., Koster, C., & Schokker, J. (1994). Amsterdam—Nijmegen everyday language test: Construction, reliability and validity. Aphasiology, 8(4), 381–407. https://doi.org/10.1080/02687039408248666
  • Boehme, A. K., Martin-Schild, S., Marshall, R. S., & Lazar, R. M. (2016). Effect of aphasia on acute stroke outcomes. Neurology, 87(22), 2348–2354. https://doi.org/10.1212/WNL.0000000000003297
  • Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta- analysis. John Wiley & Sons, Ltd.
  • Brady, M. C., Kelly, H., Godwin, J., Enderby, P., & Campbell, P. (2016). Speech and language therapy for aphasia following stroke. Cochrane Database Syst Rev, 6, CD000425. doi:10.1002/14651858.CD000425.pub4. http://www.ncbi.nlm.nih.gov/pubmed/27245310
  • Breitenstein, C., Grewe, T., Floel, A., Ziegler, W., Springer, L., Martus, P., Huber, W., Willmes, K., Ringelstein, E. B., Haeusler, K. G., Abel, S., Glindemann, R., Domahs, F., Regenbrecht, F., Schlenck, K. J., Thomas, M., Obrig, H., de Langen, E., Rocker, R., … Baumgaertner, A., & FCET2EC study group (2017). Intensive speech and language therapy in patients with chronic aphasia after stroke: A randomised, open-label, blinded- endpoint, controlled trial in a health-care setting. Lancet, 389(10078), 1528–1538 doi:10.1016/S0140-6736(17)31801-9.
  • Broderick, J. P., Adeoye, O., & Elm, J. (2017). Evolution of the modified rankin scale and its use in future stroke trials. Stroke, 48(7), 2007–2012. https://doi.org/10.1161/STROKEAHA.117.017866
  • Cadilhac, D. A., Kim, J., Wilson, A., Berge, E., Patel, A., Ali, M., Saver, J., Christensen, H., Cuche, M., Crews, S., Wu, O., Provoyeur, M., McMeekin, P., Durand-Zaleski, I., Ford, G. A., Muhlemann, N., Bath, P. M., Abdul-Rahim, A. H., Sunnerhagen, K., … Lees, K. R., & group, E. S. O. H. E. W. (2020). Improving economic evaluations in stroke: A report from the ESO health economics working group. European Stroke Journal, 5(2), 184–192. https://doi.org/10.1177/2396987319897466
  • Caporali, A., & Basso, A. (2003). A survey of long-term outcome of aphasia and of chances of gainful employment. Aphasiology, 17(9), 815–834. https://doi.org/10.1080/02687030344000247
  • Charter, R. A. (2008). Statistical approaches to achieving sufficiently high test score reliabilities for research purposes. The Journal of General Psychology, 135(3), 241–251. https://doi.org/10.3200/GENP.135.3.241-251
  • Chen, S., Wolf, S. L., Zhang, Q., Thompson, P. A., & Winstein, C. J. (2012). Minimal detectable change of the actual amount of use test and the motor activity log: The EXCITE trial. Neurorehabilitation and Neural Repair, 26(5), 507–514. https://doi.org/10.1177/1545968311425048
  • Cherney, L. R. (2010). Oral reading for language in aphasia: Impact of aphasia severity on cross-modal outcomes in chronic nonfluent aphasia. Seminars in Speech and Language, 31(1), 42–51. https://doi.org/10.1055/s-0029-1244952
  • Clopper, C. J., & Pearson, E. S. (1934). The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika, 26(4), 404–413. https://doi.org/10.1093/biomet/26.4.404
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Erlbaum.
  • Crocker, L., & Algina, J. (2008). Introduction to classical and modern test theory. Cengage Learning.
  • Danner, D. (2016). Reliability – The precision of a measurement. GESIS survey guidelines. GESIS –Leibniz Institute for the Social Sciences. https://doi.org/10.15465/gesis-sg_en_011
  • Darley, F., Helm, N., Holland, A., & Linebaugh, C. (1980, June 1-5). Techniques in treating mild or high-level aphasic impairment - Panel discussion. In 10th Clinical Aphasiology Conference (Minneapolis: BRK Publishers).
  • de Graaf, J. A., Kuijpers, M., Visser-Meily, J., Kappelle, L. J., & Post, M. (2020). Validity of an enhanced EQ-5D-5L measure with an added cognitive dimension in patients with stroke. Clinical Rehabilitation, 34(4), 545–550. https://doi.org/10.1177/0269215520907990
  • de Haan, R., Limburg, M., Bossuyt, P., van der Meulen, J., & Aaronson, N. (1995). The clinical meaning of Rankin ‘handicap’ grades after stroke. Stroke, 26(11), 2027–2030. https://doi.org/10.1161/01.STR.26.11.2027
  • de Vet, H. C., & Terwee, C. B. (2010). The minimal detectable change should not replace the minimal important difference. Journal of Clinical Epidemiology, 63 (7), 804–805. author reply 806. https://doi.org/10.1016/j.jclinepi.2009.12.015
  • Deeks, J. J., Higgins, J. P. T., & Altman, D. G. (2021). Chapter 10: Analysing data and undertaking meta-analyses. In J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page, and V. A. Welch (Eds.), Cochrane handbook for systematic reviews of interventions version 6.2 (updated February 2021). Cochrane www.training.cochrane.org/handbook.
  • Dekhtyar, M., Braun, E. J., Billot, A., Foo, L., & Kiran, S. (2020). Videoconference administration of the western aphasia battery-revised: Feasibility and validity. American Journal of Speech-Language Pathology, 29(2), 673–687. https://doi.org/10.1044/2019_AJSLP-19-00023
  • Devji, T., Carrasco-Labra, A., Qasim, A., Phillips, M., Johnston, B. C., Devasenapathy, N., Zeraatkar, D., Bhatt, M., Jin, X., Brignardello-Petersen, R., Urquhart, O., Foroutan, F., Schandelmaier, S., Pardo-Hernandez, H., Vernooij, R. W., Huang, H., Rizwan, Y., Siemieniuk, R., Lytvyn, L., … Guyatt, G. H. (2020). Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: Instrument development and reliability study. BMJ 2020; 369:m1714. https://doi.org/10.1136/bmj.m1714
  • Dijkerman, H. C., Wood, V. A., & Hewer, R. L. (1996). Long-term outcome after discharge from a stroke rehabilitation unit. Journal of the Royal College of Physicians of London, 30(6), 538–546.
  • Donoghue, D., & Physiotherapy Research and Older People (PROP) group, & Stokes, E. K. (2009). How much change is true change? The minimum detectable change of the Berg Balance Scale in elderly people. Journal of Rehabilitation Medicine, 41(5), 343–346. https://doi.org/10.2340/16501977-0337
  • Doucet, T., Muller, F., Verdun-Esquer, C., Debelleix, X., & Brochard, P. (2012). Returning to work after a stroke: A retrospective study at the physical and rehabilitation medicine center La Tour de Gassies. Annals of Physical and Rehabilitation Medicine, 55(2), 112–127. https://doi.org/10.1016/j.rehab.2012.01.007
  • Ekker, M. S., Verhoeven, J. I., Vaartjes, I., Jolink, W. M. T., Klijn, C. J. M., & de Leeuw, F. E. (2019). Association of stroke among adults aged 18 to 49 years with long-term mortality. JAMA, 321(21), 2113–2123. https://doi.org/10.1001/jama.2019.6560
  • El Hachioui, H., Lingsma, H. F., van de Sandt-koenderman, M. W., Dippel, D. W., Koudstaal, P. J., & Visch-Brink, E. G. (2013). Long-term prognosis of aphasia after stroke. Journal of Neurology, Neurosurgery & Psychiatry, 84(3), 310–315. https://doi.org/10.1136/jnnp-2012-302596
  • Ellis, C., Lindrooth, R. C., & Horner, J. (2014). Retrospective cost-effectiveness analysis of treatments for aphasia: An approach using experimental data. American Journal of Speech-Language Pathology, 23(2), 186–195. https://doi.org/10.1044/2013_AJSLP-13-0037
  • Ellis, C., Simpson, A. N., Bonilha, H., Mauldin, P. D., & Simpson, K. N. (2012). The one-year attributable cost of poststroke aphasia. Stroke, 43(5), 1429–1431. https://doi.org/10.1161/STROKEAHA.111.647339
  • Elman, R. J., & Bernstein-Ellis, E. (1999). The efficacy of group communication treatment in adults with chronic aphasia. Journal of Speech, Language, and Hearing Research, 42(2), 411–419. https://doi.org/10.1044/jslhr.4202.411
  • Eom, B., & Sung, J. E. (2016). The effects of sentence repetition–based working memory treatment on sentence comprehension abilities in individuals with aphasia. American Journal of Speech- Language Pathology, 25(4S), S823–S838. https://doi.org/10.1044/2016_AJSLP-15-0151
  • Everett, E. A., Everett, W., Brier, M. R., & White, P. (2021). Appraisal of health states worse than death in patients with acute stroke. Neurology: Clinical Practice, 11(1), 43–48. https://doi.org/10.1212/CPJ.0000000000000856
  • Falconer, C., & Antonucci, S. M. (2012). Use of semantic feature analysis in group discourse treatment for aphasia: Extension and expansion. Aphasiology, 26(1), 64–82. https://doi.org/10.1080/02687038.2011.602390
  • Faraone, S. V. (2008). Interpreting estimates of treatment effects: Implications for managed care. P & T : A Peer-reviewed Journal for Formulary Management, 33(12), 700–711 https://www.ncbi.nlm.nih.gov/mc/articles/PMC2730804/
  • Flowers, H. L., Skoretz, S. A., Silver, F. L., Rochon, E., Fang, J., Flamand-Roze, C., & Martino, R. (2016). Poststroke aphasia frequency, recovery, and outcomes: A systematic review and meta- analysis. Archives of Physical Medicine and Rehabilitation, 97(12), 2188–2201 e2188. https://doi.org/10.1016/j.apmr.2016.03.006
  • Franklin, S., Hahrhen, D., Hayes, M., Mc Manus, S. D., & Pollock, A. (2018). Top 10 research priorities relating to aphasia following stroke. Aphasiology, 32(11), 1388–1395. https://doi.org/10.1080/02687038.2017.1417539
  • Frattali, C. M., Thompson, C. M., Holland, A. L., Wohl, C. B., & Ferketic, M. M. (1995). The FACS of life ASHA facs–a functional outcome measure for adults. ASHA, 37(4), 40–46.
  • Fridriksson, J., & Hillis, A. E. (2021). Current approaches to the treatment of post-stroke aphasia. Journal of Stroke, 23(2), 183–201. https://doi.org/10.5853/jos.2020.05015
  • Furlan, L., & Sterr, A. (2018). The applicability of standard error of measurement and minimal detectable change to motor learning research-a behavioral study. Frontiers in Human Neuroscience, 12, 95. https://www.frontiersin.org/articles/10.3389/fnhum.2018.00095/full
  • Galeoto, G., Iori, F., De Santis, R., Santilli, V., Mollica, R., Marquez, M. A., Sansoni, J., & Berardi, A. (2019). The outcome measures for loss of functionality in the activities of daily living of adults after stroke: A systematic review. Topics in Stroke Rehabilitation, 26(3), 236–245. https://doi.org/10.1080/10749357.2019.1574060
  • Gallagher, M., Hares, T., Spencer, J., Bradshaw, C., & Webb, I. (1993). The nominal group technique: A research tool for general practice? Family Practice, 10(1), 76–81. https://doi.org/10.1093/fampra/10.1.76
  • Gerdes, N., Funke, U. N., Schuwer, U., Themann, P., Pfeiffer, G., & Meffert, C. (2012). Selbstaendigkeits-Index fuer die Neurologische und Geriatrische Rehabilitation (SINGER) - Entwicklung und Validierung eines neuen Assessment-Instruments. [Scores of Independence for Neurologic and Geriatric Rehabilitation (SINGER) - development and validation of a new assessment instrument]. Rehabilitation (Stuttg), 51(5), 289–299. https://doi.org/10.1055/s-0031-1287805
  • Gilmore, N., Dwyer, M., & Kiran, S. (2019). Benchmarks of significant change after aphasia rehabilitation. Archives of Physical Medicine and Rehabilitation, 100(6), 1131–1139 e1187. https://doi.org/10.1016/j.apmr.2018.08.177
  • Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Sage.
  • Global Burden of Disease Neurology Collaborators. (2019). Global, regional, and national burden of neurological disorders, 1990-2016: A systematic analysis for the Global Burden of Disease Study 2016. The Lancet Neurology, 18(5), 459–480. https://www.thelancet.com/journals/laneur/article/PIIS1474-4422(18)30499-X/fulltext#%20
  • Godecke, E., Armstrong, E., Rai, T., Ciccone, N., Rose, M. L., Middleton, S., Whitworth, A., Holland, A., Ellery, F., Hankey, G. J., Cadilhac, D. A., Bernhardt, J., & Group, V. C. (2021). A randomized control trial of intensive aphasia therapy after acute stroke: The Very Early Rehabilitation for SpEech (VERSE) study. Int J Stroke 16(5):556–572; https://doi.org/10.1177/1747493020961926
  • Godecke, E., Rai, T., Cadilhac, D. A., Armstrong, E., Middleton, S., Ciccone, N., Whitworth, A., Rose, M. L., Holland, A., Ellery, F., Hankey, G. J., Bernhardt, J., & Collaboration, V. (2018). Statistical analysis plan (SAP) for the Very Early Rehabilitation in Speech (VERSE) after stroke trial: An international 3-arm clinical trial to determine the effectiveness of early, intensive, prescribed, direct aphasia therapy. International Journal of Stroke, 13(8), 863–880. https://doi.org/10.1177/1747493018790055
  • Goldberg, D. P., Gater, R., Sartorius, N., Ustun, T. B., Piccinelli, M., Gureje, O., & Rutter, C. (1997). The validity of two versions of the GHQ in the WHO study of mental illness in general health care. Psychological Medicine, 27(1), 191–197. https://doi.org/10.1017/s0033291796004242
  • Goodglass, H., Kaplan, E., & Barresi, B. (2001). Boston Diagnostic Aphasia Examination (BDAE-3) (3rd ed.). Pro-Ed.
  • Graham, J. R., Pereira, S., & Teasell, R. (2011). Aphasia and return to work in younger stroke survivors. Aphasiology, 25(8), 952–960. https://doi.org/10.1080/02687038.2011.563861
  • Granger, C. V., Hamilton, B. B., Keith, R. A., Zielezny, M., & Sherwin, F. S. (1986). Advances in functional assessment for medical rehabilitation. Topics in Geriatric Rehabilitation, 1(3), 59–74. https://doi.org/10.1097/00013614-198604000-00007
  • Greenland, S., Senn, S. J., Rothman, K. J., Carlin, J. B., Poole, C., Goodman, S. N., & Altman, D. G. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31(4), 337–350. https://doi.org/10.1007/s10654-016-0149-3
  • Guo, Y. E., Togher, L., Power, E., Heard, R., Luo, N., Yap, P., & Koh, G. C. H. (2015). Sensitivity to change and responsiveness of the Stroke and Aphasia Quality-of-Life Scale (SAQOL) in a Singapore stroke population. Aphasiology, 31(4), 427. https://doi.org/10.1080/02687038.2016.1261269
  • Haley, K. L., Womack, J. L., Harmon, T. G., McCulloch, K. L., & Faldowski, R. A. (2019). Life activity choices by people with aphasia: Repeated interviews and proxy agreement. Aphasiology, 33(6), 710–730. https://doi.org/10.1080/02687038.2018.1506087
  • Harrison, J. K., McArthur, K. S., & Quinn, T. J. (2013). Assessment scales in stroke: Clinimetric and clinical considerations. Clin Interv Aging, 8, 201–211. https://doi.org/10.2147/CIA.S32405
  • Heuschmann, P. U., Busse, O., Wagner, M., Endres, M., Villringer, A., Röther, J., Kolominsky-Rabas, P. L., & Berger, K. (2010). Schlaganfallhäufigkeit und Versorgung von Schlaganfallpatienten in Deutschland [Stroke frequency and routine care for stroke patients in Germany]. Aktuelle Neurologie, 37(7), 333–340. https://doi.org/10.1055/s-0030-1248611
  • Higgins, J. P. T., Li, T., & Deeks, J. J. (2021). Chapter 6: Choosing effect measures and computing estimates of effect. In Clinical interventions in, J. P. T. Higgins, J. Thomas, J. Chandler, M. Cumpston, T. Li, M. J. Page, & V. A. Welch (Eds.). Cochrane handbook for systematic reviews of interventions version 6.2 (updated February 2021). Cochrane. www.training.cochrane.org/handbook
  • Hilari, K., Behn, N., Marshall, J., Simpson, A., Thomas, S., Northcott, S., Flood, C., McVicker, S., Jofre- Bonet, M., Moss, B., James, K., & Goldsmith, K. (2019). Adjustment with aphasia after stroke: Study protocol for a pilot feasibility randomised controlled trial for SUpporting wellbeing through PEeR Befriending (SUPERB). Pilot and Feasibility Studies, 5, 14. https://doi.org/10.1186/s40814-019-0397-6
  • Hilari, K., Byng, S., Lamping, D. L., & Smith, S. C. (2003). Stroke and Aphasia Quality of Life Scale-39 (SAQOL-39): Evaluation of acceptability, reliability, and validity. Stroke, 34(8), 1944–1950. https://doi.org/10.1161/01.STR.0000081987.46660.ED
  • Hilari, K., Lamping, D. L., Smith, S. C., Northcott, S., Lamb, A., & Marshall, J. (2009). Psychometric properties of the Stroke and Aphasia Quality of Life Scale (SAQOL-39) in a generic stroke population. Clinical Rehabilitation, 23(6), 544–557. https://doi.org/10.1177/0269215508101729
  • Hillis, A. E., Ulatowski, J. A., Barker, P. B., Torbey, M., Ziai, W., Beauchamp, N. J., Oh, S., & Wityk, R. J. (2003). A pilot randomized trial of induced blood pressure elevation: Effects on function and focal perfusion in acute and subacute stroke. Cerebrovascular Diseases, 16(3), 236–246. https://doi.org/10.1159/000071122
  • Hillis, A. E. (2007). Magnetic resonance perfusion imaging in the study of language. Brain and Language, 102(2), 165–175. https://doi.org/10.1016/j.bandl.2006.04.016
  • Hinckley, J. J. (2002). Vocational and social outcomes of adults with chronic aphasia. Journal of Communication Disorders, 35(6), 543–560. https://doi.org/10.1016/s0021-9924(02)00119-3
  • Hinckley, J. J., Boyle, E., Lombard, D., & Bartels-Tobin, L. (2014). Towards a consumer-informed research agenda for aphasia: Preliminary work. Disability and Rehabilitation, 36(12), 1042–1050. https://doi.org/10.3109/09638288.2013.829528
  • Hinckley, J. J. (1998). Investigating the predictors of lifestyle satisfaction among younger adults with chronic aphasia. Aphasiology, 12(7–8), 509–518. https://doi.org/10.1080/02687039808249554
  • Holland, A. L., Wozniak, L., & Fromm, D. (2018). CADL-3: Communication activities of daily living. Pro- Ed.
  • Hula, W. D., Donovan, N. J., Kendall, D. L., & Gonzalez-Rothi, L. J. (2010). Item response theory analysis of the Western Aphasia Battery. Aphasiology, 24(11), 1326–1341. https://doi.org/10.1080/02687030903422502
  • Hula, W. D., Doyle, P. J., Stone, C. A., Austermann Hula, S. N., Kellough, S., Wambaugh, J. L., Ross, K. B., Schumacher, J. G., & St Jacque, A. (2015). The Aphasia Communication Outcome Measure (ACOM): Dimensionality, item bank calibration, and initial validation. Journal of Speech, Language, and Hearing Research, 58(3), 906–919. https://doi.org/10.1044/2015_JSLHR-L-14-0235
  • Intercollegiate Stroke Working Group Party. (2016). National [UK] clinical guideline for stroke (5 ed.). Royal College of Physicians.
  • Isaacs, M., Ali, M., Brady, M. C., & Wallace, S. J. (2021). Establishing standards for reporting participant characteristics in post-stroke aphasia research: An international e-Delphi exercise and consensus meeting [Manuscript in preparation]. School of Health and Rehabilitation Sciences, The University of Queensland.
  • Janssen, M. F., Pickard, A. S., Golicki, D., Gudex, C., Niewada, M., Scalone, L., Swinburn, P., & Busschbach, J. (2013). Measurement properties of the EQ-5D-5L compared to the EQ-5D-3L across eight patient groups: A multi-country study. Quality of Life Research, 22(7), 1717–1727. https://doi.org/10.1007/s11136-012-0322-4
  • Johnson, B. T., & Huedo-Medina, T. B. (2013). Meta-analytic statistical inferences for continuous measure outcomes as a function of effect size metric and other assumptions. www.effectivehealthcare.ahrq.gov/reports/final.cfm
  • Johnson, L., Basilakos, A., Yourganov, G., Cai, B., Bonilha, L., Rorden, C., & Fridriksson, J. (2019). Progression of aphasia severity in the chronic stages of stroke. American Journal of Speech-Language Pathology, 28(2), 639–649. https://doi.org/10.1044/2018_AJSLP-18-0123
  • Kaplan, E. F., Goodglas, H., & Weinstraub, S. (2002). The Boston Naming Test (2 ed.). Lea Febiger.
  • Katz, R. C., & Wertz, R. T. (1997). The efficacy of computer-provided reading treatment for chronic aphasic adults. Journal of Speech, Language, and Hearing Research, 40(3), 493–507. https://doi.org/10.1044/jslhr.4003.493
  • Kelley, K. (2007). Confidence intervals for standardized effect sizes: Theory, application, and implementation. Journal of Statistical Software, 20(8), 1–24. https://doi.org/10.18637/jss.v020.i08
  • Kempler, D., & Goral, M. (2011). A comparison of drill-and communication-based treatment for aphasia. Aphasiology, 25(11), 1327–1346. https://doi.org/10.1080/02687038.2011.599364
  • Kertesz, A. (2007). The Western Aphasia Battery-revised. Grune & Stratton.
  • Kissela, B. M., Khoury, J. C., Alwell, K., Moomaw, C. J., Woo, D., Adeoye, O., Flaherty, M. L., Khatri, P., Ferioli, S., De Los Rios La Rosa, F., Broderick, J. P., & Kleindorfer, D. O. (2012). Age at stroke: Temporal trends in stroke incidence in a large, biracial population. Neurology, 79(17), 1781–1787. https://doi.org/10.1212/WNL.0b013e318270401d
  • Kleindorfer, D. O., Towfighi, A., Chaturvedi, S., Cockroft, K. M., Gutierrez, J., Lombardi-Hill, D., Kamel, H., Kernan, W. N., Kittner, S. J., Leira, E. C., Lennon, O., Meschia, J. F., Nguyen, T. N., Pollak, P. M., Santangeli, P., Sharrief, A. Z., Smith, S. C., Jr., Turan, T. N., & Williams, L. S. (2021). 2021 guideline for the prevention of stroke in patients with stroke and transient ischemic attack: A Guideline from the American Heart Association/American Stroke Association. Stroke, 52(7), e364–e467. https://doi.org/10.1161/STR.0000000000000375
  • Kwakkel, G., Lannin, N. A., Borschmann, K., English, C., Ali, M., Churilov, L., Saposnik, G., Winstein, C., van Wegen, E. E. H., Wolf, S. L., Krakauer, J. W., & Bernhardt, J. (2017). Standardized measurement of sensorimotor recovery in stroke trials: Consensus-based core recommendations from the stroke recovery and rehabilitation roundtable. Neurorehabilitation and Neural Repair, 31(9), 784–792. https://doi.org/10.1177/1545968317732662
  • Latimer, N. R., Bhadhuri, A., Alshreef, A. O., Palmer, R., Cross, E., Dimairo, M., Julious, S., Cooper, C., Enderby, P., Brady, M. C., Bowen, A., Bradley, E., & Harrison, M. (2021). Self-managed, computerised word finding therapy as an add-on to usual care for chronic aphasia post- stroke: An economic evaluation. Clin Rehabil 35(5): 703–717. https://doi.org/10.1177/0269215520975348
  • Lazar, R. M., & Antoniello, D. (2008). Variability in recovery from aphasia. Current Neurology and Neuroscience Reports, 8(6), 497–502. https://doi.org/10.1007/s11910-008-0079-x
  • Lazar, R. M., & Boehme, A. K. (2017). Aphasia As a Predictor of Stroke Outcome. Current Neurology and Neuroscience Reports, 17(11), 83. https://doi.org/10.1007/s11910-017-0797-z
  • Lenhard, W., & Lenhard, A. (2016). Calculation of effect sizes (Psychometrica). https://www.psychometrica.de/effect_size.html
  • Lomas, J., Pickard, L., Bester, S., Elbard, H., Finlayson, A., & Zoghaib, C. (1989). The communicative effectiveness index: Development and psychometric evaluation of a functional communication measure for adult aphasia. Journal of Speech and Hearing Disorders, 54(1), 113–124. https://doi.org/10.1044/jshd.5401.113
  • Long, A., Hesketh, A., Paszek, G., Booth, M., & Bowen, A. (2008). Development of a reliable self- report outcome measure for pragmatic trials of communication therapy following stroke: The Communication Outcome after Stroke (COAST) scale. Clinical Rehabilitation, 22(12), 1083–1094. https://doi.org/10.1177/0269215508090091
  • Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley.
  • Magnusson, K . (2020). Interpreting Cohen’s deffect size. An interactive visualization (Version 2.5.1) [Web App]. R Psychologist. https://rpsychologist.com/d3/cohend/
  • Maher, L. M., Kendall, D., Swearengin, J. A., Rodriguez, A., Leon, S. A., Pingel, K., Holland, A., & Rothi, L. J. (2006). A pilot study of use-dependent learning in the context of Constraint Induced Language Therapy. Journal of the International Neuropsychological Society, 12(6), 843–852. https://doi.org/10.1017/S1355617706061029
  • Mahoney, F. I., & Barthel, D. W. (1965). Functional evaluation: The Barthel index. Md State Med J, 14, 61–65.
  • Marshall, J., Devane, N., Talbot, R., Caute, A., Cruice, M., Hilari, K., MacKenzie, G., Maguire, K., Patel, A., Roper, A., & Wilson, S. (2020). A randomised trial of social support group intervention for people with aphasia: A Novel application of virtual reality. PLoS One, 15(9), e0239715. https://doi.org/10.1371/journal.pone.0239715
  • McGill, K., Sackley, C., Godwin, J., McGarry, J., & Brady, M. C. (2021). Using the Barthel Index and modified Rankin Scale as outcome measures for stroke rehabilitation trials; A Comparison of minimum sample size requirements. Journal of Stroke and Cerebrovascular Diseases, 31(2) 106229. doi:10.1016/j.jstrokecerebrovasdis.2021.106229.
  • McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. https://doi.org/10.1037/1082-989X.1.1.30
  • McManus, I. C. (2012). The misinterpretation of the standard error of measurement in medical education: A primer on the problems, pitfalls and peculiarities of the three different standard errors of measurement. Medical Teacher, 34(7), 569–576. https://doi.org/10.3109/0142159X.2012.670318
  • Meier, E. L., Johnson, J. P., Villard, S., & Kiran, S. (2017). Does naming therapy make ordering in a restaurant easier? Dynamics of co-occurring change in cognitive-linguistic and functional communication skills in aphasia. American Journal of Speech-Language Pathology, 26(2), 266–280. https://doi.org/10.1044/2016_AJSLP-16-0028
  • Menahemi-Falkov, M., Breitenstein, C., Pierce, J. E., Hill, A. J., O’Halloran, R., & Rose, M. L. (2021). A systematic review of maintenance following intensive therapy programs in chronic post-stroke aphasia: Importance of individual response analysis. Disability and Rehabilitation, 1–16. https://doi.org/10.1080/09638288.2021.1955303
  • Middel, B., & van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: Some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care, 2(4), e15. https://doi.org/10.5334/ijic.65
  • Mitchell, C., Gittins, M., Tyson, S., Vail, A., Conroy, P., Paley, L., & Bowen, A. (2021). Prevalence of aphasia and dysarthria among inpatient stroke survivors: Describing the population, therapy provision and outcomes on discharge. Aphasiology, 35(7), 950–960. https://doi.org/10.1080/02687038.2020.1759772
  • Mokkink, L. B., Boers, M., van der Vleuten, C. P. M., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2020). COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: A Delphi study. BMC Medical Research Methodology, 20(1), 293. https://doi.org/10.1186/s12874-020-01179-5
  • Mokkink, L. B., Boers, M., van der Vleuten, C., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Terwee, C. B. (2020). COSMIN Risk of Bias tool to assess the quality of studies on reliability and measurement error of outcome measurement instrument. User manual. BMC Medical Research Methodology, 20(1), 293. https://www.cosmin.nl/wp-content/uploads/user-manual-COSMIN-Risk-of-Bias-tool_v4_JAN_final.pdf
  • Mokkink, L. B., Prinsen, C. A., Bouter, L. M., Vet, H. C., & Terwee, C. B. (2016). The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument. Brazilian Journal of Physical Therapy, 20(2), 105–113. https://doi.org/10.1590/bjpt-rbf.2014.0143
  • Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. (2010). The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research, 19(4), 539–549. https://doi.org/10.1007/s11136-010-9606-8
  • Mozeiko, J., Myers, E. B., & Coelho, C. A. (2018). Treatment response to a double administration of constraint-induced language therapy in chronic aphasia. Journal of Speech, Language, and Hearing Research, 61(7), 1664–1690. https://doi.org/10.1044/2018_JSLHR-L-16-0102
  • National Institute for Health and Care Excellence, N. I. C. E. (2019). NICEimpact stroke. https://www.nice.org.uk/Media/Default/About/what-we-do/Into-practice/measuring-uptake/NICE-Impact-stroke.pdf
  • Northcott, S., Simpson, A., Thomas, S. A., Hirani, S. P., Flood, C., & Hilari, K. (2019). Solution Focused brief therapy In post-stroke Aphasia (Sofia Trial): Protocol for a feasibility randomised controlled trial. AMRC Open Research, 1:11. https://doi.org/10.12688/amrcopenres.12873.2
  • Olesen, J., Gustavsson, A., Svensson, M., Wittchen, H. U., & Jonsson, B., & group, C. s., & European Brain, C. (2012). The economic cost of brain disorders in Europe. European Journal of Neurology, 19(1), 155–162. https://doi.org/10.1111/j.1468-1331.2011.03590.x
  • Ottenbacher, K. J., Hsu, Y., Granger, C. V., & Fiedler, R. C. (1996). The reliability of the functional Independence measure: A quantitative review. Archives of Physical Medicine and Rehabilitation, 77(12), 1226–1232. https://doi.org/10.1016/s0003-9993(96)90184-7
  • Padilla, M. (2019). A primer on reliability via coefficient alpha and omega. Archives of Psychology, 3(8), 1–15. https://doi.org/10.31296/aop.v3i8.125
  • Palmer, R., Dimairo, M., Cooper, C., Enderby, P., Brady, M., Bowen, A., Latimer, N., Julious, S., Cross, E., Alshreef, A., Harrison, M., Bradley, E., Witts, H., & Chater, T. (2019). Self-managed, computerised speech and language therapy for patients with chronic aphasia post-stroke compared with usual care or attention control (Big CACTUS): A multicentre, single-blinded, randomised controlled trial. The Lancet Neurology, 18(9), 821–833. https://doi.org/10.1016/S1474-4422(19)30192-9
  • Parr, S., Byng, S., Gilpin, S., & Ireland, C. (1997). Talking about aphasia: Living with loss of language after stroke. Open University Press.
  • Peach, R. K., Beck, K. M., Gorman, M., & Fisher, C. (2019). Clinical outcomes following language- specific attention treatment versus direct attention training for aphasia: A comparative effectiveness study. Journal of Speech, Language, and Hearing Research, 62(8), 2785–2811. https://doi.org/10.1044/2019_JSLHR-L-18-0504
  • Pedersen, P. M., Jorgensen, H. S., Nakayama, H., Raaschou, H. O., & Olsen, T. S. (1995). Aphasia in acute stroke: Incidence, determinants, and recovery. Annals of Neurology, 38 (4), 659–666. . https://doi.org/10.1002/ana.410380416
  • Persad, C., Wozniak, L., & Kostopoulos, E. (2013). Retrospective analysis of outcomes from two intensive comprehensive aphasia programs. Topics in Stroke Rehabilitation, 20 (5), 388–397. . https://doi.org/10.1310/tsr2005-388
  • Rabin, R., & de Charro, F .(2001). EQ-5D: A measure of health status from the EuroQol Group. Annals of Medicine, 33(5), 337–343. https://doi.org/10.3109/07853890109002087
  • Raftery, J., Young, A., Stanton, L., Milne, R., Cook, A., Turner, D., & Davidson, P. (2015). Clinical trial metadata: Defining and extracting metadata on the design, conduct, results and costs of 125 randomised clinical trials funded by the National Institute for Health Research Health Technology Assessment programme. Health Technology Assessment, 19(11), 1–138. https://doi.org/10.3310/hta19110
  • Rai, S. K., Yazdany, J., Fortin, P. R., & Avina-Zubieta, J. A. (2015). Approaches for estimating minimal clinically important differences in systemic lupus erythematosus. Arthritis Research & Therapy, 17(1), 143. https://doi.org/10.1186/s13075-015-0658-6
  • Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015). Cost-effectiveness analysis alongside clinical trials II-An ISPOR good research practices task force report. Value Health, 18(2), 161–172. https://doi.org/10.1016/j.jval.2015.02.001
  • Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109. https://doi.org/10.1016/j.jclinepi.2007.03.012
  • Rochmah, T. N., Rahmawati, I. T., Dahlui, M., Budiarto, W., & Bilqis, N. (2021). Economic burden of stroke disease: A systematic review. International Journal of Environmental Research and Public Health, 18(14), 7552. https://doi.org/10.3390/ijerph18147552
  • Rose, M. L., Copland, D., Nickels, L., Togher, L., Meinzer, M., Rai, T., Cadilhac, D. A., Kim, J., Foster, A., Carragher, M., Hurley, M., & Godecke, E. (2019). Constraint-induced or multi-modal personalized aphasia rehabilitation (COMPARE): A randomized controlled trial for stroke- related chronic aphasia. International Journal of Stroke, 14(9), 972–976. https://doi.org/10.1177/1747493019870401
  • Rose, M. L., Rai, T., Copland, D., Nickels, L., Togher, L., Meinzer, M., Godecke, E., Kim, J., Cadilhac, D. A., Hurley, M., Wilcox, C., & Carragher, M. (2021). Statistical analysis plan for the COMPARE trial: A 3-arm randomised controlled trial comparing the effectiveness of Constraint-induced Aphasia Therapy Plus and Multi-modality Aphasia Therapy to usual care in chronic post- stroke aphasia (COMPARE). Trials, 22(1), 303. https://doi.org/10.1186/s13063-021-05238-0
  • Rousson, V. (2011). Assessing inter-rater reliability when the raters are fixed: Two concepts and two estimates. Biometrical Journal, 53(3), 477–490. https://doi.org/10.1002/bimj.201000066
  • Sachs, A., Rising, K., & Beeson, P. M. (2020). A retrospective study of long-term improvement on the Boston Naming Test. American Journal of Speech-Language Pathology, 29(1S), 425–436. https://doi.org/10.1044/2019_AJSLP-CAC48-18-0224
  • Sanderson, T., Hewlett, S., Calnan, M., Morris, M., Raza, K., & Kumar, K. (2012). Exploring the cultural validity of rheumatology outcomes. British Journal of Nursing, 21(17), 1015–1020, 1522–1523. https://doi.org/10.12968/bjon.2012.21.17.1015
  • Shewan, C. M., & Kertesz, A. (1980). Reliability and validity characteristics of the Western Aphasia Battery (WAB). Journal of Speech and Hearing Disorders, 45(3), 308–324. https://doi.org/10.1044/jshd.4503.308
  • Smania, N., Gandolfi, M., Aglioti, S. M., Girardi, P., Fiaschi, A., & Girardi, F. (2010). How long is the recovery of global aphasia? Twenty-five years of follow-up in a patient with left hemisphere stroke. Neurorehabilitation and Neural Repair, 24(9), 871–875. https://doi.org/10.1177/1545968310368962
  • Stahl, B., Darkow, R., Von Podewils, V., Meinzer, M., Grittner, U., Reinhold, T., Grewe, T., Breitenstein, C., & Floel, A. (2019). Transcranial direct current stimulation to enhance training effectiveness in chronic post-stroke aphasia: A randomized controlled trial protocol. Frontiers in Neurology, 10, 1089. https://doi.org/10.3389/fneur.2019.01089
  • Stroke Association U.K. (2021). Shaping stroke research to rebuild lives: The stroke priority setting partnership results for investment. https://www.stroke.org.uk/sites/default/files/research/stroke_priority_setting_partnership_full_report.pdf
  • Tarrant, M., Carter, M., Dean, S. G., Taylor, R. S., Warren, F. C., Spencer, A., Adamson, J., Landa, P., Code, C., & Calitri, R. (2018). Singing for people with aphasia (SPA): A protocol for a pilot randomised controlled trial of a group singing intervention to improve well-being. BMJ Open, 8(9), e025167. https://doi.org/10.1136/bmjopen-2018-025167
  • Terluin, B., Eekhout, I., Terwee, C. B., & de Vet, H. C. (2015). Minimal important change (MIC) based on a predictive modeling approach was more precise than MIC based on ROC analysis. Journal of Clinical Epidemiology, 68(12), 1388–1396. https://doi.org/10.1016/j.jclinepi.2015.03.015
  • Terry, L., & Kelley, K. (2012). Sample size planning for composite reliability coefficients: Accuracy in parameter estimation via narrow confidence intervals. British Journal of Mathematical and Statistical Psychology, 65(3), 371–401. https://doi.org/10.1111/j.2044-8317.2011.02030.x
  • Terwee, C. B., Peipert, J. D., Chapman, R., Lai, J. S., Terluin, B., Cella, D., Griffith, P., & Mokkink, L. B. (2021). Minimal important change (MIC): A conceptual clarification and systematic review of MIC estimates of PROMIS measures. Qual Life Res, 30(10), 2729–2754. https://doi.org/10.1007/s11136-021-02925-y
  • van Bloemendaal, M., van de Water, A. T., & van de Port, I. G. (2012). Walking tests for stroke survivors: A systematic review of their measurement properties. Disability and Rehabilitation, 34(26), 2207–2221. https://doi.org/10.3109/09638288.2012.680649
  • van der Gaag, A., & Brooks, R. (2008). Economic aspects of a therapy and support service for people with long-term stroke and aphasia. International Journal of Language & Communication Disorders, 43(3), 233–244. https://doi.org/10.1080/13682820701560376
  • van der Meulen, I., van de Sandt-koenderman, M. W. M. E., Duivenvoorden, H. J., & Ribbers, G. M. (2010). Measuring verbal and non-verbal communication in aphasia: Reliability, validity, and sensitivity to change of the Scenario Test. International Journal of Language & Communication Disorders, 45(4), 424–435. https://doi.org/10.3109/13682820903111952
  • Wallace, S. J., Worrall, L., Le Dorze, G., Brandenburg, C., Foulkes, J., & Rose, T. A. (2020). Many ways of measuring: A scoping review of measurement instruments for use with people with aphasia. Aphasiology, https://doi.org/10.1080/02687038.2020.1836318
  • Wallace, S. J., Worrall, L., Rose, T., Alyahya, R. S. W., Babbitt, E., Beeke, S., de Beer, C., Bose, A., Bowen, A., Brady, M., Breitenstein, C., Bruehl, S., Bryant, L., Cherney, L., Conroy, P., Copland, D., Croteau, C., Cruice, M., Dipper, L., … Le Dorze, G. (2021). Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting [Manuscript in preparation]. School of Health and Rehabilitation Sciences, The University of Queensland.
  • Wallace, S. J., Worrall, L., Rose, T., Le Dorze, G., Breitenstein, C., Hilari, K., Babbitt, E., Bose, A., Brady, M., Cherney, L. R., Copland, D., Cruice, M., Enderby, P., Hersh, D., Howe, T., Kelly, H., Kiran, S., Laska, A. C., Marshall, J., … Webster, J. (2019). A core outcome set for aphasia treatment research: The ROMA consensus statement. Int J Stroke 14(2): 180–185. https://doi.org/10.1177/1747493018806200
  • Wallace, S. J., Worrall, L., Rose, T., Le Dorze, G., Cruice, M., Isaksen, J., Kong, A. P. H., Simmons- Mackie, N., Scarinci, N., & Gauvreau, C. A. (2017b). Which outcomes are most important to people with aphasia and their families? An international nominal group technique study framed within the ICF. Disability and Rehabilitation, 39(14), 1364–1379. https://doi.org/10.1080/09638288.2016.1194899
  • Wallace, S. J., Worrall, L., Rose, T., & Le Dorze, G. (2016). Core outcomes in aphasia treatment research: An e-Delphi consensus study of international aphasia researchers. American Journal of Speech-Language Pathology, 25(4S), S729–S742. https://doi.org/10.1044/2016_AJSLP-15-0150
  • Wallace, S. J., Worrall, L., Rose, T., & Le Dorze, G. (2017a). Which treatment outcomes are most important to aphasia clinicians and managers? An international e-Delphi consensus study. Aphasiology, 31(6), 643–673. https://doi.org/10.1080/02687038.2016.1186265
  • Wallace, S. J., Worrall, L., Rose, T., & Le Dorze, G. (2019). Using the International Classification of Functioning, Disability, and Health to identify outcome domains for a core outcome set for aphasia: A comparison of stakeholder perspectives. Disability and Rehabilitation, 41(5), 564–573. https://doi.org/10.1080/09638288.2017.1400593
  • Ware, J. E., Jr. (1992). Measures for a new era of health assessments. In A. L. Stewart & J. E. Ware (Eds.), Measuring functioning and well-being: The medical outcomes study approach (pp. 3–11). Duke University Press.
  • Wenke, R., Cardell, E., Lawrie, M., & Gunning, D. (2018). Communication and well-being outcomes of a hybrid service delivery model of intensive impairment-based treatment for aphasia in the hospital setting: A pilot study. Disability and Rehabilitation, 40(13), 1532–1541. https://doi.org/10.1080/09638288.2017.1300949
  • Whitehurst, D. G. T., Latimer, N. R., Kagan, A., Palmer, R., Simmons-Mackie, N., Victor, J. C., & Hoch, J. S. (2018). Developing accessible, pictorial versions of health-related quality-of-life instruments suitable for economic evaluation: A report of preliminary studies conducted in Canada and the United Kingdom. PharmacoEconomics - Open, 2(3), 225–231. https://doi.org/10.1007/s41669-018-0083-2
  • Wiley, R. W., & Rapp, B. (2019). Statistical analysis in Small-N Designs: Using linear mixed-effects modeling for evaluating intervention effectiveness. Aphasiology, 33(1), 1–30. https://doi.org/10.1080/02687038.2018.1454884
  • Willmes, K. (1985). An approach to analyzing a single subject’s scores obtained in a standardized test with application to the Aachen Aphasia Test (AAT). Journal of Clinical and Experimental Neuropsychology, 7(4), 331–352. https://doi.org/10.1080/01688638508401268
  • Winstein, C. J., Stein, J., Arena, R., Bates, B., Cherney, L. R., Cramer, S. C., Deruyter, F., Eng, J. J., Fisher, B., Harvey, R. L., Lang, C. E., MacKay-Lyons, M., Ottenbacher, K. J., Pugh, S., Reeves, M. J., Richards, L. G., Stiers, W., & Zorowitz, R. D., & American Heart Association Stroke Council, C. o. C., Stroke Nursing, C. o. C. C., Council on Quality of, C., & Outcomes, R. (2016). Guidelines for adult stroke rehabilitation and recovery: A Guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke, 47(6), e98–e169 doi: 10.1161/STR.0000000000000098.
  • World Health Organisation/WHO (2001). International classification of functioning, disability and health. https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health
  • Worrall, L., & Yiu, E. (2000). Effectiveness of functional communication therapy by volunteers for people with aphasia following stroke. Aphasiology, 14(9), 911–924. https://doi.org/10.1080/02687030050127711
  • Zeppieri, G., Jr., & George, S. Z. (2017). Patient-defined desired outcome, success criteria, and expectation in outpatient physical therapy: A longitudinal assessment. Health and Quality of Life Outcomes, 15(29), 1–10. https://doi.org/10.1186/s12955-017-0604-1

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.