The methodological quality of aphasia therapy research: An investigation of group studies using the PsycBITE^TM evidence‐based practice database

Abstract

Background: This paper examines the methodological quality of aphasia therapy research using the Psychological database for Brain Impairment Treatment Efficacy (www.psycbite.com). PsycBITE^TM includes five designs: Systematic Reviews (SR), Randomised Controlled Trials (RCT), non‐RCTs (NRCT), Case Series (CS), and Single Subject Designs (SSD).

Aim: To provide an overview of the types of research designs and levels of compliance used in aphasia treatment research studies, and assess the methodological quality of aphasia research.

Methods & Procedures: A search was completed on 27 September 2007 of all papers in the target area Communication/Language/Speech on the PsycBITE^TM database. Papers were listed according to the methodology used and a mean methodological quality rating (MQR) score was determined for RCTs, and NRCTs based on the PEDro scale. Finally, the rate of compliance of RCTs and NRCTs for each of the criteria on the PEDro scale was analysed.

Outcomes & Results: Of 339 studies indexed for aphasia: SR  =  9 (3%); RCT  =  23 (7%); NRCT  =  18 (5%); CS  =  51 (15%); and SSD  =  238 (70%). Methodological quality ratings (MQR) using the PEDro scale (scored out of 10) were available for 21 RCTs (mean MQR  =  4.4, SD  =  1.7, range  =  2–8), and 14 NRCTs (mean MQR  =  2.6, SD  =  1.0, range  =  1–4).

Conclusions: Methodological quality of current aphasia treatment studies is modest. The current examination of a small sample of RCTs and non‐RCTs indicates that sources of bias are not sufficiently well controlled. These results have implications for aphasia therapy researchers in the design and report of their work. It is hoped that access to databases such as PsycBITE^TM and rating scales such as PEDro will facilitate this process.

Keywords:

• Aphasia
• Methodological quality
• Evidence‐based practice

Notes

We would like to acknowledge the financial support from the Motor Accidents Authority of NSW, and the library resources generously provided by Royal Ryde Rehabilitation Centre Sydney.