1,927
Views
5
CrossRef citations to date
0
Altmetric
CONSIDERATIONS OF HOW TO CONDUCT META-ANALYSES IN PSYCHOLOGICAL INTERVENTIONS

Cochrane’s risk of bias tool in the context of psychotherapy outcome research

&
Pages 347-355 | Received 12 Aug 2017, Accepted 15 Nov 2017, Published online: 09 Dec 2017
 

Abstract

The Cochrane risk of bias tool (RoB) is a widely used measure for methodological quality of randomized controlled trials. This paper discusses RoB’s rationale and risk of bias domains, reports on its application in current psychotherapy meta-analyses, and offers comments regarding the application of RoB in the context of psychotherapy outcome research. Our suggestions include focusing on patient’s and therapist’s expectations when judging the domain “blinding of personnel and participants” and paying greater attention to the domain “selective outcome reporting” and to matters of “treatment implementation.”

Clinical or methodological significance of this article: This paper discusses the rationale of a widely used tool to assess the methodological quality of primary studies for meta-analysis and provides suggestions for its use in the context of psychotherapy outcome research.

Resumo

A ferramenta de risco de viés da Cochrane (RV) é uma medida amplamente utilizada para a qualidade metodológica de ensaios clínicos randomizados. Este artigo discute o raciocínio da RV e os domínios de risco de viés, relata sua aplicação em metanálises de psicoterapia atuais, e oferece comentários sobre a aplicação do RV no contexto da pesquisa de resultados em psicoterapia. Nossas sugestões incluem o foco nas expectativas do paciente e do terapeuta ao julgar o domínio "cegamento da equipe e participantes" e prestar mais atenção ao domínio "relato seletivo de resultados" e às questões de " implementação de tratamento".

Significância clínica ou metodológica deste artigo: Este artigo discute a justificativa de uma ferramenta amplamente utilizada para avaliar a qualidade metodológica dos estudos primários para metanálise e fornece sugestões para seu uso no contexto da pesquisa de resultados em psicoterapia.

Zusammenfassung

Das Risk-of-Bias (RoB)-Tool der Cochrane Collaboration ist ein weit verbreitetes Messinstrument für die methodologische Qualität randomisierter kontrollierter Studien. Dieser Artikel diskutiert das Grundprinzip des RoB und Bereiche systematischer Verzerrungseffekte, berichtet über deren Anwendung in derzeitigen psychotherapeutischen Metaanalysen und bietet eine Stellungnahme bezüglich der Anwendung des RoB im Kontext der Psychotherapieergebnisforschung. Unsere Empfehlungen beinhalten, die Erwartungen von Patient und Therapeut zu fokussieren, wenn es um die Beurteilung der Domänen „Verblendung von Personal und Teilnehmern“ geht und aufmerksamer mit dem Bereich „Selektiver Ergebnisbericht“ und in Sachen „Behandlungsimplementierung“ umzugehen.

摘要

Cochrane誤差風險工具(RoB)廣泛被用來測量隨機控制試驗中的方法學品質。本 文討論RoB的理念與誤差區塊的風險,呈現在當前心理治療後設分析的應用狀況, 以及提供RoB應用在心理治療效果研究的評論。我們的建議包括,在評斷「維持人 員與參與者的盲性」區塊與更注意「選擇性效果回報」區塊與「處遇的執行」時, 應聚焦於個案與治療師的期待。

Lo strumento che rileva il rischio di errore di Cochrane (RoB) è una misura ampiamente utilizzata per la qualità metodologica di studi randomizzati controllati. In questo lavoro viene illustrato il razionale del RoB e il rischio di domini di errore, si descrive la sua applicazione nelle attuali metanalisi di psicoterapia e si presentano commenti riguardanti l'applicazione del RoB nella ricerca di esito in psicoterapia. I nostri suggerimenti includono quello di concentrarsi sulle aspettative del paziente e del terapeuta quando si giudica il dominio "a cieco del personale e partecipanti" e di prestare maggiore attenzione al dominio "riportare esiti selettivi" e alle questioni di "implementazione del trattamento".

Significato clinico o metodologico di questo articolo: Questo articolo discute il razionale di uno strumento ampiamente utilizzato per valutare la qualità metodologica degli studi primari per le meta-analisi e fornisce suggerimenti per il suo utilizzo nell'ambito delle ricerche di esito in psicoterapia.

Notes

1 Adult psychotherapy meta-analyses published during 2016 in American Journal of Psychiatry, Clinical Psychology Review, Journal of Consulting and Clinical Psychology, Psychological Medicine, Psychotherapy Research, World Psychiatry, or comparative psychotherapy meta-analyses included in Spielmans and Flückiger (Citation2018).

2 Use of RoB domains was coded independently by two researchers. Consensus was used to resolve disagreements.

3 Suggested cut-off levels for kappa are <0.40 = poor, 0.40–0.59 = fair, 0.60–0.74 = good, and 0.75–1.00 = excellent (Fleiss, Levin, & Paik, Citation2013).

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.