111
Views
0
CrossRef citations to date
0
Altmetric
Original Research

Reporting health care decision models: a prospective reliability study of a multidimensional evaluation framework

, , , , , , , & show all
Pages 619-627 | Published online: 17 Dec 2015
 

ABSTRACT

The aim of this study was to evaluate the inter-rater reliability of the Phillips-checklist, a proposed framework for the quality assessment of modeling studies. Six raters evaluated nine modeling studies from three different medical specialties. Intra-class correlation (ICC) and corresponding variance components were estimated from these studies. Raters were asked to comment on their experience with the framework. While overall the mean inter-rater reliability showed no significant rater-effect (ICC = 0.69, p = 0.064), there was – presumably as a result of a lower study variability – a significant rater effect for clopidogrel only (p < 0.001). The framework allowed a more structured methodological assessment but several items remained unclear. Regarding the quality assessment of modeling studies with the proposed framework, the rater variability is similar or even higher than variability because of studies or residual effects. Several scoring items can and should be improved to ease interpretation.

Acknowledgments

There was no funding provided for this work from any organization, company or institute. The authors have no financial interests to disclose directly or indirectly related to the research in the article.

Financial & competing interests disclosure

The authors have no relevant affiliations or financial involvement with any organization or entity with a financial interest in or financial conflict with the subject matter or materials discussed in the manuscript. This includes employment, consultancies, honoraria, stock ownership or options, expert testimony, grants or patents received or pending, or royalties.

Supplemental data

Supplemental data for this article can be accessed here.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 99.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 493.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.