Advanced search
Publication Cover
Disability and Rehabilitation Volume 42, 2020 - Issue 18
Submit an article Journal homepage
141
Views
1
CrossRef citations to date
0
Altmetric
Assessment Procedures

Setwise comparison: efficient fine-grained rating of movement videos using algorithmic support – a proof of concept study

Saskia SteinheimerDepartment of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, SwitzerlandView further author information
,
Jonas F. DornNovartis Pharma AG, Basel, SwitzerlandORCID Iconhttp://orcid.org/0000-0001-6696-0117View further author information
ORCID Icon,
Cecily MorrisonMicrosoft Research, Cambridge, UKORCID Iconhttp://orcid.org/0000-0001-5013-3715View further author information
ORCID Icon,
Advait SarkarMicrosoft Research, Cambridge, UKView further author information
,
Marcus D’SouzaNeurology, Departments of Medicine, Clinical Research, Biomedicine and Biomedical Engineering, University Hospital Basel, Basel, Switzerland;NeuroCure Clinical Research Center, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, BerlinGermanyView further author information
,
Jacques BoisvertNovartis Pharma AG, Basel, SwitzerlandView further author information
,
Rishi BediNovartis Pharma AG, Basel, SwitzerlandView further author information
,
Jessica BurggraaffDepartment of Neurology, Amsterdam University Medical Centers, Amsterdam, The NetherlandsView further author information
,
Peter KontschiederMicrosoft Research, Cambridge, UKView further author information
,
Frank DahlkeNovartis Pharma AG, Basel, SwitzerlandView further author information
,
Abigail SellenMicrosoft Research, Cambridge, UKORCID Iconhttp://orcid.org/0000-0001-9065-3061View further author information
ORCID Icon,
Bernard M. J. UitdehaagDepartment of Neurology, Amsterdam University Medical Centers, Amsterdam, The NetherlandsView further author information
,
Ludwig KapposNeurology, Departments of Medicine, Clinical Research, Biomedicine and Biomedical Engineering, University Hospital Basel, Basel, SwitzerlandView further author information
&
Christian P. KammDepartment of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland;Neurology and Neurorehabilitation Center, Luzerner Kantonsspital, Lucerne, SwitzerlandCorrespondence[email protected]
View further author information
 show all
Pages 2640-2646 | Received 26 Apr 2018, Accepted 22 Dec 2018, Published online: 20 Feb 2019

References

  • Kamm CP, Uitdehaag BM, Polman CH. Multiple sclerosis: current knowledge and future outlook. Eur Neurol. 2014;72:132–141.
  • Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983;33:1444–1452.
  • Hobart JC, Cano SJ, Zajicek JP, et al. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6:1094–1105.
  • Goodkin DE, Cookfair D, Wende K, et al. Inter- and intrarater scoring agreement using grades 1.0 to 3.5 of the Kurtzke Expanded Disability Status Scale (EDSS). Neurology. 1992;42:859–863.
  • Hobart J, Freeman J, Thompson A. Kurtzke scales revisited: the application of psychometric methods to clinical intuition. Brain. 2000;123:1027–1040.
  • Cohen JA, Reingold SC, Polman CH, et al. Disability outcome measures in multiple sclerosis clinical trials: current status and future prospects. Lancet Neurol. 2012;11:467–476.
  • Meyer-Moock S, Feng YS, Maeurer M, et al. Systematic literature review and validity evaluation of the Expanded Disability Status Scale (EDSS) and the Multiple Sclerosis Functional Composite (MSFC) in patients with multiple sclerosis. BMC Neurol. 2014;14:1–10.
  • Rabadi MH, Vincent AS. Comparison of the Kurtkze expanded disability status scale and the functional independence measure: measures of multiple sclerosis-related disability. Disabil Rehabil. 2013;35:1877–1884.
  • D’Souza M, Yaldizli O, Gersbach B, et al. Neurostatus e-scoring improves consistency of expanded disability status scale assessments: a proof of concept study. Mult Scler. 2017;23:597–603.
  • Miller GA. The magical number seven plus or minus two: some limits on our capacity for processing information. Psychol Rev. 1956;63:81–97.
  • Herbrich R, Minka T, Graepel T. TrueSkill™: a Bayesian skill rating system. Advances in Neural Information Processing Systems (NIPS2006); 2006.
  • Burggraaff J, Dorn JF, D’Souza M, et al. Video-based pairwise comparison: enabling the development of automated rating of motor dysfunction in multiple sclerosis, in submission.
  • Sarkar A, Morrison C, Dorn JF, et al. Setwise comparison: consistent, scalable, continuum labels for computer vision. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems; 2016 May 07–12; San Jose, CA. p.261–271.
  • Polman CH, Reingold SC, Banwell B, et al. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria (review). Ann Neurol. 2011;69:292–302.
  • Oxford Grice K, Vogel KA, Le V, et al. Adult norms for a commercially available Nine Hole Peg Test for finger dexterity. Am J Occup Ther. 2003;57:570–573.
  • Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv Psychol. 1988;52:139–183.
  • McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996;1:30–46.
  • Amato MP, Fratiglioni L, Groppi C, et al. Interrater Reliability in assessing Functional Systems and Disability on the Kurtzke Scale in Multiple Sclerosis. Arch Neurol. 1988;45:746–748.
  • Noseworthy JH, Vandervoort MK, Wong CJ, et al. Interrater variability with the Expanded Disability Status Scale (EDSS): and functional systems (FS) in a multiple sclerosis clinical trial. Neurology. 1990;40:971–975.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.