Reliability of an Adapted Version of the Modified Six Elements Test as a Measure of Executive Function

REFERENCES

• Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the Multiple Errands Shopping Test. Journal of the International Neuropsychological Society, 9, 31–44. doi:10.10170S1355617703910046
   PubMed Web of Science ®Google Scholar
• Atkinson, G., & Nevill, A. M. (1998). Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Medicine, 26, 217–238.
   PubMed Web of Science ®Google Scholar
• Beckerman, H., Roebroeck, M. E., Lankhorst, G. J., Becher, J. G., Bezemer, P. D., & Verbeek, A. L. (2001). Smallest real difference, a link between reproducibility and responsiveness. Quality of Life Research, 10, 571–578.
   PubMed Web of Science ®Google Scholar
• Bennett, P. C., Ong, B., & Ponsford, J. (2005). Assessment of executive dysfunction following traumatic brain injury: Comparison of the BADS with other clinical neuropsychological measures. Journal of the International Neuropsychological Society, 11, 606–613. doi:10.1017/S1355617705050721
   PubMed Web of Science ®Google Scholar
• Bertens, D., Frankenmolen, N., Boelen, D. H. E., Kessels, R. P. C., & Fasotti, L. (2015). Validity of an adapted scoring method for a Modified Six Elements Test in individuals with brain injury. Archives of Clinical Neuropsychology, 30, 122–129.
   Google Scholar
• Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 1, 307–310. doi:10.1016/S0140–6736(86)90837–8
   PubMed Web of Science ®Google Scholar
• Bogod, N. M., Mateer, C. A., & MacDonald, S. W. (2003). Self-awareness after traumatic brain injury: A comparison of measures and their relationship to executive functions. Journal of the International Neuropsychological Society, 9, 450–458. doi:10.1017/S1355617703930104
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., Alderman, N., Evans, J., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547–558. doi:10.1017/S1355617798466037
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L. M., Dawson, D. R., … Channon, S. (2006). The case for the development and use of ‘ecologically valid’ measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society, 12, 194–209. doi:10.10170S1355617706060310
   PubMed Web of Science ®Google Scholar
• Calamia, M., Markon, K., & Tranel, D. (2013). The robust reliability of neuropsychological measures: Meta-analyses of test–retest correlations. The Clinical Neuropsychologist, 27, 1077–1105. doi:10.1080/13854046.2013.809795
   PubMed Web of Science ®Google Scholar
• Chan, D. (2009). So why ask me? Are self-report data really that bad?. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 309–335). New York, NY: Routledge.
   Google Scholar
• Chan, R. C., Chen, E. Y., Cheung, E. F., & Cheung, H. K. (2004). Executive dysfunctions in schizophrenia. Relationships to clinical manifestation. European Archives of Psychiatry and Clinical Neuroscience, 254, 256–262. doi:10.1007/s00406–004-0492–3
   PubMed Web of Science ®Google Scholar
• Chan, R. C., & Manly, T. (2002). The application of ‘dysexecutive syndrome’ measures across cultures: Performance and checklist assessment in neurologically healthy and traumatically brain-injured Hong Kong Chinese volunteers. Journal of the International Neuropsychological Society, 8, 771–780. doi:10.1017/S1355617702860052
   PubMed Web of Science ®Google Scholar
• Delis, D. C., Kramer, J. H., Kaplan, E., & Holdnack, J. (2004). Reliability and validity of the Delis-Kaplan Executive Function System: An update. Journal of the International Neuropsychological Society, 10, 301–303. doi:10.1017/S1355617704102191
   PubMed Web of Science ®Google Scholar
• Emmanouel, A., Kessels, R. P., Mouza, E., & Fasotti, L. (2014). Sensitivity, specificity and predictive value of the BADS to anterior executive dysfunction. Neuropsychological Rehabilitation, 24, 1–25. doi:10.1080/09602011.2013.863731
   PubMed Web of Science ®Google Scholar
• Emslie, H., Wilson, F. C., Burden, V., Nimmo-Smith, I., & Wilson, B. A. (2003). Behavioural Assessment of the Dysexecutive Syndrome in Children (BADS-C). London, England: Harcourt Assessment/ Psychological Corporation.
   Google Scholar
• Espinosa, A., Alegret, M., Boada, M., Vinyes, G., Valero, S., Martinez-Lage, P. & Tarraga, L. (2009). Ecological assessment of executive functions in mild cognitive impairment and mild Alzheimer’s disease. Journal of the International Neuropsychological Society, 15, 751–757. doi:10.1017/S135561770999035X
   PubMed Web of Science ®Google Scholar
• Fernandez-Serrano, M. J., Perez-Garcia, M., Schmidt Rio-Valle, J., & Verdejo-Garcia, A. (2010). Neuropsychological consequences of alcohol and drug abuse on different components of executive functions. Journal of Psychopharmacology, 24, 1317–1332. doi:10.1177/0269881109349841
   PubMed Web of Science ®Google Scholar
• Flansbjer, U. B., Holmback, A. M., Downham, D., Patten, C., & Lexell, J. (2005). Reliability of gait performance tests in men and women with hemiparesis after stroke. Journal of Rehabilitation Medicine, 37, 75–82. doi:10.1080/16501970410017215
   PubMed Web of Science ®Google Scholar
• Fleiss, J. L. (1986). The design and analysis of clinical experiments. New York, NY: John Wiley & Sons.
   Google Scholar
• Gervais, R. O., Ben-Porath, Y. S., & Wygant, D. B. (2009). Empirical correlates and interpretation of the MMPI-2-RF Cognitive Complaints (COG) Scale. Clinical Neuropsychology, 23, 996–1015. doi:10.1080/13854040902748249.
   PubMed Web of Science ®Google Scholar
• Goel, V., Grafman, J., Tajik, J., Gana, S., & Danto, D. (1997). A study of the performance of patients with frontal lesions in a financial planning task. Brain, 120, 1805–1822.
   PubMed Web of Science ®Google Scholar
• Gouveia, P. A., Brucki, S. M., Malheiros, S. M., & Bueno, O. F. (2007). Disorders in planning and strategy application in frontal lobe lesion patients. Brain and Cognition, 63, 240–246. doi:10.1016/j.bandc.2006.09.001
   PubMed Web of Science ®Google Scholar
• Janssen, G. (2014). Diagnostic assessment of psychiatric patients: A contextual perspective on executive functioning (Unpublished doctoral dissertation). Radboud University, Nijmegen, The Netherlands.
   Google Scholar
• Janssen, G., De Mey, H. R. A., & Egger, J. I. M. (2009). Executive functioning in college students: Evaluation of the Dutch Executive Function Index (EFI-NL). International Journal of Neuroscience, 119, 792–805.
   PubMed Web of Science ®Google Scholar
• Jelicic, M., Henquet, C. E., Derix, M. M., & Jolles, J. (2001). Test–retest stability of the Behavioural Assessment of the Dysexecutive Syndrome in a sample of psychiatric patients. International Journal of Neuroscience, 110, 73–78.
   PubMed Web of Science ®Google Scholar
• Kaufman, A. S., & Kaufman, N. L. (1993). Manual for the Kaufman Adolescent and Adult Intelligence Test (KAIT). Circle Pines, MN: American Guidance Service.
   Google Scholar
• Lexell, J. E., & Downham, D. Y. (2005). How to assess the reliability of measurements in rehabilitation. American Journal of Physical Medicine and Rehabilitation, 84, 719–723. doi:10.1097/01.phm.0000176452.17771.20
   PubMed Web of Science ®Google Scholar
• Liaw, L. J., Hsieh, C. L., Lo, S. K., Chen, H. M., Lee, S., & Lin, J. H. (2008). The relative and absolute reliability of two balance performance measures in chronic stroke patients. Disability and Rehabilitation, 30, 656–661. doi:10.1080/09638280701400698
   PubMed Web of Science ®Google Scholar
• Liu, K. C., Chan, R. C., Chan, K. K., Tang, J. Y., Chiu, C. P., Lam, M. M., & Chen, E. Y. (2011). Executive function in first-episode schizophrenia: A three-year longitudinal study of an ecologically valid test. Schizophrenia Research, 126, 87–92. doi:10.1016/j.schres.2010.11.023
   PubMed Web of Science ®Google Scholar
• Lu, W. S., Chen, C. C., Huang, S. L., & Hsieh, C. L. (2012). Smallest real difference of 2 instrumental activities of daily living measures in patients with chronic stroke. Archives of Physical Medicine and Rehabilitation, 93, 1097–1100. doi:10.1016/j.apmr.2012.01.015
   PubMed Web of Science ®Google Scholar
• Manly, T., Hawkins, K., Evans, J., Woldt, K., & Robertson, I. H. (2002). Rehabilitation of executive function: Facilitation of effective goal management on complex tasks using periodic auditory alerts. Neuropsychologia, 40, 271–281. doi:10.1016/S0028–3932(01)00094-X
   PubMed Web of Science ®Google Scholar
• Norris, T., & Tate, R. L. (2000). The Behavioural Assessment of the Dysexecutive Syndrome (BADS): Ecological, concurrent and construct validity. Neuropsychological Rehabilitation, 10, 33–45. doi:10.1080/096020100389282
   Web of Science ®Google Scholar
• Pietrzak, R. H., Maruff, P., Mayes, L. C., Roman, S. A., Sosa, J. A., & Snyder, P. J. (2008). An examination of the construct validity and factor structure of the Groton Maze Learning Test, a new measure of spatial working memory, learning efficiency, and error monitoring. Archives of Clinical Neuropsychology, 23, 433–445. doi:10.1016/j.acn.2008.03.002
   PubMed Web of Science ®Google Scholar
• Rankin, G., & Stokes, M. (1998). Reliability of assessment tools in rehabilitation: An illustration of appropriate statistical analyses. Clinical Rehabilitation, 12, 187–199. doi:10.1191/026921598672178340
   PubMed Web of Science ®Google Scholar
• Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function: The Virtual Library Task. Journal of the International Neuropsychological Society, 18, 440–450. doi:10.1017/S1355617711001883
   PubMed Web of Science ®Google Scholar
• Schmand, B., Lindeboom, J., & Harskamp, F. (1992). De Nederlandse leestest voor volwassenen [The Dutch reading test for adults]. Lisse, The Netherlands: Swets & Zeitlinger.
   Google Scholar
• Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society of London B, 298, 199–209.
   PubMed Web of Science ®Google Scholar
• Shallice, T., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741.
   PubMed Web of Science ®Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428.
   PubMed Web of Science ®Google Scholar
• Smidt, N., van der Windt, D. A., Assendelft, W. J., Mourits, A. J., Deville, W. L., de Winter, A. F., & Bouter, L. M. (2002). Interobserver reproducibility of the assessment of severity of complaints, grip strength, and pressure pain threshold in patients with lateral epicondylitis. Archives of Physical Medicine and Rehabilitation, 83, 1145–1150. doi:10.1053/apmr.2002.33728
   PubMed Web of Science ®Google Scholar
• Spinella, M. (2005). Self-rated executive function: Development of the Executive Function Index. International Journal of Neuroscience, 115, 649–667. doi:10.1080/00207450590524304
   PubMed Web of Science ®Google Scholar
• van Beilen, M., Withaar, F. K., van Zomeren, E. H., van den Bosch, R. J., & Bouma, A. (2006). Deviant strategy on the Modified Six Elements Test in patients with schizophrenia. The Clinical Neuropsychologist, 20, 469–479. doi:10.1080/13854040590967126
   PubMed Web of Science ®Google Scholar
• Weir, J. P. (2005). Quantifying test–retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength & Conditioning Research, 19, 231–240. doi:10.1519/15184.1
   PubMed Web of Science ®Google Scholar
• Wilson, B. A., Alderman, N., Burgess, P. W., Emslie, H., & Evans, J. J. (1996). Behavioural Assessment of the Dysexecutive Syndrome (BADS). Bury St Edmunds, England: Thames Valley Test Company.
   Google Scholar