It’s about time: The role of temporal variability in improving assessment of executive functioning

References

• Aminikhanghahi, S., Schmitter-Edgecombe, M., & Cook, D. J. (2019). Context-aware delivery of ecological momentary assessment. IEEE Journal of Biomedical and Health Informatics, 1. doi:10.1109/JBHI.2019.2937116.
   Web of Science ®Google Scholar
• Banich, M. T. (2009). Executive functioning: The search for an integrated account. Current Directions in Psychological Science, 3(1), 41–44. doi:10.3905/jpm.1976.408586.
   Google Scholar
• Barkley, R. (2001). The executive functions and self-regulation; an evolutionary neuropychological perspective. Neuropsychology Review, 11(1), 1–29.
   PubMed Web of Science ®Google Scholar
• Barrett, M. A., Humblet, O., Hiatt, R. A., & Adler, N. E. (2013). Big data and disease prevention: From quantified self to quantified communities. Big Data, 1(3), 168–175. doi:10.1089/big.2013.0027
   PubMed Web of Science ®Google Scholar
• Bay, E., Sikorskii, A., & Gao, F. (2008). Functional status, chronic stress, and cortisol response after mild-to-moderate traumatic brain injury. Biological Research for Nursing 10, 213–225.
   PubMed Web of Science ®Google Scholar
• Beglinger, L., Gaydos, B., Tangphaodaniels, O., Duff, K., Kareken, D., Crawford, J., … Siemers, E. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. doi:10.1016/j.acn.2004.12.003
   PubMed Web of Science ®Google Scholar
• Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. A. (2010a). Intraindividual variability in reaction time predicts cognitive outcomes 5 years later. Neuropsychology, 24(6), 731–741. doi:10.1037/a0019802
   PubMed Web of Science ®Google Scholar
• Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. A. (2010b). Intraindividual variability is related to cognitive change in older adults: Evidence for within-person coupling. Psychology and Aging, 25(3), 575–586. doi:10.1037/a0019503
   PubMed Web of Science ®Google Scholar
• Bilder, R. M., & Reise, S. P. (2019). Neuropsychological tests of the future: How do we get there from here? The Clinical Neuropsychologist, 33(2), 220–245. doi:10.1080/13854046.2018.1521993
   PubMed Web of Science ®Google Scholar
• Boker, S. M., & Martin, M. (2018). A conversation between theory, methods, and data. Multivariate Behavioral Research, 53(6), 806–819. doi:10.1080/00273171.2018.1437017
   PubMed Web of Science ®Google Scholar
• Boker, S. M., Molenaar, P. C., & Nesselroade, J. R. (2009). Issues in intraindividual variability: Individual differences in equilibria and dynamics over multiple time scales. Psychology and Aging, 24(4), 858–862. doi:10.1037/a0017912
   PubMed Web of Science ®Google Scholar
• Brose, A., Schmiedek, F., Lövdén, M., & Lindenberger, U. (2012). Daily variability in working memory is coupled with negative affect: The role of attention and motivation. Emotion, 12(3), 605–617. doi:10.1037/a0024436
   PubMed Web of Science ®Google Scholar
• Burton, C. L., Hultsch, D. F., Strauss, E., Hunter, M. A., Burton, C. L., Hultsch, D. F., … Hunter, M. A. (2010). Intraindividual variability in physical and emotional functioning: Comparison of adults with traumatic brain injuries and healthy adults. The Clinical Neuropsychologist 16, 264–279. doi:10.1076/clin.16.3.264.13854
   Google Scholar
• Butner, J. (2017). Quantitative reasoning under a dynamical social science. Salt Lake City, UT. Retrieved from http://systems.psych.utah.edu/quantitative-butner.html
   Google Scholar
• Camicioli, R. M., Wieler, M., Frias, C. M., De., & Martin, W. R. W. (2008). Early, untreated Parkinson’s disease patients show reaction time variability. Neuroscience Letters, 441(1), 77–80. doi:10.1016/j.neulet.2008.06.004
   PubMed Web of Science ®Google Scholar
• Chamelian, L., & Feinstein, A. (2006). The effect of major depression on subjective and objective cognitive deficits in mild to moderate traumatic brain injury. The Journal of Neuropsychiatry and Clinical Neurosciences, 18(1), 33–38. doi:10.1176/jnp.18.1.33
   PubMed Web of Science ®Google Scholar
• Chan, R. C. K., Shum, D., Toulopoulou, T., & Chen, E. Y. H. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201–216. doi:10.1016/j.acn.2007.08.010
   PubMed Web of Science ®Google Scholar
• Costa, A. S., Dogan, I., Schulz, J. B., Reetz, K., Sofia, A., Dogan, I., … Reetz, K. (2019). Going beyond the mean: Intraindividual variability of cognitive performance in prodromal and early neurodegenerative disorders. The Clinical Neuropsychologist, 33(2), 369–389. doi:10.1080/13854046.2018.1533587
   PubMed Web of Science ®Google Scholar
• Cranford, J. A., Shrout, P. E., Iida, M., Rafaeli, E., Yip, T., & Bolger, N. (2006). A procedure for evaluating sensitivity to within-person change: Can mood measures in diary studies detect change reliably? Personality and Social Psychology Bulletin, 32(7), 917–929. doi:10.1177/0146167206287721
   PubMed Web of Science ®Google Scholar
• Davis, C. L., Tomporowski, P. D., McDowell, J. E., Austin, B. P., Miller, P. H., Yanasak, N. E., … Naglieri, J. A. (2011). Exercise improves executive function and achievement and alters brain activation in overweight children: A randomized controlled trial. Health Psychology, 30(1), 91–98. doi:10.1037/a0021766
   PubMed Web of Science ®Google Scholar
• Dawson, D. R., & Marcotte, T. D. (2017). Special issue on ecological validity and cognitive assessment. Neuropsychological Rehabilitation, 27(5), 599–602. doi:10.1080/09602011.2017.1313379
   PubMed Web of Science ®Google Scholar
• Deboeck, P. R., Montpetit, M. A., Bergeman, C. S., & Boker, S. M. (2009). Using derivative estimates to describe intraindividual variability at multiple time scales. Psychological Methods, 14(4), 367–386. doi:10.1037/a0016622
   PubMed Web of Science ®Google Scholar
• Dixon, R. A., Garrett, D. D., Lentz, T. L., MacDonald, S. W. S., Strauss, E., & Hultsch, D. F. (2007). Neurocognitive markers of cognitive impairment: Exploring the roles of speed and inconsistency. Neuropsychology, 21(3), 381–399. doi:10.1037/0894-4105.21.3.381
   PubMed Web of Science ®Google Scholar
• Doebler, P., & Scheffler, B. (2016). The relationship of choice reaction time variability and intelligence: A meta-analysis. Learning and Individual Differences, 52, 157–166. doi:10.1016/j.lindif.2015.02.009
   Web of Science ®Google Scholar
• Dubad, M., Winsper, C., Meyer, C., Livanou, M., & Marwaha, S. (2019). A systematic review of the psychometric properties, usability and clinical impacts of mobile mood-monitoring applications in young people. Psychological Medicine, 48, 208–228. doi:10.1017/S0033291717001659
   Web of Science ®Google Scholar
• Duchek, J. M., Balota, D. A., Tse, C. S., Holtzman, D. M., Fagan, A. M., & Goate, A. M. (2009). The utility of intraindividual variability in selective attention tasks as an early marker for Alzheimer’s disease. Neuropsychology, 23(6), 746–758. doi:10.1037/a0016583
   PubMed Web of Science ®Google Scholar
• Epstein, J. N., Langberg, J. M., Rosen, P. J., Graham, A., Narad, M. E., Antonini, T. N., … Altaye, M. (2011). Evidence for higher reaction time variability for children with ADHD on a range of cognitive tasks including reward and event rate manipulations. Neuropsychology, 25(4), 427–441. doi:10.1037/a0022155
   PubMed Web of Science ®Google Scholar
• Euler, M. J., Niermeyer, M. A., & Suchy, Y. (2016). Neurocognitive and neurophysiological correlates of motor planning during familiar and novel contexts. Neuropsychology, 30(1), 109–119. doi:10.1037/neu0000219
   PubMed Web of Science ®Google Scholar
• Falleti, M., Maruff, P., Collie, A., & Darby, D. (2006). Practice effects associated with the repeated assessment of cognitive function using the CogState battery at 10-minute, one week and one month test-retest intervals. Journal of Clinical and Experimental Neuropsychology, 28(7), 1095–1112. doi:10.1080/13803390500205718
   PubMed Web of Science ®Google Scholar
• Fanning, J., Porter, G., Awick, E. A., Ehlers, D. K., Roberts, S. A., Cooke, G., … McAuley, E. (2017). Replacing sedentary time with sleep, light, or moderate-to-vigorous physical activity: Effects on self-regulation and executive functioning. Journal of Behavioral Medicine, 40(2), 332–342. doi:10.1007/s10865-016-9788-9
   PubMed Web of Science ®Google Scholar
• Feldman, G., Lavalle, J., Gildawie, K., & Greeson, J. M. (2016). Dispositional mindfulness uncouples physiological and emotional reactivity to a laboratory stressor and emotional reactivity to executive functioning lapses in daily life. Mindfulness, 7(2), 527–541. doi:10.1007/s12671-015-0487-3
   PubMed Web of Science ®Google Scholar
• Franchow, E. I., & Suchy, Y. (2015). Naturally-occurring expressive suppression in daily life depletes executive functioning. Emotion, 15(1), 78–89. doi:10.1037/emo0000013
   PubMed Web of Science ®Google Scholar
• Frank, B., Jacobson, N. C., Hurley, L., & Mckay, D. (2017). A theoretical and empirical modeling of anxiety integrated with RDoC and temporal dynamics. Journal of Anxiety Disorders, 51, 39–46. doi:10.1016/j.janxdis.2017.09.002
   PubMed Web of Science ®Google Scholar
• Friedman, N. P., Haberstick, B. C., Willcutt, E. G., Miyake, A., Young, S. E., Corley, R. P., & Hewitt, J. K. (2007). Greater attention problems during childhood predict poorer executive functioning in late adolescence. Psychological Science, 18(10), 893–900. doi:10.1111/j.1467-9280.2007.01997.x
   PubMed Web of Science ®Google Scholar
• Geraldo, A., Azeredo, A., Pasion, R., Dores, A. R., & Barbosa, F. (2019). Fostering advances to neuropsychological assessment based on the research domain criteria: The bridge between cognitive functioning and physiology. The Clinical Neuropsychologist, 33(2), 327–356. doi:10.1080/13854046.2018.1523467
   PubMed Web of Science ®Google Scholar
• Germine, L., Reinecke, K., & Chaytor, N. S. (2018). Digital neuropsychology: Challenges and opportunities at the intersection of science and software. The Clinical Neuropsychologist, 33(2), 271–286. doi:10.1080/13854046.2018.1535662
   Web of Science ®Google Scholar
• Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017). Progress toward openness, transparency, and reproducibility in cognitive neuroscience. Annals of the New York Academy of Sciences, 1396(1), 5–18. doi:10.1177/0333102415576222.Is.
   PubMed Web of Science ®Google Scholar
• Gmehlin, D., Fuermaier, A. B. M., Walther, S., Debelak, R., Rentrop, M., Westermann, C., … Aschenbrenner, S. (2014). Intraindividual variability in inhibitory function in adults with ADHD – An Ex-gaussian approach. PLoS One, 9(12), e112298–19. doi:10.1371/journal.pone.0112298
   PubMed Web of Science ®Google Scholar
• Goldberger, A. L., Amaral, L. A. N., Hausdorff, J. M., Ivanov, P. C., Peng, C., & Stanley, H. E. (2002). Fractal dynamics in physiology: Alterations with disease and aging. Proceedings of the National Academy of Sciences of Sciences, 99(Supplement 1), 2466–2472. doi:10.1073/pnas.012579499
   PubMedGoogle Scholar
• Goldberger, A. L., & West, B. J. (1987). Fractals in physiology and medicine. The Yale Journal of Biology and Medicine, 60(5), 421–435.
   PubMed Web of Science ®Google Scholar
• Graves, R. E., Bezeau, S. C., Fogarty, J., Blair, R., Bezeau, S. C., Fogarty, J., … Blair, R. (2010). Boston naming test short forms: A comparison of previous forms with new item response theory based forms. Journal of Clinical and Experimental Neuropsychology, 26, 891–902. doi:10.1080/13803390490510716.
   Google Scholar
• Hall, P. A., Fong, G. T., Epp, L. J., & Elias, L. J. (2008). Executive function moderates the intention-behavior link for physical activity and dietary behavior. Psychology & Health, 23(3), 309–326. doi:10.1080/14768320701212099
   PubMed Web of Science ®Google Scholar
• Harari, G. M., Müller, S. R., Aung, M. S., & Rentfrow, P. J. (2017). Smartphone sensing methods for studying behavior in everyday life. Current Opinion in Behavioral Sciences, 18, 83–90. doi:10.1016/j.cobeha.2017.07.018
   Web of Science ®Google Scholar
• Harrison, S. J., & Stergiou, N. (2015). Complex adaptive behavior and dexterous action. Nonlinear Dynamics, Psychology, and Life Sciences, 19(4), 345–394.
   PubMed Web of Science ®Google Scholar
• Hayden, K. M., Jones, R. N., Zimmer, C., Plassman, B. L., Browndyke, J. N., Pieper, C., … Welsh, K. A. (2012). Factor structure of the National Alzheimer’s Coordinating Centers uniform dataset neuropsychological battery: An evaluation of invariance between and within groups over time. Alzheimer Disease & Associated Disorders, 25(2), 128–137. doi:10.1097/WAD.0b013e3181ffa76d
   Web of Science ®Google Scholar
• Henríquez-Henríquez, M. P., Billeke, P., Henríquez, H., Zamorano, F. J., Rothhammer, F., & Aboitiz, F. (2015). Intra-individual response variability assessed by ex-Gaussian analysis may be a new endophenotype for attention-deficit/hyperactivity disorder. Frontiers in Psychiatry, 6, 1–8. doi:10.3389/fpsyt.2014.00197
   PubMedGoogle Scholar
• Hervey, A. S., Epstein, J. N., Curry, J. F., Tonev, S., Eugene Arnold, L., Keith Conners, C., … Hechtman, L. (2006). Reaction time distribution analysis of neuropsychological performance in an ADHD sample. Child Neuropsychology, 12(2), 125–140. doi:10.1080/09297040500499081
   PubMed Web of Science ®Google Scholar
• Hofmann, W., Schmeichel, B. J., & Baddeley, A. D. (2012). Executive functions and self-regulation. Trends in Cognitive Sciences, 16(3), 174–180. doi:10.1016/j.tics.2012.01.006
   PubMed Web of Science ®Google Scholar
• Holden, J. G., Choi, I., Amazeen, P. G., & Van Orden, G. C. (2011). Fractal 1/f dynamics suggest entanglement of measurement and human performance fractal 1/ƒ dynamics suggest entanglement of measurement and human performance. Journal of Experimental Psychology: Human Perception and Performance, 37(3), 935–948. doi:10.1037/a0020991
   PubMed Web of Science ®Google Scholar
• Holtzer, R., Mahoney, J., & Verghese, J. (2014). Intraindividual variability in executive functions but not speed of processing or conflict resolution predicts performance differences in gait speed in older adults. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 69(8), 980–986. doi:10.1093/gerona/glt180
   PubMed Web of Science ®Google Scholar
• Howieson, D. (2019). Current limitations of neuropsychological tests and assessment procedures assessment procedures. The Clinical Neuropsychologist, 33(2), 200–208. doi:10.1080/13854046.2018.1552762
   PubMed Web of Science ®Google Scholar
• Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036. doi:10.1016/j.neuropsychologia.2006.01.010
   PubMed Web of Science ®Google Scholar
• Hultsch, D. F., MacDonald, S. W. S., & Dixon, R. A. (2002a). Intraindividual variability in cognitive performance in three groups of older adults: Cross-domain links to physical status and self-perceived affect and beliefs. Journal of the International Neuropsychological Society, 8, 893–906. doi:10.1017/S1355617702870035
   PubMed Web of Science ®Google Scholar
• Hultsch, D. F., MacDonald, S. W. S., & Dixon, R. A. (2002b). Variability in reaction time performance of younger and older adults. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 57(2), 101–115. doi:10.1093/geronb/57.2.P101
   PubMed Web of Science ®Google Scholar
• Jefferson, A. L., Paul, R. H., Ozonoff, A., & Cohen, R. A. (2006). Evaluating elements of executive functioning as predictors of instrumental activities of daily living (IADLs). Archives of Clinical Neuropsychology, 21(4), 311–320. doi:10.1016/j.acn.2006.03.007
   PubMed Web of Science ®Google Scholar
• Jensen, A. R. (1992). The importance of intraindividual variation in reaction time. Personality and Individual Differences, 13(8), 869–881. doi:10.1016/0191-8869(92)90004-9
   Web of Science ®Google Scholar
• Johann, V. E., & Karbach, J. (2018). Validation of new online game-based executive function tasks for children. Journal of Experimental Child Psychology, 176, 150–161. doi:10.1016/j.jecp.2018.07.009
   PubMed Web of Science ®Google Scholar
• Jones, A., Remmerswaal, D., Verveer, I., Robinson, E., Franken, I. H. A., Fred Wen, C. K., & Field, M. (2018). Compliance with ecological momentary assessment protocols in substance users: A meta-analysis. Addiction. 114(4), 609–619, doi:10.1111/add.14503
   Web of Science ®Google Scholar
• Kane, M. J., Leslie, B. H., McVay, J. C., Paul, S. J., Inez, M.-G., & Kwapil, T. R. (2007). For whom the mind wanders, and when: An experience-sampling study of working memory and executive control in daily life. Psychological Science, 18(7), 614–621. doi:10.1111/j.1467-9280.2007.01948.x
   PubMed Web of Science ®Google Scholar
• Kessels, R. P. C. (2018). Improving precision in neuropsychological assessment: Bridging the gap between classic paper-and-pencil tests and paradigms from cognitive neuroscience. The Clinical Neuropsychologist, 33(2), 357–368. doi:10.1080/13854046.2018.1518489
   PubMed Web of Science ®Google Scholar
• Kloos, H., & van Orden, G. C. (2009). Soft-assembled mechanisms for the grand theory. In J.P. Spencer, M. Thomas, & J. McClelland (Eds.), Toward a new grand theory of development? Connectionism and dynamic systems theory reconsidered (pp. 253–267). Oxford, UK: Oxford University Press.
   Google Scholar
• Kolfer, M. J., Rapport, M. D., Sarver, D. E., Raiker, J. S., Orban, S. A., Friedman, L. M., & Kolomeyer, E. G. (2013). Reaction time variability in ADHD: A meta-analytic review of 319 studies. Clinical Psychology Review, 33(6), 795–811. doi:10.1016/j.cpr.2013.06.001
   PubMed Web of Science ®Google Scholar
• Kovacs, K., & Conway, A. R. A. (2016). Process overlap theory: A unified account of the general factor of intelligence. Psychological Inquiry, 27(3), 151–177. doi:10.1080/1047840X.2016.1153946
   Web of Science ®Google Scholar
• Kovalchik, S. A., Martino, S. C., Collins, R. L., Shadel, W. G., D’Amico, E. J., & Becker, K. (2017). Scaled inverse probability weighting: A method to assess potential bias due to event nonreporting in ecological momentary assessment studies. Journal of Educational and Behavioral Statistics, 43(3), 107699861773824. doi:10.3102/1076998617738241
   Web of Science ®Google Scholar
• Kuppens, P., Oravecz, Z., & Tuerlinckx, F. (2010). Feelings change: Accounting for individual differences in the temporal dynamics of affect. Journal of Personality and Social Psychology, 99(6), 1042–1060. doi:10.1037/a0020962
   PubMed Web of Science ®Google Scholar
• Lathia, N., Sandstrom, G. M., Mascolo, C., & Rentfrow, P. J. (2017). Happier people live more active lives: Using smartphones to link happiness and physical activity. PLoS One, 12(1), e0160589–13. doi:10.1371/journal.pone.0160589
   PubMed Web of Science ®Google Scholar
• Lumsden, J., Edwards, E., Lawrence, N. S., Coyle, D., & Munafò, M. R. (2016). Gamification of cognitive assessment and cognitive training: A systematic review of applications and efficacy. JMIR Serious Games, 4(2), e11. doi:10.2196/games.5888
   PubMed Web of Science ®Google Scholar
• MacDonald, S. W. S., Cervenka, S., Farde, L., Nyberg, L., & Bäckman, L. (2009). Extrastriatal dopamine D2 receptor binding modulates intraindividual variability in episodic recognition and executive functioning. Neuropsychologia, 47(11), 2299–2304. doi:10.1016/j.neuropsychologia.2009.01.016
   PubMed Web of Science ®Google Scholar
• MacDonald, S. W. S., Nyberg, L., & Bäckman, L. (2006). Intra-individual variability in behavior: Links to brain structure, neurotransmission and neuronal activity. Trends in Neurosciences, 29(8), 474–480. doi:10.1016/j.tins.2006.06.011
   PubMed Web of Science ®Google Scholar
• Maldonado, E. F., Fernandez, F. J., Trianes, M. V., Wesnes, K., Petrini, O., Zangara, A., … Ambrosetti, L. (2008). Cognitive performance and morning levels of salivary cortisol and α-amylase in children reporting high vs. low daily stress perception. The Spanish Journal of Psychology, 11(1), 3–15. doi:10.1017/S1138741600004066
   PubMed Web of Science ®Google Scholar
• Marshall, G. A., Rentz, D. M., Frey, M. T., Locascio, J. J., Johnson, K. A., & Sperling, R. A. (2011). Executive function and instrumental activities of daily living in mild cognitive impairment and Alzheimer’s disease. Alzheimer’s & Dementia, 7(3), 300–308. doi:10.1016/j.jalz.2010.04.005
   PubMed Web of Science ®Google Scholar
• Martyr, A., & Clare, L. (2012). Executive function and activities of daily living in Alzheimer’s disease: A correlational meta-analysis. Dementia and Geriatric Cognitive Disorders, 33(2-3), 189–203. doi:10.1159/000338233
   PubMed Web of Science ®Google Scholar
• McVay, J. C., & Kane, M. J. (2012). Drifting from slow to “D’oh!”: Working memory capacity and mind wandering predict extreme reaction times and executive control errors. Journal of Experimental Psychology: Learning Memory and Cognition, 38(3), 525–549. doi:10.1037/a0025896
   PubMed Web of Science ®Google Scholar
• Miller, G. (2012). The smartphone psychology manifesto. Perspectives on Psychological Science, 7(3), 221–237. doi:10.1177/1745691612441215
   Web of Science ®Google Scholar
• Miller, J. B. (2019). Big data and biomedical informatics: Preparing for the modernization of clinical neuropsychology. The Clinical Neuropsychologist, 33(2), 287–304. doi:10.1080/13854046.2018.1523466
   PubMed Web of Science ®Google Scholar
• Miller, J. B., & Barr, W. B. (2017). The technology crisis in neuropsychology. Archives of Clinical Neuropsychology, 32(5), 541–554. doi:10.1093/arclin/acx050
   PubMed Web of Science ®Google Scholar
• Mitra, S., Amazeen, P. G., & Turvey, M. T. (1998). Intermediate motor learning as decreasing active (dynamical) degrees of freedom. Human Movement Science, 17(1), 17–65. doi:10.1016/S0167-9457(97)00023-7
   Web of Science ®Google Scholar
• Pew Research Center. (2019). Mobile Fact Sheet. Retrieved from http://www.pewinternet.org/fact-sheet/mobile/
   Google Scholar
• Molenaar, P. C. (2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement: Interdisciplinary Research & Perspective, 2(4), 201–218. doi:10.1207/s15366359mea0204_1
   Google Scholar
• Molenaar, P., & Campbell, C. G. (2009). The new person-specifc paradigm in psychology. Current Directions in Psychological Science, 18(2), 112–117. doi:10.1111/j.1467-8721.2009.01619.x
   Web of Science ®Google Scholar
• Moore, R. C., Swendsen, J., & Depp, C. A. (2017). Applications for self-administered mobile cognitive assessments in clinical research: A systematic review. International Journal of Methods in Psychiatric Research, 26(4), e1562. doi:10.1002/mpr.1562
   PubMed Web of Science ®Google Scholar
• Moskowitz, D. S., & Young, S. N. (2006). Ecological momentary assessment: What it is and why it is a method of the future in clinical psychopharmacology. Journal of Psychiatry & Neuroscience, 31(1), 13–20.
   PubMed Web of Science ®Google Scholar
• Mulligan, B. P., Smart, C. M., Segalowitz, S. J., Mulligan, B. P., Smart, C. M., & Segalowitz, S. J. (2019). Neuropsychological and resting-state electroencephalographic markers of older adult neurocognitive adaptability. The Clinical Neuropsychologist, 33(2), 390–418. doi:10.1080/13854046.2018.1543453
   PubMed Web of Science ®Google Scholar
• Mungas, D., & Reed, B. R. (2000). Application of item response theory for development of a global functioning measure of dementia with linear measurement properties. Statistics in Medicine, 19, 1631–1644. doi:10.1002/(SICI)1097-0258(20000615/30)19:11/12<1631::AID-SIM451>3.0.CO;2-P
   PubMed Web of Science ®Google Scholar
• Nesselroade, J. R. (1991). Interindividual differences in intraindividual change. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change: Recent advances, unanswered questions, future directions (p. 92–105). American Psychological Association. doi:10.1037/10099-006
   Google Scholar
• Nesselroade, J. R., & Salthouse, T. A. (2004). Methodological and theoretical implications of intraindividual variability in perceptual motor performance. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 59(2), P49–P55. doi:10.1093/geronb/59.2.P49
   PubMed Web of Science ®Google Scholar
• Niermeyer, M. A., Franchow, E. I., & Suchy, Y. (2016). Reported expressive suppression in daily life is associated with slower action planning. Journal of the International Neuropsychological Society, 22(6), 671–681. doi:10.1017/S1355617716000473
   PubMed Web of Science ®Google Scholar
• Niermeyer, M. A., Ziemnik, R. E., Franchow, E. I., Barron, C. A., & Suchy, Y. (2018). Greater naturally occurring expressive suppression is associated with poorer executive functioning and motor-sequence learning among older adults. Journal of Clinical and Experimental Neuropsychology, 41(2), 118–132. doi:10.1080/13803395.2018.1502257
   PubMed Web of Science ®Google Scholar
• Ode, S., Robinson, M. D., Hanson, D. M., Ode, S., Robinson, M. D., Cognitive, D. M. H., … Hanson, D. M. (2011). Cognitive-emotional dysfunction among noisy minds: Predictions from individual differences in reaction time variability. Cognition & Emotion, 25, 307–327. doi:10.1080/02699931.2010.494387.
   PubMed Web of Science ®Google Scholar
• Onnela, J.-P., & Rauch, S. L. (2016). Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology, 41(7), 1691–1696. doi:10.1038/npp.2016.7
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., & Duffield, T. (2019). National Institutes of Health initiatives for advancing scientific developments in clinical neuropsychology scientific developments in clinical neuropsychology. The Clinical Neuropsychologist, 33(2), 246–270. doi:10.1080/13854046.2018.1523465
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., McMahan, T., & Kane, R. (2018). Practice parameters facilitating adoption of advanced technologies for enhancing neuropsychological assessment paradigms. The Clinical Neuropsychologist, 32(1), 16–41. doi:10.1080/13854046.2017.1337932
   PubMed Web of Science ®Google Scholar
• Raento, M., Oulasvirta, A., & Eagle, N. (2009). An emerging tool for social scientists. Sociological Methods & Research, 37(3), 426–454. doi:10.1177/0049124108330005
   Web of Science ®Google Scholar
• Ram, N., Gerstorf, D., Lindenberger, U., & Smith, J. (2011). Developmental change and intraindividual variability: Relating cognitive aging to cognitive plasticity, cardiovascular lability, and emotional diversity. Psychology and Aging, 26(2), 363–371. doi:10.1037/a0021500
   PubMed Web of Science ®Google Scholar
• Ram, N., Rabbitt, P., Stollery, B., & Nesselroade, J. R. (2005). Cognitive performance inconsistency: Intraindividual change and variability. Psychology and Aging, 20(4), 623–633. doi:10.1037/0882-7974.20.4.623
   PubMed Web of Science ®Google Scholar
• Rammsayer, T., & Troche, S. (2016). Validity of the worst performance rule as a function of task complexity and psychometric g: On the crucial role of g saturation. Journal of Intelligence, 4(1), 5. doi:10.3390/jintelligence4010005
   Google Scholar
• Rapoport, M. J., Mccullagh, S., Shammi, P., & Feinstein, A. (2005). Cognitive impairment associated with major depression following mild and moderate traumatic brain injury. The Journal of Neuropsychiatry and Clinical Neurosciences, 17(1), 61–65. doi:10.1176/jnp.17.1.61
   PubMed Web of Science ®Google Scholar
• Reckess, G. Z., Varvaris, M., Gordon, B., & Schretlen, D. J. (2014). Within-person distributions of neuropsychological test scores as a function of dementia severity. Neuropsychology, 28(2), 254–260. doi:10.1037/neu0000017
   PubMed Web of Science ®Google Scholar
• Reger, M. A., Welsh, R. K., Watson, G. S., Cholerton, B., Baker, L. D., & Craft, S. (2004). The relationship between neuropsychological functioning and driving ability in dementia: A meta-analysis. Neuropsychology, 18(1), 85–93. doi:10.1037/0894-4105.18.1.85
   PubMed Web of Science ®Google Scholar
• Royall, D. R., Lauterbach, E. C., Cummings, J. L., Reeve, A., Rummans, T. A., Kaufer, D. I., … Coffey, C. E. (2002). Executive control function: A review of its promise and challenges for clinical research. Journal of Neuropsychiatry, 14(4), 377–405. doi:10.1176/appi.neuropsych.14.4.377
   PubMed Web of Science ®Google Scholar
• Salthouse, T. A. (2010). Influence of age on practice effects in longitudinal neurocognitive change. Neuropsychology, 24(5), 563–572. doi:10.1037/a0019026
   PubMed Web of Science ®Google Scholar
• Salthouse, T. A., & Davis, H. P. (2006). Organization of cognitive abilities and neuropsychological variables across the lifespan. Developmental Review, 26(1), 31–54. doi:10.1016/j.dr.2005.09.001
   Web of Science ®Google Scholar
• Sandstrom, G. M., Lathia, N., Mascolo, C., & Rentfrow, P. J. (2017). Putting mood in context: Using smartphones to examine how people feel in different locations. Journal of Research in Personality, 69, 96–101. doi:10.1016/j.jrp.2016.06.004
   Web of Science ®Google Scholar
• Schmand, B. (2019). Why are neuropsychologists so reluctant to embrace modern assessment techniques ?. The Clinical Neuropsychologist, 33(2), 209–219. doi:10.1080/13854046.2018.1523468
   PubMed Web of Science ®Google Scholar
• Schmiedek, F., Lövdén, M., & Lindenberger, U. (2009). On the relation of mean reaction time and intraindividual reaction time variability. Psychology and Aging, 24(4), 841–857. doi:10.1037/a0017799
   PubMed Web of Science ®Google Scholar
• Schmiedek, F., Oberauer, K., Wilhelm, O., Süß, H. M., & Wittmann, W. W. (2007). Individual differences in components of reaction time distributions and their relations to working memory and intelligence. Journal of Experimental Psychology: General, 136(3), 414–429. doi:10.1037/0096-3445.136.3.414
   PubMed Web of Science ®Google Scholar
• Schretlen, D. J., Munro, C. A., Anthony, J. C., & Pearlson, G. D. (2019). Examining the range of normal intraindividual variability in neuropsychological test performance. Journal of the International Neuropsychological Society 9, 864–870. doi:10.1017/S1355617703960061
   Google Scholar
• Shallice, T., Burgess, P., Robertson, I., Shallice, T. I. M., & Burgess, P. (1996). The domain of supervisory processes and temporal organization of behaviour. Philosophical Transactions: Biological Sciences, 351(1346), 1405–1412.
   PubMed Web of Science ®Google Scholar
• Shields, G. S., Bonner, J. C., & Moons, W. G. (2015). Does cortisol influence core executive functions? A meta-analysis of acute cortisol administration effects on working memory, inhibition, and set-shifting. Psychoneuroendocrinology, 58, 91–103. doi:10.1016/j.psyneuen.2015.04.017
   PubMed Web of Science ®Google Scholar
• Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4(1), 1–32. doi:10.1146/annurev.clinpsy.3.022806.091415
   PubMed Web of Science ®Google Scholar
• Sliwinski, M. J., Smyth, J. M., Hofer, S. M., & Stawski, R. S. (2006). Intraindividual coupling of daily stress and cognition. Psychology and Aging, 21(3), 545–557. doi:10.1037/0882-7974.21.3.545
   PubMed Web of Science ®Google Scholar
• Solhan, M. B., Trull, T. J., Jahng, S., & Wood, P. K. (2009). Clinical assessment of affective instability: Comparing EMA indices, questionnaire reports, and retrospective recall. Psychological Assessment, 21(3), 425–436. doi:10.1037/a0016869
   PubMed Web of Science ®Google Scholar
• Spook, J. E., Paulussen, T., Kok, G., & Van Empelen, P. (2013). Monitoring dietary intake and physical activity electronically: Feasibility, usability, and ecological validity of a mobile-based ecological momentary assessment tool. Journal of Medical Internet Research, 15(9), e214. doi:10.2196/jmir.2617
   PubMed Web of Science ®Google Scholar
• Staples, P., Torous, J., Barnett, I., Carlson, K., Sandoval, L., Keshavan, M., & Onnela, J.-P. (2017). A comparison of passive and active estimates of sleep in a cohort with schizophrenia. NPJ Schizophrenia, 3(1), 37. doi:10.1038/s41537-017-0038-0
   PubMedGoogle Scholar
• Stuss, D. T. (2011). Traumatic brain injury: Relation to executive dysfunction and the frontal lobes. Current Opinion in Neurology, 24(6), 584–589. doi:10.1097/WCO.0b013e32834c7eb9
   PubMed Web of Science ®Google Scholar
• Stuss, D. T., Pogue, J., Buckle, L., & Bondar, J. (1994). Characterization of stability of performance in patients with traumatic brain injury: Variability and consistency on reaction time tests. Neuropsychology, 8(3), 316–324. doi:10.1037/0894-4105.8.3.316
   Google Scholar
• Suchy, Y. (2009). Executive functioning: Overview, assessment, and research issues for non-neuropsychologists. Annals of Behavioral Medicine, 37(2), 106–116. doi:10.1007/s12160-009-9097-4
   PubMed Web of Science ®Google Scholar
• Suchy, Y., Euler, M., & Eastvold, A. (2014). Exaggerated reaction to novelty as a subclinical consequence of mild traumatic brain injury. Brain Injury, 28(7), 972–979. doi:10.3109/02699052.2014.888766
   PubMed Web of Science ®Google Scholar
• Tarantino, V., Cutini, S., Mogentale, C., & Bisiacchi, P. S. (2013). Time-on-task in children with ADHD: An ex-Gaussian analysis. Journal of the International Neuropsychological Society, 19(7), 820–828. doi:10.1017/S1355617713000623
   PubMed Web of Science ®Google Scholar
• Thayer, J. F., Hansen, A. L., Saus-Rose, E., & Johnsen, B. H. (2009). Heart rate variability, prefrontal neural function, and cognitive performance: The neurovisceral integration perspective on self-regulation, adaptation, and health. Annals of Behavioral Medicine, 37(2), 141–153. doi:10.1007/s12160-009-9101-z
   PubMed Web of Science ®Google Scholar
• Thomas, M. L. (2011). The value of item response theory in clinical assessment: A review. Assessment, 18(3), 291–307. doi:10.1177/1073191110374797
   PubMed Web of Science ®Google Scholar
• Timmers, C., Maeghs, A., Vestjens, M., Bonnemayer, C., Hamers, H., & Blokland, A. (2014). Ambulant cognitive assessment using a smartphone. Applied Neuropsychology: Adult, 21(2), 136–142. doi:10.1080/09084282.2013.778261
   PubMed Web of Science ®Google Scholar
• Tiplady, B., Oshinowo, B., Thomson, J., & Drummond, G. B. (2009). Alcohol and cognitive function: Assessment in everyday life and laboratory settings using mobile phones. Alcoholism: Clinical and Experimental Research, 33(12), 2094–2102. doi:10.1111/j.1530-0277.2009.01049.x
   PubMed Web of Science ®Google Scholar
• Torous, J., Staples, P., & Onnela, J. (2015). Realizing the potential of mobile mental health: New methods for new data in psychiatry. Current Psychiatry Reports, 14(2), 201–210. doi:10.1007/s11920-015-0602-0
   Google Scholar
• Triantafillou, E., Georgiadou, E., & Economides, A. A. (2007). The design and evaluation of a computerized adaptive test on mobile devices. Computers & Education, 50(4), 1319–1330. doi:10.1016/j.compedu.2006.12.005
   Web of Science ®Google Scholar
• Trull, T. J., & Ebner-Priemer, U. W. (2009). Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: Introduction to the special section. Psychological Assessment, 21(4), 457–462. doi:10.1037/a0017653
   PubMed Web of Science ®Google Scholar
• Turvey, M. T. (2007). Action and perception at the level of synergies. Human Movement Science, 26(4), 1–41. doi:10.1016/j.humov.2007.04.002
   PubMed Web of Science ®Google Scholar
• van der Niet, A. G., Smith, J., Scherder, E. J. A., Oosterlaan, J., Hartman, E., & Visscher, C. (2015). Associations between daily physical activity and executive functioning in primary school-aged children. Journal of Science and Medicine in Sport , 18(6), 673–677. doi:10.1016/j.jsams.2014.09.006
   PubMed Web of Science ®Google Scholar
• van Gelder, T., & Port, R. F. (1995). Its about time: An overview of the dynamical approach to cognition. In van Gelder, T., & Port, R. F. (Eds.) Mind as motion: Explorations in the dynamics of cognition (pp. 1–43). Cambridge, MA: MIT Pre. doi:10.1109/TBME.2006.884649.
   Google Scholar
• van Orden, G. C. (2007). The fractal picture of health and wellbeing. Psychological Science Agenda, 22(7). Retrieved from http://www.fractal.org/Life-Science-Technology/Publications/The-Fractal-Picture-of-Health-and-Wellbeing.htm
   Google Scholar
• Van Orden, G. C., Kloos, H., & Wallot, S. (2009). Living in the pink: Intentionality. Wellbeing, and Complexity, 10.
   Google Scholar
• Ware, J. E., Bjorner, J. B., & Kosinski, M. (2000). Practical implications of item response theory and computerized adaptive testing: A brief summary of ongoing studies of widely used headache impact scales. Medical Care, 38(9), II–82.
   Web of Science ®Google Scholar
• Waters, A. J., & Li, Y. (2008). Evaluating the utility of administering a reaction time task in an ecological momentary assessment study. Psychopharmacology, 197(1), 25–35. doi:10.1007/s00213-007-1006-6
   PubMed Web of Science ®Google Scholar
• Wen, C. K. F., Schneider, S., Stone, A. A., & Spruijt-Metz, D. (2017). Compliance with mobile ecological momentary assessment protocols in children and adolescents: A systematic review and meta-analysis. Journal of Medical Internet Research, 19(4), e132–23. doi:10.2196/jmir.6641
   PubMedGoogle Scholar
• Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636. doi:10.3758/BF03196322
   PubMed Web of Science ®Google Scholar
• Wojtowicz, M. A., Ishigami, Y., Mazerolle, E. L., Fisk, J. D., Wojtowicz, M. A., Ishigami, Y., … Fisk, J. D. (2014). Stability of intraindividual variability as a marker of neurologic dysfunction in relapsing remitting multiple sclerosis Stability of intraindividual variability as a marker of neurologic dysfunction in relapsing remitting multiple sclerosis. Journal of Clinical and Experimental Neuropsychology, 36(5), 455–463. doi:10.1080/13803395.2014.903898
   PubMed Web of Science ®Google Scholar