Measurement of neuropsychiatric symptoms in the older adults with mild cognitive impairment based on speech and facial expressions: a cross-sectional observational study

References

• Baltrušaitis, T., Robinson, P., & Morency, L.-P. (2016). Openface: An open source facial behavior analysis toolkit [Paper presentation]. 2016 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 1–10. https://doi.org/10.1109/WACV.2016.7477553
   Google Scholar
• Bergkvist, L., & Rossiter, J. R. (2007). The predictive validity of multiple-item versus single-item measures of the same constructs. Journal of Marketing Research, 44(2), 175–184. https://doi.org/10.1509/jmkr.44.2.175
   Web of Science ®Google Scholar
• Bergstra, J., Komer, B., Eliasmith, C., Yamins, D., & Cox, D. D. (2015). Hyperopt: A python library for model selection and hyperparameter optimization. Computational Science & Discovery, 8(1), 014008. https://doi.org/10.1088/1749-4699/8/1/014008
   Google Scholar
• Chaplin, T. M. (2015). Gender and emotion expression: A developmental contextual perspective. Emotion Review: Journal of the International Society for Research on Emotion, 7(1), 14–21. https://doi.org/10.1177/1754073914544408
   PubMed Web of Science ®Google Scholar
• Chen, Y.-X., Liang, N., Li, X.-L., Yang, S.-H., Wang, Y.-P., & Shi, N.-N. (2021). Diagnosis and treatment for mild cognitive impairment: A systematic review of clinical practice guidelines and consensus statements. Frontiers in Neurology, 12(10), 719849. https://doi.org/10.3389/fneur.2021.719849
   PubMedGoogle Scholar
• Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2015). A review of depression and suicide risk assessment using speech analysis. Speech Communication, 71(7), 10–49. https://doi.org/10.1016/j.specom.2015.03.004
   Google Scholar
• Ekman, P., & Friesen, W. V. (1978). Facial action coding system. Environmental Psychology & Nonverbal Behavior. Retrieved from https://doi.org/10.1037/t27734-000
   Google Scholar
• Eyben, F., Scherer, K. R., Schuller, B. W., Sundberg, J., Andre, E., Busso, C., Devillers, L. Y., Epps, J., Laukka, P., Narayanan, S. S., & Truong, K. P. (2016). The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing. IEEE Transactions on Affective Computing, 7(2), 190–202. https://doi.org/10.1109/TAFFC.2015.2457417
   Web of Science ®Google Scholar
• Fushiki, T. (2011). Estimation of prediction error by using K-fold cross-validation. Statistics and Computing, 21(2), 137–146. https://doi.org/10.1007/s11222-009-9153-8
   Web of Science ®Google Scholar
• Gavrilescu, M., & Vizireanu, N. (2019). Predicting depression, anxiety, and stress levels from videos using the facial action coding system. Sensors (Basel, Switzerland), 19(17), 3693. https://doi.org/10.3390/s19173693
   PubMed Web of Science ®Google Scholar
• Guercio, B. J., Donovan, N. J., Munro, C. E., Aghjayan, S. L., Wigman, S. E., Locascio, J. J., Amariglio, R. E., Rentz, D. M., Johnson, K. A., Sperling, R. A., & Marshall, G. A. (2015). The apathy evaluation scale: A comparison of subject, informant, and clinician report in cognitively normal elderly and mild cognitive impairment. Journal of Alzheimer’s Disease: JAD, 47(2), 421–432. https://doi.org/10.3233/jad-150146
   PubMed Web of Science ®Google Scholar
• Hall, M. A. (2000). Correlation-based feature selection of discrete and numeric class machine learning. Retrieved from https://hdl.handle.net/10289/1024
   Google Scholar
• König, A., Linz, N., Zeghari, R., Klinge, X., Tröger, J., Alexandersson, J., & Robert, P. (2019). Detecting apathy in older adults with cognitive disorders using automatic speech analysis. Journal of Alzheimer’s Disease: JAD, 69(4), 1183–1193. https://doi.org/10.3233/jad-181033
   PubMed Web of Science ®Google Scholar
• König, A., Mallick, E., Tröger, J., Linz, N., Zeghari, R., Manera, V., & Robert, P. (2021). Measuring neuropsychiatric symptoms in patients with early cognitive decline using speech analysis. European Psychiatry: The Journal of the Association of European Psychiatrists, 64(1), e64–e71. https://doi.org/10.1192/j.eurpsy.2021.2236
   PubMed Web of Science ®Google Scholar
• Krishna, S., & Anju, J. (2020). Different approaches in depression analysis: A review [Paper presentation]. 2020 International Conference on Computational Performance Evaluation (ComPE), 407–414. https://doi.org/10.1109/ComPE49325.2020.9200001
   Google Scholar
• Langa, K. M., & Levine, D. A. (2014). The diagnosis and management of mild cognitive impairment: A clinical review. JAMA, 312(23), 2551–2561. https://doi.org/10.1001/jama.2014.13806
   PubMed Web of Science ®Google Scholar
• Lee, S.-H., Wen, M.-C., Chao, C.-C., Chen, Y. J., & Yen, C.-F. (2008). Apathy in late-life depression among Taiwanese patients. International Psychogeriatrics, 20(2), 328–337. https://doi.org/10.1017/S1041610207005698
   PubMed Web of Science ®Google Scholar
• Leung, D. K., Chan, W. C., Spector, A., & Wong, G. H. (2021). Prevalence of depression, anxiety, and apathy symptoms across dementia stages: A systematic review and meta-analysis. International Journal of Geriatric Psychiatry, 36(9), 1330–1344. https://doi.org/10.1002/gps.5556
   PubMed Web of Science ®Google Scholar
• Lu, B., Hui, M., & Yu-Xia, H. (2005). The development of Native Chinese Affective Picture System: A pretest in 46 college students. Chinese Mental Health Journal, 11(9), 719–722. https://doi.org/10.3321/J.ISSN:1000-6729.20
   Google Scholar
• Martin, E., & Velayudhan, L. (2020). Neuropsychiatric symptoms in mild cognitive impairment: A literature review. Dementia and Geriatric Cognitive Disorders, 49(2), 146–155. https://doi.org/10.1159/000507078
   PubMed Web of Science ®Google Scholar
• Mohammed, R., Rawashdeh, J., & Abdullah, M. (2020). Machine learning with oversampling and undersampling techniques: Overview study and experimental results [Paper presentation].2020 11th International Conference on Information and Communication Systems (ICICS), 243–248. https://doi.org/10.1109/ICICS49469.2020.239556
   Google Scholar
• Pampouchidou, A., Simantiraki, O., Vazakopoulou, C. M., Chatzaki, C., Pediaditis, M., Maridaki, A., Marias, K., Simos, P., Yang, F., Meriaudeau, F., & Tsiknakis, M. (2017). Facial geometry and speech analysis for depression detection [Paper presentation]. 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 1433–1436. https://doi.org/10.1109/EMBC.2017.8037103
   Google Scholar
• Petersen, R. C., Caracciolo, B., Brayne, C., Gauthier, S., Jelic, V., & Fratiglioni, L. (2014). Mild cognitive impairment: A concept in evolution. Journal of Internal Medicine, 275(3), 214–228. https://doi.org/10.1111/joim.12190
   PubMed Web of Science ®Google Scholar
• Powers, D. M. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv preprint arXiv:2010.16061. https://doi.org/10.48550/arXiv.2010.16061
   Google Scholar
• Robert, J., Webbie, M. (2011). Pydub. Github. Retrieved from https://github.com/jiaaro/pydub
   Google Scholar
• Sarker, I. A.-O. (2021). Deep learning: A comprehensive overview on techniques, taxonomy, applications and research directions. SN Computer Science, 2(6), 420–440. https://doi.org/10.1007/s42979-021-00815-1
   PubMedGoogle Scholar
• Stathopoulos, E. T., Huber, J. E., & Sussman, J. E. (2011). Changes in acoustic characteristics of the voice across the life span: Measures from individuals 4–93 years of age. Journal of Speech, Language, and Hearing Research: JSLHR, 54(4), 1011–1021. https://doi.org/10.1044/1092-4388(2010/10-0036)
   PubMed Web of Science ®Google Scholar
• Sun, Y., Kong, Z., Song, Y., Liu, J., & Wang, X. (2022). The validity and reliability of the PHQ-9 on screening of depression in neurology: A cross sectional study. BMC Psychiatry, 22(1), 98–100. https://doi.org/10.1186/s12888-021-03661-w
   PubMed Web of Science ®Google Scholar
• Tong, X., An, D., McGonigal, A., Park, S.-P., & Zhou, D. (2016). Validation of the Generalized Anxiety Disorder-7 (GAD-7) among Chinese people with epilepsy. Epilepsy Research, 120(2), 31–36. https://doi.org/10.1016/j.eplepsyres.2015.11.019
   PubMedGoogle Scholar
• Zeghari, R., König, A., Guerchouche, R., Sharma, G., Joshi, J., Fabre, R., Robert, P., & Manera, V. (2021). Correlations between facial expressivity and apathy in elderly people with neurocognitive disorders: Exploratory study. JMIR Formative Research, 5(3), e24727. https://doi.org/10.2196/24727
   PubMedGoogle Scholar
• Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020). Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review. Information Fusion, 59, 103–126. https://doi.org/10.1016/j.inffus.2020.01.011
   Web of Science ®Google Scholar
• Zhou, Y., Yao, X., Han, W., Wang, Y., Li, Z., & Li, Y. (2022). Distinguishing apathy and depression in older adults with mild cognitive impairment using text, audio, and video based on multiclass classification and shapely additive explanations. International Journal of Geriatric Psychiatry, 37(11), 5827. https://doi.org/10.1002/gps.5827
   Web of Science ®Google Scholar