The Chinese Version of the Perceived Stress Questionnaire-13: Psychometric Properties and Measurement Invariance for Medical Students

References

• Szabo S, Tache Y, Somogyi A. The legacy of Hans Selye and the origins of stress research: a retrospective 75 years after his landmark brief “letter” to the editor# of nature. Stress. 2012;15(5):472–478. doi:10.3109/10253890.2012.710919
   PubMed Web of Science ®Google Scholar
• Selye H. Stress in Health and Disease. Butterworth’s, Inc.; 1976:1256.
   Google Scholar
• Selye H. The Stress of Life. McGraw-Hill Book Co.; 1956:324.
   Google Scholar
• Selye H. A syndrome produced by diverse nocuous agents. J Neuropsych Clin N. 1936;10(2):230a–231. doi:10.1176/jnp.10.2.230a
   Google Scholar
• Kopp MS, Thege BK, Balog P, et al. Measures of stress in epidemiological research. J Psychosom Res. 2010;69(2):211–225. doi:10.1016/j.jpsychores.2009.09.006
   PubMed Web of Science ®Google Scholar
• Folkman S. Stress: appraisal and coping. In: Gellman MD, Turner JR, editors. Encyclopedia of Behavioral Medicine. Springer New York; 2013:1913–1915.
   Google Scholar
• Cohen S, Kessler RC, Gordon LU. Measuring Stress: A Guide for Health and Social Scientists. Measuring Stress: A Guide for Health and Social Scientists. Oxford University Press; 1995:236.
   Google Scholar
• Phillips AC. Perceived stress. In: Gellman MD, Turner JR, editors. Encyclopedia of Behavioral Medicine. Springer New York; 2013:1453–1454.
   Google Scholar
• Cohen S, Tyrrell DA, Smith AP. Negative life events, perceived stress, negative affect, and susceptibility to the common cold. J Pers Soc Psychol. 1993;64(1):131–140. doi:10.1037//0022-3514.64.1.131
   PubMed Web of Science ®Google Scholar
• Sanz-Carrillo C, García-Campayo J, Rubio A, Santed MA, Montoro M. Validation of the Spanish version of the perceived stress questionnaire. J Psychosom Res. 2002;52(3):167–172. doi:10.1016/s0022-3999(01)00275-6
   PubMed Web of Science ®Google Scholar
• Montero-Marin J, Piva Demarzo MM, Pereira JP, Olea M, García-Campayo J. Reassessment of the psychometric characteristics and factor structure of the ‘Perceived Stress Questionnaire’ (PSQ): analysis in a sample of dental students. PLoS One. 2014;9(1):e87071. doi:10.1371/journal.pone.0087071
   PubMed Web of Science ®Google Scholar
• Umucu E, Iwanaga K, Wu J-R, et al. Preliminary validation of a short form of the perceived stress questionnaire for use in clinical rehabilitation counseling research and practice. Rehabi Res Policy Educ. 2018;(4):232–243. doi:10.1891/0889-7018.32.4.232
   Web of Science ®Google Scholar
• Beiter R, Nash R, McCrady M, et al. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. J Affect Disord. 2015;173:90–96. doi:10.1016/j.jad.2014.10.054
   PubMed Web of Science ®Google Scholar
• Shamsuddin K, Fadzil F, Ismail WSW, et al. Correlates of depression, anxiety and stress among Malaysian university students. Asian J Psychiatr. 2013;6(4):318–323. doi:10.1016/j.ajp.2013.01.014
   PubMedGoogle Scholar
• Zainal Badri SK, Wan Mohd Yunus WMA, Ramos HM, Mahmud N. Remote learning and its implications toward study-life conflicts and the mental health of university students: does studying at home or campus matter? High Educ Res Dev. 2021;1–15. doi:10.1080/07294360.2021.2014407
   Web of Science ®Google Scholar
• Qi M, Gao H. Acute psychological stress promotes general alertness and attentional control processes: an ERP study. Psychophysiology. 2020;57(4):e13521. doi:10.1111/psyp.13521
   PubMed Web of Science ®Google Scholar
• Meng R, Luo X, Du S, et al. The mediating role of perceived stress in associations between self-compassion and anxiety and depression: further evidence from Chinese medical workers. Risk Manag Healthc Policy. 2020;13:2729–2741. doi:10.2147/rmhp.S261489
   PubMed Web of Science ®Google Scholar
• Luo Y, Meng R, Li J, Liu B, Cao X, Ge W. Self-compassion may reduce anxiety and depression in nursing students: a pathway through perceived stress. Public Health. 2019;174:1–10. doi:10.1016/j.puhe.2019.05.015
   PubMed Web of Science ®Google Scholar
• Luo Y, Fei S, Gong B, Sun T, Meng R. Understanding the mediating role of anxiety and depression on the relationship between perceived stress and sleep quality among health care workers in the COVID-19 response. Nat Sci Sleep. 2021;13:1747–1758. doi:10.2147/nss.S313258
   PubMed Web of Science ®Google Scholar
• Zhao Y, Sang B, Ding C, Li T, Wu J, Xia Y. Moderating effect of work stress on the relationship between workload and professional identity among in-service teachers. Curr Psychol. 2022. doi:10.1007/s12144-022-03639-1
   Web of Science ®Google Scholar
• Mezo PG, Baker RM. The moderating effects of stress and rumination on depressive symptoms in women and men. Stress Health. 2012;28(4):333–339. doi:10.1002/smi.2417
   PubMed Web of Science ®Google Scholar
• Cohen S, Janicki-Deverts D, Miller GE. Psychological stress and disease. JAMA. 2007;298(14):1685–1687. doi:10.1001/jama.298.14.1685
   PubMed Web of Science ®Google Scholar
• Fliege H, Rose M, Arck P, et al. The Perceived Stress Questionnaire (PSQ) reconsidered: validation and reference values from different clinical and healthy adult samples. Psychosom Med. 2005;67(1):78–88. doi:10.1097/01.psy.0000151491.80178.78
   PubMed Web of Science ®Google Scholar
• Levenstein S, Prantera C, Varvo V, et al. Development of the perceived stress questionnaire: a new tool for psychosomatic research. J Psychosom Res. 1993;37(1):19–32. doi:10.1016/0022-3999(93)90120-5
   PubMed Web of Science ®Google Scholar
• Rhode PC, Froehlich-Grobe K, Hockemeyer JR, Carlson JA, Lee J. Assessing stress in disability: developing and piloting the disability related stress scale. Disabil Health J. 2012;5(3):168–176. doi:10.1016/j.dhjo.2012.03.002
   PubMed Web of Science ®Google Scholar
• Rönnlund M, Vestergren P, Stenling A, Nilsson LG, Bergdahl M, Bergdahl J. Dimensionality of stress experiences: factorial structure of the Perceived Stress Questionnaire (PSQ) in a population-based Swedish sample. Scand J Psychol. 2015;56(5):592–598. doi:10.1111/sjop.12214
   PubMed Web of Science ®Google Scholar
• Xiong B, Skitmore M, Xia B. Exploring and validating the internal dimensions of occupational stress: evidence from construction cost estimators in China. Construct Manag Econ. 2015;33(5–6):495–507. doi:10.1080/01446193.2015.1050967
   Web of Science ®Google Scholar
• Meng R, Li J, Wang Z, et al. The Chinese version of the perceived stress questionnaire: development and validation amongst medical students and workers. Health Qual Life Out. 2020;18(1):70. doi:10.1186/s12955-020-01307-1
   PubMed Web of Science ®Google Scholar
• Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16(Suppl 1):5–18. doi:10.1007/s11136-007-9198-0
   PubMed Web of Science ®Google Scholar
• Keszei AP, Novak M, Streiner DL. Introduction to health measurement scales. J Psychosom Res. 2010;68(4):319–323. doi:10.1016/j.jpsychores.2010.01.006
   PubMed Web of Science ®Google Scholar
• Roy C, Bakan G, Li Z, Nguyen TH. Coping measurement: creating short form of coping and adaptation processing scale using item response theory and patients dealing with chronic and acute health conditions. Appl Nurs Res. 2016;32:73–79. doi:10.1016/j.apnr.2016.06.002
   PubMed Web of Science ®Google Scholar
• Cappelleri JC, Jason Lundy J, Hays RD. Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures. Clin Ther. 2014;36(5):648–662. doi:10.1016/j.clinthera.2014.04.006
   PubMed Web of Science ®Google Scholar
• Luo Y, Gong B, Meng R, et al. Validation and application of the Chinese version of the Perceived Stress Questionnaire (C-PSQ) in nursing students. PeerJ. 2018;6:e4503. doi:10.7717/peerj.4503
   PubMed Web of Science ®Google Scholar
• World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191–2194. doi:10.1001/jama.2013.281053
   PubMed Web of Science ®Google Scholar
• Everitt BS. Multivariate analysis: the need for data, and other problems. Br J Psychiatry. 1975;126(3):237–240. doi:10.1192/bjp.126.3.237
   PubMed Web of Science ®Google Scholar
• Hair J, Black WC, Babin B, Anderson RE, Tatham R. Multivariate Data Analysis. 7th ed. Prentice Hall; 2009.
   Google Scholar
• Cattell RB. The scientific use of factor analysis in behavioral and life sciences. 2012;497–502.
   Google Scholar
• Mundfrom DJ, Shaw DG, Ke TL. Minimum sample size recommendations for conducting factor analyses. Int J Test. 2005;5(2):159–168. doi:10.1207/s15327574ijt0502_4
   Google Scholar
• Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–396. doi:10.2307/2136404
   PubMed Web of Science ®Google Scholar
• Cohen S. Perceived stress in a probability sample of the United States. The social psychology of health. Sage Publications, Inc. The Claremont Symposium on Applied Social Psychology; 1988:31–67.
   Google Scholar
• Wang Z, Chen J, Boyd JE, et al. Psychometric properties of the Chinese version of the perceived stress scale in policewomen. PLoS One. 2011;6(12):e28610–e28610. doi:10.1371/journal.pone.0028610
   PubMed Web of Science ®Google Scholar
• McDonald RP, Ho MH. Principles and practice in reporting structural equation analyses. Psychol Methods. 2002;7(1):64–82. doi:10.1037/1082-989x.7.1.64
   PubMed Web of Science ®Google Scholar
• Korkmaz S, Goksuluk D, Zararsiz G. MVN: an R package for assessing multivariate normality. R Journal. 2014;6:151–162. doi:10.32614/RJ-2014-031
   Web of Science ®Google Scholar
• Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–745. doi:10.1016/j.jclinepi.2010.02.006
   PubMed Web of Science ®Google Scholar
• Mokkink LB, Prinsen CAC, Patrick DL, et al. COSMIN taxonomy of measurement properties. Available from: https://www.cosmin.nl/. Accessed December 19, 2022.
   Google Scholar
• Prinsen CAC, Mokkink LB, Bouter LM, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–1157. doi:10.1007/s11136-018-1798-3
   PubMed Web of Science ®Google Scholar
• DiStefano C, Morgan GB. A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Struct Equat Model. 2014;21(3):425–438. doi:10.1080/10705511.2014.915373
   Web of Science ®Google Scholar
• Wu H, Estabrook R. Identification of confirmatory factor analysis models of different levels of invariance for ordered categorical outcomes. Psychometrika. 2016;81(4):1014–1045. doi:10.1007/s11336-016-9506-0
   PubMed Web of Science ®Google Scholar
• Rosseel Y. lavaan: an R package for structural equation modeling. J Stat Softw. 2012;48:1–36. doi:10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Satorra A, Bentler PM. A scaled difference chi-square test statistic for moment structure analysis. Psychometrika. 2001;66(4):507–514. doi:10.1007/BF02296192
   Web of Science ®Google Scholar
• Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55. doi:10.1080/10705519909540118
   Web of Science ®Google Scholar
• DeVon HA, Block ME, Moyle-Wright P, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–164. doi:10.1111/j.1547-5069.2007.00161.x
   PubMed Web of Science ®Google Scholar
• Svetina D, Rutkowski L, Rutkowski D. Multiple-group invariance with categorical outcomes using updated guidelines: an illustration using mplus and the lavaan/semTools packages. Struct Equ Modeling. 2020;27(1):111–130. doi:10.1080/10705511.2019.1602776
   Web of Science ®Google Scholar
• Winter SD, Depaoli S. An illustration of Bayesian approximate measurement invariance with longitudinal data and a small sample size. Int J Behav Dev. 2020;44(4):371–382. doi:10.1177/0165025419880610
   Web of Science ®Google Scholar
• Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Modeling. 2002;9:233–255. doi:10.1207/S15328007SEM0902_5
   Web of Science ®Google Scholar
• Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Modeling. 2007;14(3):464–504. doi:10.1080/10705510701301834
   Web of Science ®Google Scholar
• Meade AW, Johnson EC, Braddy PW. Power and sensitivity of alternative fit indices in tests of measurement invariance. J Appl Psychol. 2008;93(3):568–592. doi:10.1037/0021-9010.93.3.568
   PubMed Web of Science ®Google Scholar
• Peters G-J. The alpha and the omega of scale reliability and validity: why and how to abandon Cronbach's alpha and the route towards more comprehensive assessment of scale quality. Euro Health Psychologist. 2014;16:56–69.
   Google Scholar
• Zumbo B, Gadermann A, Zeisser C. Ordinal versions of coefficients alpha and theta for likert rating scales. J Mod Appl Stat Meth. 2007;6:21–29. doi:10.22237/jmasm/1177992180
   Google Scholar
• Crutzen R, Peters G-JY. Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health Psychol Rev. 2017;11(3):242–247. doi:10.1080/17437199.2015.1124240
   PubMed Web of Science ®Google Scholar
• Gamer M, Lemon J, Singh I. irr: various coefficients of interrater reliability and agreement. Available from: https://rdrr.io/cran/irr/. Accessed December 19, 2022.
   Google Scholar
• Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19(1):231–240. doi:10.1519/15184.1
   PubMed Web of Science ®Google Scholar
• Terwee CB, Bot SD, de Boer MR, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42. doi:10.1016/j.jclinepi.2006.03.012
   PubMed Web of Science ®Google Scholar
• Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–163. doi:10.1016/j.jcm.2016.02.012
   PubMed Web of Science ®Google Scholar
• Mao Y, Zhang N, Liu J, Zhu B, He R, Wang X. A systematic review of depression and anxiety in medical students in China. BMC Med Educ. 2019;19(1):327. doi:10.1186/s12909-019-1744-2
   PubMed Web of Science ®Google Scholar
• Schwartz S, Campbell UB, Gatto NM, Gordon K. Toward a clarification of the taxonomy of “bias” in epidemiology textbooks. Epidemiology. 2015;26(2):216–222. doi:10.1097/EDE.0000000000000224
   PubMed Web of Science ®Google Scholar