Optimal recall periods for patient-reported outcomes: challenges and potential solutions

References

• Redelmeier DA, Katz J, Kahneman D. Memories of colonoscopy: a randomized trial. Pain 2003;104:187-94
   PubMed Web of Science ®Google Scholar
• Stone AA, Broderick JE, Schwartz JE, et al. Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction. Pain 2003;104:343-51
   PubMed Web of Science ®Google Scholar
• Stone AA, Schwartz JE, Broderick JE, et al. Variability of momentary pain predicts recall of weekly pain: a consequence of the peak (or salience) memory heuristic. Pers Soc Psychol Bull 2005;31:1340-6
   PubMed Web of Science ®Google Scholar
• Evans C, Crawford B. Patient self-reports in pharmacoeconomic studies. Their use and impact on study validity. Pharmacoeconomics 1999;15:241-56
   Google Scholar
• McColl E. Best practice in symptom assessment: a review. Gut 2004;53 (Suppl 4):iv49-54
   PubMed Web of Science ®Google Scholar
• Schmier JK, Jordana K, Halpern MT, Michael T. Patient recall and recall bias of health state and health status. Expert Rev Pharmacoecon Outcom Res 2004;4:159-63
   PubMedGoogle Scholar
• Gendreau M, Hufford MR, Stone AA. Measuring clinical pain in chronic widespread pain: selected methodological issues. Best Pract Res Clin Rheumatol 2003;17:575-92
   PubMed Web of Science ®Google Scholar
• Gutek BA. On the accuracy of retrospective attitudinal data. Public Opin Q 1978;42:390-401
   Web of Science ®Google Scholar
• Ebbinghaus H. A Contribution to Experimental Psychology. New York: Teachers College, 1913
   Google Scholar
• Mathiowetz NA. The effects of length of recall on the quality of survey data. Paper presented at: Fourth Conference on Methodological Issues in Official Statistics, 2000, Stockholm, Sweden
   Google Scholar
• Bradburn NM, Rips LJ, Shevell SK. Answering autobiographical questions: the impact of memory and inference on surveys. Science 1987;236:157-61
   PubMed Web of Science ®Google Scholar
• Skowronski JJ, Betz AL, Thompson CP, et al. Social memory in every day life: recall of self-events and other-events. J Pers Soc Psychol 1991;64:831-43
   Google Scholar
• Bradburn NM. Temporal and event dating. In: Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtzman HS, Cain VS, eds. The Science of Self-Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates, 2000
   Google Scholar
• Sudman S, Schwartz N. Contributions of cognitive psychology to advertising research. J Advert Res 1989;29:43-53
   Web of Science ®Google Scholar
• Bound J, Brown C, Mathiowetz N. Measurement error in survey data. In: Heckman JJ, Leamer E, eds. Handbook of Econometrics, Vol 5. Amsterdam: North-Holland, 2001
   Google Scholar
• Mahalanobis PC, Sen SB. On some aspects of the Indian National Sample Survey. Bull Int Stat Inst 1953;34:5-14
   Google Scholar
• Neter J, Waksberg J. A Study of response errors in expenditures data from household interviews. J Am Stat Assoc 1964;59:18-55
   Web of Science ®Google Scholar
• Dedominicis R, Grechi G. Comparison of hospitalization reporting in three survey procedures. A study of alternative survey methods for collection of hospitalization data from household respondents. Vital Health Stat 1 1965;115:1-48
   PubMedGoogle Scholar
• Biering-Sorensen U. Reporting of hospitalization in the health interview survey. Vital Health Stat 1 1965;61:1-71
   PubMedGoogle Scholar
• Cash WS, Moss AJ. Optimum recall period for reporting persons injured in motor vehicle accidents. Vital Health Stat 2 1972;50:1-33
   PubMedGoogle Scholar
• Murphy L, Cowan C. Effects of bounding on telescoping in the National Crime Survey. Proceedings of the Social Statistics Section: American Statistical Association, 1976;:633-8
   Google Scholar
• Gems B, Ghosh D, Hitlin R. A recall experiment: impact of time on recall of recreational fishing trips. Proceedings of the Section on Survey Research Methods: American Statistical Association, 1982;:372-5
   Google Scholar
• Baxter SD, Smith AF, Litaker MS, et al. Recency affects reporting accuracy of children's dietary recalls. Ann Epidemiol 2004;14:385-90
   PubMed Web of Science ®Google Scholar
• Gordon NP, Hiatt RA, Lampert DI. Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 1993;85:566-70
   PubMed Web of Science ®Google Scholar
• Zapka JG, Bigelow C, Hurley T, et al. Mammography use among sociodemographically diverse women: the accuracy of self-report. Am J Public Health 1996;86:1016-21
   PubMed Web of Science ®Google Scholar
• Amjadi-Begvand S, Khanna D, Park GS, et al. Dating the ‘window of therapeutic opportunity’ in early rheumatoid arthritis: accuracy of patient recall of arthritis symptom onset. J Rheumatol 2004;31:1686-92
   PubMed Web of Science ®Google Scholar
• Cannell CF, Marquis KH, Laurent A. A summary of studies of interviewing methodology. Vital Health Stat 2 1977;i-viii:1-78
   Google Scholar
• Fowler FJ. Improving Survey Questions: Design and Evaluation. Thousand Oaks, CA: Sage Publications, 1995
   Google Scholar
• Revicki DA, Irwin D, Reblando J, et al. The accuracy of self-reported disability days. Med Care 1994;32:401-4
   PubMed Web of Science ®Google Scholar
• Reilly MC, Bracco A, Ricci JF, et al. The validity and accuracy of the Work Productivity and Activity Impairment questionnaire -- irritable bowel syndrome version (WPAI:IBS). Aliment Pharmacol Ther 2004;20:459-67
   PubMed Web of Science ®Google Scholar
• Converse JM, Presser S. Survey Questions: Handcrafting the Standardized Questionnaire. Sage University Paper series on Quantitative Applications in the Social Sciences, 07--063. Newbury Park, CA: Sage Publications, 1986
   Google Scholar
• Reis HT, Gable SL. Event sampling and other methods for studying everyday experience. In: Reis HT, Judd CM, eds. Handbook of Research Methods in Social and Personality Psychology. Cambridge: Cambridge University Press, 2000:190-222
   Google Scholar
• Madow WG. Interview data on chronic conditions compared with information derived from medical records. Vital Health Stat 2 1967;23:1-84
   PubMedGoogle Scholar
• Thomas DL, Diener E. Memory accuracy in the recall of emotions. J Pers Soc Psychol 1990;59:291-7
   Web of Science ®Google Scholar
• Dawson EG, Kanim LE, Sra P, et al. Low back pain recollection versus concurrent accounts: outcomes analysis. Spine 2002;27:984-93
   PubMed Web of Science ®Google Scholar
• Howard GS, Dailey PR. Response-shift bias: a source of contamination of self-report measures. J Appl Psychol 1979;64:144-50
   Web of Science ®Google Scholar
• Howard GS. Response-shift bias: a problem in evaluating interventions with pre/post self-reports. Eval Rev 1980;4:93-106
   Web of Science ®Google Scholar
• Cronbach LJ, Furby L. How should we measure ‘change’ -- or should we? Psychol Bull 1970;74:68-80
   Web of Science ®Google Scholar
• Sprangers MA, Schwartz CE. Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med 1999;48:1507-15
   PubMed Web of Science ®Google Scholar
• Schwartz CE, Sprangers MA. Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med 1999;48:1531-48
   PubMed Web of Science ®Google Scholar
• Litwin MS, McGuigan KA. Accuracy of recall in health-related quality-of-life assessment among men treated for prostate cancer. J Clin Oncol 1999;17:2882-8
   PubMed Web of Science ®Google Scholar
• Ahmed S, Mayo NE, Wood-Dauphinee S, et al. Response shift influenced estimates of change in health-related quality of life poststroke. J Clin Epidemiol 2004;57:561-70
   PubMed Web of Science ®Google Scholar
• Broderick JE, Schwartz JE, Shiffman S, et al. Signaling does not adequately improve diary compliance. Ann Behav Med 2003;26:139-48
   PubMed Web of Science ®Google Scholar
• Raselli C and Broderick JE. The association of depression and neuroticism with pain reports: a comparison of momentary and recalled pain assessment. J Psychosom Res 2007;62:313-20
   PubMed Web of Science ®Google Scholar
• Blaney PH. Affect and memory: a review. Psychol Bull 1986;99:229-46
   PubMed Web of Science ®Google Scholar
• Eich E, Reeves JL, Jaeger B, et al. Memory for pain: relation between past and present pain intensity. Pain 1985;23:375-80
   PubMed Web of Science ®Google Scholar
• Parkinson B, Briner RB, Reynolds S, et al. Time frames for mood: Relations between momentary and generalized ratings of affect. Pers Soc Psychol Bull 1995;21:331-9
   Web of Science ®Google Scholar
• Cappelleri J, Bushmakin A, Baker C, et al. Confirmatory factor analyses and reliability of the modified cigarette evaluation questionnaire. Addict Behav 2007;32:912-23
   PubMed Web of Science ®Google Scholar
• Shiffman S, Hufford M, Hickcox M, et al. Remember that? A comparison of real-time versus retrospective recall of smoking lapses. J Consult Clin Psychol 1997;65:292-300
   PubMed Web of Science ®Google Scholar
• Smyth J, Stone A. Ecological momentary assessment research in behavioral medicine. J Happiness Stud 2003;4:35-52
   Google Scholar
• Wyrwich KW, Tardino VM. A blueprint for symptom scales and responses: measurement and reporting. Gut 2004;53 (Suppl 4):iv45-8
   PubMed Web of Science ®Google Scholar
• Stone AA, Shiffman S, Schwartz JE, et al. Patient non-compliance with paper diaries. BMJ 2002;324:1193-4
   PubMed Web of Science ®Google Scholar
• Stone AA, Broderick JE, Kaell AT, et al. Does the peak-end phenomenon observed in laboratory pain studies apply to real-world pain in rheumatoid arthritics? J Pain 2000;1:212-17
   PubMed Web of Science ®Google Scholar
• Broderick JE, Schwartz JE, Vikingstad G, et al. The accuracy of pain and fatigue items across different reporting periods. Pain 2008;139:146-57
   PubMed Web of Science ®Google Scholar
• Linton SJ. Memory for chronic pain intensity: correlates of accuracy. Percept Mot Skills 1991;72 (3 Pt 2):1091-5
   PubMed Web of Science ®Google Scholar
• Peters ML, Sorbi MJ, Kruise DA, et al. Electronic diary assessment of pain, disability and psychological adaptation in patients differing in duration of pain. Pain 2000;84:181-92
   PubMed Web of Science ®Google Scholar
• Stone AA, Broderick JE, Shiffman SS, Schwartz JE. Understanding recall of weekly pain from a momentary assessment perspective: absolute agreement, between- and within-person consistency, and judged change in weekly pain. Pain 2004;107:61-9
   PubMed Web of Science ®Google Scholar
• Williams DA, Gendreau M, Hufford MR, et al. Pain assessment in patients with fibromyalgia syndrome: a consideration of methods for clinical trials. Clin J Pain 2004;20:348-56
   PubMed Web of Science ®Google Scholar
• Kahneman D, Fredrickson D, Schreiber C, Redelemeier D. When more pain is preferred to less: Adding a better end. Psychol Sci 1993;4:401-5
   Web of Science ®Google Scholar
• Lingard EA, Wright EA, Sledge CB. Pitfalls of using patient recall to derive preoperative status in outcome studies of total knee arthroplasty. J Bone Joint Surg Am 2001;83-A:1149-56
   PubMed Web of Science ®Google Scholar
• Redelmeier DA, Kahneman D. Patients’ memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain 1996;66:3-8
   PubMed Web of Science ®Google Scholar
• de C Williams AC, Davies HT, et al. Simple pain rating scales hide complex idiosyncratic meanings. Pain 2000;85:457-63
   PubMed Web of Science ®Google Scholar
• Booth MI, Stratford J, Dehn TC. Patient self-assessment of test-day symptoms in 24-h pH-metry for suspected gastroesophageal reflux disease. Scand J Gastroenterol 2001;36:795-9
   PubMed Web of Science ®Google Scholar
• Friedberg F, Sohl SJ. Memory for fatigue in chronic fatigue syndrome: the relation between weeklyrecall and momentary ratings. Int J Behav Med 2008;15:29-33
   PubMed Web of Science ®Google Scholar
• Sohl SJ, Friedberg F. Memory for fatigue in chronic fatigue syndrome: relationships to fatigue variability, catastrophizing, and negative affect. Behav Med 2008;34:29-38
   PubMed Web of Science ®Google Scholar
• Karakiewicz P, Shariat SF, Naderi A, et al. Reliability of remembered International Index of Erectile Function domain scores in men with localized prostate cancer. Urology 2005;65:131-5
   PubMed Web of Science ®Google Scholar
• Tidermark J, Zethraeus N, Svensson O, et al. Femoral neck fractures in the elderly: functional outcome and quality of life according to EuroQol. Qual Life Res 2002;11:473-81
   PubMed Web of Science ®Google Scholar
• Howell J, Xu M, Duncan CP, Masri BA, et al. A comparison between patient recall and concurrent measurement of preoperativequality of life outcome in total hip arthroplasty. J Arthroplasty 2008;23:843-9
   PubMed Web of Science ®Google Scholar
• Ballatori E, Roila F. Impact of nausea and vomiting on quality of life in cancer patients during chemotherapy. Health Qual Life Outcomes 2003;1:46
   PubMedGoogle Scholar
• Martin AR, Pearson JD, Cai B, et al. Assessing the impact of chemotherapy-induced nausea and vomiting on patients’ daily lives: a modified version of the Functional Living Index-Emesis (FLIE) with 5-day recall. Support Care Cancer 2003;11:522-7
   PubMed Web of Science ®Google Scholar
• Dorman P, Slattery J, Farrell B, et al. Qualitative comparison of the reliability of health status assessments with the EuroQol and SF-36 questionnaires after stroke. United Kingdom Collaborators in the International Stroke Trial. Stroke 1998;29:63-8
   PubMed Web of Science ®Google Scholar
• Perneger TV, Etter JF, Rougemont A. Prospective versus retrospective measurement of change in health status: a community based study in Geneva, Switzerland. J Epidemiol Community Health 1997;51:320-5
   PubMed Web of Science ®Google Scholar
• Keller SD, Bayliss MS, Ware JE Jr, , et al. Comparison of responses to SF-36 Health Survey questions with one-week and four-week recall periods. Health Serv Res 1997;32:367-84
   PubMed Web of Science ®Google Scholar
• Barr JT, Schumacher GE, Freeman S, et al. American translation, modification, and validation of the St. George's Respiratory Questionnaire. Clin Ther 2000;22:1121-45
   Google Scholar
• Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 1988;54:1063-70
   PubMed Web of Science ®Google Scholar
• Watson D, Clark LA. The PANAS-X Manual for the positive and negative affect schedule - expanded form. Iowa: The University of Iowa, 1994. Available at: http://www.psychology.uiowa.edu/Faculty/Clark/PANAS-X.pdf. Accessed Jan 27, 2006
   Google Scholar
• Tellegen A. Structures of mood and personality and their relevance to assessing anxiety, with an emphasis on self-report. In: Tuma AH, Maser JD, eds. Anxiety and the Anxiety Disorders. Hillsdale, NJ: Erlbaum, 1985:681-706
   Google Scholar
• Huisman SJ, van Damm FSAM, Aronson NK, etal. On measuring complaints of cancer patients: some remarks on the time span of the question. In: Aronson NK, Beckman J, eds. The Quality of Life in Cancer Patients. New York: Raven Press, 1987:101-9
   Google Scholar
• Sutinen S, Lahti S, Nuttall NM, et al. Effect of a 1-month vs. a 12-month reference period on responses to the 14-item Oral Health Impact Profile. Eur J Oral Sci 2007;115:246-9
   PubMed Web of Science ®Google Scholar
• Clark PM, Fiebig DG, Gerdtham UG. Optimal recall length in survey design. J Health Econ 2008;27:1275-84
   PubMed Web of Science ®Google Scholar
• Harrison GG, Galal OM, Ibrahim N, et al. Underreporting of food intake by dietary recall is not universal: a comparison of data from Egyptian and American women. J Nutr 2000;130:2049-54
   PubMed Web of Science ®Google Scholar
• Tourangeau R, Rips L, Rasinski K. The Psychology of Survey Response. Cambridge: Cambridge University Press, 2000
   Google Scholar
• Steen IN, McColl E. Developing and testing symptom-based outcome measures. In Hutchinson A, McColl E, Christie M, Riccalton C, eds. Health Outcome Measures in Primary and Out-patient Care. Newark NJ: Harwood Academic Publishers, 1996
   Google Scholar