Communicating epidemiological results through alternative indicators: Cognitive interviewing to assess a questionnaire on risk perception in a high environmental risk area

References

• Akl, E. A., Oxman, A. D., Herrin, J., Vist, G. E., Terrenato, I., Sperati, F., … Schünemann, H. (2011). Using alternative statistical formats for presenting risks and risk reductions. Cochrane Database of Systematic Reviews, 3, CD006776. doi:10.1002/14651858.CD006776.pub2
   Web of Science ®Google Scholar
• Ancker, J. S., Senathirajah, Y., Kukafka, R., & Starren, J. B. (2006). Design features of graphs in health risk communication: A systematic review. Journal of the American Medical Informatics Association, 13, 608–618.10.1197/jamia.M2115
   PubMed Web of Science ®Google Scholar
• Baum, F., MacDougall, C., & Smith, D. (2006). Participatory action research. Journal of Epidemiology and Community Health, 60, 854–857.10.1136/jech.2004.028662
   PubMed Web of Science ®Google Scholar
• Beatty, P. C., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71, 287–311.10.1093/poq/nfm006
   Web of Science ®Google Scholar
• Bennett, P. (1999). Understanding responses to risk: Some basic findings. In P. Bennett & K. Calman (Eds.), Risk communication and public health (pp. 3–19). Oxford: Oxford University Press.
   Google Scholar
• Bennett, P., & Calman, K. (1999). Risk communication and public health. Oxford: Oxford University Press.
   Google Scholar
• Bergus, G. R., Levin, I. P., & Elstein, A. S. (2002). Presenting risks and benefits to patients. Journal of General Internal Medicine, 17, 1525–1497.
   Web of Science ®Google Scholar
• Biernacki, P., & Waldorf, D. (1981). Snowball sampling: Problem and techniques of chain referral sampling. Sociological Methods and Research, 10, 141–163.
   Web of Science ®Google Scholar
• Biggeri, A., Lagazio, C., Catelan, D., Pirastu, R., Casson, F., & Terracini, B. (2006). Rapporto sullo stato di salute delle popolazioni residenti in aree interessate da poli industriali, minerari o militari della Regione Sardegna. Epidemiologia e Prevenzione, 30, 1–96.
   Google Scholar
• Boholm, Å. (2008). New perspectives on risk communication: uncertainty in a complex society. Journal of Risk Research, 11, 1–3.10.1080/13669870801947897
   Web of Science ®Google Scholar
• Bouyer, M., Bagdassarian, S., Chaabanne, S., & Mullet, E. (2001). Personality correlates of risk perception. Risk Analysis, 21, 457–466.10.1111/risk.2001.21.issue-3
   PubMed Web of Science ®Google Scholar
• Brydon-Miller, M. (2003). Using participatory action research to address community health issues. In M. Murray (Ed.), Critical health psychology (pp. 187–202). London: Palgrave.
   Google Scholar
• Burawoy, M. (2005). The critical turn to public sociology. Critical Sociology, 31, 313–326.10.1163/1569163053946291
   Google Scholar
• Carbone, E. T., Campbell, M. K., & Honess-Monreale, K. (2002). Use of cognitive interview techniques in the development of nutrition surveys and interactive nutrition messages for low income populations. Journal of the American Dietetic Association, 102, 691–696.
   Google Scholar
• Cataldi, S. (2014). Public sociology and participatory approaches. Towards a democratization of social research? Qualitative Sociology Review, 10, 152–172.
   Google Scholar
• Chevalier, J. M., & Buckles, D. J. (2013). Participatory action research: Theory and methods for engaged inquiry. London: Routledge.
   Google Scholar
• Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229–238.10.1023/A:1023254226592
   PubMed Web of Science ®Google Scholar
• Commission of the European Communities. (1990). Council directive 82/501/EEC on the major-accident hazards of certain industrial activities. Luxembourg: Office for Official Publications of the European Communities. Retrieved from http://goo.gl/kRX29h
   Google Scholar
• Commission of the European Communities. (1997). Council directive 96/82/EC of 9 December 1996 on the control of major-accident hazards involving dangerous substances. Official Journal of the European Communities, L 10, 13–33. Retrieved from http://goo.gl/uhkzyu
   Google Scholar
• Commission of the European Communities. (2012). Directive 2012/18/EU of the European parliament and of the council of 4 July 2012 on the control of major-accident hazards involving dangerous substances, amending and subsequently repealing Council Directive 96/82/EC. Official Journal of the European Union, L 197, 1–37. Retrieved from http://goo.gl/cwL9Zp
   Google Scholar
• Conrad, F., & Blair, J. (1996). From impression to data: Increasing objectivity of cognitive interviews. Proceedings of the Section on Survey Research methods, American Statistical Association. Retrieved from http://www.bls.gov/osmr/pdf/st960080.pdf
   Google Scholar
• Covello, V. T. (1989). Communicating information about the health risks of radioactive waste: a review of obstacles to public understanding. Bulletin of the New York Academy of Medicine, 65, 467–482.
   PubMedGoogle Scholar
• Covello, V. T., & Sandman, P. M. (2001). Risk communication: Evolution and revolution. In A. Wolbarst (Ed.), Solutions to an environment in peril (pp. 164–178). Baltimore, MD: John Hopkins University Press.
   Google Scholar
• De Marchi, B., Funtowicz, S., & Pereira, A. G. (2001). From the right to be informed to the right to participate: Responding to the evolution of European legislation with ICT. International Journal of Environment and Pollution, 15, 1–21.10.1504/IJEP.2001.000588
   Web of Science ®Google Scholar
• Douglas, M., & Wildavsky, A. (1982). Risk and culture: An essay on the selection of technical and environmental dangers. Berkeley, CA: University of California Press.
   Google Scholar
• Drennan, J. (2003). Cognitive interviewing: verbal data in the design and pretesting of questionnaires. Journal of Advanced Nursing, 42, 57–63.10.1046/j.1365-2648.2003.02579.x
   PubMed Web of Science ®Google Scholar
• Feldman-Stewart, D., Kocovski, N., McConnell, B. A., Brundage, M. D., & Mackillop, W. J. (2000). Perception of quantitative information for treatment decisions. Medical Decision Making, 20, 228–238.10.1177/0272989X0002000208
   PubMed Web of Science ®Google Scholar
• Fischhoff, B., Slovic, P., Lichtenstein, S., Read, S., & Combs, B. (1978). How safe is safe enough? A psychometric study of attitudes towards technological risks and benefits. Policy Sciences, 9, 127–152.10.1007/BF00143739
   Web of Science ®Google Scholar
• Fortune-Greeley, A. K., Flynn, K. E., Jeffery, D. D., Williams, M. S., Keefe, F. J., Reeve, B. B., … Weinfurt, K. P. (2009). Using cognitive interviews to evaluate items for measuring sexual functioning across cancer populations: Improvements and remaining challenges. Quality of Life Research, 18, 1085–1093.10.1007/s11136-009-9523-x
   PubMed Web of Science ®Google Scholar
• Gigerenzer, G., & Edwards, A. (2003). Simple tools for understanding risks: From innumeracy to insight. British Medical Journal, 327, 741–744.10.1136/bmj.327.7417.741
   PubMed Web of Science ®Google Scholar
• Gigerenzer, G., Gaissmaier, W., Kurtz-Milke, E., Scwartz, L. M., & Woloshin, S. (2008). Helping doctors and patients make sense of health statistics. Association for Psychological Science, 8, 53–96.
   Google Scholar
• Gomes, B., McCrone, P., Hall, S., Riley, J., Koffmann, J., & Higginson, H. J. (2013). Cognitive interviewing of bereaved relatives to improve the measurement of health outcomes and care utilization at the end of life in a mortality follow back survey. Supportive Care in Cancer, 21, 2834–2844.
   Web of Science ®Google Scholar
• Grant, E. N., Turner-Roan, K., Daugherty, S. R., Li, T., Eckenfels, E., Baier, C., … Weiss, K. B. (1999). Development of a survey of asthma knowledge, attitudes, and perceptions: The chicago community asthma survey. Chest, 116, 178S–183S.10.1378/chest.116.suppl_2.178S
   PubMed Web of Science ®Google Scholar
• Habermas, J. (1985). The theory of communicative action. Cambridge: Beacon Press.
   Google Scholar
• Hagemann, K. S., & Scholderer, J. (2009). Hot potato: Expert-consumer differences in the perception of a second-generation novel food. Risk Analysis, 29, 1041–1055.10.1111/risk.2009.29.issue-7
   PubMed Web of Science ®Google Scholar
• Halvorsen, P. A., Selmer, R., & Kristiansen, I. S. (2007). Different ways to describe the benefits of risk-reducing treatments: A randomized trial . Annals of Internal Medicine, 146, 848–856.10.7326/0003-4819-146-12-200706190-00006
   PubMed Web of Science ®Google Scholar
• Harrison, J. D., Young, J. M., Butow, P., Salkeld, G., & Solomon, M. J. (2005). Is it worth the risk? A systematic review of instruments that measure risk propensity for use in the health setting. Social Science & Medicine, 60, 1385–1396.10.1016/j.socscimed.2004.07.006
   PubMed Web of Science ®Google Scholar
• Hay, J. L., Atkinson, T. M., Reeve, B. B., Mitchell, S. A., Mendoza, T. R., Willis, G., … Chen, A. (2014). Cognitive interviewing of the US national cancer institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Quality of Life Research, 23, 257–269.10.1007/s11136-013-0470-1
   PubMed Web of Science ®Google Scholar
• Heron, J. (1996). Co-operative inquiry: Research into the human condition. London: Sage.
   Google Scholar
• Horwood, J., Pollard, B., Ayis, S., McIlvenna, T., & Johnston, M. (2010). Listening to patients: Using verbal data in the validation of the Aberdeen measures of impairment, activity limitation and participation restriction (Ab-IAP). BMC Musculoskeletal Disorders, 11, 182. doi:10.1186/1471-2474-11-182
   PubMed Web of Science ®Google Scholar
• Irwin, D. E., Varni, J. W., Yeatts, K., & DeWalt, D. A. (2009). Cognitive interviewing methodology in the development of a pediatric item bank: A patient reported outcomes measurement information system (PROMIS) study. Health and Quality of Life Outcomes, 7, 3. doi:10.1186/1477-7525-7-3
   PubMed Web of Science ®Google Scholar
• Jardine, C. G., & Hrudey, S. E. (1997). Mixed messages in risk communication. Risk Analysis, 17, 489–498.10.1111/risk.1997.17.issue-4
   Web of Science ®Google Scholar
• Johnson, B. B., & Slovic, P. (1995). Presenting uncertainty in health risk assessment: Initial studies of its effects on risk perception and trust. Risk Analysis, 15, 485–494.10.1111/risk.1995.15.issue-4
   PubMed Web of Science ®Google Scholar
• Johnson, B. B., & Slovic, P. (1998). Lay views on uncertainty in environmental health risk assessment. Journal of Risk Research, 1, 261–279.10.1080/136698798377042
   Google Scholar
• Jovchelovitch, S. (2007). Knowledge in context: Representations, community and culture. London: Routledge.
   Google Scholar
• Karnieli-Miller, O., Strier, R., & Pessach, L. (2009). Power relations in qualitative research. Qualitative Health Research, 19, 279–289.10.1177/1049732308329306
   PubMed Web of Science ®Google Scholar
• Krauss, R. M., & Fussell, S. R. (1996). Social psychological models of interpersonal communication. In E. T. Higgins, & A. Kruglanski (Eds.), Social psychology: Handbook of basic principles (pp. 655–701). New York, NY: Guilford Press.
   Google Scholar
• Leiss, W. (1996). Three phases in the evolution of risk communication practice. The ANNALS of the American Academy of Political and Social Science, 545, 85–94.10.1177/0002716296545001009
   Web of Science ®Google Scholar
• Leung, M. W., Yen, I. H., & Minkler, M. (2004). Community based participatory research: A promising approach for increasing epidemiology’s relevance in the 21st century. International Journal of Epidemiology, 33, 499–506.10.1093/ije/dyh010
   PubMed Web of Science ®Google Scholar
• Löfstedt, R. E. (2005). Risk Management in Post-Trust Societies. Basingstoke: Palgrave MacMillan.10.1057/9780230503946
   Google Scholar
• Manganello, J. A., & Clayman, M. L. (2011). The association of understanding of medical statistics with health information seeking and health provider interaction in a national sample of young adults. Journal of Health Communication, 16, 163–176.10.1080/10810730.2011.604704
   PubMed Web of Science ®Google Scholar
• Martuzzi, M., Mitis, F., Biggeri, A., Terracini, B., & Bertollini, R. (2002). Ambiente e stato di salute nella popolazione delle aree ad alto rischio di crisi ambientale in Italia. Epidemiologia e Prevenzione, 26, 1–53.
   PubMedGoogle Scholar
• McComas, K. (2006). Defining moments in risk communication research: 1996–2005. Journal of Health Communication, 11, 75–91.10.1080/10810730500461091
   PubMed Web of Science ®Google Scholar
• Misselbrook, D., & Armstrong, D. (2001). Patients’ responses to risk information about the benefit of treating hypertension. British Journal of General Practice, 51, 276–279.
   PubMed Web of Science ®Google Scholar
• Møller, A., Reventlow, S., Andersen, J. H., Avlund, K., & Mortensen, O. S. (2012). Validity of workers’ self-reports. Evaluation of a question assessing lifetime exposure to occupational physical activity. British Journal of Medicine and Medical Research, 2, 536–552.10.9734/BJMMR
   Google Scholar
• Morgan, S. J., Amtmann, D., Abrahamson, D. C., Kajlich, A. J., & Hafner, B. J. (2014). Use of cognitive interviews in the development of the PLUS-M item bank. Quality of Life Research, 23, 1767–1775.10.1007/s11136-013-0618-z
   PubMed Web of Science ®Google Scholar
• Myers, M. D., & Newman, M. (2007). The qualitative interview in IS research: Examining the craft. Information and Organization, 17, 2–26.10.1016/j.infoandorg.2006.11.001
   Google Scholar
• Naik, G., Ahmed, H., & Edwards, A. G. (2012). Communicating risk to patients and the public. British Journal of General Practice, 62, 213–216.10.3399/bjgp12X636236
   PubMed Web of Science ®Google Scholar
• Nelson, W., Reyna, V. F., Fagerlin, A., Lipkus, I., & Peters, E. (2008). Clinical implications of numeracy: Theory and practice. Annals of Behavioral Medicine, 35, 261–274.10.1007/s12160-008-9037-8
   PubMed Web of Science ®Google Scholar
• Otway, H. (1987). Experts, risk, communication and democracy. Risk Analysis, 7, 125–129.10.1111/risk.1987.7.issue-2
   Web of Science ®Google Scholar
• Paling, J. (2003). Strategies to help patients understand risks. British Medical Journal, 327, 745–748.10.1136/bmj.327.7417.745
   PubMed Web of Science ®Google Scholar
• Peters, E. (2008). Numeracy and the perception and communication of risk. Annals of the New York Academy of Sciences, 1128, 1–7.10.1196/nyas.2008.1128.issue-1
   PubMed Web of Science ®Google Scholar
• Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006). Numeracy and decision making. Psychological Science, 17, 407–413.10.1111/j.1467-9280.2006.01720.x
   PubMed Web of Science ®Google Scholar
• Purvis-Roberts, K. L., Werner, C. A., & Frank, I. (2007). Perceived risks from radiation and nuclear testing near Semipalatinsk, Kazakhstan: A comparison between physicians, scientists, and the public. Risk Analysis, 27, 291–302.10.1111/risk.2007.27.issue-2
   PubMed Web of Science ®Google Scholar
• Reason, P., & Bradbury, H. (2001). Handbook of action research: Participative inquiry and practice. London: Sage.
   Google Scholar
• Renn, O. (1998). Three decades of risk research: Accomplishments and new challenges. Journal of Risk Research, 1, 49–71.10.1080/136698798377321
   Google Scholar
• Renn, O. (2004). Participatory processes for designing environmental policies. Land Use Policy, 23, 34–43.
   Web of Science ®Google Scholar
• Reyna, V. F., Nelson, W. L., Han, P. K., & Dieckmann, N. F. (2009). How numeracy influences risk comprehension and medical decision making. Psychological Bulletin, 135, 943–973.10.1037/a0017327
   PubMed Web of Science ®Google Scholar
• Scherer, C. W., & Cho, H. (2003). A social network contagion theory of risk perception. Risk Analysis, 23, 261–267.10.1111/risk.2003.23.issue-2
   PubMed Web of Science ®Google Scholar
• Schwartz, L. M., Woloshin, S., Black, W. C., & Welch, H. G. (1997). The role of numeracy in understanding the benefit of screening Mammography. Annals of Internal Medicine, 127, 966–972.10.7326/0003-4819-127-11-199712010-00003
   PubMed Web of Science ®Google Scholar
• Sheridan, S. L., Pignone, M. P., & Lewis, C. L. (2003). A randomized comparison of patients’ understanding of number needed to treat and other common risk reduction formats. Journal of General Internal Medicine, 18, 884–892.10.1046/j.1525-1497.2003.21102.x
   PubMed Web of Science ®Google Scholar
• Sherman, K. J., Eaves, E. R., Ritenbaugh, C., Hsu, C., Cherkin, D. C., & Turner, J. A. (2014). Cognitive interviews guide design of a new CAM patient expectations questionnaire. BMC Complementary and Alternative Medicine, 14, 39. doi:10.1186/1472-6882-14-39
   PubMed Web of Science ®Google Scholar
• Siegrist, M., Keller, C., Kastenholz, H., Frey, S., & Wiek, A. (2007). Laypeople's and experts' perception of nanotechnology hazards. Risk Analysis, 27, 59–69.10.1111/risk.2007.27.issue-1
   PubMed Web of Science ®Google Scholar
• Simon, A. E., Forbes, L. J., Boniface, D., Warburton, F., Brain, K. E., Dessaix, A., … Petermann, L. (2012). An international measure of awareness and beliefs about cancer: development and testing of the ABC. BMJ Open, 2, e001758. doi:10.1136/bmjopen-2012-001758
   PubMed Web of Science ®Google Scholar
• Sjöberg, L. (2000). Factors in risk perception. Risk Analysis, 20, 1–12.10.1111/risk.2000.20.issue-1
   PubMed Web of Science ®Google Scholar
• Slovic, P., Finucane, M. L., Peters, E., & MacGregor, D. G. (2007). The affect heuristic. European Journal of Operational Research, 177, 1333–1352.10.1016/j.ejor.2005.04.006
   Web of Science ®Google Scholar
• Slovic, P., Fischhoff, B., & Lichtenstein, S. (1979). Rating the risks. Environment: Science and Policy for Sustainable Development, 21, 14–39.10.1080/00139157.1979.9933091
   Web of Science ®Google Scholar
• Sorensen, L., Gyrd-Hansen, D., Kristiansen, I. S., Nexøe, J., & Nielsen, J. B. (2008). Laypersons' understanding of relative risk reductions: Randomised cross-sectional study. BMC Medical Informatics and Decision Making, 8, 31. doi:10.1186/1472-6947-8-31
   PubMed Web of Science ®Google Scholar
• Stern, P. C., & Fineberg, H. C. (1996). Understanding risk: Informing decisions in a democratic society. Washington, DC: U.S. National Research Council.
   Google Scholar
• Stewart, P., Rice, C., Beatty, P., Wilson, B., Stewart, W., & Blair, A. (2002). A qualitative evaluation of questions and responses from five occupational questionnaires developed to assess exposures. Applied Occupational and Environmental Hygiene, 17, 444–453.10.1080/10473220290035480
   PubMedGoogle Scholar
• Storey, J. D. (2003). The positive false discovery rate: a Bayesian interpretation and the q-value. The Annals of Statistics, 31, 2013–2035.10.1214/aos/1074290335
   Web of Science ®Google Scholar
• Thompson, J. J., Kelly, K. L., Ritenbaugh, C., Hopkins, A. L., Sims, C. M., & Coons, S. J. (2011). Developing a patient-centered outcome measure for complementary and alternative medicine therapies II: Refining content validity through cognitive interviews. BMC Complementary and Alternative Medicine, 11, 136. doi:10.1186/1472-6882-11-136
   PubMed Web of Science ®Google Scholar
• Tourangeau, R. (1984). Cognitive sciences and survey methods. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey methodology: Building a bridge between disciplines (pp. 73–100). Washington, DC: National Academy Press.
   Google Scholar
• Turner-Bowker, D. M., Saris-Baglama, R., DeRosa, M. A., Paulsen, C. A., & Bransfield, C. P. (2009). Using qualitative research to inform the development of a comprehensive outcomes assessment for Asthma. The Patient: Patient-Centered Outcomes Research, 2, 269–282.10.2165/11313840-000000000-00000
   Web of Science ®Google Scholar
• Wang, C., O’Neill, S. M., Rothrock, N., Gramling, R., Sen, A., Acheson, L. S., … Ruffin, M. T. (2009). Comparison of risk perceptions and beliefs across common chronic diseases. Preventive Medicine, 48, 197–202.10.1016/j.ypmed.2008.11.008
   PubMed Web of Science ®Google Scholar
• Wardman, J. K. (2008). The constitution of risk communication in advanced liberal societies. Risk Analysis, 28, 1619–1637.10.1111/risk.2008.28.issue-6
   PubMed Web of Science ®Google Scholar
• Watt, T., Rasmussen, Å. K., Groenvold, M., Bjorner, J. B., Watt, S. H., Bonnema, S. J., … Feldt-Rasmussen, U. (2008). Improving a newly developed patient-reported outcome for thyroid patients, using cognitive interviewing. Quality of Life Research, 17, 1009–1017.10.1007/s11136-008-9364-z
   PubMed Web of Science ®Google Scholar
• Weber, E. U., Blais, A. R., & Betz, N. (2002). A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. Journal of Behavioral Decision Making, 15, 263–290.10.1002/(ISSN)1099-0771
   Web of Science ®Google Scholar
• White, M. C., Berger-Frank, S., Campagna, D., Inserra, S. G., Middleton, D., Millette, M. D., … Williamson, D. (2004). Communicating results to community residents: Lesson from recent ATSDS Health investigations. Journal of Exposure Analysis and Environmental Epidemiology, 14, 484–491.
   PubMedGoogle Scholar
• Williams, P. (2004). Health risk communication using comparative risk analyses. Journal of Exposure Analysis and Environmental Epidemiology, 14, 498–515.10.1038/sj.jea.7500395
   PubMedGoogle Scholar
• Willis, G. B., Royston, P., & Bercini, D. (1991). The use of verbal report methods in the development and testing of survey questionnaires. Applied Cognitive Psychology, 5, 251–267.10.1002/(ISSN)1099-0720
   Web of Science ®Google Scholar