Inter-Rater Reliability of Assessed Prenatal Maternal Occupational Exposures to Solvents, Polycyclic Aromatic Hydrocarbons, and Heavy Metals

REFERENCES

• Endocrine Disruptor Screening and Testing Advisory Committee . 2011 . Endocrine Disruptor Screening and Testing Advisory Committee (EDSTAC) Final Report . [Online] Available at http://www.epa.gov/endo/pubs/edspoverview/finalrpt.htm (accessed March 14
   Google Scholar
• Teschke , K. , Olshan , A. F. Daniels , J. L. 2002 . Occupational exposure assessment in case-control studies: Opportunities for improvement . Occup. Environ. Med. , 59 ( 9 ) : 575 – 93 . discussion 594
   PubMed Web of Science ®Google Scholar
• Bauer , E. P. , Romitti , P. A. and Reynolds , S. J. 1999 . Evaluation of reports of periconceptual occupational exposure: Maternal-assessed versus industrial hygienist-assessed exposure . Am. J. Ind. Med. , 36 ( 5 ) : 573 – 578 .
   PubMed Web of Science ®Google Scholar
• Kromhout , H. , Oostendorp , Y. , Heederik , D. and Boleij , J. S. 1987 . Agreement between qualitative exposure estimates and quantitative exposure measurements . Am. J. Ind. Med. , 12 ( 5 ) : 551 – 562 .
   PubMed Web of Science ®Google Scholar
• Benke , G. , Sim , M. , Forbes , A. and Salzberg , M. 1997 . Retrospective assessment of occupational exposure to chemicals in community-based studies: Validity and repeatability of industrial hygiene panel ratings . Int. J. Epidemiol. , 26 ( 3 ) : 635 – 642 .
   PubMed Web of Science ®Google Scholar
• Hawkins , N. C. and Evans , J. S. 1989 . Subjective estimation of toluene exposures: A calibration study of occupational hygienists . Appl. Ind. Hyg. J. , 4 ( 3 ) : 61 – 68 .
   Google Scholar
• Correa , A. , Stewart , W. F. , Yeh , H. C. and Santos-Burgoa , C. 1994 . Exposure measurement in case-control studies: Reported methods and recommendations . Epidemiol. Rev. , 16 ( 1 ) : 18 – 32 .
   Web of Science ®Google Scholar
• White , E. , Armstrong , B. K. and Saracci , R. 2008 . Principles of Exposure Measurement in Epidemiology , 2nd ed , New York : Oxford University Press .
   Google Scholar
• Yoon , P. W. , Rasmussen , S. A. Lynberg , M. C. 2001 . The national birth defects prevention study . Public Health Rep. , 116 ( Suppl 1 ) : 32 – 40 .
   PubMed Web of Science ®Google Scholar
• Cohen , J. A. 1960 . A coefficient of agreement for nominal scales . Educ. Psychol. Meas. , 30 : 37 – 46 .
   Web of Science ®Google Scholar
• Fleiss , J. L. 1981 . Statistical Methods for Rates and Proportions , New York : John Wiley & Sons .
   Google Scholar
• Cicchetti , D. V. and Feinstein , A. R. 1990 . High agreement but low kappa: II. Resolving the paradoxes . J. Clin. Epidemiol. , 43 ( 6 ) : 551 – 558 .
   PubMed Web of Science ®Google Scholar
• Bartko , J. J. 1966 . The intraclass correlation coefficient as a measure of reliability . Psychol. Rep. , 19 ( 1 ) : 3 – 11 .
   PubMed Web of Science ®Google Scholar
• Fleiss , J. L. , Slakter , M. J. , Fischman , S. L. , Park , M. H. and Chilton , N. W. 1979 . Inter-examiner reliability in caries trials . J. Dent. Res. , 58 ( 2 ) : 604 – 609 .
   Web of Science ®Google Scholar
• Burstyn , I. and Teschke , K. 1999 . Studying the determinants of exposure: A review of methods . Am. Ind. Hyg. Assoc. J. , 60 : 57 – 72 .
   PubMed Web of Science ®Google Scholar
• Kromhout , H. , Symanski , E. and Rappaport , S. M. 1993 . A comprehensive evaluation of within- and between-worker components of occupational exposure to chemical agents . Ann. Occup. Hyg. , 37 ( 3 ) : 253 – 270 .
   PubMed Web of Science ®Google Scholar
• Park , D. , Stewart , P. A. and Coble , J. B. 2009 . Determinants of exposure to metalworking fluid aerosols: A literature review and analysis of reported measurements . Ann. Occup. Hyg. , 53 ( 3 ) : 271 – 288 .
   PubMed Web of Science ®Google Scholar
• Pronk , A. , Coble , J. and Stewart , P. A. 2009 . Occupational exposure to diesel engine exhaust: A literature review . J. Expo. Sci. Environ. Epidemiol. , 19 ( 5 ) : 443 – 457 .
   PubMed Web of Science ®Google Scholar
• Rappaport , S. M. 1991 . Assessment of long-term exposures to toxic substances in air . Ann. Occup. Hyg. , 35 ( 1 ) : 61 – 121 .
   PubMed Web of Science ®Google Scholar
• Rybicki , B. A. , Peterson , E. L. , Johnson , C. C. , Kortsha , G. X. , Cleary , W. M. and Gorell , J. M. 1998 . Intra- and inter-rater agreement in the assessment of occupational exposure to metals . Int. J. Epidemiol. , 27 ( 2 ) : 269 – 273 .
   Web of Science ®Google Scholar
• Siemiatycki , J. , Fritschi , L. , Nadon , L. and Gerin , M. 1997 . Reliability of an expert rating procedure for retrospective assessment of occupational exposures in community-based case-control studies . Am. J. Ind. Med. , 31 ( 3 ) : 280 – 286 .
   PubMed Web of Science ®Google Scholar
• Stewart , P. A. , Carel , R. , Schairer , C. and Blair , A. 2000 . Comparison of industrial hygienists’ exposure evaluations for an epidemiologic study . Scand. J. Work Environ. Health 26 , : 44 – 51 .
   Google Scholar
• Correa , A. , Min , Y. I. Stewart , P. A. 2006 . Inter-rater agreement of assessed prenatal maternal occupational exposures to lead . Birth Defects Res. A Clin. Mol. Teratol. , 76 ( 11 ) : 811 – 624 .
   PubMed Web of Science ®Google Scholar
• Stewart , P. A. and Stewart , W. F. 1994 . Occupational case-control studies: II. Recommendations for exposure assessment . Am. J. Ind. Med. , 26 ( 3 ) : 313 – 326 .
   PubMed Web of Science ®Google Scholar
• Clavel , J. , Glass , D. C. , Cordier , S. and Hemon , D. 1993 . Standardization in the retrospective evaluation by experts of occupational exposure to organic solvents in a population-based case-control study . Int. J. Epidemiol. , 22 ( Suppl 2 ) : S121 – S126 .
   Google Scholar
• Bradburn , N. M. , Rips , L. J. and Shevell , S. K. 1987 . Answering autobiographical questions: The impact of memory and inference on surveys . Science 236 , 4798 : 157 – 161 .
   Web of Science ®Google Scholar
• Teschke , K. , Marion , S. A. Ostry , A. 1996 . Reliability of retrospective chlorophenol exposure estimates over five decades . Am. J. Ind. Med. , 30 ( 5 ) : 616 – 622 .
   Web of Science ®Google Scholar
• McGuire , V. , Nelson , L. M. , Koepsell , T. D. , Checkoway , H. and Longstreth , W. T. Jr. 1998 . Assessment of occupational exposures in community-based case-control studies . Ann. Rev. Public Health , 19 : 35 – 53 .
   PubMed Web of Science ®Google Scholar
• Macaluso , M. , Delzell , E. , Rose , V. , Perkins , J. and Oestenstad , K. 1993 . Inter-rater agreement in the assessment of solvent exposure at a car assembly plant . Am. Ind. Hyg. Assoc. J. , 54 : 351 – 359 .
   PubMed Web of Science ®Google Scholar
• De Cock , J. , Kromhout , H. , Heederik , D. and Burema , J. 1996 . Experts’ subjective assessment of pesticide exposure in fruit growing . Scand. J. Work Environ. Health , 22 ( 6 ) : 425 – 432 .
   PubMed Web of Science ®Google Scholar
• Walker , K. D. , Catalano , P. , Hammitt , J. K. and Evans , J. S. 2003 . Use of expert judgment in exposure assessment: Part 2. Calibration of expert judgments about personal exposures to benzene . J. Expo. Anal. Environ Epidemiol. , 13 ( 1 ) : 1 – 16 .
   Google Scholar
• Walker , K. D. , Evans , J. S. and MacIntosh , D. 2001 . Use of expert judgment in exposure assessment. Part I. Characterization of personal exposure to benzene . J. Expo. Anal. Environ. Epidemiol. , 11 ( 4 ) : 308 – 322 .
   PubMedGoogle Scholar