Human biomarker interpretation: the importance of intra-class correlation coefficients (ICC) and their calculations based on mixed models, ANOVA, and variance estimates

References

• Alfano, C. M. 2012. Physical activity, biomarkers, and disease outcomes in cancer survivors: A systematic review. Journal of the National Cancer Institute 104:815–40. doi:10.1093/jnci/djs207.
   PubMedGoogle Scholar
• Amann, A., B. de Lacy Costello, W. Miekisch, J. Schubert, B. Buszewski, J. D. Pleil, N. Ratcliffe, and T. H. Risby. 2014. The human volatilome: Volatile organic compounds (VOCs) in exhaled breath, skin emanations, urine, feces and saliva. Journal of Breath Research 8:034001. doi:10.1088/1752-7155/8/3/034001.
   PubMed Web of Science ®Google Scholar
• Angrish, M. M., J. D. Pleil, M. A. Stiegel, M. C. Madden, V. C. Moser, and D. W. Herr. 2016. Taxonomic applicability of inflammatory cytokines in adverse outcome pathway (AOP) development. Journal of Toxicology and Environmental Health A 79:184–96. doi:10.1080/15287394.2016.1138923.
   PubMed Web of Science ®Google Scholar
• Aylward, L. L., C. R. Kirman, J. L. Adgate, L. M. McKenzie, and S. M. Hays. 2012. Interpreting variability in population biomonitoring data: Role of elimination kinetics. Journal of Exposure Science and Environmental Epidemiology 22:398–408. doi:10.1038/jes.2012.35.
   PubMed Web of Science ®Google Scholar
• Baker, D. B., and M. J. Nieuwenhuijsen, ed. 2008. Environmental epidemiology: Study methods and application. Oxford: Oxford University Press.
   Google Scholar
• Ballard-Barbash, R., C. M. Friedenreich, K. S. Courneya, S. M. Siddiqi, A. McTiernan, and C. M. Alfano. 2012. Physical activity, biomarkers, and disease outcomes in cancer survivors: A systematic review. Journal of the National Cancer Institute 104:815–40. doi:10.1093/jnci/djs207.
   PubMed Web of Science ®Google Scholar
• Bartko, J. J. 1976. On various intraclass correlation reliability coefficients. Psychological Bulletin 83:762. doi:10.1037/0033-2909.83.5.762.
   Web of Science ®Google Scholar
• Bartlett, M. S. 1937. Properties of sufficiency and statistical tests. Proceedings of the Royal Society of London 160: 268–82.
   Google Scholar
• Bell, B. A., M. Ene, W. Smiley, and J. A. Schoeneberger. 2013. A multilevel model primer using SAS PROC MIXED. SAS Global Forum. University of South Carolina College of Education, Columbia, SC. http://support.sas.com/resources/papers/proceedings13/433-2013.pdf.
   Google Scholar
• Boffetta, P., N. Jourenkova, and P. Gustavsson. 1997. Cancer risk from occupational and environmental exposure to polycyclic aromatic hydrocarbons. Cancer Causes & Control 8:444–72. doi:10.1023/A:1018465507029.
   PubMed Web of Science ®Google Scholar
• Bonvallot, N., M. Tremblay-Franco, C. Chevrier, C. Canlet, L. Debrauwer, J. P. Cravedi, and S. Cordier. 2014. Potential input from metabolomics for exploring and understanding the links between environment and health. Journal of Toxicology and Environmental Health B 17:21–44. doi:10.1080/10937404.2013.860318.
   PubMed Web of Science ®Google Scholar
• Breit, M., C. Baumgartner, M. Netzer, and K. M. Weinberger. 2016. Clinical bioinformatics for biomarker discovery in targeted metabolomics. In Application of Clinical Bioinformatics, ed. X. Wang, C. Baumgartner, D. Shields, HW Deng, J. Beckmann, 213–40. Dordrecht: Springer.
   Google Scholar
• Brown, J. R., and J. L. Thornton. 1957. Percivall Pott (1714-1788) and chimney sweepers’ cancer of the scrotum. British Journal of Industrial Medicine 14:68.
   PubMedGoogle Scholar
• Centers for Disease Control and Prevention (CDC), 2009. Fourth national report on human exposure to environmental chemicals, 1600 Clifton Rd
Atlanta, GA 30333 http://www.cdc.gov/exposurereport/
   Google Scholar
• Cherrie, J. W. 2003. Commentary: The beginning of the science underpinning occupational hygiene. Annals of Occupational Hygiene 47:179–85.
   PubMedGoogle Scholar
• Cole, D. C., J. Eyles, and B. L. Gibson. 1998. Indicators of human health in ecosystems: What do we measure? Science of the Total Environment 224:201–13.
   PubMed Web of Science ®Google Scholar
• Corbeil, R. R., and S. R. Searle. 1976. Restricted maximum likelihood (REML) estimation of variance components in the mixed model. Technometrics 18:31–38. doi:10.2307/1267913.
   Web of Science ®Google Scholar
• Cosselman, K. E., A. Navas-Acien, and J. D. Kaufman. 2015. Environmental factors in cardiovascular disease. Nature Reviews Cardiology 12:627. doi:10.1038/nrcardio.2015.152.
   PubMed Web of Science ®Google Scholar
• Daughton, C. G. 2012. Using biomarkers in sewage to monitor community-wide human health: Isoprostanes as conceptual prototype. Science of the Total Environment 424:16–38. doi:10.1016/j.scitotenv.2012.02.038.
   PubMed Web of Science ®Google Scholar
• Delfino, R. J. 2002. Epidemiologic evidence for asthma and exposure to air toxics: Linkages between occupational, indoor, and community air pollution research. Environmental Health Perspectives 110(Suppl 4):573.
   PubMedGoogle Scholar
• Diamond, G. L., N. P. Skoulis, A. R. Jeffcoat, and J. F. Nash. 2017. A physiologically based pharmacokinetic model for the broad-spectrum antimicrobial zinc pyrithione: I. Development and verification. Journal of Toxicology and Environmental Health A 80:69–90. doi:10.1080/15287394.2016.1245123.
   PubMed Web of Science ®Google Scholar
• Egeghy, P. P., R. Tornero-Velez, and S. M. Rappaport. 2000. Environmental and biological monitoring of benzene during self-service automobile refueling. Environmental Health Perspectives 108:1195–202.
   PubMed Web of Science ®Google Scholar
• Epa, U. S. 2012. Biomonitoring - an exposure science tool for exposure and risk assessment. Washington, DC: U.S. Environmental Protection Agency. EPA/600/R-12/039 (NTIS PB2012-112321).
   Google Scholar
• Etzel, R. A. 2003. How environmental exposures influence the development and exacerbation of asthma. Pediatrics 112(Supplement 1):233–39.
   PubMed Web of Science ®Google Scholar
• Fisher, R. A. 1918. The correlation between relatives on the supposition of mendelian inheritance. Philosophical Transactions of the Royal Society of Edinburgh 52:399–433. doi:10.1017/S0080456800012163.
   Google Scholar
• Fisher, R. A. 1921. On the “Probable Error” of a coefficient of correlation deduced from a small sample. Metron 1:3–32.
   Google Scholar
• Fisher, R. A. 1925. Statistical methods for research workers, Oliver and Boyd Ltd., Edinburgh. 5th. is available online: http://www.haghish.com/resources/materials/Statistical_Methods_for_Research_Workers.pdf.
   Google Scholar
• Giraudeau, B., and J. Y. Mary. 2001. Planning a reproducibility study: How many subjects and how many replicates per subject for an expected width of the 95 per cent confidence interval of the intraclass correlation coefficient. Statistics in Medicine 20:3205–14.
   PubMed Web of Science ®Google Scholar
• Goldstein, H. 1986. Multilevel mixed linear model analysis using iterative generalized least squares. Biometrika 73:43–56. doi:10.1093/biomet/73.1.43.
   Web of Science ®Google Scholar
• Gordon, J. N., A. Taylor, and P. N. Bennett. 2002. Lead poisoning: Case studies. British Journal of Clinical Pharmacology 53:451–58.
   PubMed Web of Science ®Google Scholar
• Gulliford, M. C., O. C. Ukoumunne, and S. Chinn. 1999. Components of variance and intraclass correlations for the design of community-based surveys and intervention studies: Data from the Health Survey for England 1994. American Journal of Epidemiology 149:876–83.
   PubMed Web of Science ®Google Scholar
• Hall, J. E. 2015. Guyton and hall textbook of medical physiology e-book. Elsevier Health Sciences. eBook. 13th edition (Online), Saunders. ISBN:9780323389303.
   Google Scholar
• Ismail, A. A., K. Wang, J. R. Olson, M. R. Bonner, O. Hendy, G. Abdel Rasoul, and D. S. Rohlman. 2017. The impact of repeated organophosphorus pesticide exposure on biomarkers and neurobehavioral outcomes among adolescent pesticide applicators. Journal of Toxicology and Environmental Health A 80:542–55. doi:10.1080/15287394.2017.1362612.
   PubMed Web of Science ®Google Scholar
• Johnson, C. H., and F. J. Gonzalez. 2012. Challenges and opportunities of metabolomics. Journal of Cellular Physiology 227:2975–81. doi:10.1002/jcp.24002.
   PubMed Web of Science ®Google Scholar
• Kessler, R., and R. E. Glasgow. 2011. A proposal to speed translation of healthcare research into practice: Dramatic change is needed. American Journal of Preventative Medicine 40:637–44. doi:10.1016/j.amepre.2011.02.023.
   PubMed Web of Science ®Google Scholar
• Koo, T. K., and M. Y. Li. 2016. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine 15:155–63. doi:10.1016/j.jcm.2016.02.012.
   PubMed Web of Science ®Google Scholar
• Kromhout, H., Y. Oostendorp, D. Heederik, and J. S. Boleij. 1987. Agreement between qualitative exposure estimates and quantitative exposure measurements. American Journal of Industrial Medicine 12:551–62.
   PubMed Web of Science ®Google Scholar
• Kromhout, H., E. Symanski, and S. M. Rappaport. 1993. A comprehensive evaluation of within-and between-worker components of occupational exposure to chemical agents. Annals of Occupational Hygiene 37:253–70.
   PubMed Web of Science ®Google Scholar
• LaKind, J. S., L. G. Anthony, and M. Goodman. 2017. Review of reviews on exposures to synthetic organic chemicals and children’s neurodevelopment: Methodological and interpretation challenges. Journal of Toxicology and Environmental Health A 20:390–422. doi:10.1080/10937404.2017.1370847.
   Google Scholar
• Landis, J. R., T. S. King, J. W. Choi, V. M. Chinchilli, and G. G. Koch. 2011. Measures of agreement and concordance with clinical research applications. Statistics in Biopharmaceutical Research 3:185–209. doi:10.1198/sbr.2011.10019.
   Web of Science ®Google Scholar
• Lianidou, E. S., and A. Markou. 2011. Circulating tumor cells in breast cancer: Detection systems, molecular characterization, and future challenges. Clinical Chemistry 57:1242–55. doi:10.1373/clinchem.2011.165068.
   PubMed Web of Science ®Google Scholar
• Lin, Y. S., L. L. Kupper, and S. M. Rappaport. 2005. Air samples versus biomarkers for epidemiology. Occupation and Environmental Medicine 62:750–60. doi:10.1136/oem.2004.013102.
   PubMed Web of Science ®Google Scholar
• Lyles, R. H., L. L. Kupper, and S. M. Rappaport. 1997. A lognormal distribution-based exposure assessment method for unbalanced data. Annals of Occupational Hygiene 41:63–76. doi:10.1016/S0003-4878(96)00020-8.
   PubMed Web of Science ®Google Scholar
• McGraw, K. O., and S. P. Wong. 1996. Forming inferences about some intraclass correlation coefficients. Psychological Methods 1:30–46. doi:10.1037/1082-989X.1.1.30.
   Web of Science ®Google Scholar
• Mehan, M. R., R. Ostroff, S. K. Wilcox, F. Steele, D. Schneider, T. C. Jarvis, G. S. Baird, L. Gold, and N. Janjic. 2013. Highly multiplexed proteomic platform for biomarker discovery, diagnostics, and therapeutics. In Complement Therapeutics, ed. J. D. Lambris, V. M. Holers, D. Ricklin, 283–300. Boston, MA: Springer.
   Google Scholar
• Metcalf, S. W., and K. G. Orloff. 2004. Biomarkers of exposure in community settings. Journal of Toxicology and Environmental Health A 67:715–26. doi:10.1080/15287390490428198.
   PubMed Web of Science ®Google Scholar
• Moons, K. G., J. A. de Groot, K. Linnet, J. B. Reitsma, and P. M. Bossuyt. 2012. Quantifying the added value of a diagnostic test or marker. Clinical Chemistry 58:1408–17. doi:10.1373/clinchem.2012.182550.
   PubMed Web of Science ®Google Scholar
• Müller, R., and P. Büttner. 1994. A critical discussion of intraclass correlation coefficients. Statistics in Medicine 13:2465–76.
   PubMed Web of Science ®Google Scholar
• National Institutes of Environmental Health (NIEHS). 2012. “Biomarkers.” http://www.niehs.nih.gov/health/topics/science/biomarkers/
   Google Scholar
• National Research Council (NRC). 2006. Human biomonitoring for environmental chemicals. Washington, DC: The National Academies Press.
   Google Scholar
• Oldham, P. D., and S. A. Roach. 1952. A sampling procedure for measuring industrial dust exposure. British Journal of Industrial Medicine 9:112–19.
   PubMedGoogle Scholar
• Orchard, S., P. A. Binz, C. Borchers, M. K. Gilson, A. R. Jones, G. Nicola, J. A. Vizcaino, E. W. Deutsch, and H. Hermjakob. 2012. Ten years of standardizing proteomic data: A report on the HUPO‐PSI spring workshop. Proteomics 12:2767–72. doi:10.1002/pmic.201270126.
   PubMed Web of Science ®Google Scholar
• Pierce, K. M., J. C. Hoggard, R. E. Mohler, and R. E. Synovec. 2008. Recent advancements in comprehensive two-dimensional separations with chemometrics. Journal of Chromatography A 1184:341–52. doi:10.1016/j.chroma.2007.07.059.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2009. Influence of systems biology response and environmental exposure level on between-subject variability in breath and blood biomarkers. Biomarkers 14:560–71. doi:10.3109/13547500903186460.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2012. Categorizing biomarkers of the human exposome and developing metrics for assessing environmental sustainability. Journal of Toxicology and Environmental Health B 15:264–80. doi:10.1080/10937404.2012.672148.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2015. Understanding new “exploratory” biomarker data: A first look at observed concentrations and associated detection limits. Biomarkers 20:168–69. doi:10.3109/1354750X.2015.1040841.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2016a. Breath biomarkers in toxicology. Archives of Toxicology 90:2669–82. doi:10.1007/s00204-016-1817-5.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2016b. QQ-plots for assessing distributions of biomarker measurements and generating defensible summary statistics. Journal of Breath Research 10:035001. doi:10.1088/1752-7155/10/3/035001.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D. 2016c. Imputing defensible values for left-censored ‘below level of quantitation’ (LoQ) biomarker measurements. Journal of Breath Research 10:045001. doi:10.1088/1752-7155/10/4/045001.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., J. D. Beauchamp, and W. Miekisch. 2017. Cellular respiration, metabolomics and the search for illicit drug biomarkers in breath: Report from PittCon 2017. Journal of Breath Research 11:039001. doi:10.1088/1752-7163/aa7174.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., and K. K. Isaacs. 2016. High-resolution mass spectrometry: Basic principles for using exact mass and mass defect for discovery analysis of organic molecules in blood, breath, urine and environmental media. Journal of Breath Research 10:012001. doi:10.1088/1752-7155/10/1/012001.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., and L. S. Sheldon. 2011. Adapting concepts from systems biology to develop systems exposure event networks for exposure science research. Biomarkers 16:99–105. doi:10.3109/1354750X.2010.541565.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., and J. R. Sobus. 2013. Estimating lifetime risk from spot biomarker data and intra-class correlation coefficients (ICC). Journal of Toxicology and Environmental Health A 76:747–66. doi:10.1080/15287394.2013.821394.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., and J. R. Sobus. 2016. Estimating central tendency from a single spot measure: A closed-form solution for lognormally distributed biomarker data for risk assessment at the individual level. Journal of Toxicology and Environmental Health A 79:837–47. doi:10.1080/15287394.2016.1193108.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., J. R. Sobus, M. A. Stiegel, D. Hu, K. D. Oliver, C. Olenick, M. Strynar, M. Clark, M. C. Madden, and W. E. Funk. 2014. Estimating common parameters of lognormally distributed environmental and biomonitoring data: Harmonizing disparate statistics from publications. Journal of Toxicology and Environmental Health B 17 341–68. doi:10.1080/10937404.2014.956854.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., M. A. Stiegel, M. C. Madden, and J. R. Sobus. 2011c. Heat map visualization of complex environmental and biomarker measurements. Chemosphere 84:716–23. doi:10.1016/j.chemosphere.2011.03.017.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., M. A. Stiegel, and J. R. Sobus. 2011a. Breath biomarkers in environmental health science: Exploring patterns in the human exposome. Journal of Breath Research 5:046005. doi:10.1088/1752-7155/5/4/046005.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., M. A. Stiegel, J. R. Sobus, W. Liu, and M. C. Madden. 2011b. Observing the human exposome as reflected in breath biomarkers: Heat map data interpretation for environmental and intelligence research. Journal of Breath Research 5:037104. doi:10.1088/1752-7155/5/3/037104.
   PubMed Web of Science ®Google Scholar
• Pleil, J. D., M. Williams, and J. R. Sobus. 2012. Chemical Safety for Sustainability (CSS): Biomonitoring in vivo data for distinguishing among adverse, adaptive, and random responses from in vitro toxicology. Toxicology Letters 215:201–07. doi:10.1016/j.toxlet.2012.10.011.
   PubMed Web of Science ®Google Scholar
• Polichetti, G., S. Cocco, A. Spinali, V. Trimarco, and A. Nunziata. 2009. Effects of particulate matter (PM10, PM2. 5 and PM1) on the cardiovascular system. Toxicology 261:1–8. doi:10.1016/j.tox.2009.04.035.
   PubMed Web of Science ®Google Scholar
• Rappaport, S. M. 1984. The rules of the game: An analysis of OSHA’s enforcement strategy. American Journal of Industrial Medicine 6:291–303.
   PubMed Web of Science ®Google Scholar
• Rappaport, S. M. 1991. Assessment of long-term exposures to toxic substances in air. Annals of Occupational Hygiene 35:61–121.
   PubMed Web of Science ®Google Scholar
• Rappaport, S. M., and L. L. Kupper. 2008. Quantitative exposure assessment. El Cerrito, CA: S.M. Rappaport.
   Google Scholar
• Rappaport, S. M., R. H. Lyles, and L. L. Kupper. 1995. An exposure assessment strategy accounting for within and between workers sources of variability. Annals of Occupational Hygiene 39:469–95.
   PubMed Web of Science ®Google Scholar
• Rappaport, S. M., and M. T. Smith. 2010. Epidemiology: Environment and disease risk. Science 33:460–61. doi:10.1126/science.1192603.
   Web of Science ®Google Scholar
• Rappaport, S. M., R. C. Spear, and S. Selvin. 1988. The influence of exposure variability on dose-response relationships in Inhaled Particles VI, Proceedings of an International Symposium and Workshop on Lung Dosimetry, British Occupational Hygiene Society, pp. 529–37.
   Google Scholar
• Rubino, F. M., M. Pitton, D. Di Fabio, and A. Colombi. 2009. Toward an “omic” physiopathology of reactive chemicals: Thirty years of mass spectrometric study of the protein adducts with endogenous and xenobiotic compounds. Mass Spectrometry Reviews 28:725–84. doi:10.1002/mas.20207.
   PubMed Web of Science ®Google Scholar
• Ruiz, I., M. Sprowls, Y. Deng, D. Kulick, H. Destaillats, and E. S. Forzani. 2018. Assessing metabolic rate and indoor air quality with passive environmental sensors. Journal of Breath Research 12:036012. doi:10.1088/1752-7163/aaaec9.
   PubMed Web of Science ®Google Scholar
• Sexton, K., and A. D. Ryan. 2012. Using exposure biomarkers in children to compare between-child and within-child variance and calculate correlations among siblings for multiple environmental chemicals. Journal of Exposure Science and Environmental Epidemiology 22:16–23. doi:10.1038/jes.2011.30.
   PubMed Web of Science ®Google Scholar
• Shek, D. T., and C. Ma. 2011. Longitudinal data analyses using linear mixed models in SPSS: Concepts, procedures and illustrations. The Scientific World Journal 11:42–76. doi:10.1100/tsw.2011.2.
   Web of Science ®Google Scholar
• Sherwood, R. J., and M. Lippmann. 1997. Historical perspectives: Realization, development, and first applications of the personal air sampler. Applied Occupational and Environmental Hygiene 12:229–34. doi:10.1080/1047322X.1997.10389495.
   Google Scholar
• Shrout, P. E., and J. L. Fleiss. 1979. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86:420. doi:10.1037/0033-2909.86.2.420.
   PubMed Web of Science ®Google Scholar
• Silva, S. S., C. Lopes, A. L. Teixeira, M. C. de Sousa, and R. Medeiros. 2015. Forensic miRNA: Potential biomarker for body fluids? Forensic Science International: Genetics 14:1–10. doi:10.1016/j.fsigen.2014.09.002.
   PubMed Web of Science ®Google Scholar
• Singer, J. D. 1998. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics 23:323–55. doi:10.3102/10769986023004323.
   Web of Science ®Google Scholar
• Sobus, J. R., R. S. Dewoskin, Y. M. Tan, J. D. Pleil, M. B. Phillips, B. J. George, K. Y. Christensen, D. M. Schreinemachers, M. A. Williams, E. A. Cohen-Hubal, and S. W. Edwards. 2015. Uses of NHANES biomarker data for chemical risk assessment: Trends, challenges and opportunities. Environmental Health Perspectives 123:919–27. doi:10.1289/ehp.1409177.
   PubMed Web of Science ®Google Scholar
• Sobus, J. R., M. D. McClean, R. F. Herrick, S. Waidyanatha, L. A. Nylander-French, L. L. Kupper, and S. M. Rappaport. 2009. Comparing urinary biomarkers of airborne and dermal exposure to polycyclic aromatic compounds in asphalt-exposed workers. Annals of Occupational Hygiene 53:561–71. doi:10.1093/annhyg/mep042.
   PubMed Web of Science ®Google Scholar
• Sobus, J. R., M. K. Morgan, J. D. Pleil, and D. B. Barr. 2010b. Biomonitoring: Current tools and approaches for assessing human exposure to pesticides, Chap. 45: Hayes handbook of pesticide toxicology, Elsevier Ltd. Oxford, UK, ed. R. Krieger
   Google Scholar
• Sobus, J. R., J. D. Pleil, M. D. McClean, R. F. Herrick, and S. M. Rappaport. 2010a. Biomarker variance component estimation for exposure surrogate selection and toxicokinetic inference. Toxicology Letters 199:247–53. doi:10.1016/j.toxlet.2010.09.006.
   PubMed Web of Science ®Google Scholar
• Stiegel, M. A., J. D. Pleil, J. R. Sobus, T. Stevens, and M. C. Madden. 2017. Linking physiological parameters to perturbations in the human exposome: Environmental exposures modify blood pressure and lung function via inflammatory cytokine pathway. Journal of Toxicology and Environmental Health, Part A 80:485–501. doi:10.1080/15287394.2017.1330578.
   PubMed Web of Science ®Google Scholar
• Stigler, S. M. 1990. The history of statistics. The measurement of uncertainty before 1900. Belknap Press World: Cambridge, MA.
   Google Scholar
• Tan, Y. M., J. R. Sobus, D. Chang, R. Tornero-Velez, M. Goldsmith, J. D. Pleil, and C. Dary. 2012. Reconstructing human exposures using biomarkers and other “clues”. Journal of Toxicology and Environmental Health, Part B 15:22–38. doi:10.1080/10937404.2012.632360.
   PubMed Web of Science ®Google Scholar
• Tinsley, H. E., and D. J. Weiss. 1975. Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology 22:358. doi:10.1037/h0076640.
   Web of Science ®Google Scholar
• Tremaroli, V., and F. Bäckhed. 2012. Functional interactions between the gut microbiota and host metabolism. Nature 489:242–49. doi:10.1038/nature11552.
   PubMed Web of Science ®Google Scholar
• Tsai, -S.-S., C.-Y. Tsai, and C.-Y. Yang. 2018. Fine particulate air pollution associated with risk of hospital admissions for hypertension in a tropical city, Kaohsiung, Taiwan. Journal of Toxicology and Environmental Health A 81:567–75. doi:10.1080/15287394.2018.1460788.
   PubMed Web of Science ®Google Scholar
• Wallace, M. A., T. M. Kormos, and J. D. Pleil. 2016. Blood-borne biomarkers and bioindicators for linking exposure to health effects in environmental health science. Journal of Toxicology and Environmental Health B 19:380–409. doi:10.1080/10937404.2016.1215772.
   PubMed Web of Science ®Google Scholar
• Walton, W. H., and J. H. Vincent. 1998. Aerosol instrumentation in occupational hygiene: An historical perspective. Aerosol Science and Technology 28:417–38. doi:10.1080/02786829808965535.
   Web of Science ®Google Scholar
• Wang, C. S., B. S. Yandell, and J. J. Rutledge. 1992. The dilemma of negative analysis of variance estimators of intraclass correlation. Theoretical and Applied Genetics 85:79–88. doi:10.1007/BF00223848.
   PubMed Web of Science ®Google Scholar
• Wang, L., D. Du, D. Lu, C. T. Lin, J. N. Smith, C. Timchalk, F. Liu, J. Wang, and Y. Lin. 2011. Enzyme-linked immunosorbent assay for detection of organophosphorylated butyrylcholinesterase: A biomarker of exposure to organophosphate agents. Analytica Chimica Acta 693:1–6. doi:10.1016/j.aca.2011.03.013.
   PubMed Web of Science ®Google Scholar
• Weaver, M. A., L. L. Kupper, D. Taylor, H. Kromhout, P. Susi, and S. M. Rappaport. 2001. Simultaneous assessment of occupational exposures from multiple worker groups. Annals of Occupational. Hygiene 45:525–42. doi:10.1016/S0003-4878(01)00014-X.
   PubMed Web of Science ®Google Scholar
• Weir, J. P. 2005. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Conditioning Research 19:231–40. doi:10.1519/15184.1.
   PubMed Web of Science ®Google Scholar
• Wild, C. P. 2005. Complementing the genome with an “exposome”: The outstanding challenge of environmental exposure measurement in molecular epidemiology. Cancer Epidemiology, Biomarkers, & Prevention 14:1847–50. doi:10.1158/1055-9965.EPI-05-0456.
   PubMed Web of Science ®Google Scholar
• Zuurman, L., A. E. Ippel, E. Moin, and J. Van Gerven. 2009. Biomarkers for the effects of cannabis and THC in healthy volunteers. British Journal of Clinical Pharmacology 67:5–21. doi:10.1111/j.1365-2125.2008.03329.x.
   PubMed Web of Science ®Google Scholar