Assessment of average of normals (AON) procedure for outlier-free datasets including qualitative values below limit of detection (LoD): an application within tumor markers such as CA 15-3, CA 125, and CA 19-9

References

• Cembrowski GS, Chandler EP, Westgard JO. Assessment of “average of normals” quality control procedures and guidelines for implementation. Am J Clin Pathol 1984;81:492–9.
   PubMed Web of Science ®Google Scholar
• Lolekha PH, Vanavanan S, Lolekha S. Update on value of the anion gap in clinical diagnosis and laboratory evaluation. Clin Chim Acta 2001;307:33–6.
   PubMed Web of Science ®Google Scholar
• Bull BS, Elashoff RM, Heilbron DC, Couperus J. A study of various estimators for the derivation of quality control procedures from patient erythrocyte indices. Am J Clin Pathol 1974;61:473–81.
   PubMed Web of Science ®Google Scholar
• Slotnick HB, Etzell P. Multivariate interpretation of laboratory tests used in monitoring patients. Clin Chem 1990;36:748–51.
   PubMed Web of Science ®Google Scholar
• Iizuka Y, Kume H, Kitamura M. Multivariate delta check method for detecting specimen mix-up. Clin Chem 1982;28:2244–8.
   PubMed Web of Science ®Google Scholar
• Hoffmann RG, Waid ME. The “average of normals” method of quality control. Am J Clin Pathol 1965;43:134–41.
   PubMed Web of Science ®Google Scholar
• Westgard JO, Smith FA, Mountain PJ, Boss S. Design and assessment of average of normals (AON) patient data algorithms to maximize run lengths for automatic process control. Clin Chem 1996;42:1683–8.
   PubMed Web of Science ®Google Scholar
• Douville P, Cembrowski GS, Strauss JF. Evaluation of the average of patients: application to endocrine assays. Clin Chim Acta 1987;167:173–85.
   PubMed Web of Science ®Google Scholar
• Pierson-Perry JF, Vaks JE, Durham AP, Fischer C, Gutenbrunner C, Hillyard D, Kondratovich MV, Ladwig P, Middleberg RA. Evaluation of detection capability for clinical laboratory measurement procedures; approved guideline – Second edition. Clinical and Laboratory Standards Institute. Vol. 32, No. 8. Wayne, PA: CLSI publication EP17-A2; 2012.
   Google Scholar
• Armbruster DA, Pry T. Limit of blank, limit of detection and limit of quantitation. Clin Biochem Rev 2008;29:S49–S52.
   PubMedGoogle Scholar
• Moretti M, Sisti D, Rocchi MB, Delprete E. CLSI EP17-A protocol: a useful tool for better understanding the low end performance of total prostate-specific antigen assays. Clin Chim Acta 2011;412:1143–5.
   PubMed Web of Science ®Google Scholar
• Hay ID, Bayer MF, Kaplan MM, Klee GG, Larsen PR, Spencer CA. The Committee on Nomenclature of the American Thyroid Association. American Thyroid Association assessment of current free thyroid hormone and thyrotropin measurements and guidelines for future clinical assays. Clin Chem 1991;37:2002–8.
   PubMed Web of Science ®Google Scholar
• Moretti M, Pieretti B, Sisti D, Rocchi M, Gasperoni S. Analytical performance and clinical decision limit of a new release for cardiac troponin I assay. Ann Clin Biochem 2015;52:169–72.
   PubMed Web of Science ®Google Scholar
• NORDTEST technical report 537: handbook for calculation of measurement uncertainty in environmental laboratories. NORDTEST; 2003 [www.nordtest.org].
   Google Scholar
• White GH, Farrance I, AACB Uncertainty of Measurement Working Group. Uncertainty of measurement in quantitative medical testing: a laboratory implementation guide. Clin Biochem Rev 2004;25:S1–S24.
   PubMedGoogle Scholar
• Magnusson B, Ossowicki H, Rienitz O, Theodorsson E. Routine internal – and external-quality control data in clinical laboratories for estimating measurement and diagnostic uncertainty using GUM principles. Scand J Clin Lab Invest 2012;72:212–20.
   PubMed Web of Science ®Google Scholar
• Leys C, Ley C, Klein O, Bernard P, Licata L. Detecting outliers: do not use standard deviation around the mean, use absolute deviation around the median. J Exp Soc Psychol 2013;49:764–6.
   Web of Science ®Google Scholar
• Cembrowski GS, Carey RN. Laboratory quality management: QC and QA. Chicago, IL: ASCP Press; 1989, pp. 147–54.
   Google Scholar
• Horn PS, Feng L, Li Y, Pesce AJ. Effect of outliers and nonhealthy individuals on reference interval estimation. Clin Chem 2001;47:2137–45.
   PubMed Web of Science ®Google Scholar
• Woo J, LeFever D, Winkelman JW. Use of “average of normals” quality control procedure in the detection and resolution of assay discrepancies. Am J Clin Pathol 1988;89:125–9.
   PubMed Web of Science ®Google Scholar
• Ichihara K, Miyai K, Takeoka K, Katsumaru K, Yasuhara M. Distribution of patients’ test values and applicability of “average of normals” method to quality-control of radioimmunoassays. Am J Clin Pathol 1985;83:206–10.
   PubMed Web of Science ®Google Scholar
• Dnistrian AM, Schwartz MK, Greenberg EJ, Smith CA, Schwartz DC. CA 15-3 and carcinoembryonic antigen in the clinical evaluation of breast cancer. Clin Chim Acta 1991;200:81–93.
   PubMed Web of Science ®Google Scholar
• Chan DW, Beveridge RA, Muss H, Fritsche HA, Hortobagyi G, Theriault R, Kiang D, Kennedy BJ, Evelegh M. Use of Truquant BR radioimmunoassay for early detection of breast cancer recurrence in patients with stage II and stage III disease. J Clin Oncol 1997;15:2322–8.
   PubMed Web of Science ®Google Scholar
• Niloff JM, Knapp RC, Lavin PT, Malkasian GD, Berek JS, Mortel R, Whitney C, Zurawski VR Jr, Bast RC Jr. The CA 125 assay as a predictor of clinical recurrence in epithelial ovarian cancer. Am J Obstet Gynecol 1986;155:56–60.
   PubMed Web of Science ®Google Scholar
• Niloff JM, Bast RC Jr, Schaetzl EM, Knapp RC. Predictive value of CA 125 antigen levels in second-look procedures for ovarian cancer. Am J Obstet Gynecol 1985;151:981–6.
   PubMed Web of Science ®Google Scholar
• Steinberg W. The clinical utility of the CA 19-9 tumor-associated antigen. Am J Gastroenterol 1990;85:350–5.
   PubMed Web of Science ®Google Scholar
• Lott JA, Smith DA, Mitchell LC, Moeschberger ML. Use of medians and “average of normals” of patients’ data for assessment of long-term analytical stability. Clin Chem 1996;42:888–92.
   PubMed Web of Science ®Google Scholar
• Hampel FR. The influence curve and its role in robust estimation. J Am Statist Assoc 1974;69:383–93.
   Web of Science ®Google Scholar
• Kazmierczak SC. Laboratory quality control: using patient data to assess analytical performance. Clin Chem Lab Med 2003;41:617–27.
   PubMed Web of Science ®Google Scholar
• Smith FA, Kroft SH. Exponentially adjusted moving mean procedure for quality control. An optimized patient sample control procedure. Am J Clin Pathol 1996;105:44–51.
   PubMed Web of Science ®Google Scholar
• Ricós C, Alvarez V, Cava F, García-Lario JV, Hernández A, Jiménez CV, Minchinela J, Perich C, Simón M. Current databases on biological variation: pros, cons and progress. Scand J Clin Lab Invest 1999;59:491–500.
   PubMed Web of Science ®Google Scholar
• Ricós C, Álvarez V, Perich C, Fernández-Calle P, Minchinela J, Cava F, Biosca C, Boned B, Doménech M, García-Lario JV, Simón M, Fernández PF, Diaz-Garzón J, González-Lao E. Rationale for using data on biological variation. Clin Chem Lab Med 2015;53:863–70.
   PubMed Web of Science ®Google Scholar
• Westgard JO. Desirable specifications for Total Error, Imprecision, and Bias, derived from biologic variation. http://www.westgard.com/biodatabase1.htm (Accessed on July 21, 2015).
   Google Scholar
• Plebani M, Giacomini A, Beghi L, de Paoli M, Roveroni G, Galeotti F, Corsini A, Fraser CG. Serum tumor markers in monitoring patients: interpretation of results using analytical and biological variation. Anticancer Res 1996;16:2249–52.
   PubMed Web of Science ®Google Scholar
• Vestergaard EM, Hein HO, Meyer H, Grunnet N, Jørgensen J, Wolf H, Orntoft TF. Reference values and biological variation for tumor marker CA 19-9 in serum for different Lewis and secretor genotypes and evaluation of secretor and Lewis genotyping in a Caucasian population. Clin Chem 1999;45:54–61.
   PubMed Web of Science ®Google Scholar
• Erden G, Barazi AO, Tezcan G, Yildirimkaya MM. Biological variation and reference change values of CA 19-9, CEA, AFP in serum of healthy individuals. Scand J Clin Lab Invest 2008;68:212–8.
   PubMed Web of Science ®Google Scholar