62
Views
25
CrossRef citations to date
0
Altmetric
Original Research

Effectiveness of circulating tumor DNA for detection of KRAS gene mutations in colorectal cancer patients: a meta-analysis

, , , , , , , , & show all
Pages 945-953 | Published online: 16 Feb 2017

Abstract

Circulating tumor DNA (ctDNA) can be identified in the peripheral blood of patients and harbors the genomic alterations found in tumor tissues, which provides a noninvasive approach for detection of gene mutations. We conducted this meta-analysis to investigate whether ctDNA can be used for monitoring KRAS gene mutations in colorectal cancer (CRC) patients. Medline, Embase, Cochrane Library and Web of Science were searched for the included eligible studies in English, and data were extracted for statistical analysis according to the numbers of true-positive (TP), true-negative (TN), false-positive (FP) and false-negative (FN) cases. Sensitivity, specificity and diagnostic odds ratio (DOR) were calculated, and the area under the receiver operating characteristic curve (AUROC) was used to evaluate the diagnostic performance. After independent searching and reviewing, 21 studies involving 1,812 cancer patients were analyzed. The overall sensitivity, specificity and DOR were 0.67 (95% confidence interval [CI] =0.55–0.78), 0.96 (95% CI =0.93–0.98) and 53.95 (95% CI =26.24–110.92), respectively. The AUROC was 0.95 (95% CI =0.92–0.96), which indicated the high diagnostic accuracy of ctDNA. After stratified analysis, we found the higher diagnostic accuracy in subgroup of patients detected in blood sample of plasma. The ctDNA may be an ideal source for detection of KRAS gene mutations in CRC patients with high specificity and diagnostic value.

Introduction

Cancer is becoming the second most common cause for death in recent years.Citation1 Surgery is the main treatment for early cancer patients; adjuvant and palliative treatments are mainly used in patients with advanced cancer, involving traditional chemotherapy and targeted therapy. Pathological test of tumor tissues is the gold standard method for histological diagnosing, and detection of gene mutations in tumor tissues is a directive factor for selection of targeted drugs.Citation2 For non-small cell lung cancer (NSCLC), the status of EGFR gene mutations is a sensitive and reliable biomarker for EGFR-TKIs therapy (eg, gefitinib and erlotinib).Citation3,Citation4 For colorectal cancer (CRC), the anti-EGFR MoAb (eg, cetuximab) is now restricted to patients with wild-type KRAS gene, and the mutation status of BRAF gene is predictive of the drug resistance of anti-EGFR MoAb in wild-type KRAS patients.Citation5,Citation6 At the same time, detection of other gene mutations has also been used in patients with different cancers. For diagnosing genomic mutation, biopsy and surgery of primary and metastatic tumors are the main resources of tumor tissues, but they are invasive, uncomfortable and of high cost.Citation7,Citation8 Thus, new non-invasive methods for gene detection are increasingly focused on.

Circulating tumor DNA (ctDNA) is tumor DNA of cell-free DNA (cfDNA) circulating in plasma or serum of cancer patients,Citation9 which is ~170 bp. ctDNA originates from tumor cells, which can be identified in blood samples, and rapidly disappears after surgery or chemotherapy. The level of ctDNA is significantly higher in cancer patients than in healthy controls, which can harbor the somatic genomic alterations found in tumor tissues.Citation10,Citation11 Unlike tissue biopsy, obtaining a sample of ctDNA is a noninvasive approach, with less risk and lower cost. Thus, detection of ctDNA is actively being explored and provides opportunities for minimally invasive cancer diagnosis, prognosis and tumor monitoring in cancer patients.Citation12Citation15

Many studies have been carried out to validate the possibility of ctDNA as a new source for detection of gene mutations. On the basis of this background, we decided to conduct this meta-analysis to investigate the diagnostic value of ctDNA for detection of KRAS gene mutations in CRC patients. The results will help establishing whether ctDNA can be used for detection of gene mutations in cancer patients.

Materials and methods

Literature search strategy

Two investigators independently searched Medline, Embase, Cochrane library and Web of Science databases for potentially relevant articles between inception and January 31, 2016. The search heading terms and keywords were “carcinoma” or “cancer” or “neoplasm”, “serum” or “plasma” or “circulating”, “KRAS” and “mutation”, which were limited to English publications in human beings. Then, the results were manually searched for included studies and double-checked by a second investigator.

Selection criteria

We searched the full-text articles that investigated the comparison of detection of KRAS gene mutations between tumor tissue and the matched plasma or serum in CRC patients. The following publications were excluded: abstracts, news, letters, case reports and reviews. Publications retrieved from databases were first screened by titles and abstracts; full-text articles were reviewed and selected according to the inclusion criteria. The inclusion criteria were as follows: 1) CRC patients should be diagnosed by histopathological or cytological examination; 2) KRAS mutations should be detected in tumor tissue and the paired ctDNA; 3) sufficient information should be provided to conduct the statistical analysis; and 4) studies should be limited to human trials and published in English language. The study with most patients was included from those reported using the same technique by the same center.

Data extraction and quality assessment

Two investigators independently abstracted following information from each trial: name of the first author, year of publication, location where the study was performed, number of patients enrolled, stage of cancer (according to tumor–node–metastasis [TNM] criteria), storage method of tumor tissues, detection method of ctDNA, collection time of blood samples (before or after chemotherapy), format of blood samples (serum or plasma), true positive (TP), false negative (FN), false positive (FP) and true negative (TN). When the study included ≥2 methods of mutation detection, we used the data with the best sensitivity or specificity. The discrepancy between the 2 investigators was resolved by discussion among all the authors. Quality assessment of eligible studies was evaluated using QUADAS-2 (quality assessment of studies of diagnostic accuracy included in systematic reviews-2).

Statistical analysis

The publication bias was detected using Deeks funnel plot, and P<0.05 suggested the significant publication bias. The detection of KRAS gene mutation in tumor tissues acted as the gold standard for diagnosing gene mutation in this analysis. We calculated the sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), corresponding 95% confidence intervals (95% CIs) and area under the ROC curve (AUROC), according to the numbers of TP, TN, FP and FN. Subgroup analyses were also conducted according to different clinical data. Statistical heterogeneity was evaluated by Q test and inconsistency index (I2), with significant heterogeneity set at P≤0.05 and I2>50%. All statistical analyses were performed using STATA software (version 12.1, StataCorp LP) with the Midas module.

Results

Eligible studies

After independent searching, 6,033 records were retrieved from these databases. After reviewing the titles and abstracts, 5,977 records were excluded. After full-text articles were reviewed, 20 publications were considered to be eligible for inclusion in our analysis ().Citation15Citation34 In the article reported by Morgan et al,Citation25 the blood samples including serum and plasma were analyzed. Subsequently, 21 eligible studies were included for analyzing the effectiveness of ctDNA for detection of KRAS gene mutations in CRC patients.

Figure 1 A flow chart showing the studies included in this meta-analysis.

Figure 1 A flow chart showing the studies included in this meta-analysis.

Study characteristics

Our analysis included 21 eligible studies, which are shown in . In total, 5 studies were from China, 4 from France, 3 from the USA, 2 from Italy, 2 from Japan, 1 from Switzerland, 1 from multi-country, 1 from Denmark, 1 from Korea and 1 from the Netherlands. A total of 1,812 CRC patients were included. In all, 18 studies detected both codon 12 and codon 13 of KRAS gene. A total of 3 studies detected only codon 12 of KRAS gene. In all, 14 studies reported the exact collection times of both tumor tissue samples and blood samples, which were collected before chemotherapy. A total of 16 circulating blood samples were plasma and 5 samples were serum. In all, 12 formalin-fixed and paraffin-embedded (FFPE) tumor tissue samples were used for detection of KRAS gene mutations; 4 tumor tissues were frozen before detection. Various detection methods were used, in which the allele refractory mutation system – quantitative polymerase chain reaction (ARMS-qPCR) was the most frequently reported.

Table 1 Characteristics of eligible studies

Study quality

We assessed the quality of eligible studies by QUADAS-2 and found that the quality of all studies was good (). The Deeks regression test was performed, and no significant publication bias was detected (P=0.060; ).

Figure 2 The Deeks regression line showing the publication bias of studies.

Abbreviations: ESS, effective sample size; DOR, diagnostic odds ratio.
Figure 2 The Deeks regression line showing the publication bias of studies.

Table 2 QUADAS-2 score of eligible studies

Meta-analysis of specificity and sensitivity in overall population

In our analysis, the overall pooled specificity was 0.96 (95% CI =0.93–0.98), the pooled sensitivity was 0.67 (95% CI =0.55–0.78), the DOR was 53.95 (95% CI =26.24–110.92) and the AUROC was 0.95 (95% CI =0.92–0.96) ( and ). Specificity can quantify the ability of avoiding FPs, so the high specificity indicated high accuracy of ctDNA for detection of KRAS gene mutations. Sensitivity refers to the ability of correctly detecting patients who do have the condition. Considering the trade-off between sensitivity and specificity, AUROC is used to measure the diagnostic performance of ctDNA. When AUROC is >0.9, the diagnostic accuracy is high enough for a detection method to act as an effective maker. The PLR was 18.33 (>10), suggesting that it could be used for confirming KRAS gene mutations. The NLR was 0.34 (>0.1), showing that a negative result was 34% likely to be an FN ( and ). The between-study heterogeneity was evaluated by chi-square test (Q =53.58, P=0.000<0.05) and I-square test (I2=96.27, 95% CI =93.48–99.06), which suggested the significantly high heterogeneity. From the likelihood ratio (LR) scattergram, we found that ctDNA was located in the right upper quadrant, indicating ctDNA could be used for confirming KRAS gene mutations ().

Figure 3 The SROC curve of ctDNA for detection of KRAS gene mutations.

Abbreviations: SROC, summary receiver operating characteristic; AUC, area under the curve.
Figure 3 The SROC curve of ctDNA for detection of KRAS gene mutations.

Figure 4 Fagan’s nomogram of ctDNA for detection of KRAS gene mutations.

Abbreviation: LR, likelihood ratio.
Figure 4 Fagan’s nomogram of ctDNA for detection of KRAS gene mutations.

Figure 5 LR scattergram of ctDNA for detection of KRAS gene mutations.

Abbreviations: LR, likelihood ratio; NLR, negative likelihood ratio; PLR, positive likelihood ratio; CI, confidence interval; LUQ, left upper quadrant; LRP, likelihood ratio for positive results; RUQ, right upper quadrant; LLQ, left lower quadrant; RLQ, right lower quadrant; LRN, likelihood ratio for negative results.
Figure 5 LR scattergram of ctDNA for detection of KRAS gene mutations.

Table 3 Meta-analysis of subgroup

Subgroup analysis

To determine the effect of potential confounding factors, we performed subgroup analyses measured by AUROC and stratified according to TNM stage, storage method of tumor tissues, blood sample format, ctDNA detection method and detection site of KRAS gene mutation (). For blood samples, the AUROC was higher in plasma (0.96, 95% CI =0.94–0.97) than in serum (0.83, 95% CI =0.79–0.86), indicating the higher diagnostic accuracy (P=0.000<0.05). With regard to detection methods, ARMS-qPCR was the most frequently used (0.96, 95% CI =0.94–0.97). However, there was no statistically significant difference in diagnostic accuracy between different cancer stages, storage methods of tumor tissues, ctDNA detection method and detection site of KRAS gene mutation.

Discussion

Cancer is the main cause of death, and effective treatment can significantly reduce the mortality of patients with carcinoma. Besides the traditional chemotherapy based on pathological diagnosis, targeted therapy has been widely used according to gene mutation status. Gene evaluation of tumor tissue is the gold standard for assessing mutation status, but it is usually carried out only once because of the invasiveness and costliness. However, genomic alterations may vary in primary and metastatic tumor tissues with the progression of cancer, which need the repetitive genotyping.

As we know, cancer generation and progression are associated with numerous genetic and epigenetic factors, some of which can be detected in gene alternations of tumor tissues. ctDNA, also known as part of cfDNA, can be released into blood and other body fluids from tumor tissues, carrying tumor-related genetic and epigenetic alterations, and can be more informative, specific and accurate than protein biomarkers. Several observations not only suggested the role of DNA in heredity but also provided the evidence for the occurrence of DNA beyond the confinement of cells. In 1977, Leon et alCitation9 reported that the level of cfDNA in the peripheral blood of cancer patients was notably higher than that in healthy controls, especially in those patients with metastatic sites, and significantly reduced after radiation. In 1994, Sorenson et alCitation35 and Vasioukhin et alCitation36 found that RAS gene mutations can be detected in blood cfDNA. As newly improved methods, the detection rate of ctDNA for KRAS and BRAF gene mutations in blood of CRC patients has also been reported in different studies. In 2014, Thierry et alCitation15 reported that ctDNA showed 98% specificity and 92% sensitivity of KRAS gene mutations and 100% specificity and sensitivity of BRAF gene mutations. Kuo et alCitation20 pointed out that the detection rate of cfDNA for KRAS gene mutations in plasma was higher (50%) than in primary tumor tissues (28.8%). However, Perrone et alCitation27 revealed that the KRAS gene mutation rate of cfDNA in plasma was very low (3%) compared to the matched adenocarcinoma tissues (45%). Inconsistent results made the use of ctDNA screening to be unclear. In 2015, Qiu et alCitation14 compared the diagnostic value of ctDNA for detection of EGFR gene mutations with tumor tissues by a meta-analysis and suggested ctDNA as a highly specific but relatively low-sensitive biomarker in NSCLC patients. In spite of these findings, the clinical utilization of ctDNA for therapeutic monitoring is not yet widespread because of the different results in different studies. Now, we conducted this meta-analysis to suppose the consistency of KRAS gene mutations between ctDNA and the matched tumor tissues in CRC patients, for assessing the possibility of ctDNA used for gene monitoring.

As we know, anti-EGFR MoAb is now restricted to the patients with wild-type KRAS gene.Citation5 Thus, detection of KRAS gene mutations in CRC patients has become a routine clinical test. Now, we analyzed the diagnostic performance of ctDNA for detection of KRAS gene mutations in CRC patients through meta-analysis in order to assess the clinical value of ctDNA detection. In our meta-analysis, publication bias was assessed by a regression of diagnostic log odds ratio against the inverse of the square root of the effective sample size,Citation37 and P=0.060 for the slope coefficient indicated the absence of publication bias and the accuracy of meta-analysis. Our analysis showed that the overall pooled specificity was 96% and the pooled sensitivity was 67%, which were almost as same as what had been reported for ctDNA for detection of EGFR gene mutations (specificity 96%, sensitivity 62%).Citation14 According to the guideline of AUROC and DOR,Citation38 ctDNA detection of KRAS gene mutations also had high diagnostic accuracy and discriminatory value in CRC patients. LR is also used for evaluating diagnostic accuracy and clinical utility of diagnostic test.Citation37 On basis of the results of PLR and NLR in our analysis, ctDNA was located in the right upper quadrant, indicating that it could be served as a test for confirmation of KRAS gene mutations in CRC patients.

In consideration of the influences of confounding factors on diagnostic accuracy, subgroup analyses were conducted on basis of some common covariates. Many studies have reported that the level of ctDNA was associated with tumor burden and stage.Citation22,Citation39,Citation40 ctDNA has also been reported with a higher diagnostic value for detection of EGFR gene mutations in patients with advanced stage of NSCLC.Citation14 However, we did not find any significant diagnostic difference for detection of KRAS gene mutation in different stages of CRC patients, which may be due to insufficient data of I–IV stages. The mechanism of release of ctDNAg from tumor cells is not clear, so the level of ctDNA in peripheral blood may not be in accordance with the TNM stage of cancer. That is to say, ctDNA may be useful for CRC patients in different stages. We also did not find the diagnostic accuracy difference of ctDNA between different detection sites of KRAS gene mutation, while may be for the relatively few studies and low mutation rate of codon 13 in CRC patients. In general, ctDNA is obtained from plasma or serum; FFPE or frozen tumor tissue is usually used. Our further stratified analysis indicated that the detection of ctDNA extracted from plasma was more accurate than that from serum, which was consistent with what had been reported in other studies.Citation14 In 2015, Qiu et al pointed out that ctDNA extracted from plasma had higher diagnostic accuracy than that from serum for detection of EGFR gene mutations in NSCLC patients.Citation14 Though FFPE may influence the nucleic acids, we still did not find any significant diagnostic accuracy difference of AUROC between FFPE and frozen tumor tissues. What is more, ARMS-qPCR was the most frequently used and had also been proved with high diagnostic performance. The limitations of our meta-analysis were also discussed to reveal the misinterpretation of present results. First, the relatively small size and potentially important differences in subgroup studies may result in statistical biases. Second, our analysis showed high heterogeneity, but none of the present characteristics could declare the heterogeneity. Because of the insufficient reporting of included studies, we could not analyze the probable influence of some potential factors, eg, ethnicity, pathological diagnosis of carcinoma, collection time of blood, chemotherapy situation and the detailed tumor stage, which might be the main sources of heterogeneity. Third, we did not find any significant difference in diagnostic accuracy for KRAS gene mutations after stratified analyses according to cancer stage and the storage method of tumor tissues. These results were in consonance with those studies of ctDNA for detection of other gene mutations, which could be by reason of the relatively few studies and the unclear records in details. Further studies are still needed to account for these issues.

This meta-analysis revealed that ctDNA detection might be useful for repetitive and noninvasive genotyping of KRAS gene mutations in patients with carcinoma, especially for those patients without the opportunity of biopsy at the decision-making points of treatment. This would be an ideal method of gene detection, particularly for cancer patients who are resistant or unable to catch tumor tissues.

Conclusion

ctDNA may help providing information of diagnostic screen, personalized medicine selection and real-time monitoring for cancer patients.

Acknowledgments

This study was supported by the funding from First Affiliated Hospital of Chinese People’s Liberation Army General Hospital. We would like to thank Doctor Jianhua Zhu, Doctor Guanghui Li and Doctor He Zhang for their help and support in study work.

Disclosure

The authors report no conflicts of interest in this work.

References

  • Centers of Diseases Control and PreventionHealth Status and Determinants. Life Expectancy and Mortality2015 Available from: http://www.cdc.gov/nchs/data/hus/hus15.pdf#019Accessed May 1, 2016
  • National Comprehensive Cancer Network [webpage on the Internet]Guidelines for Detection, Prevention, & Risk Reduction2017 Available from: http://www.nccn.org/professionals/physician_gls/f_guidelines.aspAccessed December 24, 2016
  • HirschFRVarella-GarciaMBunnPAJrMolecular predictors of outcome with gefitinib in a phase III placebo-controlled study in advanced non-small-cell lung cancerJ Clin Oncol200624315034504217075123
  • SharmaSVBellDWSettlemanJHaberDAEpidermal growth factor receptor mutations in lung cancerNat Rev Cancer20077316918117318210
  • MoroniMVeroneseSBenvenutiSGene copy number for epidermal growth factor receptor (EGFR) and clinical response to anti-EGFR treatment in colorectal cancer: a cohort studyLancet Oncology20056527928615863375
  • KarapetisCSKhambata-FordSJonkerDJK-ras mutations and benefit from cetuximab in advanced colorectal cancerN Engl J Med2008359171757176518946061
  • HolLde JongeVvan LeerdamMEScreening for colorectal cancer: comparison of perceived test burden of guaiac-based faecal occult blood test, faecal immunochemical test and flexible sigmoidoscopyEur J Cancer201046112059206620621736
  • GerlingerMRowanAJHorswellSIntratumor heterogeneity and branched evolution revealed by multiregion sequencingN Engl J Med20123661088389222397650
  • LeonSAShapiroBSklaroffDMYarosMJFree DNA in the serum of cancer patients and the effect of therapyCancer Res1977373646650837366
  • AnkerPMulcahyHChenXQStrounMDetection of circulating tumour DNA in the blood (plasma/serum) of cancer patientsCancer Metastasis Rev1999181657310505546
  • GormallyECabouxEVineisPHainautPCirculating free DNA in plasma or serum as biomarker of carcinogenesis: practical aspects and biological significanceMutat Res20076352–310511717257890
  • KoyanagiKMoriTO’DaySJMartinezSRWangHJHoonDSAssociation of circulating tumor cells with serum tumor-related methylated DNA in peripheral blood of melanoma patientsCancer Res200666126111611716778184
  • MoriTO’DaySJUmataniNPredictive utility of circulating methylated DNA in serum of melanoma patients receiving biochemotherapyJ Clin Oncol200523369351935816361635
  • QiuMWangJXuYCirculating tumor DNA is effective for the detection of EGFR mutation in non-small cell lung cancer: a meta-analysisCancer Epidemiol Biomarkers Prev201524120621225339418
  • ThierryARMouliereFEl MessaoudiSClinical validation of the detection of KRAS and BRAF mutations from circulating tumor DNANat Med201420443043524658074
  • BettegowdaCSausenMLearyRJDetection of circulating tumor DNA in early- and late-stage human malignanciesSci Transl Med20146224224ra24
  • DaneseEMinicozziAMBenatiMComparison of genetic and epigenetic alterations of primary tumors and matched plasma samples in patients with colorectal cancerPLoS One2015105e012641725946211
  • KimSTChangWJJinLSungJSChoiYJKimYHCan serum be used for analyzing the KRAS mutation status in patients with advanced colorectal cancer?Cancer Res Treat201547479680325687873
  • KopreskiMSBenkoFABorysDJKhanAMcGarrityTJGockeCDSomatic mutation screening: identification of individuals harboring K-ras mutations with the use of plasma DNAJ Natl Cancer Inst2000921191892310841827
  • KuoYBChenJSFanCWLiYSChanECComparison of KRAS mutation analysis of primary tumors and matched circulating cell-free DNA in plasmas of patients with colorectal cancerClin Chim Acta201443328428924685572
  • LefebureBCharbonnierFDi FioreFPrognostic value of circulating mutant DNA in unresectable metastatic colorectal cancerAnn Surg2010251227528020010083
  • LinJKLinPCLinCHClinical relevance of alterations in quantity and quality of plasma DNA in colorectal cancer patients: based on the mutation spectra detected in primary tumorsAnn Surg Oncol201421suppl 4S680S68624841357
  • LiuPLiangHXueLPotential clinical significance of plasma-based KRAS mutation analysis using the COLD-PCR/Taq-Man(®) -MGB probe genotyping methodExp Ther Med20124110911223060932
  • MiyanoSHanazawaKKitabatakeTFujisawaMKojimaKDetecting KRAS mutations in peripheral blood of colorectal cancer patients by peptide nucleic acid clamp PCRExp Ther Med20124579079423226727
  • MorganSRWhiteleyJDonaldEComparison of KRAS mutation assessment in tumor DNA and circulating free DNA in plasma and serum samplesClin Med Insights Pathol20125152222661904
  • MulcahyHELyauteyJLederreyCPlasma DNA K-ras mutations in patients with gastrointestinal malignanciesAnn N Y Acad Sci2000906252810818591
  • PerroneFLampisABertanCCirculating free DNA in a screening program for early colorectal cancer detectionTumori2014100211512124852853
  • PuXPanZHuangYComparison of KRAS/BRAF mutations between primary tumors and serum in colorectal cancer: biological and clinical implicationsOncol Lett20135124925423255930
  • RyanBMLefortFMcManusRA prospective study of circulating mutant KRAS2 in the serum of patients with colorectal neoplasia: strong prognostic indicator in postoperative follow upGut200352110110812477769
  • SakaiKTsurutaniJYamanakaTExtended RAS and BRAF mutation analysis using next-generation sequencingPLoS One2015105e012189125954997
  • SefriouiDSarafan-VasseurNBeaussireLClinical value of chip-based digital-PCR platform for the detection of circulating DNA in metastatic colorectal cancerDig Liver Dis2015471088489026160500
  • SpindlerKLPallisgaardNAndersenRFBrandslundIJakobsenACirculating free DNA as biomarker and source for mutation detection in metastatic colorectal cancerPLoS One2015104e010824725875772
  • TalyVPekinDBenhaimLMultiplex picodroplet digital PCR to detect KRAS mutations in circulating DNA from the plasma of colorectal cancer patientsClin Chem201359121722173123938455
  • XuJMLiuXJGeFJKRAS mutations in tumor tissue and plasma by different assays predict survival of patients with metastatic colorectal cancerJ Exp Clin Cancer Res20143310425491325
  • SorensonGDPribishDMValoneFHMemoliVABzikDJYaoSLSoluble normal and mutated DNA sequences from single-copy genes in human bloodCancer Epidemiol Biomarkers Prev19943167718118388
  • VasioukhinVAnkerPMauricePLyauteryJLederreyCStrounMPoint mutations of the N-ras gene in the blood plasma DNA of patients with myelodysplastic syndrome or acute myelogenous leukaemiaBr J Haematol19948647747797918071
  • DeeksJJMacaskillPIrwigLThe performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessedJ Clin Epidemiol200558988289316085191
  • SwetsJAMeasuring the accuracy of diagnostic systemsScience19882404857128512933287615
  • DiehlFSchmidtKChotiMACirculating mutant DNA to assess tumor dynamicsNat Med200814998599018670422
  • NygaardADSpindlerKGPallisgaardNAndersonRFJakobsenALevels of cell-free DNA and plasma KRAS during treatment of advanced NSCLCOncol Rep20143196997424316734