The COLOFOL trial: study design and comparison of the study population with the source cancer population

Abstract

Introduction

The COLOFOL trial, a prospective randomized multicenter trial comparing two follow-up regimes after curative surgical treatment for colorectal cancer, focuses on detection of asymptomatic recurrences. This paper aims to describe the design and recruitment procedure in the COLOFOL trial, comparing demographic characteristics between randomized patients and eligible patients not included in the study.

Materials and methods

COLOFOL was designed as a pragmatic trial with wide inclusion criteria and few exclusion criteria, in order to obtain a sample reflecting the general patient population. To be eligible, patients had to be 75 years or younger and curatively resected for stage II or III colorectal cancer. Exclusion criteria were hereditary colorectal cancer, no signed consent, other malignancy, and life expectancy less than 2 years due to concomitant disease. In four of the 24 participating centers, we scrutinized hospital inpatient data to identify all colorectal cancer patients who underwent surgery, in order to ascertain all eligible patients who were not included in the study and to compare them with enrolled patients.

Results

Of a total of 4,445 eligible patients, 2,509 patients were randomized (56.4% inclusion rate). A total of 1,221 eligible patients were identified in the scrutinized hospitals, of which 684 (56%) were randomized. No difference in age or sex distribution was observed between randomized and nonrandomized eligible patients. However, a difference was noted in tumor location and stage distribution, with 5.6% more patients in the randomized group having colon cancer and 6.7% more patients having stage II disease.

Conclusion

Patients in the two study arms were not only demographically similar, but also similar to nonincluded eligible patients, apart from stage and localization. The analyses will be stratified by these variables. Taken together, we conclude that our trial results will be robust and possible to extrapolate to the target population.

Keywords:

• trial design
• source population
• colorectal cancer
• follow-up

Introduction

Follow-up after colorectal cancer surgery has three purposes: patient support, monitoring, and detection of asymptomatic recurrences to allow treatment with curative intent. However, it is not clear whether scheduled examinations and visits to the outpatient clinic have any survival benefit.¹ Existing trials have been too small to be able to detect a difference between arms. The majority were also conducted in the era before modern imaging techniques and/or before availability of modern multimodal treatment of metastatic disease.^2–8

Meta-analyses of six randomized trials have indicated that more intense follow-up programs have a survival benefit.^9,10 However, the heterogeneity of the trials calls their results into question. For example, the control group in one trial involved more examinations than the exposed group in another trial.^5,6 Two of these trials showed a positive effect on survival. However, in one of them, this was explained by allocation of more patients with stage III disease to the control group.⁴ In the other trial, all re-resections were performed on local recurrences, which were very frequent (19% and 25%, respectively),⁸ indicating suboptimal primary treatment.

Thus, there is a strong need for a large randomized trial to evaluate different follow-up regimens for patients treated for colorectal cancer. The COLOFOL trial, launched in 2005, is a pragmatic trial focusing on detection of potentially curable recurrences. It evaluates two follow-up schedules in patients who underwent surgery for colorectal cancer with curative intent (http://www.colofol.com). Primary outcomes are overall survival and disease-free survival. By December 2010, target enrollment was reached, and recruitment was stopped. The trial is registered in the Clinical Trials Register (NCT00225641).

A randomized controlled trial represents the most unbiased method to compare different treatments between groups, because it prevents unmeasured and unknown confounding. However, trial inclusion procedures create the risk that the study population does not reflect the target population, due to too narrow inclusion criteria and/or nonrandom exclusion of eligible nonparticipants.¹¹ This leads to subsequent difficulty in extrapolating the results to the general patient population and might explain why trial-based treatment effects cannot always be reproduced in clinical series or registry-based studies.^12–15 A key factor in minimizing this risk is to ensure that the study population resembles the true population at risk. In this context, we aim, in this paper, to describe the design and recruitment procedure in the COLOFOL trial, comparing demographic characteristics in randomized patients and in eligible nonparticipants.

Materials and methods

This study targeted patients who underwent radical surgery for stage II or III sporadic colorectal cancer. To benefit from detection of a recurrence, a patient has to be fit enough to undergo chemotherapy and surgery for metastatic disease. Hence, the trial was restricted to patients ≤75 years of age with a life expectancy exceeding 2 years based on concomitant disease. Complete inclusion and exclusion criteria are provided in Table 1. All patients had to personally sign a written consent before embarking in the study and the trial was approved by the ethical committee of Uppsala University, 2004: M-453 (Sweden) and Copenhagen and Frederikberg Scientific committee, KF 01-194/04 (Denmark).

Table 1 Inclusion and exclusion criteria in the COLOFOL trial

Inclusion criteria	Exclusion criteria
R0 resection	Lynch syndrome or FAP
Age ≤75 years	Local excision (eg, TEM)
Written informed consent	Life expectancy <2 years
Clean colon	Inability or refusal to perform informed consent
Tumor stage II–III	Inability to comply with the control or intense follow-up program
Ability to perform informed consent	Participation in other clinical trials interfering with the COLOFOL study

Abbreviations: FAP, familial adenomatous polyposis; TEM, transanal endoscopic microsurgery.

Requirements for participating as a study center were to recruit at least 30% of eligible patients and to recruit a total of 25 patients annually. Strict adherence to both requirements proved too difficult for smaller centres and it was later decided to implement a minimum inclusion of 20 patients as cut off to ensure quality. Four centers did not meet these targets and were dropped, leaving 24 recruitment centers in Denmark, Sweden, and Uruguay.

Patients were randomized to either high-frequency or low-frequency follow-up. Both schedules included the same examinations at every follow-up appointment, ie, clinical examination, carcinoembryonic antigen (CEA) test, and computed tomography scan of the liver and thorax. A colonoscopy was required in the perioperative period to verify a clean colon, while further endoscopies were optional. Follow-up occurred at 12 and 36 months postoperatively in the low-frequency arm and at 6, 12, 18, 24, and 36 months in the high-frequency arm. Individualized cut-off levels for CEA were used in both arms, based on serum measurements 4 weeks postoperatively. Randomization was computerized in blocks, stratified by center and cancer stage. The size of the blocks was variable and unknown to the participating centers. We considered a 6% difference in survival as a minimal relevant difference between study arms. We performed a power calculation based on this assumption and estimated 5-year survival at 60%. With a calculated risk of type 1 error estimated at 5% and type 2 errors at 15%, we determined that 1,100 patients needed to be randomized in each group. The planned number of randomized patients was set at 2,500, with an expected dropout rate of approximately 20%.

Centers were instructed to register all eligible patients in the web-based study database with a reason for noninclusion, if applicable. In addition, the hospital inpatient rosters of four of the largest participating centers (Aarhus, Bispebjerg, Malmö and Stockholm), accounting for approximately 25% of all enrolled patients, were examined, in order to identify all patients undergoing colorectal cancer surgery during the recruitment period. Each patient was screened for eligibility, yielding a complete cohort of eligible patients who were not randomized, to serve as controls to the randomized cohort.

The Mann–Whitney U-test was utilized for group comparisons of continuous variables, in which a P-value of <0.05 was considered statistically significant. Prevalence ratios with 95% confidence intervals were calculated to compare categorical variables.

Results

Recruitment

A total of 13,718 patients underwent surgery for colorectal cancer in the 24 participating centers during the study period. Of these, 5,643 patients met the inclusion criteria. Subsequently, 1,198 (21.0%) were found to be ineligible, most commonly (34%) due to a synchronous or previous malignancy. Of the 4,445 remaining eligible patients, 2,509 were randomized (Figure 1). This corresponds to an inclusion rate of 56.4% among eligible patients, ranging from 17% to 92% in the different centers (Figure 2). The median number of randomized patients per center was 77, and the mean number was 107. The most common reasons for not including eligible patients were as follows: 1) patient was not asked to participate, n=759 (17.1%); 2) patient did not want to participate, n=382 (8.6%); 3) patient was followed at another hospital, n=171 (3.8%); and 4) other reasons, n=466 (10.5%). The study flow chart is provided in Figure 1. The recruitment rate was stable, with a median inclusion rate of 43 patients per month (interquartile range: 31–53) (Figure 3).

Figure 1 Consort diagram of the COLOFOL trial.

Figure 2 Randomized and eligible patients per center.

Figure 3 Inclusion rate.

At the Aarhus, Bispebjerg, Malmö, and Stockholm centers, a total of 1,221 patients were identified as eligible based on examination of inpatient rosters. Of these, 684 were randomized, corresponding to an inclusion rate of 56% (range: 46%–82%). A total of 537 eligible patients were not randomized, among whom 387 (72%) were reported by study staff and 150 (28%) were missed originally.

Demographics

In the entire study group (n=2,509), the mean age was 64 years, and the distribution of tumor stage II and III was 54% and 46%, the male-to-female distribution was 55% to 45% and the colon-to-rectum distribution was 65% to 35%, without any differences between the two study arms.

In the sample of 1,221 patients from the Aarhus, Bispebjerg, Malmö, and Stockholm centers, as described in the Material and methods section, no differences between randomized and nonrandomized patients were observed for age (median age of 65 years in both groups) or sex (60/40% male-to-female distribution in both groups). These figures were also comparable to the study cohort. However, there were differences in stage distribution and the proportions of colon and rectal cancers, with 6.7% more stage II disease (prevalence ratio 1.13 [1.02–1.26]) and 5.6% more colon cancers (prevalence ratio 1.11 [0.99–1.24]) in the randomized group (Table 2).

Table 2 Demography of randomized patients and eligible but nonrandomized patients in four major hospitals, n=1,221

Demographic parameters	Randomized patients (N=684)	Nonrandomized eligible patients (N=537)
Median age, years (range)	65 (15–76)	65 (15–75)
Colon cancer, n (%)	385 (56)	272 (51)
Rectal cancer, n (%)	299 (44)	264 (49)
Stage II, n (%)	383 (56)	265 (49)
Stage III, n (%)	301 (44)	272 (51)
Male, n (%)	408 (60)	323 (60)
Female, n (%)	276 (40)	214 (40)

Patients with stage III disease were younger than patients with stage II disease; however, mean age in stage II and III did not differ significantly between the randomized and nonrandomized groups, 64.5 years and 62.6 years, respectively, in the nonrandomized group compared with 64.1 years and 62.8 years in the randomized group. A higher proportion of elderly (>70 years) was found in the nonrandomized group, both in stage II, 37.0% compared with 26.4% (P<0.01, χ²) and stage III disease, 28.3% compared with 20.9% (P<0.01, χ²).

Discussion

A total of 2,509 patients were randomized in the COLOFOL trial, making it by far the largest randomized trial of follow-up in the field of colorectal cancer. Although this large trial has sufficient power to unveil statistically significant differences, the question arises whether its results can be extrapolated to the target population of colorectal cancer patients. Our comparative analysis of randomized patients and eligible nonparticipants indicated that results of COLOFOL can be generalized.

When designing and performing a study, priorities are to include a well-defined study population based on strict criteria and to rule out the influence of confounders and external contributing factors. However, the risk remains that the results will be difficult to extrapolate to the target population of patients with a given condition. There are several examples of trials whose results could not be reproduced in the general population,^12,14,15 probably due to selection bias regarding comorbidity. Study designs thus represent a delicate balance.^11,14 In the COLOFOL trial, we chose a pragmatic design with wide inclusion criteria and few exclusion criteria.

A potential trial weakness is that 43.6% of eligible patients were not randomized. Furthermore, the subanalysis based on hospital inpatient rosters revealed that true number of nonparticipating patients was higher, because only 72% of nonparticipating patients were originally reported. Our thorough analysis of nonparticipants showed good agreement between eligible nonparticipating patients and randomized patients in regard to age and sex distribution, but moderate, although statistically significant, differences in distribution by cancer stage and localization. The reasons for this are unclear. However, the protocol states that trial analyses will be stratified by stage and localization, which will compensate for these differences (though at the cost of power). No difference in mean age was noted between randomized and nonrandomized patients, whereas a higher proportion of elderly (>70 years) was found in the nonrandomized group. The reason for this is unclear but more comorbidity and inability to consent in this group might contribute. The true percentage of missed eligible patients seems to be higher than the estimated 43.6%. This is of minor importance, because the analysis of eligible nonparticipants indicated that the study cohort was comparable to the source population in respects other than stage and localization. Most likely, differences in localization will not affect the ability to generalize the trial results, because rates of metastasis are similar in colon and rectal cancers. In contrast, stage is the most important risk factor for developing metastases. However, stratification for this parameter should still yield large enough subgroups to permit generalization by stage.

Another shortcoming is a lack of information on comorbidity, except that patients with low life expectancy and patients with American Society of Anesthesiologists’ classification of Physical Health score of 4, who were excluded. While randomization ensures that there is no risk for a systematic difference in comorbidity between the study groups, comorbidity can have an unrecognized impact on the generalizability of trial results.

The GILDA trial, another large trial in the field of colorectal cancer, has been recruiting patients since 1998, with the aim of randomizing 1,500 patients.¹⁶ No results have been published so far indicating a slow inclusion rate. The CEA second look trial in the UK aimed to randomize 2,000 patients, but was stopped after 11 years of recruitment, and 1,474 patients enrolled, due to inability to show any survival benefit from CEA-guided second look surgery.¹⁷ The same negative results for CEA surveillance were reported by Jones et al.¹⁸ Results from the “Follow-up After Colorectal Surgery” (FACS) trial, in which 1,202 patients were randomized to four different follow-up regimens, were published in 2014.¹⁹ No advantage was found for any of the regimens. A higher percentage of recurrences were treated with curative intent in the follow-up regimens taken together, compared with minimal follow-up, but no survival benefit was found. Apart from a problem with power, this is probably due to the small possible positive effect, ie, the low rate of asymptomatic recurrences which can be cured by early intervention. One can speculate that this reflects tumor biology, as the correlation between early detection and prognosis is not as strong for metastases as for primary tumors. Compared with the FACS trial, the COLOFOL trial has four times as many patients in each study arm and thus a better chance to detect any difference. Analysis of the final 5-year COLOFOL data will provide strong evidence about the effectiveness of treatment of recurrences with curative intent. Its pragmatic design with wide inclusion criteria and uncomplicated inclusion procedures, reflected by a high and stable monthly recruitment rate, yielded a representative study population and faster recruitment than similar trials. The requirement that at least 30% of eligible patients be recruited at each center in the COLOFOL trial and its steady recruitment rate have decreased selection biases.

Randomized controlled trials are considered to provide the highest level of scientific evidence. Over 2,500 patients have been randomized in the COLOFOL trial, with a fairly high rate of inclusion. High technical requirements for imaging procedures, verification of a clean colon, standardized algorithms for work-up, and mandatory assessment by multidisciplinary boards enhance the possibility of fair comparison between the study groups. Taken together, all this will permit firm conclusions regarding any benefit on survival of high-frequency compared with low-frequency follow-up after curative surgery for colorectal cancer. Apart from differences in stage and localization (colon or rectum), which will be handled by stratification in the analyses, we found a strong similarity between participants and eligible nonparticipants. This indicates that it will be possible to extrapolate the results to the target population. Three-year data will be available in late 2015.

Acknowledgments

The COLOFOL Study Group consists of (in alphabetic order):

Steering committee: Peer Wille-Jørgensen (PI), Bispebjerg University Hospital, Copenhagen, Denmark; Sören Laurberg, Aarhus University Hospital, Denmark; Lars Påhlman, Uppsala Academic Hospital, Sweden; Andrew Renehan, The Christie NHS Foundation Trust, University of Manchester, Manchester Academic Health Science Centre, Manchester UK; Kennet Smedh, Västerås Hospital, Sweden; Ingvar Syk, Skåne University Hospital, Malmö, Sweden; Henrik Toft Sørensen, Aarhus University Hospital, Denmark.

Denmark: Henrik Christensen, Aarhus University Hospital; Per Gandrup, Aalborg University Hospital; Allan Gorm Pedersen, Randers Hospital; Per Jess, Hilleröd Hospital; Mogens Rørbæk Madsen, Herning Hospital; Per Vadgaard Andersen, Svendborg Hospital; Peer Wille-Jørgensen, Bispebjerg University Hospital, Copenhagen; Erling Østergaard, Viborg Hospital.

Sweden: Jonas Bengtsson, Sahlgrenska Hospital, Gothenburg; Mats Bragmark, Danderyd University Hospital; Pamela Buchwald, Helsingborg Hospital; Joakim Folkesson, Uppsala Academic Hospital; Michael Goldinger, St Görans Hospital, Stockholm; Pernilla Hansdotter Andersson, Skåne University Hospital, Malmö; Rolf Heuman, Mora Hospital; Kenneth Lindberg, Södertälje Hospital; Anna Martling, Karolinska Hospital Solna, Stockholm; Michael Dahlberg, Sunderby Hospital, Luleå; Johan Ottosson, Kristianstad Hospital; Birger Sandzén, Norrland University Hospital, Umeå; Monika Egenvall, Karolinska Hospital Huddinge, Stockholm; Kennet Smedh, Västerås Hospital; Parastau Farahnak, Södersjukhuset, Stockholm.

Uruguay: Carlos Barberousse, Maciel University Hospital, Montevideo Uruguay.

This study was supported by unregistered grants from the Nordic Cancer Union, A.P. Møller Foundation, Beckettfoundation, Grosserer Chr. Andersen og hustru bursary, Sigvald og Edith Rasmussens Memorial Fund, Martha Margrethe og Christian Hermansens Fund, the Danish Medical Association, the Danish Cancer Society, the Danish Council for Independent Research/Medical Sciences and Swedish Cancer Foundation project CAN 2013/553.

Disclosure

The authors report no conflicts of interest in this work.