60
Views
5
CrossRef citations to date
0
Altmetric
Review

A retrospective cohort study of clinical outcomes for intravitreal crystalline retained lens fragments after age-related cataract surgery: a comparison of same-day versus delayed vitrectomy

, , , , &
Pages 1135-1148 | Published online: 18 Jul 2012

Abstract

Background

This analysis compared outcomes for same-day (under a no-move, no-wait policy) versus delayed vitrectomy for intravitreal crystalline retained lens fragments after surgery for age-related cataract.

Methods

This was a retrospective, nonrandomized treatment comparison cohort study with a consecutive series of 35 eyes (23 same-day, 12 delayed) receiving both cataract surgery and vitrectomy at the Mayo Clinic Florida between 1999 and 2010. Outcome measures included visual acuity (VA), glaucoma progression, visual utility, and complications. Several techniques (bootstrapping, robust confidence intervals, jackknifing, and a homogeneous sample) were used to reduce selection bias and increase confidence in our small sample’s results.

Results

No significant baseline treatment group differences. Mean previtrectomy delay (12 eyes) was 40.9 days (median 29.5, range 1–166). Mean postvitrectomy follow-up (35 eyes) was 47.5 months (median 40.5, range 3.1–123.5). Same-day patients had significantly better final VA (adjusted for age [t = −2.14, P = 0.040] and precataract surgery VA [t = −2.98, P = 0.006]); a higher rate of good final VA (≥20/40), 78.3% (18/23) versus 58.3% (7/12); a lower rate of bad final VA (≤20/200), 4.3% (1/23) versus 25.0% (3/12); and fewer final retinal conditions, 4.3% (1/23) versus 50.0% (6/12). Same-day patients also had marginally significant better mean final VA in the operated eye (20/40 versus 20/90, Z = 1.51, P = 0.130) despite poorer initial VA (20/98 versus 20/75) and higher age (3+ years), better final visual utility, and longer survival times for better VA. Among patients with preexisting glaucoma, same-day patients experienced significantly less differential (operated versus nonoperated eye) glaucoma progression.

Conclusion

Results favored same-day patients, who experienced better final VA and visual utility, less differential glaucoma progression, and fewer complications. Results need confirmation with larger samples.

Introduction

Phacoemulsification cataract surgery occasionally results in fragments or the entire crystalline lens dislocating into the vitreous. There is evidence that the clinical course for patients with retained lens fragments (RLF) begins the instant the fragments enter the vitreous and is affected by the cataract surgeon’s decisions and actions.Citation1 Lack of immediate availability of an experienced vitreoretinal surgeon and the necessary equipment usually precludes a same-day vitrectomy, which many suggest might be the optimal time for RLF removal.Citation2Citation6

Studies comparing same-day and delayed vitrectomy show mixed results. Several authors reported better visual acuity (VA)Citation7Citation9 and lower rates of complications – retinal detachment (RD),Citation7Citation10 corneal edema,Citation10,Citation11 glaucoma/elevated intraocular pressure (IOP),Citation7Citation12 cystoid macular edema (CME),Citation7,Citation8,Citation10 and intraocular inflammation/infectionCitation7,Citation10,Citation11 – among same-day patients. Lower rates of elevated IOP and/or CME may be related to less intraocular inflammation/infection.Citation8,Citation10 Others reported no significant differences in VA,Citation13 RD,Citation12 and IOPCitation13 between same-day and delayed vitrectomy patients.

This study compared outcomes of patients with RLF who received a same-day vitrectomy, under the Mayo Clinic Florida (MCF) “no move, no wait” policy, versus a delayed vitrectomy any day after cataract surgery. The MCF policy is that a same-day vitrectomy can be performed only if a vitreoretinal surgeon begins the procedure within 15 minutes of cataract surgery and the patient is not moved from the original operating room. Outcomes included VA, visual utility, new glaucoma cases, differential progression of preexisting glaucoma, and ocular complications. This study received institutional review board approval and an informed consent waiver from the MCF Institutional Review Board.

Methods

Patients, study design, and setting

This was a retrospective cohort study with a consecutive series of 34 patients (35 eyes) who had received both cataract surgery and vitrectomy at MCF (1999–2010). Inclusion criteria were scheduled phacoemulsification cataract surgery for an age-related cataract and intravitreal crystalline RLF managed surgically with a standard three-port pars plana vitrectomy. Twelve eyes (exposed to RLF for 1+ days) received a delayed vitrectomy (1999–2004) with mean delay of 40.9 days (median 29.5, range 1–166). Indications for vitrectomy in this delayed group included elevated IOP, excessive inflammation, CME, and/or decreased VA. Same-day vitrectomy (1999–2010) was successfully performed on 22 eyes and attempted on the remaining eye, but not completed due to an equipment problem. This patient’s data were analyzed in the same-day group, according to intention-to-treat,Citation14 yielding an unexposed group with 23 eyes. All patients returned for follow-up visits (mean postvitrectomy follow up 47.5 months [median 40.5, range 3.1–123.5]) as per the standard of care, and data was abstracted from patients’ medical records.

Variables

All variables pertain to the operated eye unless otherwise noted. Snellen VA, measured during all visits, was converted to logarithm of the minimum angle of resolution (logMAR) for statistical analysis.Citation15 Total elapsed time was from cataract surgery to final visit. The following were considered final retinal conditions: CME, RD, background diabetic retinopathy with focal laser photocoagulation, macular scar, and/or drusen; and we included the following as final corneal conditions: superficial scar, mild edema, and/or mild haze. We defined good VA as ≥20/40, bad VA as ≤20/200, and ocular inflammation as the presence of cells in the anterior chamber.

New glaucoma cases included patients requiring long-term pressure-lowering drops (in the operated eye) after vitrectomy who did not require this before cataract surgery. Glaucoma progression was defined as the exacerbation of visual field abnormalities, calculated by subtracting precataract surgery mean deviation (MD) from final MD and precataract surgery pattern-specific deviation (PSD) from final PSD. Differential glaucoma progression was calculated (separately for MD and PSD) by subtracting glaucoma progression in the nonoperated (fellow) eye from glaucoma progression in the operated eye.

Two scales were used for final visual utility: visual utility – better eye (based mainly on VA in the better eye)Citation16 and visual utility – both eyes (adapted to use only VA data but from both eyesCitation17 because RLF typically occur only in a single eye, often the one with worse VA). Because it is patient-specific (not eye-specific), the visual utility analyses contained only 22 same-day patients because one patient received a same-day vitrectomy in both eyes.

Data analyses

All analyses compared results for patients’ operated eyes by treatment group (same-day versus delayed) and were preformed using Stata/IC version 11.1 (StataCorp, College Station, TX, USA). When doing the analyses, exact tests (which do not rely on large-sample assumptions of asymptotic normality) were used whenever possible.Citation18 In addition, model adjustment for potential confounding variables was limited because, in a small dataset, including too many variables in a model might result in overfitting.Citation19 However, it was important to adjust these analyses for potential confounding variables to reduce the effects of selection bias, which is inherent when comparing nonrandomized samples.Citation14,Citation20 Potential confounding variables included patient age (at final visit), VA precataract surgery (the best proxy available for ocular health and vision before the RLF), and total elapsed time. See the appendix, which describes additional steps taken to reduce effects of selection bias and increase confidence in our small sample results.

Continuous variables were assessed for normal distributions. Three types of models were built: analysis of covariance (ANCOVA) for final VA and final visual utility – better eye, ordinal logistic regression for final visual utility – both eyes, and exact Cox proportional-hazards regression for time from vitrectomy until VA decreased to and remained <20/40 and ≤20/200. An independent-samples t-test compared differential MD glaucoma progression, a Mann–Whitney test compared differential PSD glaucoma progression, and Fisher’s exact tests compared complication rates.

Results were considered statistically significant with P-values ≤ 0.05.Citation21,Citation22 When appropriate, marginally significant differences (P ≤ 0.15) were noted because small samples are often underpowered to detect significant differences, even when treatment effects are real.Citation14 Noting marginally significant results is as appropriate as a multiplicity of post hoc power analyses, and probably more informative, since it is specifically the marginally significant results which should be included in the hypotheses of larger studies to verify the small sample’s results. Discussing marginally significant results attempts to reduce the effect of type II errors (the failure of a statistical test to detect actual treatment group differences, when they exist), which are a problem associated with small-sample studies.Citation14

Results

During the study period (1999–2010), 7565 patients had scheduled age-related cataract surgery at MCF, so these 35 cases indicate an RLF incidence rate of 0.46%. All 35 RLF cases were included in this study. contains descriptive statistics and treatment group comparisons. There were no significant (or marginally significant) baseline group differences in any precataract surgery variable. There was a significant difference in the volume of RLF (same-day patients having larger amounts, P < 0.001) and a marginally significant difference in intraocular lens (IOL) type (more same-day patients had anterior-chamber IOLs, P = 0.084). For postvitrectomy variables, there were significant differences in both MD and PSD differential glaucoma progression (discussed below) and final retinal conditions (same-day = 4.3%, delayed = 50.0%; P = 0.003). There were also marginally significant differences in unadjusted final VA in the operated eye (same-day = 0.30, delayed = 0.65; Z = 1.51, P = 0.130), age at final visit (same-day = 84.43, delayed = 81.37; Z = −1.53, P = 0.126), bad final VA (same-day = 4.3% [1/23], delayed = 25.0% [3/12]; P = 0.106), and final visual utility – both eyes (same-day = 0.94, delayed = 0.91; Z = 1.54, P = 0.124). For all postvitrectomy clinical variables with significant or marginally significant differences, same-day patients had better results. compares precataract surgery and final VA (operated eye) and differential glaucoma progression (operated versus nonoperated eye) by treatment group.

Figure 1 Box-and-whisker plot comparisons of precataract surgery (Pre-CS) logMAR visual acuity (VA) and final logMAR VA in the operated eye and differential glaucoma progression (exacerbation) (mean deviation [MD] and pattern-specific deviation [PSD]) by treatment group.

Figure 1 Box-and-whisker plot comparisons of precataract surgery (Pre-CS) logMAR visual acuity (VA) and final logMAR VA in the operated eye and differential glaucoma progression (exacerbation) (mean deviation [MD] and pattern-specific deviation [PSD]) by treatment group.

Table 1 Patient characteristics and univariate tests of between-group differences

displays descriptive statistics and normal distribution test results. For three dependent variables, final logMAR VA in the operated eye, visual utility – both eyes, and differential PSD glaucoma progression, a normal distribution could not be assumed. Analogous ANCOVA models, built with Snellen (normally distributed) and logMAR final VA, produced similar results. We report only the logMAR final VA models’ results, because it is a continuous variable,Citation15 as required by ANCOVA. Attempts to transform the other two variables to normal distributions were unsuccessful.

Table 2 Descriptive statistics and normal distribution tests

The models’ results are summarized in . ANCOVA () indicated that same-day patients had significantly better adjusted final VA (models 1A and 1B) (age-adjusted difference = −0.42, 95% confidence interval [CI] = −0.83, −0.02, t = −2.14, P = 0.040 and precataract surgery VA-adjusted difference = −0.45, 95% CI = −0.75, −0.14, t = −2.98, P = 0.006) and marginally significant higher adjusted visual utility – better eye (models 2A and 2B), approximately the difference between 20/25 and 20/30 (age-adjusted difference = 0.04, 95% CI = −0.01, 0.10, t = 1.62, P = 0.116 and precataract surgery VA-adjusted difference = 0.04, 95% CI = −0.01, 0.09, t = 1.48, P = 0.149). shows the results of using these ANCOVA models to estimate the patients’ mean final VA and visual utility – better eye if the patients had been in the other treatment group.

Table 3 Summary comparison of outcomes and actual vs estimated (based on statistical models) if patients had been in the other treatment group

Table 4 Analysis of covariance (ANCOVA) and ordinal logistic regression models comparing final visual acuity in the operated eye and final visual utility (two scales)

Table 5 Exact Cox proportional-hazards models comparing visual acuity survival times and two-sample tests comparing differential glaucoma progression

Ordinal logistic regression (, models 3A and 3B) indicated that same-day patients had significantly higher odds of better adjusted visual utility – both eyes (age-adjusted odds ratio = 7.38, 95% CI = 1.12, 48.78, Z = 2.07, P = 0.038 and precataract surgery VA-adjusted odds ratio = 7.26, 95% CI = 1.06, 49.66, Z = 2.02, P = 0.043). Cox regressions () indicated that same-day patients had lower hazards for VA decreases for both time-to-VA < 20/40 (models 4A and 4B) (age-adjusted hazard ratio = 0.34, 95% CI = 0.01, 1.19, Z = −1.69, P = 0.092, marginally significant, and precataract surgery VA-adjusted hazard ratio = 0.17, 95% CI = 0.03, 0.87, Z = −2.13, P = 0.033, significant) and timeto-VA ≤ 20/200 (models 5A and 5B) (age-adjusted hazard ratio = 0.16, 95% CI = 0.02, 1.67, Z = −1.53, P = 0.126 and precataract surgery VA-adjusted hazard ratio = 0.07, 95% CI = 0.00, 1.06, Z = −1.92, P = 0.055, both marginally significant). compares precataract surgery VA-adjusted survival functions by treatment group.

Figure 2 Comparison of Cox proportional-hazards survival functions for good visual acuity (VA ≥ 20/40) and not bad visual acuity (VA > 20/200), in the operated eye, by treatment group, adjusted for precataract surgery VA in the operated eye.

Figure 2 Comparison of Cox proportional-hazards survival functions for good visual acuity (VA ≥ 20/40) and not bad visual acuity (VA > 20/200), in the operated eye, by treatment group, adjusted for precataract surgery VA in the operated eye.

Data for differential glaucoma progression were available for only four delayed and eight same-day patients. Both the mean MD differential (difference = −5.79, 95% CI = −10.27, −1.32, t = −2.88, P = 0.016) and the mean PSD differential (difference = 1.66, Z = 2.55, P = 0.011) were significant (, models 6 and 7) and indicated greater glaucoma-related loss of sensitivity in delayed vitrectomy eyes. shows estimated mean final MD and PSD for the operated eye, based on precataract surgery values and actual changes in the fellow eye (data not shown) if the patients had been in the other group.

Discussion

The reported incidence of RLF following cataract surgery varied between 0.1% and 1.6%,Citation2,Citation7,Citation23,Citation24 sometimes higher for inexperienced surgeons.Citation3,Citation6,Citation25 Our rate of 0.46% (35/7565) represents the 11-year history at MCF, a single academic institution, with all cataract surgeries performed by five experienced, fellowship-trained cataract surgeons. During this time, MCF developed its no-move, no-wait (more than 15 minutes) policy for same-day vitrectomies. If a cataract surgeon experiences an intraoperative complication with posteriorly dislocated lens fragments, he immediately calls the on-site vitreoretinal surgeon for assistance. The immediate surgical goals include complete pars plana removal of the lens fragments with placement of an IOL. All RLF cases during the past 6 years were handled in this manner.

Although some eyes with crystalline RLF are treated medically (at other facilities) with good long-term outcomes, most develop sufficiently severe postoperative complications (elevated IOP, visual obscuration, and inflammation) to warrant removal by vitrectomy. This may be performed during the same surgical episode (depending on the availability, experience, and philosophy of the vitreoretinal surgeon) or delayed. Patient displeasure is common following complicated cataract surgery,Citation1,Citation4 and tends not to improve if reduced VA persists.Citation26 One author reported that “… most [RLF] patients, who had expected a rapid visual recovery after cataract surgery, were very dissatisfied with poor vision post-operatively.”Citation4 Same-day vitrectomy, when feasible, could mitigate patient dissatisfaction,Citation27 prevent the need for a second procedure, and hasten visual recovery.Citation28

Some previous studies have suggested that same-day vitrectomy yields better outcomesCitation5,Citation7,Citation8,Citation29 whereas others have reported poorer same-day outcomes.Citation3,Citation11,Citation23,Citation25 For good VA (≥20/40), three studies favored same-day vitrectomy by >30%: Chen et alCitation8 (36.2%), Romero-Aroca et alCitation7 (35.7%), and Stefaniotou et alCitation5 (31.9%); while three others favored delayed vitrectomy by >10%: Stilma et alCitation23 (26.3%), Borne et alCitation25 (18.75), and Tajunisah and ReddyCitation3 (12.5%). For bad VA (≤/<20/200), two studies favored same-day vitrectomy by >20%: Stefaniotou et alCitation5 (27.8%) and Chen et alCitation8 (22.0%); while two others favored delayed vitrectomy by ≥20%: Tajunisah and ReddyCitation3 (42.9%) and Watts et alCitation11 (20.0%). Compared to our delayed group, our same-day group included more patients with good final VA (78.3% [18/23] versus 58.3% [7/12], difference = 20.7%); fewer patients with bad final VA (4.3% [1/23] versus 25.0% [3/12], difference = 20.7%); and better mean (unadjusted) final VA (20/40 versus 20/90), despite having poorer mean initial VA (20/98 versus 20/75), and older mean age (3+ years).

None of these previous studies randomized patients to same-day or delayed vitrectomy, so perhaps these inconsistent same-day versus delayed results have been confounded by different practice patterns and noncomparable treatment groups. Some inconsistency might be due to the fact that many previous studies included same-day vitrectomy patients who were transported between facilities and had much longer (>15 minutes) wait between cataract surgery and vitrectomy. No stratification (by waiting time or location of cataract surgery) was found in any previous analysis of same-day versus delayed vitrectomy outcomes. If waiting time and/or patient movement between surgeries are important factors in the relative success of same-day vitrectomy, then policy differences among facilities could explain why, in some (but not all) studies, same-day vitrectomy produced better outcomes.

Perhaps immediate vitrectomy (within 15 minutes) prevents time-dependent inflammation and the accompanying choroidal congestion that occurs with same-day patient transfer between different surgical facilities. Immediate vitrectomy for RLF closely resembles a planned pars plana lensectomy, something frequently performed without complications by vitreoretinal surgeons. Compared to waiting several hours between surgeries, immediate vitrectomy may take advantage of a clear cornea and minimally inflamed eye to enable better removal of RLF with fewer complications.

RLF have been linked to new cases of glaucoma,Citation28,Citation30 and although we did not observe a significant difference in new glaucoma cases, we discovered that vitrectomy timing may affect the progression of preexisting glaucoma. Our same-day eyes with preexisting glaucoma experienced less differential visual field loss (glaucoma progression, measured by both MD and PSD, using fellow eyes as controls). Although possible reasons that same-day vitrectomy might have a stabilizing effect on glaucoma are not known, perhaps same-day vitrectomy prevents time-dependent damage to the trabecular meshwork.Citation30 Eyes with RLF begin to develop macrophage-mediated inflammation after 3 days,Citation29,Citation31 and these large cells may exacerbate preexisting glaucoma by further affecting the already-compromised aqueous outflow.Citation29 No other analyses of the effect of vitrectomy timing on the progression of preexisting glaucoma were found in the literature, nor were other analyses found of visual utility and RLF removal timing.

Study limitations

The primary study limitation was the small, nonrandomized sample. A description of our attempts to minimize its effect may be found in the appendix. Our patients were not randomized to vitrectomy timing, because our preferred practice pattern evolved from mostly delayed vitrectomies in the early study period to exclusively same-day vitrectomies in the latter study years. However, there were no significant between-group differences in any precataract surgery variables. We used several statistical techniques, including robust CIs, bootstrapping, and jackknifing to increase confidence in our small sample’s results. In general, robust CIs and bootstrapping validated the primary models’ results ( and ).

Future research

Future researchers, who may have more data, can attempt to verify these findings. We suggest future analyses comparing outcomes for same-day versus delayed vitrectomy stratified by cataract surgery location and adjusting for potential confounding variables (eg, age and precataract surgery VA). Statistical adjustment can mitigate the selection bias inherent in nonrandomized studies, and stratification should yield more homogeneous treatment groups and help determine if vitrectomy delay and/or patient transport between facilities had an effect on the relative success of same-day vitrectomy. Outcomes should be compared for same-day and delayed patients, all of whom had cataract surgery at the same facility as the vitrectomy, possibly with subanalyses limiting the same-day group to only those patients who were not moved to another operating room and who did not wait more than 15 minutes (or another specified time) between cataract surgery and vitrectomy. Separately, outcomes should be compared for same-day and delayed patients, none of whom had cataract surgery at the same facility as the vitrectomy.

Conclusion

These results suggest that same-day vitrectomy for RLF at MCF (performed based on our no-move, no-wait policy) is associated with superior long-term outcomes. Readers should not generalize these results to RLF patients whose same-day vitrectomy was done under different policies for patient waiting and transport. Furthermore, eyes with preexisting glaucoma may benefit from same-day vitrectomy, a result not previously found in the literature. Though our practice’s ability to immediately summon a vitreoretinal surgeon to the operating room is not unique, this is not reproducible for many cataract surgeons. Because the previously published data on same-day vitrectomy are mixed, surgeons should carefully examine their own results to determine if this strategy is appropriate for their practices.

Acknowledgments

The authors would like to acknowledge Professors John Rizzo, Debra S Dwyer, and A Laurie Shroyer for their review and approval of the data analysis plan.

Disclosure

The authors report no conflicts of interest in this work.

References

  • StewartMWManaging retained lens fragments: raising the barAm J Ophthalmol2009147456957019327443
  • StenkulaSByhrECrafoordSTackling the “dropped nucleus”Acta Ophthalmol Scand19987622202239591957
  • TajunisahIReddySCDropped nucleus following phacoemulsification cataract surgeryMed J Malaysia200762536436718705466
  • TommilaPImmonenIDislocated nuclear fragments after cataract surgeryEye (Lond)19959Pt 44374417498562
  • StefaniotouMAspiotisMPappaCEftaxiasVPsilasKTiming of dislocated nuclear fragment management after cataract surgeryJ Cataract Refract Surg200329101985198814604722
  • HuttonWLSnyderWBVaiserAManagement of surgically dislocated intravitreal lens fragments by pars plana vitrectomyOphthalmology1978852176189306086
  • Romero-ArocaPFernandez-BallartJMendez-MarinISalvat-SerraMBaget-BernaldizMBuil-CalvoJAManagement of nucleus loss into the vitreous: long term follow up in 63 patientsClin Ophthalmol20071450551219668529
  • ChenCLWangTYChengJHTaiMCLuDWChenJTImmediate pars plana vitrectomy improves outcome in retained intravitreal lens fragments after phacoemulsificationOphthalmologica2008222427728318560248
  • KimJEFlynnHWJrSmiddyWERetained lens fragments after phacoemulsificationOphthalmology199410111182718327800364
  • GonversMNew approach to managing vitreous loss and dislocated lens fragments during phacoemulsificationJ Cataract Refract Surg19942033463498064614
  • WattsPHunterJBunceCVitrectomy and lensectomy in the management of posterior dislocation of lens fragmentsJ Cataract Refract Surg200026683283710889427
  • KageyamaTAyakiMOgasawaraMAsahiroCYaguchiSResults of vitrectomy performed at the time of phacoemulsification complicated by intravitreal lens fragmentsBr J Ophthalmol20018591038104011520750
  • ScottIUFlynnHWJrSmiddyWEClinical features and outcomes of pars plana vitrectomy in patients with retained lens fragmentsOphthalmology200311081567157212917174
  • BlandMAn Introduction to Medical Statistics3rd edOxfordOxford University Press2000
  • MoseleyMJJonesHSVisual acuity: calculating appropriate averagesActa Ophthalmol1993712963008362626
  • BrownGCBrownMMBrownHCKindermannSSharmaSThe goal of value-based medicine analyses: comparability. The case for neovascular macular degenerationTrans Am Ophthalmol Soc200710516017118427606
  • SzaboSMBeusterienKMPleilAMPatient preferences for diabetic retinopathy health statesInvest Ophthalmol Vis Sci20105173387339420053977
  • AgrestiAAn Introduction to Categorical Data Analysis2nd edHobokenJohn Wiley & Sons2007
  • VittinghoffEGliddenDVShiboskiSCMcCullochCERegression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures ModelsNew YorkSpringer2005
  • IezzoniLIRisk Adjustment for Measuring Health Care Outcomes3rd edChicagoHealth Administration Press2003
  • PaganoMGauvreauKPrinciples of Biostatistics2nd edPacific GroveDuxbury2000
  • DanielWWBiostatistics: A Foundation for Analysis in the Health Sciences5th edNew YorkJohn Wiley & Sons1991
  • StilmaJSvan der SluijsFAvan MeursJCMertensDAOccurrence of retained lens fragments after phacoemulsification in The NetherlandsJ Cataract Refract Surg1997238117711829368161
  • MargherioRRMargherioARPendergastSDVitrectomy for retained lens fragments after phacoemulsificationOphthalmology19971049142614329307637
  • BorneMJTasmanWRegilloCMalechaMSarinLOutcomes of vitrectomy for retained lens fragmentsOphthalmology199610369719768643257
  • LuHJiangYRGrabowHBManaging a dropped nucleus during the phacoemulsification learning curveJ Cataract Refract Surg199925344745010079455
  • DickinsonPJGrevenCMAvoiding and managing the dislocated crystalline lensCompr Ophthalmol Update20067311312716882399
  • KwokAKLiKKLaiTYLamDSPars plana vitrectomy in the management of retained intravitreal lens fragments after cataract surgeryClin Experiment Ophthalmol200230639940312427229
  • YeoLMCharterisDGBunceCLuthertPJGregorZJRetained intravitreal lens fragments after phacoemulsification: a clinicopathological correlationBr J Ophthalmol199983101135113810502573
  • Murat UyarOKapranZAkkanFCilsimSEltutarKVitreoretinal surgery for retained lens fragments after phacoemulsificationEur J Ophthalmol2003131697312635677
  • WilkinsonCPGreenWRVitrectomy for retained lens material after cataract extraction: the relationship between histopathologic findings and the time of vitreous surgeryOphthalmology200110891633163711535462
  • VannerEAStewartMWVitrectomy timing for retained lens fragments after surgery for age-related cataracts: a systematic review and meta-analysisAm J Ophthalmol2011152334535121683330
  • RemlerDVan RyzinGResearch Methods in Practice: Strategies for Description and CausationLos AngelesSage2011
  • BaileyDResearch for the Health Professional2nd edPhiladelphiaFA Davis1997
  • KaneRUnderstanding Health Care Outcomes Research2nd edSudburyJones and Bartlett2006
  • ShiLHealth Services Research Methods2nd edClifton ParkDelmar Cengage Learning2008

Appendix: how we enhanced the analysis of our small, nonrandomized sample

Statistical techniques and interpretation

Bootstrapping and robust confidence intervals

The robustness of our models’ results was assessed by bootstrapping and estimating robust CIs ( and ). Bootstrapping involves repeated sampling (with replacement) of patients from the same treatment group in the original data set. In the bootstrapped samples (at least 1000 samples for each analysis), each treatment group (same-day and delayed) had the same number of eyes as in the original data set. The same model was built with the bootstrapped samples as had been built with the original sample, and CIs were estimated based on the middle 95% of these models’ results.Citation19 In general, the bootstrapped and robust CIs supported the same conclusions as did the primary models. Unstable bootstrapping results for the Cox proportional-hazards regressions (no meaningful calculations were possible) are possibly due to the small number of events in the sample, because the robust CI results did agree with the primary models.

Jackknifing

Jackknifing assessed our models’ sensitivity to the exclusion of each eye’s data, by rebuilding the models, deleting one observation at a time.Citation19 Sensitivity to a single observation is common with small data sets, and should not be interpreted as invalidating the original analysis, but rather emphasizes that the results need to be confirmed with larger data sets.

The jackknifing analyses indicated that, while six models were not sensitive to the exclusion of any eye’s data, six models were sensitive, although often a model’s results remained marginally significant when one eye’s data were removed. Patients whose data removal changed the significance of two or more models included four delayed vitrectomy patients and two same-day vitrectomy patients. One of these delayed vitrectomy patients had the longest cataract surgery to vitrectomy delay. If delayed vitrectomy does yield inferior results,Citation32 it is possible that the patient with the longest delay would show a greater effect. The other three delayed vitrectomy patients were the oldest and had the worst precataract surgery and final VA. Perhaps the effects of a delayed vitrectomy are more acute for older patients and/or those with worse precataract surgery VA. On the other hand, the two same-day vitrectomy patients whose data changed the significance of two or more models were among the youngest, with the best precataract surgery and final VA, so perhaps any benefits of a same-day vitrectomy are greater for younger patients and/or those with better precataract surgery VA.

Statistical test interpretation

In the literature, many analyses that do not achieve statistical significance are reported as indicating no effect: a common, but not entirely accurate interpretation of the results. Any study with a difference between groups indicates an effect. There is nothing magical about alpha, the significance level of a statistical test. At the “stroke” of 0.05, the treatment effect does not turn into a pumpkin. The effect goes from significant to nonsignificant, but it does not vanish, like Cinderella’s coach. Interpretation of statistical test results involves assessing whether or not this difference is clinically significant and sufficiently likely to be generalizable to the population from which the sample was drawn. This is why it is appropriate to note marginally significant results, especially when analyzing small samples, which tend to have low power to detect significant differences.Citation14

Appropriate sample selection

In any treatment comparison, confidence in the results depends on the size, representativeness, and homogeneity of the sample and the balance of patient characteristics between treatment groups. Sample size and treatment group balance receive a great deal of attention, but representativeness and homogeneity of the sample receive little. However, homogeneity of the sample affects the estimated standard deviation used in power and sample size calculations,Citation14 and representativeness of the sample is the foundation of external validity (below).Citation33

Homogeneity of the sample refers to how similar the study’s patients are, collectively – not across treatment groups. It is better, when comparing treatments, to have a smaller but relatively more homogeneous sample rather than a slightly larger but significantly more heterogeneous sample. When considering the appropriateness of a study with a nonrandomized comparison group, the “ … crucial question to ask is whether the two treatment groups truly come from the same population.”Citation34 Of particular importance in this (and any nonrandomized) study is that if you have a relatively homogeneous sample, you are more likely to have balanced treatment groups. Creating balanced treatment groups is, of course, the objective of random assignment (to treatment groups) in clinical trials.

When doing a retrospective study, researchers often have to make a trade-off between sample size and sample homogeneity. This study’s delayed vitrectomy group included only patients who received cataract surgery at MCF, and who, therefore, would have been eligible for a same-day vitrectomy under the MCF no-move, no-wait policy. This inclusion criterion increased our sample’s homogeneity and yielded the best nonrandomized delayed vitrectomy comparison group possible.Citation34 During the period of this study, seven additional patients who did not receive their initial cataract surgery at MCF received a delayed vitrectomy for RLF at MCF, but were not included in this study. Had they been included, they would have confounded the analyses by significantly increasing the heterogeneity of the sample, because these patients were from a different population than that of the patients who received their initial cataract surgery at MCF.

In general, patients who are treated at different facilities are different in clinically significant ways,Citation20 so nonrandomized studies that combine patients who where treated at different facilities will have a greater risk of unbalanced treatment groups, significant selection bias, and sample heterogeneity. This is especially true if, as in this case, the facility (where the patient received cataract surgery) is correlated with the treatment (no non-MCF cataract surgery patients received a same-day vitrectomy). For example, perhaps the patients who had cataract surgery at MCF were more likely to have been referred by other MCF doctors, and so could have been older and sicker than the typical cataract surgery patient. In fact, these seven additional (non-MCF cataract surgery) patients were significantly younger than the MCF cataract surgery patients, and their inclusion would have resulted in many significant baseline differences between the treatment groups. To summarize, in the absence of randomization, the best way to increase treatment group balance (through increased sample homogeneity) may be limiting the sample to patients of a single facility.Citation35 By only including patients who had cataract surgery at MCF, we limited the sample to a single population to minimize treatment group imbalances.Citation34

Assessing treatment group balance at baseline

It is important to note that properly executed random assignment of patients to treatment groups, contrary to common belief, is unable to guarantee treatment group balance, especially for small samples.Citation36 Instead, randomization only ensures that any imbalances are due simply to chance.Citation14 In a randomized study, after randomization, one should use statistical tests to assess whether or not the treatment groups are in fact balanced on important variables.Citation34 If no significant differences are found, in general, researchers would conclude that the randomization procedure created balanced treatment groups.

“To the extent that subjects from both experimental and control groups can be demonstrated to be similar in all important characteristics except for the intervention, the validity of the findings will be enhanced.”Citation36 In this study, all univariate statistical tests for between-group differences at baseline (precataract surgery) were nonsignificant (none were even marginally significant; ), including mean logMAR VA in the operated eyes (same-day = 0.69, delayed = 0.57; Z = −0.33, P = 0.739) and nonoperated eyes (same-day = 0.30, delayed = 0.26; Z = 0.21, P = 0.832). Therefore, if this had been a randomized study, and if the assessment of that randomization had produced the results in , these researchers would have concluded that the randomization procedure had created balanced treatment groups. This does not, in any way, imply that this study’s treatment groups meet the criteria of randomization (that any imbalances are due only to chance) which is impossible to establish in a nonrandomized study. However, indicates that there was no baseline between-group differences on any variable tested. This is the best possible statistical indication of balanced groups in a nonrandomized study, and is often not achieved, even in a randomized study.

Assessing treatment group balance during the study

does indicate that the same-day and delayed vitrectomy groups were significantly different after cataract surgery on the variable for the volume of RLF. For patients with this data, those in the same-day group always had a large amount of lens fragments retained, which would tend to make the situation and prognosis worse, compared to patients with a lesser amount of RLF. For example, retinal detachment has been associated with a greater percentage of lens retained.Citation24 Therefore, the fact that some delayed vitrectomy patients had only a small or moderate amount of lens fragments retained would tend to yield better outcomes in the delayed vitrectomy group. Since the delayed vitrectomy group did not have better outcomes, the treatment-group imbalance for the volume of RLF should not cause concern with the study’s results. That is because this imbalance would tend to operate in the opposite direction, ie, causing the delayed group to have better outcomes, when in fact our study indicated that better outcomes were associated with same-day vitrectomy.

Also, when studying the effects of RLF, ophthalmologists often have the luxury of using the nonoperated (fellow) eye (without the RLF) as a control. indicates that there was no significant between-group difference in final logMAR VA in the fellow eye (same-day = 0.28, delayed = 0.21; Z = −0.04, P = 0.972). This does not prove, but lends credibility to, an assumption that no systemic issues (during the study period) adversely affected VA in one treatment group more than the other, and that therefore, the statistically significant group differences in adjusted final VA in the operated eye may be due to the continued presence of RLF in the delayed vitrectomy eyes.

Other internal and external validity considerations

Internal validity

When there is a small sample but many potential dependent variables, if a lot of analyses are performed, and the results collectively indicate that the same group (treatment) is better (as was the case in our study), each result lends support to the others. This does not obviate the issues of using a small, nonrandomized sample, but it can increase confidence in the results, albeit at a risk of increasing the probability of a type I error.Citation14

Nonrandomized treatment comparisons can be valuable because “ … such studies’ outcomes were not defined or assessed for research purposes, but were conditions with objective, standard assessments, recorded before the study in a patient’s record, as part of contemporary ophthalmologic practice. This reduces information and observer biases and patient misclassification, which sometimes occur during research studies.”Citation32,Citation36 Also, although data collection could not be masked, “… all risk factors were recorded before the outcomes occurred in patients’ medical records, which lack research biases.”Citation32,Citation36

“For a natural or quasi experiment to be able to reveal genuine causal effects – for it to have good internal validity – two basic conditions are needed. First, the treatment or independent variable of interest must be exogenous. In other words, variation in the independent variable can’t be driven by anything related to the outcome.”Citation33 The MCF practice pattern evolved over time from mostly delayed vitrectomies to exclusively same-day vitrectomies. No clinical or demographic variable, in any way, influenced treatment group assignment. Therefore, in this study, treatment timing was indeed exogenous; that is, it was not based on anything that was related to any of the outcomes.

“Second, the treatment and comparison groups must be truly comparable – or homogeneous – the same in all relevant ways. For measured characteristics, the researcher can simply look at the available data to see how equivalent the treatment and comparison groups appear to be.”Citation33 As stated above, in this study, all univariate statistical tests for between-group differences at baseline (precataract surgery) were nonsignificant (). “For unmeasured characteristics, we cannot tell so easily and so must try to reason or guess if important unseen differences might lie beneath the surface.”Citation33 As stated above, we increased the sample’s homogeneity by including only patients who received cataract surgery at MCF. We are confident that this yielded the best comparison groups possible by minimizing unmeasured group differences.Citation34

External validity

“The generalizability – or external validity – of quasi experiments and natural experiments often turns out to be better than in randomized field experiments.”Citation33 We avoided volunteer bias, which is present in prospective studies, because this sample was a consecutive series that included every RLF case from cataract surgery at MCF during the study years (1999–2010).Citation36 Therefore, the results are generalizable, certainly to future patients at MCF.Citation36 Additional studies are needed to determine if same-day vitrectomies, performed under a no-move, no-wait policy, might be associated with similar, superior long-term outcomes at other facilities.