605
Views
59
CrossRef citations to date
0
Altmetric
Review

The use of patient-reported outcome research in modern ophthalmology: impact on clinical trials and routine clinical practice

, , , &
Pages 9-24 | Published online: 24 Jan 2019

Abstract

This review article considers the rising demand for patient-reported outcome measures (PROMs) in modern ophthalmic research and clinical practice. We review what PROMs are, how they are developed and chosen for use, and how their quality can be critically appraised. We outline the progress made to develop PROMs in each clinical subspecialty. We highlight recent examples of the use of PROMs as secondary outcome measures in randomized controlled clinical trials and consider the impact they have had. With increasing interest in using PROMs as primary outcome measures, particularly where interventions have been found to be of equivalent efficacy by traditional outcome metrics, we highlight the importance of instrument precision in permitting smaller sample sizes to be recruited. Our review finds that while there has been considerable progress in PROM development, particularly in cataract, glaucoma, medical retina, and low vision, there is a paucity of useful tools for less common ophthalmic conditions. Development and validation of item banks, administered using computer adaptive testing, has been proposed as a solution to overcome many of the traditional limitations of PROMs, but further work will be needed to examine their acceptability to patients, clinicians, and investigators.

Introduction

Recent years have seen greater awareness of the importance of the patient voice in ophthalmology.Citation6 This paradigm shift influences our understanding of the impact of disease, and the efficacy of interventions, with implications for both clinical practice and clinical trials. There has been a move away from the sole use of traditional outcome metrics (eg, visual acuity, intraocular pressure [IOP]) toward inclusion of metrics that matter as much, or possibly more, to patients and providers (eg, symptoms, quality of life [QoL], convenience, and cost of treatment). Patient-reported outcome measures (PROMs) seek to comprehensively capture these important outcomes.

PROMs are increasingly used in clinical trials to assess the impact of treatment from the patient perspective. They offer particular value as the primary outcome measure where two interventions have been established to be equally efficacious in terms of a traditional outcome measure (eg, IOP lowering effect), but where differences are anticipated in terms of side effects, cost, and convenience. Multiple randomized controlled clinical trials (RCTs) have recently completed or are in progress using PROMs as the primary outcome measure.Citation7Citation10 PROM data from trials may be used to inform pharmaceutical labeling claims, clinical guideline development, reimbursement decisions, and health policy. In addition, PROMs have potential application in clinical governance and quality assurance, performance management of health care providers, and integration into routine clinical practice.Citation11,Citation12 The international consortium for health outcome measurement (ICHOM) has proposed standard outcome sets including PROMs for clinical assessment of cataract (using Catquest-9SF) and age-related macular degeneration (AMD) (using the Impact of Vision Impairment, IVI) (http://www.ichom.org/medical-conditions/). Reporting of ICHOM outcome sets for ophthalmic conditions was recently mapped to current reporting practices in eight large eye centers internationally.Citation14 This exercise revealed wide variation in current reporting practice, and no reporting of vision or eye disease-related PROMs by any hospital. Potential barriers to extend the use of PROMS in routine clinical care include logistical, social, legal, technical, and cultural factors.Citation12

This review outlines what PROMs are, explores PROMs development, and probes the extent to which they have had meaningful impact on clinical and research practice in modern ophthalmology.

What are PROMs?

PROMs are sets of questions, or “items,” that capture information on health from the patients’ perspective. Some PROMs provide rudimentary summary information, while others provide detailed measurement suited to statistical analysis. Measurement of PROMs began in the 1950s, and there has been rapid expansion in the past two decades in all fields of health care, including ophthalmology. A small survey in 1998 reveled that very few UK ophthalmologists were familiar with QoL outcome measures.Citation15 In 2001, Massof and Rubin reported that more than 12 PROMs had been developed since 1980.Citation16 Now there are more than 160 PROM instruments in ophthalmology and optometry.Citation17 Many have been developed for use in glaucoma, cataract, and low vision, but there are no validated PROMs for a large number of eye diseases and interventions.

There are many generic instruments (eg, EQ-5D, Short Form [SF]-36, Health Utilities Index-3 [HUI-3]), vision-related instruments (eg, IVI, National Eye Institute-Vision Function Questionnaire, NEI-VFQ-25), and ocular disease-specific PROM instruments (eg, Catquest-9SF). The plethora of available instruments presents a challenge – how should one be selected for use in clinical practice or a clinical trial?

Selecting a PROM

There is no “gold standard” PROM. In order to select a PROM, investigators and clinicians must choose the latent trait that they want to measure, in consultation with patients and their carers. This might be the impact of disease, or treatment, on symptoms, daily activities, emotional well-being, or side effects, measured at one time point or longitudinally. The choice of PROM will depend on the rationale for assessment. For example, if the data will be used to provide in-depth information to clinicians and patients on the impact of disease, then a disease-specific measure may be most appropriate. However, if data will be used for health economic evaluation, then a health utility measure, which seeks to take account of preferences for different health states, such as the EQ-5D, will be required. Impact on QoL is a frequently desired outcome measure, particularly by health policy makers. However, the challenge with measuring QoL is that it is a multidimensional construct. The latent traits encompassed within vision and eye disease-related QoL are proposed to include visual symptoms, ocular surface symptoms, general symptoms, emotional well-being, activity limitation, mobility, convenience, health concerns, social well-being, and economic well-being, but are not necessarily limited to these.Citation17 Each trait, or domain of interest, requires due consideration and measurement. Having chosen the latent trait or traits to be measured, a PROM can be selected from the pool of available instruments, and piloted for use to establish validity for use in a new patient or population context, or a new PROM may need to be developed. To better understand the multiple factors that should be considered, the next section explores what the ideal PROM might look like.

What does the ideal PROM look like?

Multiple approaches to evaluate PROMs have been proposedCitation18Citation22 and have informed the US Food and Drug Administration’s guidance.Citation23 In brief, important considerations include 1) content development; 2) the psychometric properties of the instrument (judged using either Classical Test Theory, or Item Response Theory approaches, including Rasch analysis – see Boxes 1 and 2 for more details); 3) responsiveness; and 4) administration burden and resource implications.

The ideal PROM contains a necessary and sufficient set of questions (content) to measure a single underlying construct such as ocular surface symptoms (unidimensionality), or, for a multidimensional construct like QoL, a series of sets of questions, each demonstrating unidimensionality and together targeting each important element of the multidimensional construct. It has a logical order of evenly spaced response categories. It is reliably able to distinguish between patients with different abilities or degrees of severity for each item, and between patients at each end of the range of the construct (measurement precision), with neither significant floor nor ceiling effects (targeting). The instrument score correlates with important clinical measures such as visual acuity (concurrent validity), and with any existing instruments purporting to measure the same construct (convergent validity), while not correlating highly with instruments purporting to measure a different construct (discriminant validity). It can discriminate between clinically distinct groups and is responsive to detecting clinically important changes over time. The instrument demonstrates test–retest reliability when repeated. Specific quality scoring criteria have been outlined in detail by Prem Senthil et al.Citation24 Further considerations include the cost of the instrument (some are not freely available), the availability of the PROM in different languages, the staffing administration requirements, and the patient response burden. One of the most frequent trade-offs that must be made is between selecting a short PROM that is readily applicable in a busy clinical or research context, and selecting a PROM that provides comprehensive insight, but takes much longer to administer. It is also important to note that a PROM developed for one target disease or patient population in one cultural context may have poor targeting of item difficulty to respondent ability in another disease or population, which is why validation is necessary.Citation17

Box 1 Classical test theory and item response theory

Analysis of patient-reported outcome measures has been centered on two approaches, Classical Test Theory (CTT), and Item Response Theory (IRT).Citation2

In CTT, each item is assumed to have equal difficulty, and each response score is assumed to have equal weight (eg, a score of 4 for “extreme difficulty” is assumed to have twice the value of a score of 2 for “mild difficulty”). Summary scores are assumed to represent measurement of the underlying trait (eg, quality of life). In IRT, both items and responders are scaled according to responses, which are assumed to reflect the different ability of responders and the different difficulty of items. Ordering of category responses is explicitly tested to ensure that “extreme difficulty” scores more highly across responders than “mild difficulty.” Rasch analysis is a special case of IRT, where the data are fit to a simple measurement model. This creates valid measurement to which parametric statistics can be applied. Massof has discussed the theoretical constructs and methodology as applied to ophthalmology in detail.Citation13

Box 2 The importance of Rasch analysis

The Rasch model provides interval-level scoring to enable examination of each unidimensional construct. Rasch analysis permits quantitative psychometric assessment of each latent trait and generates measurement data that are readily amenable to statistical analysis, whereas summary scoring does not. The classical test theory approach, which does not use Rasch analysis, is defined by the use of summary scoring (simple adding up of ordinal values assigned to response options) and a high-level reliance on simple reliability statistics like Cronbach’s alpha. The latter statistic is calculated from pairwise correlations between items and provides rudimentary insight into an instrument’s internal consistency. Gothwal et al have argued that Rasch scaling achieves smaller standard errors of the measures and further enhances precision by applying a logistic transformationto expand the range of measurement, thereby reducing ceiling and floor effects.Citation1 An important implication of this for clinical trials is that Raschvalidated instruments require a smaller sample size to detect significant differences in outcomes.

Rasch analysis has therefore been used to “re-engineer” some of the popular existing instruments, such as the Visual Function Index-14 (VF-14) and NEI-VFQ-25. For example, the VF-14 was used before and after cataract surgery, and re-engineered into a shorter instrument, achieving both reduced respondent burden and administration time, and precision 2.5 times greater than the original instrument.Citation1 Doubling the precision of the primary outcome measure halves the required sample size, with very important cost implications for clinical trials. Flaws in the psychometric properties of the, widely used, NEI-VFQ-25 have been identified by multiple investigators, and Rasch re-engineered instruments have been proposed.Citation3Citation5

Generic PROMs

Generic, multi-attribute, health-related utility instruments have been used for over three decades, and the most widely used include the EQ-5D, SF-6D, and HUI. In these instruments, answers to a series of questions yield raw health state scores that can be transformed into a utility value, where 1 represents perfect health and 0 is death. Utility values are used to calculate quality-adjusted life years (QALY) lost or gained as a result of a disease state or health care intervention. The health state weights are obtained using cardinal preference measurement approaches, such as the time trade-off or the standard gamble.

The EQ-5D instrument was developed by the EuroQol Group almost 30 years ago.Citation25 It has been translated into over 100 official languages and is widely used. It includes five questions on mobility, self-care, usual activities, anxiety/depression, and pain/discomfort. The original EQ-5D includes three levels (3L) for each question, resulting in 243 possible health states. A five-level (5L) instrument has been introduced more recently, yielding 3,125 health states.Citation26 A further three bolt-on items have been developed for EQ-5D, including a vision bolt on.Citation27 The preference weights for the EQ-5D-3L were originally obtained from a UK population sample using time-trade off, with regression analysis to estimate a value for each of the health states.Citation28 Valuation sets have since been obtained through various approaches in many other countries, and differences between valuation sets are generally small.Citation29 The original EQ-5D scale using the UK valuations extends from –0.59 to 1.00,Citation28 and a more recent UK value set for the EQ-5D-5L extends from –0.28 to 0.95.Citation30 The mean minimally important difference reported in a review of eight studies in different conditions was 0.074 (range –0.011 to –0.140).Citation31 A visual analog scale (VAS) is recommended for use alongside the EQ-5D. This consists of a “thermometer” scale from 0 to 100, on which the respondent is asked to indicate the point that best represents their own health on that day.

The Short Form (SF-6D) includes eleven items in six domains, including physical functioning, role limitations, social functioning, pain, vitality, and mental health.Citation32 This instrument yields 18,000 health states. Items were extracted from the larger, 36-item instrument (SF-36), which was developed for the Medical Outcomes Study.Citation33,Citation34 Preference weights are obtained from a UK population-representative sample and models derived to provide utility values for each health state. The SF-6D scale extends from 0.29 to 1.00, and a review of eight studies in different conditions estimates the mean minimally important difference to be 0.041 (range from 0.011 to 0.097).Citation31 The SF-36, and a shorter version – the SF-12 – are also still frequently used in studies to assess aspects of QoL more fully, where obtaining a utility value is not the primary objective.

The Health Utilities Index was developed in the early 1980s in Canada to assess outcomes in low birth weight infants.Citation35 Six domains are captured by HUI version 2 (HUI-2) including sensation, mobility, emotion, cognition, self-care, pain, and fertility.Citation36 Each has between 3 and 5 levels, resulting in 24,000 possible health states. Valuations were originally obtained from Canadian parents using standard gamble and a VAS. Version 3 (HUI-3) expands the sensation domain into vision, hearing, and speech and yields 972,000 health states.Citation37 Valuations are elicited from the general public in Canada and a utility function estimates for each of the domains, and for the overall instrument.

Up to three decades of experience with these instruments highlights that they yield differing utility values in head-to-head comparisons. In seven health conditions, not including vision disorders, SF-6D is found to have a smaller range and lower variance in values than EQ-5D.Citation38 Differences result in the estimation of different estimates of quality-adjusted survival for the same intervention and thus differing conclusions in relation to cost-effectiveness. As a result, some funding bodies are explicit about which instrument and valuation method they prefer. In England, the National Institute for Health and Clinical Excellence (NICE) prefers EQ-5D, but even among NICE Technology Appraisals, there is considerable variation in the methods used to select and incorporate utility values in economic models.Citation39 Health state valuations obtained from the general public, rather than from patients or clinical experts, are also generally preferred.

The limitation of generic PROMs is that they may lack sensitivity for the impact of eye disease and its treatment. For example, a vision-related QoL instrument, the Vision Function (VF-14), identified significant benefit of cataract surgery at 3 months, but the SF-36 found no significant benefit.Citation40 While the very brief preference-based generic QoL instruments such as EQ-5D are unable to capture QoL outcomes comprehensively, their shortness and ease of administration face to face, or by telephone, postal questionnaire, SMS messaging, web or email usually results in higher response, and completion rates than longer questionnaires. Moreover, the ability to transform raw scores into utility values provides wide application across different populations and medical specialties, thereby securing their role as important PROMs in informing resource allocation and reimbursement decisions, which typically have to make comparisons across a wide range of different disease areas. Partly in consequence, they are also increasingly used in medical product development.Citation41

Some investigators, seeking instruments more sensitive to vision-related preference, have recommended use of the Vision Preference Value Scale, first validated in 2004, in which a score of 0 is equivalent to an outcome as bad as death, and a score of 1.0 is equivalent to perfect vision.Citation42 However, caution is needed in interpreting the findings of studies using a “vision-truncated scale,” and scales anchored by vision are not generally used in cost-effectiveness analysis.Citation43

Vision-related PROMs

There are many instruments that focus on the impact of vision impairment and ocular symptoms and signs on different domains of QoL, such as the NEI-VFQ-25, the IVI, and the VF-14. These are typically referred to as vision-related or ophthalmic PROM instruments, and for consistency we have used the former throughout. Khadka et al conducted a systematic review for vision-related PROM instruments demonstrating interval measurement properties and identified 48 (out of 121 instruments in total). They appraised the quality of each against criteria similar to those proposed by the “Consensus-based Standards for the selection of Measurement Instruments” groupCitation44 and highlighted those of higher quality, by ophthalmic subspecialty.Citation45 Where no disease-specific PROM exists, the IVI has been proposed as being valuable for assessing domains including the ability to read and access information, mobility, and emotional well-being.Citation17 A shorter version, the (15-item) Brief IVI, has also been validated.Citation46

Impact of PROMs by ophthalmic subspecialty

It is beyond the scope of this review to critique all vision-specific and eye disease-specific PROMs. The following sections highlight examples of the more frequently used, or better validated PROMs in ophthalmology, by subspecialty area, and illustrate examples of their impact.

Narrative review search methodology

We performed a PubMed search for “patient reported outcome” and terms relating to each subspecialty, dated January 1990 to September 30, 2018 with no field restrictions. This identified 4,114 hits (Table S1). We screened these to identify systematic reviews of PROMs, RCTs reporting PROMs, and examples of the use of PROMs in clinical practice. In addition, we reviewed the Cochrane Eyes and Vision database (https://eyes.cochrane.org/). This revealed that across all sub-specialties, relatively few RCTs contained within systematic reviews of interventions have, to date, reported PROMs or economic outcome measures. Greatest progress in terms of developing PROMs and introducing them into RCTs have been made in low vision, medical retina and glaucoma.

Glaucoma

Vandenbroeck et al published a systematic review of PROM instruments in glaucoma in which the search, dated to December 2010, identified 27 instruments, 18 of which were disease specific.Citation47 The authors highlighted that the instruments mostly lacked a conceptual framework, had been tested using classical validation techniques, and that item generation strategies had not involved the patients’ perspective adequately. Another systematic review by Che Hamzah et al, in which the search dated to January 2009, cataloged 33 instruments.Citation48 They highlighted the NEI-VFQ-25, IVI, and Treatment Satisfaction Survey-Intraocular Pressure (TSS-IOP) as having the highest content validity. Another review of PROM instruments by Khadka et al against quality criteria recommended the Modified Glaucoma Quality of Life questionnaire (GAL-9/10), as a higher quality instrument for assessing activity limitation and mobility.Citation17 These authors subsequently took a systematic approach to identify 737 unique content items for a Glaucoma-specific item bank and refined these into a minimally representative set containing 342 unique items in ten QoL domains.Citation49 The authors highlighted that the majority of items were identified de novo from patient focus groups, rather than existing PRO instruments in glaucoma.

A review of trials and clinical studies registered with Clinicaltrials.gov, assessing the efficacy of minimally invasive glaucoma surgical devices, identified that only one of 51 studies included health-related QoL as a secondary outcome measure.Citation50 The recently published RCT protocol for the Treatment of Advanced Glaucoma Study claims to be the first RCT to set patient perspectives as the primary outcome measure.Citation51 summarizes RCTs in glaucoma that have included PROMs as primary outcome measures. This table highlights that the impact of PROMs has been relatively limited to date, with focus on anxiety levels between different treatments, but that RCTs are currently underway using PROMs as the key determinant of comparative efficacy.

Table 1 Impact of PROMs in glaucoma RCTs, highlighting only trials in which PROMs were selected as primary outcome measures

Medical retina, uveitis, and vitreoretinal disease

A systematic review of retinal disease PROMs by Prem Senthil et al (search date not specified) identified 217 studies, most frequently on AMD (108 studies), diabetic retinopathy (DR) (31 studies), and hereditary retinal dystrophies (29 studies). In total, 110 different PROM instruments were reported, more than half of which were generic (62 studies, most frequently the SF-36, and the Hospital Anxiety and Depression Scale [HADS]), followed by disease-specific (29 studies) and vision-related (19 studies, most frequently the NEI-VFQ and VF-14) instruments.Citation24 Only three instruments had been rescaled and tested using Rasch analysis. They also critically appraised the psychometric performance of the instruments against criteria and identified numerous limitations. The authors reported that most instruments had limited content coverage, typically measuring only one or a few domains of QoL. In another study by Prem Senthil et al, semi-structured, qualitative interview data from 79 patients with hereditary and acquired retinal diseases identified nine QoL domains relevant to both the groups, which were each explored and reported in detail. This paper provides a scientific basis for splitting vs lumping less common retinal diseases to develop a retina-specific PROM.Citation52 Further work has formed the basis for a hereditary retinal disease item bank.Citation53

A systematic review of clinical trial registries to identify uveitis trials reported that none out of 104 registered by October 2013 used a PROM as a primary outcome measure.Citation54 The Core Outcome Set for Uveitic Macular Oedema (COSUMO) study aims to develop a core outcome set for trials, using systematic review, qualitative research with focus groups, and a Delphi process to reach consensus.Citation55 A core outcome set is also being developed by the Outcome Measures in Rheumatology (OMERACT) Vasculitis Working Group for Behcet’s disease, which includes the ocular manifestations.Citation56 Another core outcome set has been proposed for JIA-associated uveitis.Citation57 The Multicenter Uveitis Steroid Treatment study (MUST) investigators reported that their trial, comparing systemic or implanted corticosteroid therapy in 255 patients, was underpowered to explore secondary outcomes of interest including QoL, highlighting the importance of considering sample size in future comparative effectiveness trials.Citation58 provides examples of the inclusion of PROMs in uveitis RCTs. The examples illustrate that PROMs are making an important impact in this specialty, where identification of traditional outcome metrics (eg, cells in the vitreous) that correlate meaningfully with the patient-centered experience of disease and its treatment has been more challenging likely due to the reliance on non-disease-specific instruments.

Table 2 Impact of PROMs in uveitis RCTs, illustrating inclusion of PROMs as secondary outcome measures (no RCTs found including PROMs as primary outcome measure)

Krezel et al systematically reviewed the frequency and type of PROMs used in RCTs for AMD published between 2010 and 2013.Citation59 They reported 177 RCTs including 858 outcomes, of which 38 outcomes were PROMs (4.4%), and these were included in 25 trials (14.1%). The NEI-VFQ was the most frequently used instrument. A minimum set of standardized outcome measures has been defined for macular degeneration and promoted internationally, recommending IVI be used due to its three measurable traits and valid interval scaling.Citation60 However, there are currently no PROMs that are clinically validated and acceptable to regulatory agencies for drug development in intermediate AMD, and development of another novel PROM has been proposed.Citation61 In a study reviewing health state utility values in AMD and their use in health care decision-making, Butt et al highlight that generic health-related QoL instruments may lack sensitivity in AMD and that the choice of a utility value should be explicitly critiqued given the existing variability in utility values derived by different studies.Citation62

PROMs have been used to assess diabetic eye disease for many years. In the landmark Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications, intensive diabetes therapy in this cohort modestly improved NEI-VFQ score at 30 years.Citation63 However, reviews in the past decade have highlighted the importance of capturing the patient perspective in diabetic retinopathy more comprehensively,Citation64 including the need to measure its social and emotional impact through further PROMs development.Citation65 A systematic and comprehensive approach to identify the content for inclusion in a DR item bank yield 1,165 unique items that were winnowed to a minimally representative set of 314 items across nine domains of QoL.Citation66,Citation67 Initial evaluation of DR and DME item banks has been undertaken using computer adaptive testing (CAT).Citation68

provides examples of landmark RCTs in medical retina in which PROMs have had an impact. Many of these trials have used PROMs not only to demonstrate improvement in patient experience in comparison with sham interventions, but also, importantly, to demonstrate non-inferiority of QoL outcomes for interventions differing dramatically in cost. Such trial data have very important health policy implications. A very recent example is the NICE guideline (2018) to recommend the more cost-effective anti-VEGF therapy bevacizumab as an effective therapy for the treatment of AMD in the UK’s NHS. PROM data (mostly using the NEI-VFQ-25 and SF-36) contributed to this policy decision.Citation69 No vitreoretinal PROMs were identified by our search.

Table 3 Impact of PROMs in medical retina RCTs, highlighting two RCTs in which the PROM was the primary outcome measure

Cataract

The first vision-related activity limitation instrument for cataract was introduced in 1992, and a review of questionnaires published since 1992 explored the relative merits and psychometric properties of each.Citation18 Another review compared 16 Rasch-scaled cataract questionnaires before, and 6 months after, cataract surgery.Citation70 This study found the Catquest-9SF to be the most responsive to cataract surgery and, being short, was advocated as the best tool for measuring visual functioning outcomes in trials and routine practice. A minimum standardized outcome set has been proposed internationally for cataract surgery, which includes administration of Catquest-9SF pre- and 3-months postoperatively.Citation71 This instrument has also been included as a secondary outcome measure in a recent RCT protocol (The FACT trial).Citation72 A newer PROM, Cat-PROM5, has been tested head-to-head against Catquest-9SF in 822 typical NHS cataract surgery patients and, as an even shorter instrument, advocated as being preferred by patients, and better suited for use in high volume routine surgical practice.Citation73

Amblyopia, strabismus, and pediatric ophthalmology

Kumaran et al conducted a systematic review of PROMs in amblyopia and strabismus published up to July 2016.Citation74 This identified 71 PROMs of which 32 were amblyopia and/or strabismus specific, but only four of these had been subjected to psychometric tests, and only the adult strabismus questionnaire (AS-20) demonstrated good measurement properties. The authors concluded that all instruments had gaps in their content and failed to assess QoL comprehensively and proposed the development of an item bank to address this. Another review recommended the Modified AS-20 instrument, which measures self-perception, interaction, reading, and general function, as one of the strongest of the existing instruments.Citation17,Citation75 Incorporation of AS-20 QoL questionnaires into pre- and postoperative clinical practice has been proposed, on account of finding that many apparent surgical failures report subjective improvement.Citation76

Tadić et al conducted a systematic review of PROMs for ophthalmic disorders in children, and identified 17 instruments, of which 11 were condition-specific and six were for children and young people with visual impairment. The authors recommended the need for the development of new instruments.Citation77 Tadić and Rahi further elaborated on issues particular to the development of PROMs for use in children.Citation78 These include conflation between theoretically distinct vision-related constructs and outcomes, the importance of developmentally appropriate approaches to design and application, the feasibility of administering self-report standard questionnaire formats to visually impaired children, ethical issues, and statistical issues. More recently, Hatt et al have identified a comprehensive list of child- and parent-derived items from 180 children and 328 parents, which they grouped into 614 unique items identified by children in 36 subgroups, and 589 items identified by parents in 61 bins. The authors report that they intend to develop a formal set of pediatric PROMs from this pool.Citation79

Cornea and external disease

A systematic review of PROMs for surgically amenable epiphora identified that 69% of 227 studies included a PROM as the primary outcome measure, although in 48% the PROM was a single-item symptom score.Citation80 The authors critically appraised each PROM and concluded that they lacked adequate content validity. In Primary Sjogren’s Syndrome, qualitative work and PROM development have been done to identify 484 items covering 86 concepts in 3 dimensions impacting QoL.Citation81,Citation82 In the TEARS trial (Toler-ability and Efficacy of Rituximab in Primary Sjogren’s Syndrome), SF-36 scores were found to be strongly associated with patient-reported symptoms.Citation83 A review of PROMS for use in RCTs of dry eye identified 18 instruments, some of which were generic, many of which focused on symptoms, and concluded that very few available PROMs satisfy FDA guidance on the requirements of a suitable PROM to be acceptable as support for a label claim in support of a drug or medical device.Citation84 The first RCT (n=16) to demonstrate the beneficial effects of autologous serum in patients with severe ocular surface disease used a daily subjective symptom scale, the Rasch-scored Faces scale, to demonstrate a significant effect of the intervention.Citation85

While limited PROMs have been designed for use in corneal diseases, Catquest-9SF has been validated for use in patients who have had corneal transplant surgery.Citation86

Refractive error

Kandel et al conducted a systematic review for studies using PROMs to assess refractive surgery outcomes.Citation87 They identified 27 instruments, 12 of which were specific to refractive error. The authors reported that while the NEI Refractive Error Quality of Life instrument (NEI-RQL) was the most frequently used, it did not provide valid measurement, whereas a number of other instruments, including the Quality of Vision, Near Activity Visual Questionnaire, and Quality of Life questionnaire (QIRC) had been constructed using Rasch analysis and were suited to measurement of visual symptoms, activity limitations, and QoL, respectively. They subsequently developed a pool of refractive error items from patient groups in Australia (n=337 items) and Nepal (n=308 items), spanning 12 QoL domains and are working to develop a CAT system suitable for use in both high- and low-income country settings.Citation88 An RCT using PROMs as the primary outcome measure to compare ready-made spectacles and custom-made spectacles for the correction of refractive error in adults in India found that both result in comparable patient satisfaction and large gains in visual function and QoL, with the custom-made spectacles achieving a small but statistically significant higher QoL outcome.Citation89

Oculoplastics

A systematic review of PROMs for eyelid, orbit, and lacrimal disorders, conducted in 2013, identified ten generic and 32 disease-specific instruments and assessed their content domains and psychometric quality.Citation90 The SF-36 and NEI-VFQ-25 were the most frequently used generic instruments, and thyroid eye disease was the most studied condition. Of the 32 disease-specific instruments, 13 were developed for eyelid-related disease, ten for orbital disease, and nine for lacrimal disease. Physical function and self-image were the most frequently studied domains of QoL. The authors reported that the majority of instruments had very limited psychometric development and poorly defined content domains and concluded that efforts to develop PROMs in oculofacial surgery had been sparse, fragmented, and generally rudimentary, making assimilation into daily clinical practice challenging. More recently, the FACE-Q Eye Module has been developed for use in cosmetic eye treatments and contains four scales measuring appearance of the eyes, upper and lower eyelids and eyelashes,Citation91 and a module for children and young adults with diverse conditions causing facial appearance differences has also been developed.Citation92 While there have been a few further clinical studies reported since 2013, no RCTs utilizing PROMs as key outcome measures were identified by our search.

Neuro-ophthalmology

We identified one systematic review of PROMs for use in patients with vision impairment following stroke, which identified 34 vision-specific PROMs, and critically appraised the quality of the identified instruments.Citation93 The authors highlighted four high-quality instruments, including NEI-VFQ, Activity Inventory (AI), Daily Living Tasks Dependent on Vision (DLTV), and the Veterans Affairs Low Visual Function Questionnaire (VA LV VFQ), but cautioned that these had each only been assessed in a limited number of patients.

There were no other systematic reviews of PROM instruments for neuro-ophthalmic conditions, and only scattered examples of PROMs that have been developed for specific conditions. A neuro-ophthalmic module was developed for the NEI-VFQ.Citation94 This was assessed for content and quality by Ramey et al and considered to perform reasonably well by classical test criteria.Citation90 Generic instruments including NEI-VFQ and SF-36 have been used in an RCT in idiopathic intracranial hypertension (IIH) patients,Citation95 and in a study of neurofibromatosis (NF) type 2.Citation96 The Children’s Visual Function Questionnaire has been proposed as a secondary endpoint for clinical trials in children with NF1-associated optic pathway gliomas.Citation76 Disease-specific instruments have been developed for patients with neuromyelitis optica spectrum disorders.Citation97,Citation98 The first use of a PROM information system utilizing CAT in patients with neurofibromatosis has also been reported.Citation99

Low vision

A literature review of RCTs on low vision rehabilitation identified 15 trials, utilizing nine PROMs, and one hybrid PROM and performance-based outcome measure, the Melbourne Low-Vision ADL Index.Citation100 The other instruments included the AI, Canadian Occupational Performance Measure, Functional Assessment Questionnaire, Groningen Activity Restriction Scale, IVI, Katz’ Index of Activities of Daily Living, Low Vision QOL, NEI-VFQ, and the VA LV VFQ. Most of these instruments (seven out of ten) have utilized Rasch or IRT modeling, have been validated for use in low-vision populations, and include items in a number of different domains. The Veterans Affairs Low Vision Intervention Trials (LOVIT I and II) used LV VFQ-48 as the primary outcome measure. Significant benefit on reading ability at 4 months was demonstrated for low-vision rehabilitation (n=126 patients with low vision from macular disease).Citation9 The LOVIT II trial randomized 323 patients to receive low vision devices with or without rehabilitation therapy and found that the latter group improved more in all visual function domains except mobility.Citation10

The Impact of PROMs in routine clinical practice

Our search identified very few examples of the use of PROMs in routine clinical practice. Clinicians may be more likely to report such progress and real-life experience in the gray literature and unpublished sources, and we recognize that this is a limitation of this narrative, rather than systematic, review of the published literature indexed in PubMed.

The Swedish National Cataract Outcome Study (1995–1999) prospectively administered Catquest-9SF, before and after surgery, to 8,595 patient eyes and demonstrated greater impact on satisfaction, and surgical benefit to vision, of second-eye surgery.Citation101 A similar finding was reported when Catquest-9SF was administered to 870 patients in five Dutch hospitals.Citation102 Data for the Swedish National Outcome Study (2008–2011), on 9,707 patient eyes before and after surgery, further revealed large variation in PROMs, influenced by factors including the degree of anisometropia, indication for surgery, and postoperative problems.Citation103 These examples highlight the value of implementing PROMs in real-world clinical practice and Illustrate that they may reveal patient preferences unexpected by clinicians and policy makers.

Hee et al recently explored the feasibility of implementing glaucoma PROMs in daily clinical practice in Singapore.Citation104 They reported that while the majority of health care professionals and patients felt that the four glaucoma PROMs selected for use in this study were relevant to them, there were multiple barriers to their routine use. These included the need for brevity, yet the desire for a more comprehensive instrument able to capture patient concerns more fully, and the challenge for patients with vision impairment to self-administer the instrument on paper. Furthermore, responders highlighted the desire for inclusion of measurement of financial impact. The authors highlighted that participation in completing PROMs was much lower among patients from lower socioeconomic and education backgrounds, who tend to be those most severely affected by eye disease.

A single PROM for all ophthalmic situations?

The previous section outlines considerable achievements in recent years to develop PROMs for the most prevalent eye diseases globally. In some ophthalmic subspecialties, such as low vision, medical retina, and glaucoma, PROMs are frequently included as secondary, and increasingly as primary, outcome measures in clinical trials, and are being explored for integration into routine clinical practice. Other subspecialties are still at an earlier stage of developing and assessing PROMs that target the impact of the key diseases and treatments. There is a dearth of PROMs for rarer diseases, especially in neuro-ophthalmology. The issues particular to PROM research in rare diseases have been explored by Slade et al.Citation105 A key challenge is the time it takes to develop a valid and reliable PROM. High-quality PROM development requires extensive qualitative work with patients and focus groups, pilot studies in which a long set of potential items are administered to patients, psychometric data analysis and winnowing of redundant items, before validation of the final instrument in clinical practice and trials, and PROMs are not necessarily directly applicable in differing cultural contexts.

One solution is to develop a very large bank of items and to validate subsets of questions from this bank in many different diseases and patient populations.Citation106 Methods to develop one such “Eye-tem bank” to measure vision and eye disease-related QoL have been outlined.Citation17 This bank is being developed across 13 disease groups, namely AMD, cataract, glaucoma, DR, retinal detachment, other vitreoretinal, cornea, refractive error, uveitis, other inflammation, amblyopia and strabismus, lacrimal and ocular surface, and neuro-ophthalmology.Citation17 While CAT can be used to target items to the dynamic responses of each individual responder, further work will be needed to ascertain the time response burden and acceptability of such comprehensive tools in both research and clinical practice settings.

Another approach is to routinely include at least one generic PROM such as the EQ-5D alongside the wide range of vision and eye disease-related PROMs currently being used.

Future research priorities

Guidelines for the inclusion of patient-reported outcomes in clinical trial protocols and reporting guidelines have been developed: the SPIRIT-PRO and CONSORT-PRO Extensions, respectively.Citation107 Standardization of vision-related PROMs is needed, and progress toward achieving this has been made in other fields. For example, the SISAQOL consortium, “Setting International Standards in analyzing PRO and QOL endpoints for cancer clinical trials,” is developing standardized approaches for the analysis of PROM data in cancer.Citation108

A systematic review has identified methodological frameworks to measure the health care impact of research.Citation109 Beyond measuring PROMs more precisely, reliably, and comprehensively in the future, further research is needed to better understand and demonstrate the impact of measuring PROMs in ophthalmic research and clinical practice.

Conclusion

There is much improved awareness of PROMs among both researchers and clinicians over recent decades, but much work needs to be done to standardize the outcomes and the measures. PROMs provide a unique and exciting opportunity to capture what matters to patients and to inform understanding of all stakeholders. Through influencing the decisions of clinicians, regulators, and policy makers involved in the care of patients with ophthalmic diseases, PROMs have the potential to transform medical care.

Author contributions

All authors contributed to data analysis. TB drafted the manuscript in consultation with all co-authors, who provided critical revision. All authors gave final approval of the version to be published, and agree to be accountable for all aspects of the work.

Supplementary material

Table S1 PubMed search

Disclosure

Tasanee Braithwaite has received funding support from the charity Olivia’s Vision and is a Cochrane Eyes and Vision Contact Editor. Part of this work contributed to her thesis (University of Oxford, Doctor of Medicine), submitted to the University of Oxford for the Doctor of Medicine degree. Melanie Calvert is funded by the NIHR Birmingham Biomedical Research Centre and the NIHR Surgical Reconstruction and Microbiology Research Centre at the University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham. Konrad Pesudovs has over 25 years of experience in vision and eye disease-related PROMs, has created numerous instruments including the Visual Disability Assessment, the Quality of Life Impact of Refractive Correction, the Contact Lens Impact on Quality of Life, the Quality of Vision Questionnaire, and the Eye-tem Bank. He has been involved in the revalidation using Rasch analysis of numerous instruments mentioned in this review including the Catquest 9SF, the IVI, and the GAL9. He is a proponent of quality assessment of outcomes using PROMs. Inevitably some of his works are mentioned herein. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health. Melanie Calvert reports receipt of personal fees from Astellas, Takeda, and Merck and grants from Macmillan Cancer Support and the NIHR and is a coinvestigator within Health Data Research UK Midlands. The authors report no other conflicts of interest in this work.

References

  • GothwalVKWrightTALamoureuxELPesudovsKMeasuring outcomes of cataract surgery using the Visual Function Index-14J Cataract Refract Surg20103671181118820610098
  • PesudovsKPatient-centred measurement in ophthalmology-a paradigm shiftBMC Ophthalmol200662516774690
  • PesudovsKGothwalVKWrightTLamoureuxELRemediating serious flaws in the National Eye Institute Visual Function QuestionnaireJ Cataract Refract Surg201036571873220457362
  • PetrilloJBresslerNMLamoureuxEFerreiraACanoSDevelopment of a new Rasch-based scoring algorithm for the National Eye Institute Visual Functioning Questionnaire to improve its interpretabilityHealth Qual Life Outcomes201715115728807029
  • McalindenCSkiadaresiEMooreJPesudovsKSubscale assessment of the NEI-RQL-42 questionnaire with Rasch analysisInvest Opthalmol Vis Sci201152856855694
  • DeanSMathersJMCalvertM“The patient is speaking”: discovering the patient voice in ophthalmologyBr J Ophthalmol2017101670070828455280
  • LamoureuxELMcintoshRConstantinouMComparing the effectiveness of selective laser trabeculoplasty with topical medication as initial treatment (the Glaucoma Initial Treatment Study): study protocol for a randomised controlled trialTrials20151640626362541
  • GazzardGKonstantakopoulouEGarway-HeathDLaser in Glaucoma and Ocular Hypertension (LiGHT) trial. A multicentre, randomised controlled trial: design and methodologyBr J Ophthalmol2018102559359828903966
  • StelmackJATangXCRedaDJOutcomes of the Veterans Affairs Low Vision Intervention Trial (LOVIT)Arch Ophthalmol2008126560861718474769
  • StelmackJATangXCWeiYOutcomes of the Veterans Affairs Low Vision Intervention Trial II (LOVIT II): a randomized clinical trialJAMA Ophthalmol Epub20161215
  • DawsonJDollHFitzpatrickRJenkinsonCCarrAJThe routine use of patient reported outcome measures in health care settingsBMJ2010340c18620083546
  • NelsonECEftimovskaELindCHagerAWassonJHLindbladSPatient reported outcome measures in practiceBMJ2015350g781825670183
  • MassofRWThe measurement of vision disabilityOptom Vis Sci200279851655212199545
  • MichelottiMde KorneDFWeizerJSMapping standard ophthalmic outcome sets to metrics currently reported in eight eye hospitalsBMC Ophthalmol201717126929284445
  • HartPMChakravarthyUStevensonMRQuestionnaire-based survey on the importance of quality of life measures in ophthalmic practiceEye199812Pt 11241269614528
  • MassofRWRubinGSVisual function assessment questionnairesSurv Ophthalmol200145653154811425359
  • KhadkaJFenwickELamoureuxEPesudovsKMethods to develop the eye-tem bank to measure ophthalmic quality of lifeOptom Vis Sci201693121485149427668638
  • LundströmMPesudovsKQuestionnaires for measuring cataract surgery outcomesJ Cataract Refract Surg201137594595921511158
  • PetrilloJCanoSJMcleodLDCoonCDUsing classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examplesValue Health2015181253425595231
  • TerweeCBBotSDde BoerMRQuality criteria were proposed for measurement properties of health status questionnairesJ Clin Epidemiol2007601344217161752
  • de BoerMRMollACde VetHCTerweeCBVölker-DiebenHJvan RensGHPsychometric properties of vision-related quality of life questionnaires: a systematic reviewOphthalmic Physiol Opt200424425727315228503
  • PesudovsKBurrJMHarleyCElliottDBThe development, assessment, and selection of questionnairesOptom Vis Sci200784866367417700331
  • US Department of Health and Human Services FaDAFGuidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labelling Claims2009 Available from: http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdfAccessed September 25, 2018
  • Prem SenthilMKhadkaJPesudovsKAssessment of patient-reported outcomes in retinal diseases: a systematic reviewSurv Ophthalmol201762454658228062197
  • EuroQol GroupEuroQol-a new facility for the measurement of health-related quality of lifeHealth Policy199016319920810109801
  • HerdmanMGudexCLloydADevelopment and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L)Qual Life Res201120101727173621479777
  • YangYRowenDBrazierJTsuchiyaAYoungTLongworthLAn exploratory study to test the impact on three “bolt-on” items to the EQ-5DValue Health2015181526025595234
  • DolanPModeling valuations for EuroQol health statesMed Care19973511109511089366889
  • BernertSFernándezAHaroJMComparison of different valuation methods for population health status measured by the EQ-5D in three European countriesValue Health200912575075819490564
  • DevlinNJShahKKFengYMulhernBvan HoutBValuing health-related quality of life: An EQ-5D-5L value set for EnglandHealth Econ201827172228833869
  • WaltersSJBrazierJEComparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6DQual Life Res20051461523153216110932
  • BrazierJUsherwoodTHarperRThomasKDeriving a preference-based single index from the UK SF-36 Health SurveyJ Clin Epidemiol19985111111511289817129
  • WareJESherbourneCDThe MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selectionMed Care19923064734831593914
  • BrazierJRobertsJDeverillMThe estimation of a preference-based measure of health from the SF-36J Health Econ200221227129211939242
  • TorranceGWMeasurement of health state utilities for economic appraisalJ Health Econ19865113010311607
  • HorsmanJFurlongWFeenyDTorranceGThe Health Utilities Index (HUI): concepts, measurement properties and applicationsHealth Qual Life Outcomes200315414613568
  • FurlongWFDTorranceGWGoldsmithCMultiplicative Multi-Attribute Utility Function for the Helth Utilities Indiex Mark 3 (HUI3) System: A Technical ReportHamilton, Ontario, CanadaMcMaster University1998
  • BrazierJRobertsJTsuchiyaABusschbachJA comparison of the EQ-5D and SF-6D across seven patient groupsHealth Econ200413987388415362179
  • ToshJCLongworthLJGeorgeEUtility values in National Institute for Health and Clinical Excellence (NICE) Technology AppraisalsValue Health201114110210921211492
  • BilbaoAQuintanaJMEscobarAResponsiveness and clinically important differences for the VF-14 index, SF-36, and visual acuity in patients undergoing cataract surgeryOphthalmology2009116341842419168220
  • IjzermanMJKoffijbergHFenwickEKrahnMEmerging use of early health technology assessment in medical product development: a scoping review of the literaturePharmacoeconomics201735772774028432642
  • BassEBMarshMJMangioneCMPatients’ perceptions of the value of current vision: assessment of preference values among patients with subfoveal choroidal neovascularization-The Submacular Surgery Trials Vision Preference Value Scale: SST Report No. 6Arch Ophthalmol2004122121856186715596591
  • KymesSMLeeBSPreference-based quality of life measures in people with visual impairmentOptom Vis Sci200784880981617700344
  • MokkinkLBTerweeCBKnolDLThe COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its contentBMC Med Res Methodol2010102220298572
  • KhadkaJMcAlindenCPesudovsKQuality assessment of ophthalmic questionnaires: review and recommendationsOptom Vis Sci201390872074423873034
  • FenwickEKManREReesGKeeffeJWongTYLamoureuxELReducing respondent burden: validation of the Brief Impact of Vision Impairment questionnaireQual Life Res201726247948827558785
  • VandenbroeckSde GeestSZeyenTStalmansIDobbelsFPatient-reported outcomes (PRO’s) in glaucoma: a systematic reviewEye201125555557721423144
  • Che HamzahJBurrJMRamsayCRAzuara-BlancoAPriorMChoosing appropriate patient-reported outcomes instrument for glaucoma research: a systematic review of vision instrumentsQual Life Res20112071141115821203852
  • KhadkaJMcAlindenCCraigJEFenwickEKLamoureuxELPesudovsKIdentifying content for the glaucoma-specific item bank to measure quality-of-life parametersJ Glaucoma2015241121923552836
  • LeJTViswanathanSTarverMEEydelmanMLiTAssessment of the incorporation of patient-centric outcomes in studies of minimally invasive glaucoma surgical devicesJAMA Ophthalmol201613491054105627389667
  • KingAJFernieGAzuara-BlancoATreatment of advanced glaucoma study: a multicentre randomised controlled trial comparing primary medical treatment with primary trabeculectomy for people with newly diagnosed advanced glaucoma-study protocolBr J Ophthalmol2018102792292829074496
  • Prem SenthilMKhadkaJGilhotraJSSimonSPesudovsKExploring the quality of life issues in people with retinal diseases: a qualitative studyJ Patient Rep Outcomes2017111529757297
  • Prem SenthilMKhadkaJde RoachJDeveloping an item bank to measure the coping strategies of people with hereditary retinal diseasesGraefes Arch Clin Exp Ophthalmol201825671291129829730797
  • DennistonAKHollandGNKidessAHeterogeneity of primary outcome measures used in clinical trials of treatments for intermediate, posterior, and panuveitisOrphanet J Rare Dis2015109726286265
  • TallouziMOMathersJMMooreDJCOSUMO: study protocol for the development of a core outcome set for efficacy and effectiveness trials in posterior segment-involving uveitisTrials201718157629191216
  • HatemiGMearaAOzgulerYDeveloping a Core Set of Outcome Measures for Behçet Disease: Report from OMERACT 2016J Rheumatol201744111750175328365574
  • HeiligenhausAFoeldvariIEdelstenCProposed outcome measures for prospective clinical trials in juvenile idiopathic arthritis-associated uveitis: a consensus effort from the multinational interdisciplinary working group for uveitis in childhoodArthritis Care Res201264913651372
  • HolbrookJTKempenJHPrusakowskiNAAltaweelMMJabsDAMulticenter Uveitis Steroid Treatment (MUST) Trial Research GroupChallenges in the design and implementation of the Multicenter Uveitis Steroid Treatment (MUST) Trial-lessons for comparative effectiveness trialsClin Trials20118673674321994128
  • KrezelAKHoggREAzuara-BlancoAPatient-reported outcomes in randomised controlled trials on age-related macular degenerationBr J Ophthalmol201599111560156425934846
  • RodriguesIASprinkhuizenSMBarthelmesDDefining a minimum set of standardized patient-centered outcome measures for macular degenerationAm J Ophthalmol201616811227131774
  • FingerRPSchmitz-ValckenbergSSchmidMMACUSTAR: Development and clinical validation of functional, structural, and patient-reported endpoints in intermediate age-related macular degenerationOphthalmologica Epub2018828
  • ButtTTufailARubinGHealth state utility values for age-related macular degeneration: review and adviceAppl Health Econ Health Policy2017151233227637920
  • Writing Team for the DCCT/EDIC Research GroupGubitosi-KlugRASunWEffects of prior intensive insulin therapy and risk factors on patient-reported visual function outcomes in the Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications (DCCT/EDIC) CohortJAMA Ophthalmol2016134213714526584339
  • FenwickEKPesudovsKReesGThe impact of diabetic reti-nopathy: understanding the patient’s perspectiveBr J Ophthalmol201195677478220940313
  • FenwickEReesGPesudovsKSocial and emotional impact of diabetic retinopathy: a reviewClin Exp Ophthalmol2012401273821575125
  • FenwickEKPesudovsKKhadkaJReesGWongTYLamoureuxELEvaluation of item candidates for a diabetic retinopathy quality of life item bankQual Life Res20132271851185823135924
  • FenwickEKPesudovsKKhadkaJThe impact of diabetic retinopathy on quality of life: qualitative findings from an item bank development projectQual Life Res201221101771178222290480
  • FenwickEKKhadkaJPesudovsKReesGWongTYLamoureuxELDiabetic retinopathy and macular edema quality-of-life item banks: development and initial evaluation using computerized adaptive testingInvest Ophthalmol Vis Sci201758146379638729260195
  • Macular Degeneration Appendix H: GRADE tables and meta-analysis results2018 Available from: http://www.nice.org.uk/guidance/ng82/evidence/appendix-h-grade-tables-and-metaanalysis-results-pdf-4723229205
  • McAlindenCGothwalVKKhadkaJWrightTALamoureuxELPesudovsKA head-to-head comparison of 16 cataract surgery outcome questionnairesOphthalmology2011118122374238121945088
  • MahmudIKelleyTStowellCA proposed minimum standard set of outcome measures for cataract surgeryJAMA Ophthalmol2015133111247125226291752
  • DayACBurrJMBunceCRandomised, single-masked non-inferiority trial of femtosecond laser-assisted versus manual phacoemulsification cataract surgery for adults with visually significant cataract: the FACT trial protocolBMJ Open2015511e010381
  • SparrowJMGrzedaMTFrostNACataract surgery patient-reported outcome measures: a head-to-head comparison of the psychometric performance and patient acceptability of the Cat-PROM5 and Catquest-9SF self-report questionnairesEye201832478879529386619
  • KumaranSEKhadkaJBakerRPesudovsKPatient-reported outcome measures in amblyopia and strabismus: a systematic reviewClin Exp Optom2017
  • LeskeDAHattSRLiebermannLHolmesJMEvaluation of the adult Strabismus-20 (AS-20) questionnaire using Rasch analysisInvest Opthalmol Vis Sci201253626302639
  • HattSRLeskeDALiebermannLHolmesJMIncorporating health-related quality of life into the assessment of outcome following strabismus surgeryAm J Ophthalmol20161641526747379
  • TadićVHoganASobtiNKnowlesRLRahiJSPatient-reported outcome measures (PROMs) in paediatric ophthalmology: a systematic reviewBr J Ophthalmol201397111369138123743433
  • TadićVRahiJSOne size doesn’t fit all: time to revisit patient-reported outcome measures (PROMs) in paediatric ophthalmology?Eye201731451151828085146
  • HattSRLeskeDACastanedaYSPatient-derived questionnaire items for patient-reported outcome measures in pediatric eye conditionsJ AAPOS2018226445448.e2230243933
  • SchulzCBKennedyARogersSA Systematic Review of Patient-Reported Outcomes for Surgically Amenable EpiphoraOphthalmic Plast Reconstr Surg201834319320029737972
  • LacknerAFicjanAStradnerMHIt’s more than dryness and fatigue: the patient perspective on health-related quality of life in primary Sjögren’s syndrome – A qualitative studyPLoS One2017122e017205628182787
  • LacknerAStradnerMHHermannJAssessing health-related quality of life in primary Sjögren’s syndrome-The PSS-QoLSemin Arthritis Rheum201848110511029395257
  • CornecDDevauchelle-PensecVMarietteXSevere health-related quality of life impairment in active primary Sjögren’s syndrome and patient-reported outcomes: data from a large therapeutic trialArthritis Care Res2017694528535
  • GuilleminIBegleyCChalmersRBaudouinCArnouldBAppraisal of patient-reported outcome instruments available for randomized clinical trials in dry eye: revisiting the standardsOcul Surf2012102849922482469
  • NobleBALohRSMacLennanSComparison of autologous serum eye drops with conventional therapy in a randomised controlled crossover trial for ocular surface diseaseBr J Ophthalmol200488564765215090417
  • ClaessonMArmitageWJByströmBValidation of Cat-quest-9SF-A visual disability instrument to evaluate patient function after corneal transplantationCornea20173691083108828777777
  • KandelHKhadkaJLundströmMGogginMPesudovsKQuestionnaires for measuring refractive surgery outcomesJ Refract Surg201733641642428586503
  • KandelHKhadkaJFenwickEKConstructing item banks for measuring quality of life in refractive errorOptom Vis Sci201895757558729957741
  • BradyCJVillantiACGandhiMFriedmanDSKeayLVisual function after correction of distance refractive error with ready-made and custom spectacles: a randomized clinical trialOphthalmology2012119102014202022705346
  • RameyNAButtZBurkatCNRoseJGLucarelliMJPatient-reported outcomes: comprehensive analysis for the oculofacial clinicianOphthalmic Plast Reconstr Surg201430427928924814273
  • KlassenAFCanoSJGrottingJCFACE-Q Eye module for measuring patient-reported outcomes following cosmetic eye treatmentsJAMA Facial Plast Surg201719171427631534
  • LongmireNMWong RiffKWYO’HaraJLDevelopment of a new module of the FACE-Q for children and young adults with diverse conditions associated with visible and/or functional facial differencesFacial Plast Surg201733549950828962056
  • HepworthLRRoweFJHarperRJarvisKShipmanTRodgersHPatient reported outcome measures for visual impairment after stroke: a systematic reviewHealth Qual Life Outcomes20151314626374628
  • RaphaelBAGalettaKMJacobsDAValidation and test characteristics of a 10-item neuro-ophthalmic supplement to the NEI-VFQ-25Am J Ophthalmol200614261026103517046704
  • PiperRJKalyvasAVYoungAMHughesMAJamjoomAAFouyasIPInterventions for idiopathic intracranial hypertensionCochrane Database Syst Rev20158CD003434
  • MerkerVLBergnerALVranceanuAMMuzikanskyASlatteryWPlotkinSRHealth-related quality of life of individuals with neurofibromatosis type 2: results from the NF2 natural history studyOtol Neurotol201637557457927050651
  • MoorePJacksonCMutchKPatient-reported outcome measure for neuromyelitis optica: pretesting of preliminary instrument and protocol for further development in accordance with international guidelinesBMJ Open201669e011142
  • MethleyAMMutchKMoorePJacobADevelopment of a patientcentred conceptual framework of health-related quality of life in neuromyelitis optica: a qualitative studyHealth Expect2017201475826599425
  • Talaei-KhoeiMRiklinEMerkerVLFirst use of patient reported outcomes measurement information system (PROMIS) measures in adults with neurofibromatosisJ Neurooncol2017131241341927900643
  • EhrlichJRSpaethGLCarlozziNELeePPPatient-centered outcome measures to assess functioning in randomized controlled trials of low-vision rehabilitation: a reviewPatient2017101394927495171
  • LundströmMSteneviUThorburnWQuality of life after first- and second-eye cataract surgery: five-year data collected by the Swedish national cataract registerJ Cataract Refract Surg200127101553155911687351
  • Stolk-VosACVisserMSKlijnSEffects of clinical parameters on patient-reported outcome in cataract patients: a multicentre studyActa Ophthalmol201896658659129575507
  • MollazadeganKLundströmMA study of the correlation between patient-reported outcomes and clinical outcomes after cataract surgery in ophthalmic clinicsActa Ophthalmol201593329329824975543
  • HeeOKThngZXZhuHYLamoureuxELUsage of glaucoma-specific patient-reported outcome measures (PROMs) in the Singapore context: a qualitative scoping exerciseBMC Ophthalmol201818119730107834
  • SladeAIsaFKyteDPatient reported outcome measures in rare diseases: a narrative reviewOrphanet J Rare Dis20181316129688860
  • PesudovsKItem banking: a generational change in patient-reported outcome measurementOptom Vis Sci201087428529320142792
  • CalvertMKyteDMercieca-BebberRGuidelines for inclusion of patient-reported outcomes in clinical trial protocolsJAMA2018319548349429411037
  • BottomleyAPeMSloanJMoving forward toward standardizing analysis of quality of life data in randomized cancer clinical trialsClin Trials201815662463030141714
  • Cruz RiveraSKyteDGAiyegbusiOLKeeleyTJCalvertMJAssessing the impact of health care research: a systematic review of methodological frameworksPLoS Med2017148e100237028792957
  • KotechaAFeuerWJBartonKGeddeSJTube Versus Trabeculectomy Study GroupQuality of life in the tube versus Trabeculectomy StudyAm J Ophthalmol201717622823528161049
  • SkalickySED’MellowGHousePFenwickEGlaucoma Australia Educational Impact Study ContributorsGlaucoma Australia educational impact study: a randomized short-term clinical trial evaluating the association between glaucoma education and patient knowledge, anxiety and treatment satisfactionClin Exp Ophthalmol201846322223128691363
  • BengtssonBHeijlAJohannessonGAndersson-GeimerSAspbergJLindénCThe Glaucoma Intensive Treatment Study (GITS), a randomized clinical trial: design, methodology and baseline dataActa Ophthalmologica201896655756630171664
  • GohDde KorneDFHoHShared cared for stable glaucoma patients: economic benefits and patient-centered outcomes of a feasibility trialJ Glaucoma201827217017529271805
  • SheppardJJoshiABettsKAEffect of Adalimumab on visual functioning in patients with noninfectious intermediate uveitis, posterior uveitis, and panuveitis in the VISUAL-1 and VISUAL-2 trialsJAMA Ophthalmology2017135651151828426849
  • LescrauwaetBMiserocchiEThurauSAssociation between visual function response and reduction of inflammation in noninfectious uveitis of the posterior segmentInvest Opthalmol Vis Sci201758935553562
  • NiemeyerKMGonzalesJARathinamSRQuality-of-life outcomes from a randomized clinical trial comparing antimetabolites for intermediate, posterior, and panuveitisAm J Ophthalmol2017179101728414043
  • NaikRKRentzAMFosterCSNormative comparison of patient-reported outcomes in patients with noninfectious uveitisJAMA Ophthalmology2013131221922523411886
  • BresslerNMChangTSSuñerIJVision-related function after ranibizumab treatment by better- or worse-seeing eye: clinical trial results from MARINA and ANCHOROphthalmology2010117474775620189654
  • ScottIUFigueroaMJOdenNLSCORE2 Report 5: vision-related function in patients with macular edema secondary to central retinal or hemiretinal vein occlusionAm J Ophthalmol201718414715629074161
  • RamuJChatziralliIYangYHealth-related quality of life, visual function and treatment satisfaction following intravitreal dexamethasone implant for diabetic macular edemaPatient Prefer Adherence20171157958628360511
  • ChakravarthyUHardingSPRogersCAA randomised controlled trial to assess the clinical effectiveness and cost-effectiveness of alternative treatments to Inhibit VEGF in age-related choroidal neovascularisation (IVAN)Health Technol Assess201519781298
  • BresslerNMVarmaRSunerIJVision-related function after ranibizumab treatment for diabetic macular edema: results from RIDE and RISEOphthalmology2014121122461247225148789
  • MitchellPMassinPBresslerSThree-year patient-reported visual function outcomes in diabetic macular edema managed with ranibizumab: the RESTORE extension studyCurr Med Res Opin201531111967197526327116
  • GilliesMCLimLLCampainAA randomized clinical trial of intravitreal bevacizumab versus intravitreal dexamethasone for diabetic macular edema: the BEVORDEX studyOphthalmology2014121122473248125155371
  • LoftusJVSultanMBPleilAMChanges in vision- and health-related quality of life in patients with diabetic macular edema treated with pegaptanib sodium or shamInvest Opthalmol Vis Sci2011521074987505
  • VarmaRBresslerNMSuñerIImproved vision-related function after ranibizumab for macular edema after retinal vein occlusion: results from the BRAVO and CRUISE trialsOphthalmology2012119102108211822817833