2,411
Views
172
CrossRef citations to date
0
Altmetric
Review

Patient involvement in clinical research: why, when, and how

, , , , , , & show all
Pages 631-640 | Published online: 27 Apr 2016

Abstract

The development of a patient-centered approach to medicine is gradually allowing more patients to be involved in their own medical decisions. However, this change is not happening at the same rate in clinical research, where research generally continues to be carried out on patients, but not with patients. This work describes the why, when, and how of more active patient participation in the research process. Specific measures are proposed to improve patient involvement in 1) setting priorities, 2) study leadership and design, 3) improved access to clinical trials, 4) preparation and oversight of the information provided to participants, 5) post-study evaluation of the patient experience, and 6) the dissemination and application of results. In order to achieve these aims, the relative emphases on the ethical principles underlying research need to be changed. The current model based on the principle of beneficence must be left behind, and one that upholds the ethical principles of autonomy and non maleficence should be embraced. There is a need to improve the level of information that patients and society as a whole have on research objectives and processes; the goal is to promote the gradual emergence of the expert patient.

Introduction

Patients are gaining a more active role in health care systems. The move toward patient-centered medicine aims to provide the best health care for each individual patient, taking his or her goals, preferences, and values into account.Citation1 Doctor–patient relationships are changing, and concepts such as shared decision making and patient empowermentCitation2 are becoming a reality.

Patient advocacy groups now claim that their opinions must have greater influence on the decisions that affect them, which is reflected in the phrase “nothing about me without me”. The development of new health care management models where patients become clients and the enormous expansion of information technology are additional factors that contribute to accelerate this change.Citation3 Patient-centered medicine cannot be practiced without patients participating in their own health care decisions and in the research that informs such decisions.Citation4

Although this cultural shift is beginning to change the way we understand health care, it is not having the same impact on the research process.Citation5 This may be because society does not see patient responsibility to participate in research as obvious as the responsibility to participate in their own medical care.Citation4 According to the predominant culture, research is performed on patients, not with patients.Citation6 Thus, patients continue to be regarded as a source of data and not as the true protagonists in the process. Initiatives have been developed in recent years to change this situation, but quite often these end up being merely tokenistic.Citation7 This paper analyzes the reasons why patients should be more actively involved in research and designates the phases in which they could participate (). Moreover, there are specific examples of how patients can achieve the level of true partnership in the research process.

Figure 1 How to engage patients in clinical research?

Figure 1 How to engage patients in clinical research?

Identifying research priorities

The fact that the questions of clinical research are scientifically relevant does not necessarily mean that they are relevant from the patient’s perspective.Citation5 Although patients should play an active role in setting research priorities, such participation continues to be the exception rather than the rule.Citation8,Citation9 Patient involvement is essential for achieving true translational research.Citation10 Nevertheless, most research questions are posed from a medical or regulatory perspective, and they are often based on what has been called the “culture of the laboratory”, which is excessively focused on basic science and often removed from the true needs of patients.Citation11,Citation12

The Patient-Centered Outcomes Research InstituteCitation13 in the USA and the James Lind Alliance (www.lindalliance.org)Citation14 in the UK have outlined the differences in research priorities between doctors and patients and instituted measures to ensure that patients participate in the process. The Patient-Centered Outcomes Research Institute has started to include patients in the review and prioritization of its research projects,Citation13 and the aims of the James Lind Alliance include the creation of a database of the principal uncertainties surrounding medical treatments (UK DUETs -database of uncertainties about the effects of treatments). These uncertainties are classified as known–unknown, in order to establish where new evidence would need to be generated, and which uncertainties already lend themselves to a systematic review of current evidence.Citation15 The Alliance studies have been based on systematic prioritization devised jointly by patients, caregivers, and clinicians. The results have made clear that aspects related to real-life management of disease matter most to patients. For example, in a study performed on patients with asthma, the top priorities were management of the adverse effects associated with bronchodilator treatment and management of asthma associated with other health conditions.Citation12 The identification and proper handling of patient needs in clinical research will yield advantages in terms of clinical and economic benefits. It has been estimated that up to 80% of the expense involved in gathering evidence in research could be avoided.Citation16 Considering patients’ priorities could contribute to more efficient clinical research.

Leading and designing research

Although it is not yet common practice, some patient associations have begun to lead research projects.Citation17 The increasing development of health social networks and crowd-sourced studies has enabled organizations such as PatientsLikeMe and 23andMe to promote research projects led by patient groups.Citation18 There are actually several examples of studies that use this method.Citation19 The proliferation of these networks, based on the altruistic transfer of personal data by patients, requires proper handling in terms of privacy and data protection.

Patient involvement is crucial for identifying the questions to ask and the outcomes to assess,Citation4 therefore it is increasingly common to involve patients or patient advocacy groups on study design.Citation20Citation22 This involvement could help to achieve more relevant results, while at the same time improving patients’ recruitment and retention. Conducting comparative effectiveness researchCitation20 based on real-life data, long-term follow-up, comparisons with best current treatments, greater emphasis on individualized treatment, and, most of all, selection of variables relevant to patients or patient-reported outcomes (PROs)Citation21 should become a priority for patients engaged in study design.Citation22

It has been stated that >75% of patients with diabetes would prefer that clinical trials include variables that measure the impact of the disease on their quality of life, such as the onset of kidney failure and dialysis, or blindness, rather than surrogate variables such as HbA1c.Citation23 In oncology, there are examples that demonstrate the advantages of including patient-experience end points and not only the traditional survival-based end points.Citation24 There are similar examples for other diseases.Citation23,Citation25Citation27 Worthy of special mention is the OMERACT (Outcome Measures in Rheumatoid Arthritis Clinical Trials) project, which has demonstrated the benefits of increasing involvement of patients with rheumatologic diseases in the design of clinical trials, particularly pertaining to identification of variables that matter to them.Citation27 It is encouraging that the regulatory agencies have already taken some steps to ensure the participation of patients in study design on the assumption that without this perspective the risk-benefit trade-off analysis for new pharmaceuticals would be incomplete.

Although an increasing number of clinical studies include them, the use of PROs, defined as “any report of the status of a patient’s health condition that comes directly from the patient, without interpretation of the patient’s response by a clinician or anyone else”Citation28 is still limited.Citation29 Only 18% of clinical trials in the area of diabetesCitation30 and 16% of trials in the cardiovascular fieldCitation31 include PROs. Likewise, fewer than 30% of drug data sheets include PROs.Citation32,Citation33 The development of guidelines by regulatory agencies on the inclusion of PROs in the evaluation of new drugsCitation34 will probably increase their use in the coming years.

To be useful in clinical research, PROs must be relevant and adequately validated.Citation35 Unfortunately, this has not been the case with many of those used in researchCitation36,Citation37 and the scales continue putting too much emphasis on symptoms. Simple and easily measurable PROs based on objective metricsCitation38 that go beyond the mere symptoms of the disease must be developed and utilized. These must evaluate aspects such as quality of life and functional status, using global ratings provided by the patients themselves.Citation32 The development of computerized health applications (apps) can facilitate the use of PROs. However, it must be ensured that such applications actually measure what they are intended to measureCitation39 and that they are adequately regulated.Citation40

Improving access to clinical trials

If participation in clinical research is a societal obligation,Citation41 then the ability to do so should be a patient right. More than 70% of the general population believes that patients need more opportunities to participate in clinical trials.Citation42 In spite of this, only a small portion of patients who could participate in a clinical trial are able to do so. Participation in clinical trials typically does not exceed 5% of patients with cancer.Citation42 This is because only those patients whose doctors are also investigators participate in clinical trials. The final aim of everyone involved in the development of clinical trials and of health care systems that seek excellence should be to enable all patients who meet the selection criteria to participate in research, if they desire to do so.

Access for more patients, and for patients with different perspectives, would speed up obtaining relevant knowledge and results that are more applicable to heterogeneous groups of patients. Access to research is influenced by socioeconomic, racial, and ethnic factors and by the type of health insurance.Citation43,Citation44 Programs to prevent such disparities should be set up to ensure that all patients who wish to participate in clinical trials can do so. It would be very beneficial for improving patients’ access to clinical research to enhance and systematize information about ongoing studies and about the sites participating in them. Patient associations should receive this information so they can pass it along with their associates. In addition, opportunities offered by new technologies should not be neglected. In this regard, clinical trial databases should include information about the characteristics of ongoing studies as well as details about the participating sites. There are already several drug agencies (eg, www.clinicaltrialsregister.eu in the European Union) that include such information. Recent initiatives, such as Trials4Me (http://trials4me.lillycoi.com/) which uses Google Maps to locate sites participating in clinical trials from the Clinicaltrials.gov database, will greatly facilitate patient searches. Just as there is a unified reference database for clinical trials (ClinicalTrials.gov), a platform should be created with unified and standardized information directed to patients.

The growing development of learning health care systems should give rise to “point of care research”, where clinical research is embedded into clinical practice.Citation45,Citation46 A large number of patients could have access to comparative effectiveness studies in which health interventions used in normal clinical practice are evaluated. This would contribute not only to the more efficient generation of new and relevant knowledge for patients but also to a speedier application of the results. The enormous development of electronic health records and information technologies could help in carrying out randomized database studiesCitation47 (or randomized registry trials), a method recently termed “the next disruptive technology” in clinical research.Citation48 This method proposes the integration of research modules into usual clinical practice in order to combine the main strengths of randomized controlled trials (ie, initial randomization) and registries (ie, naturalistic follow-up). Obviously, in order for the development of big data to achieve its full potential, high-quality data with the end purpose of improving health care results in individual patients must be collected in medical practice and in research.Citation49

Adequate information about the study

It must be ensured that patients receive all the information they need to make a free and informed choice before consenting to participate in a study. The informed consent should constitute the means by which the principle of autonomy is applied. For the process to work properly, the information provided to patients must be complete, relevant, and easy to understand. Frequently, both the informed consent document (ICD) and the patient information sheet are excessively long documents that are difficult to read and understand.Citation50,Citation51 Because of this, ~30% of participants are unaware of basic aspects of the research, such as the existence of random assignment, the possibility that they will be assigned to placebo, the fact that adverse effects could occur during the study, and even the availability of an insurance policy.Citation52,Citation53

The ICD needs to be restored to its basic function, which is to ensure that patients have suitable information, not only about the overall aims of clinical research but also about the aims and characteristics of the study, its potential risks and benefits, and the option of withdrawing from it if they so desire. For this to happen, the informed consent process should no longer be viewed as an administrative requirement, which is intended to protect the researchers more than the patients themselves.Citation54 According to the new Regulation of the European Parliament on Clinical Trials on Medical Products for Human Use, the written information provided to the trial subjects or their legal representatives to obtain informed consent “shall be kept comprehensive, concise, clear, relevant, and understandable to a layperson”.Citation55

It is essential for participants to understand that the purpose of clinical research is to generate useful information for future patients and not necessarily to achieve a therapeutic benefit, since this cannot be guaranteed. Nevertheless, many patients participate in clinical trials because of the trust that they have in their doctors and the assumption that their participation will give them access to better treatments. This therapeutic misconceptionCitation56 leads many patients (as well as many researchers) to confuse research with medical care and to tend to overestimate the potential benefits of participating in clinical trials. Although there are times when participation in a clinical trial is the only way in which a patient who has failed with other alternatives can access a new, potentially more effective medication,Citation57 systematic reviews offer no evidence that clinical trial participants achieve better outcomes than nonparticipants.Citation58

There are few examples of studies where the opinion of health care system users has been considered to improve the design and readability of the patient information sheets included in clinical trials.Citation59 It would be highly advisable for patients to participate in ethical discussions related to the studies to make sure that the information provided is clear and accessible. As pointed out earlier, this participation could be achieved not only by having patients involved in study design but also through the participation of patient representatives in the Institutional Review Boards (IRBs). Although IRB members support the participation of patients in their membership lists,Citation60 very few IRBs actually put this into practice. Often, for practical reasons, the non-health care professionals who belong to IRBs are members of the hospital administration.Citation60 In this regard, the new European Regulation for clinical trials represents a positive step forward, as itCitation55 explicitly establishes that “Member States should ensure the involvement of laypersons, in particular patients or patients’ organizations”. Although in theory any citizen could represent the interests of patients, the fact that one is or has been a patient could be an additional advantage, provided of course that the individuals in question are highly motivated and have a sufficient educational level.

It has been suggested recently that, for comparative effectiveness studies on interventions in normal clinical practice, a simplified ICD could be used, similar to the one for medical care, or that the ICD could even be dispensed with.Citation61 In the case of these “low-intervention clinical trials”, the European Regulation recognizes the need to adapt the ICD,Citation55 so patients could play an important role in the review and evaluation of these simplified documents. They could also participate in the design of decision aids that would help to ensure that the consent granted by the patients is truly informed.Citation62,Citation63

Assessing patients’ experience

Carrying out a clinical trial is an enormously complex process. There are often problems with recruiting or retaining patients, which can make the process even more drawn out and expensive. Once the study is complete, it would be of great value to know about the opinions and experiences of the participants, so future studies could be designed better and achieve greater acceptance by doctors and patients.Citation64,Citation65

There have been several studies evaluating the experiences of patients who have participated in clinical trials. In a survey covering ∼5,000 patients who had taken part in clinical trials at 15 research sites supported by the National Institute of Health, 73% of the participants rated their experience with a score of 9 or 10 on a 10-point scale. In addition, 97% stated that they would definitely or probably recommend a clinical trial to a friend or relative.Citation66 These results are similar to those from another study of patients with depression, in which 87% of those interviewed were glad that they had participated in the clinical trial and 75% stated that they would be willing to participate again in the future.Citation64 Approximately 30% of the patients in the latter study stated that their participation had increased their trust in their doctors. These and other surveys indicated that one of the main motivations of patients in participating in clinical trials is their willingness to help future patients (with percentages higher than 90%).Citation64,Citation67 This should be a powerful argument for overcoming the therapeutic misconception and the underlying hidden paternalism.

Despite these positive results, there are several areas that need improvement. In the previously mentioned study,Citation66 those surveyed indicated that the ICD did not contain enough details about the study (20%) or about the risks (19%). They said that it had been difficult for them to understand the content (22%), that they had not had enough time to think over their decision before signing the ICD (21%), or that they had received some form of pressure from the research staff to participate (6%). In another study, participants mentioned problems with describing their experiences in the questionnaires that were included in the clinical trial.Citation68 Most likely, the patient experiences with respect to participation in clinical trials may vary with factors such as educational level, age, the trial phase, or the disease under study. It would therefore be advisable to collect these experiences in a systematic way to identify the problems and propose solutions adapted to each circumstance.

Informing participants about study results

According to some surveys, ∼95% of patientsCitation69 and members of IRBsCitation70 believe that patients should be informed of the results of the research study. Nevertheless, this is a fairly uncommon practice, and the usual situation is that after participating in a study, patients are not notified of the results.Citation71

The reasons offered for not informing patients have to do with their supposed desire to not know the results and with the possible anxiety that these results could cause. Then there is the difficulty, in practice, of communicating the results or ethical conflicts that a negative result could involve for the doctor in his dual role as physician and investigator.Citation71 However, it would seem to be an ethical standard, dictated by respect for the participants, to thank them for their participation and to provide them with the aggregate study results before they are made public to the scientific community.Citation72 Although informing patients of individual results is a matter of controversy, it could be justified by the same favorable arguments used to support disclosing aggregate results.Citation73 Fortunately, the 2013 update to the Declaration of Helsinki states, for the first time, that patients should have the option to receive information about the overall results of the study.Citation74

From a logistics standpoint, giving the participants information about the results is a relatively easy requirement to implement. It would involve merely including this option on the information sheet given to subjects when they are invited to participate in the study, and at the same time establishing how the results will be communicated at the end of the study to those participants who want them.Citation72,Citation73 Patients would have to be offered a summary of the aggregate results in understandable language. This would detail the most important results, their implications, the possible long-term effects that are foreseen, and how the results will be communicated to the scientific community. Whether the results are positive or negative, it is important for patients to know if the study yielded new information and was useful for the advancement of knowledge.

Several studies have evaluated the satisfaction of patients with different ways of communicating results. In one of these, most of the patients (80%) chose to receive the information in a letter.Citation75 Positive experiences have also been reported with presentations made by the investigator to a group of patients.Citation76 It would seem that patients prefer to receive the information in a more personalized manner, for example, in a telephone call, rather than impersonally via the sponsor’s press release.Citation77 These differences suggest that, ideally, an attempt should be made to communicate the results in a way that fits the preferences of the participants.

Disseminating and applying research findings

The study results should be communicated not only to the study participants but also to the wider public. This obligation is stated in the previously mentioned European Regulations on clinical trials. In 2013, the European Agency upgraded the EudraCT database to enable sponsors to enter result-related information from clinical trials, in line with guidance from the European Commission. Since 2014, with the launch of a final iteration of EudraCT, it is mandatory for sponsors to make publicly available the details of the study, including a summary of the results. Such information should use the language understandable by the general public and be presented in simple and accessible formats. It would be highly advisable to have patients involved in the preparation of these documents.

There should also be mention of the initiatives by some of the scientific journals, such as the Annals of Internal Medicine and the Journal of the American Medical Association, which publish “summaries for patients” and brief and approachable reviews of common diseases and their treatments. An additional step has been taken by the British Medical Journal, which is heading a major campaign to promote and accelerate patient participation in the various areas of the health care field. For example, they have included patients in the peer review process for research articles.Citation78

Although the purpose of research is to generate new knowledge that is able to improve outcomes for future patients, many of the results of research are never put into practice or are not implemented for many years. It requires an estimated average of 17 years for only 14% of new discoveries to enter into daily clinical practice.Citation79 It is of little use, and indeed would be unethical, to involve patients in research and ask them about their experiences if these are not used to improve care.Citation80 The experiences of patients (eg, through PROs) should be included not only in regulatory documents (eg, drug data sheets) but also in clinical practice guidelines. Patient preferences are an essential component in the health care personalization process. There are already guidelines in which recommendations are established on the basis of such preferences.Citation81 Patient participation with the groups of experts who prepare these clinical guides would ensure that patient perspectives and preferences are considered.

To achieve greater transparency in the research process, some initiatives have been launched aimed at improving the dissemination of research results. In spite of the potential risks involved,Citation82 there are unquestionable advantages to the development of an open scientific approach in which “data sharing” is the norm.Citation83 From the standpoint of society, such an approach could generate greater confidence in the results of research, improving clinical trial participation and funding.Citation84 The Institute of Medicine has established recommendations for “guide sharing of clinical trial data”.Citation85 In addition, the European Medicines AgencyCitation86 has published standards for promoting transparency and the dissemination of research results and allows different interest groups to request data from studies. Surprisingly, in the past 4 years, only 5.5%, 1.5%, and 0.5% of requests for access to European Medicines Agency documents were submitted by the general public, patient organizations, and nonprofit organizations, respectively.Citation86 It would not be surprising if the growing interest in research by patient organizations, many of which already have their own scientific advisors, were to generate an increase in requests for access to patient data.

Information and education: the expert patient

The earlier sections discussed the why, when, and how of active patient participation in research. However, there are two requirements to be met for all of these proposals to be implemented: 1) society must be much better informed on the aims and processes of clinical research and 2) the concept of the “expert patient” must be developed. Regarding the first requirement, there is a need to normalize society’s image of research. The general public’s scant familiarity with the basic aspects of research, and the fact that such familiarity tends to focus on the most negative aspects of research, contributes to it being perceived with a certain degree of suspicion and even fear.

Health care professionals, regulators, communication media, patient associations, and pharmaceutical companies need to collaborate to provide proper information about the purposes of research and the mechanisms available to protect participants. Society must realize that there is no progress without research, and that without patient participation in current studies, there can be no new knowledge to benefit future patients. For the same reason, we owe our current advantages of many medical advances to patients who participated in clinical trials in the past. The development and dissemination of campaigns in the media and educational materials can be of great help. The web pages of regulatory agencies such as the US Food and Drug Administration (http://www.fda.gov/ForPatients/ClinicalTrials/default.htm), national health institutes, such as the NIH in the USA (http://www.nih.gov/health/clinicaltrials/index.htm), and scientific associations such as the American Society of Clinical Oncology (http://www.cancer.net/) include patient-directed information on the basic principles of clinical research. Similarly, some very interesting initiatives have emerged, such as Healthtalkonline (http://healthtalkonline.org/), supported by Oxford University, that include videos in which actual patients relate their experiences with clinical trials and clarify certain basic aspects of the research process.

Second, many of the proposals made in this paper will not be feasible unless they include expert patients.Citation87 This concept, based on the idea that implementation of educational and self-care programs could help patients with chronic diseases who take an active role in managing their own conditions,Citation88 applies to the field of clinical research. Preparing patients to be experts in research will require an investment in their education. Of particular note here are the training courses offered by the European Patients’ Academy on Therapeutic Innovation (EUPATI), a consortium of 30 European organizations dedicated to providing information and resources on medical research to individuals affected by various diseases. The expert course has been designed to teach patients or their family members all about the clinical trial process, from preclinical research all the way through regulatory approval. The course consists of six training modules: 1) discovery of medicines and planning of medicine development; 2) nonclinical testing and pharmaceutical development; 3) exploratory and confirmatory clinical development; 4) clinical trials; 5) regulatory affairs, medicinal product safety, pharmacovigilance, and pharmacoepidemiology; and 6) health technology assessment principles and practice. The purpose is to empower these patients to participate actively in the research process, by direct collaboration with the industry, with regulatory agencies, or with patient associations.Citation89 The education of these expert patients could help to change the current situation, in which “experiential knowledge is often seen as less valuable than scientific knowledge”.Citation90

Conclusion

There are many opportunities for patients to participate more actively in the entire research process. As has been noted throughout this paper, some of the proposals are relatively easy to put into practice (). The lack of implementation suggests that there are cultural barriers holding back the change process. The most urgent need is probably to change the relative emphases assigned to the ethical principles guiding the physician/investigator–patient relationship. The classic relational model, based on the principle of beneficence, which in turn is based on the authority of the physician, may be responsible for the fact that research is performed for patients, but not with them. The therapeutic misconception, the absence of patients on IRBs, the poor quality of information provided to participants, and the low levels of patient participation in establishing research priorities and study design are all elements indicating that the benevolence principle predominates in the research field.

Table 1 Specific initiatives to engage patients in the research process

For the changes described to become realities, physician/investigator–patient relationships should be based on the principles of autonomy and non-maleficence. Moreover, there can be no autonomy as long as patients lack the information they need. Providing the population with more information about the aims of research will help to normalize the process, generating trust and promoting participation in research. There must be improvement in the quality of information provided to participants, and promotion of the emergence of the expert patient: one who can become actively involved in all of the activities described in this paper and who is capable of properly representing the interests of other patients.

Disclosure

JAS, RK and AF are employees of Lilly Spain. The opinions and ideas expressed in this article are personal and do not necessarily represent those of the company. The authors report no other conflicts of interest in this work.

References

  • LaineCDavidoffFPatient-centered medicine. A professional evolutionJAMA19962751521568531314
  • LipkinMShared decision makingJAMA Intern Med20131731204120523712307
  • PorterMEWhat is value in health care?N Engl J Med20103632477248121142528
  • TinettiMEBaschEPatients’ responsibility to participate in decision making and researchJAMA20133092331233223700165
  • LloydKWhiteJDemocratizing clinical researchNature201147427727821677725
  • ThorntonSBeyond rhetoric: we need a strategy for patient involvement in the health serviceBMJ2014348g407224957899
  • DomecqJPPrutskyGElraiyahTPatient engagement in research: a systematic reviewBMC Health Serv Res2014148924568690
  • Caron-FlintermanJFBroerseJEBundersJFThe experiential knowledge of patients: a new resource for biomedical research?Soc Sci Med2005602575258415814182
  • HanleyBTruesdaleAKingAElbourneDChalmersIInvolving consumers in designing, conducting, and interpreting randomised controlled trials: questionnaire surveyBMJ200132251952311230065
  • van der ScheerLGarciaEvan der LaanALvan der BurgSBoeninkMThe benefits of patient involvement for translational researchHealth Care Anal Epub20141224
  • JenksSThe public applauds cancer research but not how research priorities are setJ Natl Cancer Inst1997893503519082045
  • ElwynGCroweSFentonMIdentifying and prioritizing uncertainties: patient and clinician engagement in the identification of research questionsJ Eval Clin Pract20101662763120482747
  • FleurenceRLForsytheLPLauerMEngaging patients and stakeholders in research proposal review: the patient-centered outcomes research instituteAnn Intern Med201416112213025023251
  • ChalmersIAtkinsonPFentonMFirkinsLCroweSCowanKTackling treatment uncertainties together: the evolution of the James Lind Initiative, 2003–2013J R Soc Med201310648249123824330
  • Petit-ZemanSFirkinsLScaddingJWThe James Lind Alliance: tackling research mismatchesLancet201037666766920801389
  • ChalmersIGlasziouPAvoidable waste in the production and reporting of research evidenceLancet2009374868919525005
  • VayenaEThe next step in the patient revolution: patients initiating and leading researchBMJ2014349g431824986856
  • KayeJCurrenLAndersonNFrom patients to partners: participant-centric initiatives in biomedical researchNat Rev Genet20121337137622473380
  • SwanMCrowdsourced health research studies: an important emerging complement to clinical trials in the public health research ecosystemJ Med Internet Res2012142e4622397809
  • SoxHCGreenfieldSComparative effectiveness research: a report from the Institute of MedicineAnn Intern Med200915120320519567618
  • BarrPJElwynGMeasurement challenges in shared decision making: putting the ‘patient’ in patient-reported measuresHealth Expect Epub2015625
  • MullinsCDVandigoJZhengZWicksPPatient-centeredness in the design of clinical trialsValue Health20141747147524969009
  • MuradMHShahNDVan HoutenHKIndividuals with diabetes preferred that future trials use patient-important outcomes and provide pragmatic inferencesJ Clin Epidemiol20116474374821109401
  • BaschEToward patient-centered drug development in oncologyN Engl J Med201336939740023822654
  • LindenmeyerAHearnshawHSturtJOrmerodRAitchisonGAssessment of the benefits of user involvement in health research from the Warwick Diabetes Care Research User Group: a qualitative case studyHealth Expect20071026827717678515
  • AliKRoffeCCromePWhat patients want: consumer involvement in the design of a randomized controlled trial of routine oxygen supplementation after acute strokeStroke20063786587116456122
  • de WitMAbmaTKoelewijn-van LoonMCollinsSKirwanJInvolving patient research partners has a significant impact on outcomes research: a responsive evaluation of the international OMERACT conferencesBMJ Open201335e002241
  • U.S. Department of Health and Human Services Food and Drug AdministrationGuidance for Industry. Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling ClaimsSilver Spring, MDU.S. Department of Health and Human Services Food and Drug Administration2009
  • DinanMAComptonKLDhillonJKUse of patient-reported outcomes in randomized, double-blind, placebo-controlled clinical trialsMed Care20114941541921368680
  • GandhiGYMuradMHFujiyoshiAPatient-important outcomes in registered diabetes trialsJAMA20082992543254918523223
  • RahimiKMalhotraABanningAPJenkinsonCOutcome selection and role of patient reported outcomes in contemporary cardiovascular trials: systematic reviewBMJ2010341c570721041324
  • GnanasakthyAMordinMClarkMDeMuroCFehnelSCopley-MerrimanCA review of patient-reported outcome labels in the United States: 2006 to 2010Value Health20121543744222583453
  • WillkeRJBurkeLBEricksonPMeasuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labelsControl Clin Trials20042553555215588741
  • CoonsSJKothariSMonzBUBurkeLBThe patient-reported outcome (PRO) consortium: filling measurement gaps for PRO end points to support labeling claimsClin Pharmacol Ther20119074374821993428
  • GarrattAPatient reported outcome measures in trialsBMJ2009338a259719139137
  • VietaABadiaXSacristanJAA systematic review of patient-reported and economic outcomes: value to stakeholders in the decision-making process in patients with type 2 diabetes mellitusClin Ther2011331225124521856000
  • VietaABadiaXÁlvarezESacristánJAWhich nontraditional outcomes should be measured in healthcare decision-making in schizophrenia? A systematic reviewPerspect Psychiatr Care20124819820723005587
  • WolpertMFordTTrustamEPatient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measuresJ Ment Health20122116517322559827
  • McCartneyMHow do we know whether medical apps work?BMJ2013346f181123516158
  • KamerowDRegulating medical apps: which ones and how much?BMJ2013347f600924103694
  • HarrisJScientific research is a moral dutyJ Med Ethics20053124224815800367
  • The Patient Access to Cancer Care Excellence (PACE) [homepage on the Internet] Available from: https://pacenetwork.com/Accessed September 28, 2015
  • GiffordALCunninghamWEHeslinKCHIV Cost and Services Utilization Study ConsortiumParticipation in research and access to experimental treatments by HIV-infected patientsN Engl J Med20023461373138211986412
  • UngerJMHershmanDLAlbainKSPatient income level and cancer clinical trial participationJ Clin Oncol20133153654223295802
  • GelijnsACGabrielSELooking beyond translation – integrating clinical research with medical practiceN Engl J Med20123661659166122551126
  • SacristanJAClinical research and medical care: towards effective and complete integrationBMC Med Res Methodol201515425575454
  • SacristánJASotoJGalendeIHylanTRRandomized database studies: a new method to assess drugs’ effectiveness?J Clin Epidemiol1998517137159731918
  • LauerMSD’AgostinoRBSrThe randomized registry trial – the next disruptive technology in clinical research?N Engl J Med20133691579158123991657
  • SacristanJADillaTNo big data without small data: learning health care systems begin and end with the individual patientJ Eval Clin Pract20152161014101725832820
  • Paasche-OrlowMKTaylorHABrancatiFLReadability standards for informed-consent forms as compared with actual readabilityN Engl J Med200334872172612594317
  • TaylorHEBramleyDEAn analysis of the readability of patient information and consent forms used in research studies in anaesthesia in Australia and New ZealandAnaesth Intensive Care20124099599823194208
  • HereuPPérezEFuentesIVidalXSuñéPArnauJMConsent in clinical trials: what do patients know?Contemp Clin Trials20103144344620462521
  • TamNTHuyNTThoa leTBParticipants’ understanding of informed consent in clinical trials over three decades: systematic review and meta-analysisBull World Health Organ201593186H198H25883410
  • DreyfussDIs it better to consent to an RCT or to care? Muetadeltaepsilonnu alphagammaalphanu (“nothing in excess”)Intensive Care Med20053134535515605232
  • Regulation (EU) No 536/2014 of the European Parliament and of the Council of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20/EC.
  • HendersonGEChurchillLRDavisAMClinical trials and medical care: defining the therapeutic misconceptionPLoS Med20074e32418044980
  • AgrawalMGradyCFaircloughDLMeropolNJMaynardKEmanuelEJPatients’ decision-making process regarding participation in phase I oncology researchJ Clin Oncol2006244479448416983117
  • VistGEBryantDSomervilleLBirminghemTOxmanADOutcomes of patients who participate in randomized controlled trials compared to similar patients receiving similar interventions who do not participateCochrane Database Syst Rev20083MR00000918677782
  • KoopsLLindleyRIThrombolysis for acute ischaemic stroke: consumer involvement in design of new randomised controlled trialBMJ200232541512193356
  • VillenNRedondoSFontRQuintanaSPerfil de los miembros no sanitarios de los comités éticos de investigación clínica y comités de ética asistencial de Cataluña [Profile of lay members of ethics committees in Catalonia (Spain)]Med Clin2012138296299 Spanish
  • PletcherMJLoBGradyDInformed consent in randomized quality improvement trials: a critical barrier for learning health systemsJAMA Intern Med201417466867024615554
  • BrehautJCFergussonDAKimmelmanJShojaniaKGSaginurRElwynGUsing decision aids may improve informed consent for researchContemp Clin Trials20103121822020156597
  • GilliesKSkeaZCCampbellMKDecision aids for randomised controlled trials: a qualitative exploration of stakeholders’ viewsBMJ Open20144e005734
  • TallonDMulliganJWilesNInvolving patients with depression in research: survey of patients’ attitudes to participationBr J Gen Pract20116113414121439170
  • KostRGLeeLMYessisJCollerBSHendersonDKResearch Participant Perception Survey Focus Group SubcommitteeAssessing research participants’ perceptions of their clinical research experiencesClin Trans Sci20114403413
  • KostRGLeeLMYessisJWesleyRAHendersonDKCollerBSAssessing participant-centered outcomes to improve clinical researchN Engl J Med20133692179218124304050
  • WendlerDKrohmalBEmanuelEJGradyCESPRIT GroupWhy patients continue to participate in clinical researchArch Intern Med20081681294129918574086
  • HolmbergCKarnerJJRappeneckerJWittCMClinical trial participants’ experiences of completing questionnaires: a qualitative studyBMJ Open20144e004363
  • PartridgeAHBursteinHJGelmanRSMarcomPKWinerEPDo patients participating in clinical trials want to know study results?J Natl Cancer Inst20039549149212644548
  • MacNeilSDFernandezCVAttitudes of research ethics board chairs towards disclosure of research results to participants: results of a national surveyJ Med Ethics20073354955317761827
  • PartridgeAHWinerEPInforming clinical trial participants about study resultsJAMA200228836336512117402
  • Dal-ReRCostaJInformación de los resultados a los participantes de los ensayos clínicos [Informing clinical trials participants about the results]Med Clin2007128375378 Spanish
  • ShalowitzDIMillerFGDisclosing individual results of clinical research: implications of respect for participantsJAMA200529473774016091577
  • World Medical AssociationWorld Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjectsJAMA20133102191219424141714
  • DalalHWinghamJPritchardCCommunicating the results of research: how do participants of a cardiac rehabilitation RCT prefer to be informed?Health Expect20101332333019906214
  • AvinsALBentSPadulaAStacconeSBaduaEGoldbergHInitial experience with a group presentation of study results to research participantsTrials200891618355417
  • DorseyERBeckCAAdamsMHuntington Study Group TREND-HD InvestigatorsCommunicating clinical trial results to research participantsArch Neurol2008651590159519064746
  • RichardsTMontoriVMGodleeFLapsleyPPaulDLet the patient revolution beginBMJ2013346f261423674136
  • BalasEABorenSAYearbook of Medical Informatics: Managing Clinical Knowledge for Health Care ImprovementGermanySchattauer Verlagsgesellscaft mbH20006570
  • CoulterALocockLZieblandSCalabreseJCollecting data on patient experience is not enough: they must be used to improve careBMJ2014348g222524671966
  • ThompsonIMJrLeachRJAnkerstDPFocusing PSA testing on detection of high-risk prostate cancers by incorporating patient preferences into decision makingJAMA201431299599625090603
  • RosenblattMJainSHCahillMSharing of clinical trial data: benefits, risks, and uniform principlesAnn Intern Med201516230630725622304
  • RossJSKrumholzHMUshering in a new era of open science through data sharing: the wall must come downJAMA20133091355135623508736
  • GoodmanSNClinical trial data sharing: what do we do now?Ann Intern Med201516230830925621467
  • LoBSharing clinical trial data: maximizing benefits, minimizing riskJAMA201531379379425594500
  • BoniniSEichlerHGWathionNRasiGTransparency and the European Medicines Agency – sharing of clinical trial dataN Engl J Med20143712452245525539105
  • ElberseJECaron-FlintermanJFBroerseJEPatient-expert partnerships in research: how to stimulate inclusion of patient perspectivesHealth Expect20111422523921176013
  • CordierJFThe expert patient: towards a novel definitionEur Respir J20144485385725271227
  • ChakradharSTraining on trials: patients taught the language of drug developmentNat Med20152120921025742451
  • ElberseJEPittensCAde Cock BuningTBroerseJEPatient involvement in a scientific advisory process: setting the research agenda for medical productsHealth Policy201210723124222739128