334
Views
38
CrossRef citations to date
0
Altmetric
Original Research

A critical analysis of user satisfaction surveys in addiction services: opioid maintenance treatment as a representative case study

, , &
Pages 107-117 | Published online: 21 Jan 2014

Abstract

Background

Satisfaction with services represents a key component of the user’s perspective, and user satisfaction surveys are the most commonly used approach to evaluate the aforementioned perspective. The aim of this discursive paper is to provide a critical overview of user satisfaction surveys in addiction treatment and harm reduction services, with a particular focus on opioid maintenance treatment as a representative case.

Methods

We carried out a selective critical review and analysis of the literature on user satisfaction surveys in addiction treatment and harm reduction services.

Results

Most studies that have reported results of satisfaction surveys have found that the great majority of users (virtually all, in many cases) are highly satisfied with the services received. However, when these results are compared to the findings of studies that use different methodologies to explore the patient’s perspective, the results are not as consistent as might be expected. It is not uncommon to find that “highly satisfied” patients report significant problems when mixed-methods studies are conducted. To understand this apparent contradiction, we explored two distinct (though not mutually exclusive) lines of reasoning, one of which concerns conceptual aspects and the other, methodological questions.

Conclusion

User satisfaction surveys, as currently designed and carried out in addiction treatment and harm reduction services, do not significantly help to improve service quality. Therefore, most of the enthusiasm and naiveté with which satisfaction surveys are currently performed and interpreted – and rarely acted on in the case of nonoptimal results – should be avoided. A truly participatory approach to program evaluation is urgently needed to reshape and transform patient satisfaction surveys.

Introduction

Interventions and programs addressing drug use and related harms have traditionally been evaluated primarily by “hard” indicators or criteria,Citation1 including program retention rates, use of the primary drug of abuse and other psychoactive substances, morbidity/mortality, and criminal activity, among others. These criteria are relevant and necessary to inform health care policies; however, they do not necessarily reflect the priorities of those who use harm reduction or addiction treatment services.Citation2,Citation3 Moreover, there is evidence showing that user perspectives do not correlate with staff perspectives,Citation4,Citation5 a well-described phenomenon known as the “paradox of desynchrony.”Citation6 Therefore, it is clear that a more inclusive and comprehensive evaluation of the process and outcomes of interventions should include users’ assessment of these variables.Citation1

Satisfaction surveys, a key component of assessing the service user’s perspective,Citation7 have long been the most commonly used method of exploring this perspective.Citation8 User satisfaction surveys assessing addiction treatment and harm reduction services have consistently found high skewness toward positive satisfaction scores.Citation9Citation12 While this could be interpreted with great enthusiasm, other hypotheses should be considered, such as publication bias, lack of clarity of norms against which to compare the treatments, the psychometric properties of the instruments used, and the lack of an underlying theoretical framework of patient satisfaction.Citation13,Citation14 The aim of this paper is to provide a critical overview of user satisfaction surveys as currently carried out in addiction treatment and harm reduction services, with a special focus on opioid maintenance treatment (OMT) as a representative case. First, we argue the lack, relevance, and need for a more patient-centered approach to program evaluation. Then, we analyze the main features of client satisfaction surveys conducted at OMT centers as well as conceptual and methodological issues that may explain why the results of such surveys often diverge from results obtained via other data collection/generation methods. Finally, based on the discussion of some limitations of patient satisfaction surveys as currently performed, we suggest alternative directions for inquiry and research focused on a truly user-participatory approach to program evaluation.

Towards a more user-centered approach to program evaluation

When conducting a user-centered evaluation of OMT services, several indicators or assessment areas should be considered: a) user expectations and objectives for the treatment or intervention,Citation15,Citation16 b) patient beliefs or opinions about medication (primarily methadone or buprenorphine),Citation17Citation21 c) user appraisal of the relational dynamic with intervention providersCitation22Citation24 and the degree of perceived participation in decision-making,Citation25,Citation26 as well as patient preferences for a participatory or deferential role,Citation27,Citation28 d) indicators of user-perceived quality,Citation29 e) client perception of unmet needs,Citation30,Citation31 and f) level of satisfaction with treatment.Citation8,Citation11,Citation25,Citation32

Despite the relevance and validity of the aforementioned factors in facilitating adherence to the interventionCitation10,Citation33Citation35 and in measuring service quality,Citation36,Citation37 very few programs or centers evaluate these factors on a routine basis. This is surprising given that program adherence and service quality are two areas in which the importance of these variables is readily apparent. On one hand, these variables influence program acceptability and given that acceptability can affect adherence, these variables may mediate – at least partially – the efficacy of the interventions. On the other hand, the accreditation process of some types of treatment centers (eg, methadone treatment centers) requires the periodic evaluation of certain variables (generally, patient satisfaction) to assess quality.Citation38,Citation39

These variables (or more generally speaking, the user’s perspective) have generally received scant attentionCitation40,Citation41 and have been largely ignored by the community of mainstream researchers,Citation42 who do not acknowledge the relevance of such variables in designing, providing, and/or evaluating addiction treatment and harm reduction services. This lack of research on user perspectives contrasts with the many studies evaluating interventions and treatments. This is particularly worrisome considering that input from service users is essential if we are to define, implement, and evaluate these interventions and programs, ensuring they meet the needs of the users themselves.Citation43 Needless to say, a more in-depth understanding of user perspectives of interventions and centers would allow us to better interpret the efficacy and quality of interventions, as well as to plan and implement measures to improve those parameters. Without this knowledge, the risk of underestimating or distorting the value of treatment services to users through the usual assessment practices is high.Citation44

In recent years, interest in including users’ perspectives to evaluate interventions that address substance use appears to be growing. This interest has resulted in the increasing use of patient-reported outcome measures in both clinical trials and usual clinical practice.Citation45Citation47 This emerging framework could be related to the current trend toward altering the traditional hierarchical relationship between health care professionals and patients, ie, a relationship based on the classical model of medical practice, which implies a biased and exclusionary perception of drug users as noncompetent persons.Citation48,Citation49

Satisfaction surveys, as stated above, are a key component of assessing the service user’s perspectiveCitation7 and are the most common and most studied approach to exploring the aforementioned perspective.Citation8 Nevertheless, it is important to keep in mind that most classification systems of the opportunities or levels of participation in addiction treatment and harm reduction services consider user satisfaction surveys to be “low-involvement” activities ().Citation50Citation52 In fact, some authors prefer to exclude user satisfaction surveys from the definition of participation because such surveys do not entail the existence of mechanisms to modify planning processes in response to the survey’s findings, nor do they imply that service users participate as equal interlocutors.Citation53

Table 1 Levels of user-participation or opportunities for user-participation in addiction treatment and harm reduction services

Assessment of client satisfaction in OMT

The number of validated self-reports specifically designed to assess satisfaction with addiction treatmentCitation54,Citation55 and, more specifically, with treatment for opioid dependence,Citation56,Citation57 are quite limited. Client satisfaction with OMT has been primarily assessed through a) specific questions,Citation58,Citation59 b) nonvalidated questionnaires designed ad hoc,Citation60,Citation61 c) nonvalidated adaptations of instruments originally designed to assess satisfaction with mental health services or other types of health care services,Citation62 or d) validated generic scales designed to assess satisfaction with any type of health care center (ie, not specific to addictions).Citation11,Citation63Citation65

Patient satisfaction research conducted with instruments described above shows that most OMT clients (virtually all, in many cases) are highly satisfied with the care received.Citation11,Citation56,Citation58,Citation60,Citation65 However, these findings clearly contradict a) specific comments made by particular OMT patients on many occasions and situations;Citation66 b) most studies that have used a qualitative methodology to explore the views and experiences of OMT clients, the results of which are more nuanced, or in some cases, reflect a clearly ambivalent attitude toward OMT;Citation66Citation69 and c) the results obtained by satisfaction surveys that include (in addition to items or a scale to evaluate satisfaction) either a list of potential problems or negative treatment-related aspects from which the respondent must select, or open-ended questions requiring a short response about which aspect(s) of the user’s experience with the center he/she finds least satisfying.Citation25,Citation58,Citation70 Interestingly, these latter mixed-method studies have allowed researchers to identify significant and/or frequent problems reported by clients who, concurrently, showed a high level of satisfaction with OMT.

To explain the reasons behind this apparent discrepancy, two distinct but nonexclusive arguments can be made: one line of argument is more closely related to conceptual aspects, while the other is mostly concerned with various methodological questions.

Conceptual confusion between patient perceptions and patient satisfaction

There is a conceptual confusion originating from the interchangeable use of the terms “patient satisfaction” and “patient perceptions.” Satisfaction refers to the patient’s perception of the extent to which his/her expectations, needs, or desires have been met. Satisfaction is thus, a particular kind of perception, but it is not the only one.Citation71 This confusion has increased as most scales that assess satisfaction with addiction treatment have been developed without an underlying theoretical framework. Although various theoretical models of the “treatment satisfaction” construct exist, it seems to be assumed implicitly – and naively – that this is a construct with a universal meaning, or one that does not require greater clarification.Citation72 In fact, some authors believe that the concept of treatment satisfaction seems to have been imposed on service users, with little consideration of its relevance.Citation73 This situation is even more complex in the case of OMT, in which meanings linked to the construct of “patient satisfaction” and their respective operationalization can lead to even more confusion and ambiguity. For instance, from both a clinical and research perspective, it seems necessary to distinguish, at a minimum, between a) holding dose (ie, the dose that prevents subjective and objective opioid withdrawal symptoms over the 24-hour interdosing interval); b) dose adequacy (ie, the dose that allows patients not to use heroin, not to experience withdrawal symptoms nor heroin craving, not to show symptoms of overmedication, and in the case of heroin use, to hardly experience any subjective effects); c) satisfaction with medication; and d) satisfaction with treatment.Citation74,Citation75

Even when patients report a high degree of satisfaction with treatment, this does not necessarily entail that they have a similarly positive perception of the treatment received. High satisfaction scores can be due to negative initial expectationsCitation25,Citation76 or may reflect, among other nonexclusive alternatives, beliefs of the type “they do the best they can”Citation77,Citation78 or “really, that is not their job”,Citation78 or service user preference to demonstrate a positive interaction with the people who care for them (social etiquette),Citation79 or the limitations derived from the user’s dependent position in the health care system.Citation79 Given the consistently positive results from patient satisfaction surveys, it is no wonder that many authors believe these types of survey are little more than rhetorical practices that provide us with the comforting illusion that we are listening to patients,Citation80 or that these surveys are mechanisms by which managers and clinicians seek to legitimize and maintain the status quo of treatment centers.Citation69,Citation81Citation83

Methodological and procedural issues

The second line of argument concerns diverse methodological and procedural issues related to satisfaction surveys.

Unidimensional versus multidimensional approaches

Patient satisfaction instruments can be classified according to factor structure as either unidimensional (ie, those that report a single overall satisfaction factor) or multidimensional (ie, comprised of several factors corresponding to differentiated facets or dimensions of treatment satisfaction).Citation84,Citation85 Dissatisfaction rates are, in general, higher in surveys that use multidimensional scales compared to those obtained with surveys that have used global or unidimensional instruments,Citation85,Citation86 although this comparison is not completely appropriate due to methodological differences arising from the type of instrument used.

Affective versus factual focus

Patient satisfaction scales can be divided into two types depending on the contents: factual measures (ie, objective reports) and affective measures (ie, subjective rating scales).Citation85,Citation87 Factual instruments, which are designed to avoid value judgments, focus on the service user’s experiences. These types of instruments contain specific questions about those experiences in order to acquire objective data (“How often do you go to the center to take or pick up methadone?”; “How long after the scheduled appointment time do you usually have to wait to be seen?”) or to verify whether certain processes and specific events have occurred or not (“Have the side effects of methadone been explained to you?”). In contrast, affective instruments focus on the patient’s opinion about those experiences which reflects his/her preferences and expectations (“Do you think the frequency of your visits to the center to take/pick up methadone is excessive?”; “Are you satisfied with the waiting time between the scheduled appointment time and the actual start of the appointment?”; “Are you satisfied with the information you have received about the side effects of methadone?”).

There is a lack of validated factual instruments among the satisfaction scales available for use in addiction treatment and harm reduction services. However, when such instruments do become available, it seems likely that the experience observed in other health care settings – ie, affective measures typically detect higher levels of satisfaction with treatment than factual instrumentsCitation85,Citation88 – will be repeated.

Affective self-report instruments, particularly those with a unidimensional factor structure, are unlikely to provide information that will be useful to improve health care.Citation85,Citation86,Citation89 This is due to the way that most questions are formulated in these instruments; in many cases, it is not clear what elements, aspects, or processes need to be modified when a client’s response indicates dissatisfaction,Citation90,Citation91 and it is even less clear how such changes should be effectuated. However, the use of multidimensional instruments (especially the factual measures) can remediate, at least partially, this weakness, as has occurred in other areas of health care.Citation88,Citation92,Citation93

Early drop-outs and refusals to participate

We must not neglect a discussion of two important variables that have received insufficient attention in many of the patient satisfaction studies carried out to date in the addictions field: a) the number of early drop-outs from the program being evaluatedCitation81,Citation85,Citation94,Citation95 and b) the nonresponse rate to the survey.Citation26,Citation96Citation99 Early drop-outs and no response could be reflecting low levels of satisfaction with treatment. These factors contribute to the uncertainty of the results obtained and are a threat to both the internal validity and generalizability of such results.

A variant of the Hawthorne effect

The Hawthorne effect is a positive and transitory change in a behavior being evaluated under experimental conditions. The change in behavior occurs not because of any alterations in the independent variable, but rather because participants know they are being observed or studied.Citation100 By analogy, levels of satisfaction with treatment could, in some cases, reflect or be sensitive to this effect. Sitzia and WoodCitation101 indicate that both the extra attention implicit in the process of data collection and the apparent interest in the user’s level of satisfaction could lead to a positive perception of the service or center and, consequently, to higher scores.

The phenomenon of response shift

Finally, the response shift phenomenonCitation102 merits discussion as a potential additional explanatory factor for the high levels of patient satisfaction typically observed. This phenomenon has been widely studied in the field of health-related quality of life, although it is equally relevant to any field that uses self-report instruments.Citation103 Villar López et alCitation104 highlighted the importance of response shift in evaluating satisfaction with treatment. The response shift phenomenon in health care settings refers to the process of adaptation to changes caused by the disease or treatment.Citation103 More specifically, Sprangers and SchwartzCitation102 define response shift as a change in the meaning of the self-evaluation of the target construct as a result of a) a change in the internal standards of measure (scale recalibration); b) a change in the values themselves – in other words, in the importance of the domains or components that make up the target construct (scale reprioritization); or c) a redefinition of the target construct (reconceptualization). Many years of substance use and a relatively long OMT could potentially modify the client’s internal standards, values, and/or concept of treatment satisfaction and, thereby, overestimate those levels of satisfaction.

Future directions

Most of the instruments currently available to assess user satisfaction with addiction treatment and harm reduction services are probably unable to adequately measure satisfaction due to how those instruments were developed. In general, the available instruments are based on a theoretical model that is often only vaguely defined and which evaluates areas of interest chosen by the researchers, service providers, or policy makers.Citation105,Citation106 It seems evident that self-reports developed in this manner are more likely to reflect the priorities of the clinicians, researchers, and/or administrators rather than those of the service users.Citation101,Citation107Citation109 This implies that questions about aspects of treatment and care that are relevant to patients would not be included, even though other variables that patients might consider irrelevant are incorporated.Citation87 If true, to some extent this represents a threat to basic bioethical principles, such as autonomy,Citation110 and to the validity of data gathered with these tools,Citation111 questioning the results obtained with these instruments.

Users of addiction treatment and harm reduction services – like users of any other health care services and programs – have a complex and highly nuanced experience that can be more appropriately and fruitfully captured via more generic, open-ended questions that are formulated in terms of the user’s experience (not the satisfaction) with the service. Additional approaches include other qualitative techniques of data gathering, such as participant observation,Citation112,Citation113 focus groups,Citation31,Citation67 or in-depth interviews.Citation114Citation116 Likewise, the critical communicative methodologyCitation117Citation119 would seem to be particularly pertinent and promising in this area of research. Although the information provided by these methods can be extremely valuable for improving and redesigning interventions, a periodic quality assessment relying heavily on these approaches appears to be of questionable practicality under current circumstances.

The use of the critical communicative methodology or qualitative data gathering techniques must be an essential requirement for developing the much-needed new scales to measure treatment satisfactionCitation120 or perception of treatmentCitation121 in a more patient-centered manner ().Citation109,Citation122 A genuinely patient-centered assessment of satisfaction with treatment will not be feasible without patients participating in the development of the instrument (eg, identifying the dimensions and variables to be assessed, drafting the items). Moreover, the aforementioned techniques should also play a major role in helping health professionals and researchers to directly, through the patient’s own words, come to gain a thorough understanding of the patient’s perspective (eg, expectations, perceived participation in decision-making). Having a deeper understanding of this perspective is an essential part of any efforts to improve the quality of addiction treatment and harm reduction services. This perspective cannot and should not be limited to user satisfaction with the service, and neither should user-participation in quality improvement efforts be restricted to answering a questionnaire. That said, if planners, managers, and workers involved in addiction treatment and harm reduction services are unwilling to make the necessary effort to achieve an in-depth understanding of users’ perspective – and to act on any new insights obtained in the process – then these methodologies are unlikely to be implemented, and thus, authentic patient-centered satisfaction surveys will not be carried out.

Table 2 Classification of instruments to measure patient satisfaction according to the degree to which they incorporate the patient’s own perspective

Given this situation, it is not surprising that some authors, both in the drug-use intervention fieldCitation8 as well as in other areas of health careCitation123 pose this question: Do current satisfaction surveys form part of an emerging process of shared decision-making whose objective is to improve health care delivery and clinical care practices or, to the contrary, are such surveys a mere token gesture (ie, an empty ritual)Citation124 from which no changes will emerge? In accordance, Madden et alCitation25 affirm that “satisfaction surveys will be of only limited value in opioid treatment settings until there are agreed quality standards and formal mechanisms to educate consumers about their rights and the standards of care to which they are entitled”. Without these changes and a commitment to act on the knowledge so acquired, it is unlikely that meaningful, rather than tokenistic, modalities of user involvement will be widely implemented in the near future. In fact, service users should not be asked to participate in a satisfaction survey if their input will amount to nothing. Moreover, it should be also emphasized that the aforementioned changes are unlikely to increase the right of service users to participate if their most basic needs are not met.

Patient participation should extend beyond assessing and improving the quality of care. The involvement of drug/service users in the design and implementation of specific programs and interventions, especially in the field of harm reduction, has been remarkable, with users, at times, displaying a higher level of competence than the public health institutions themselves.Citation125Citation127 Similarly, considering that users’ rights should not be limited to treatment needs alone,Citation128,Citation129 this dialogical and participatory dynamic should be extended to other areas such as addiction researchCitation130 and the development of drug policies.Citation131

Limitations

The aim of this article was to provide a critical review of a comprehensive topic (ie, satisfaction with addiction treatment and harm reduction services) rather than a systematic examination of a focused research question. Therefore, a nonsystematic review was judged as the best approach for covering a wide range of issues relating to the topic reviewed. However, this approach implies not to systematically identify, select, appraise, and synthesize all research on the topic, representing a possible limitation of the present study. In any case, as several authors have pointed out, traditional narrative reviews are more appropriate for comprehensive topics and systematic reviews are better suited for focused topics.Citation132 Additionally, our attempts to identify relevant studies went beyond the efforts usually made in narrative reviews. Spanning the last decade, our experience in research on satisfaction with addiction and harm reduction servicesCitation5,Citation8,Citation11,Citation26,Citation29,Citation32,Citation57,Citation58,Citation74,Citation75 has rendered us current on this topic. In this regard, the PubMed interface to search MEDLINE has been used. A search strategy favoring sensitivity over specificity is periodically performed using different combinations of addiction (eg, substance abuse, heroin, cocaine) or intervention-specific (eg, methadone, detoxification, needle exchange) terms and words related to the patient’s perspective (eg, satisfaction, perception, view). In addition, reference lists included in the selected articles are normally examined for other relevant studies.

Conclusion

The current approach to user satisfaction surveys does not significantly contribute to the improvement of service quality. Therefore, most of the enthusiasm and naiveté with which user satisfaction surveys are currently conducted and interpreted – and rarely acted on in cases of nonoptimal results – in addiction treatment and harm reduction services should be avoided. A truly participatory approach to program evaluation is needed urgently to reshape and transform patient satisfaction surveys. Similarly, there is a need to implement alternative research and quality-improvement initiatives that foster meaningful, rather than merely tokenistic, service user involvement. In turn, this will surely improve the relevance as well as the psychopolitical validity (both epistemic and transformative)Citation133,Citation134 of research and interventions in the substance use field.

Author contributions

Joan Trujols and Ioseba Iraurgi conceived of and designed the present study, counting on advice from Eugenia Oviedo-Joekes and Joan Guàrdia-Olmos. Joan Trujols wrote the initial draft and led the writing of subsequent versions. All authors commented on and significantly contributed to the successive drafts. All authors read and approved the final version submitted for publication.

Acknowledgments

This article is both dedicated, in memoriam, and profoundly indebted to Imma. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. However, the article-processing charge was defrayed by a grant from the Banco de Instrumentos del Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM). An early draft of some of the ideas incorporated in this article was presented at the Encuentro FIPSE sobre Investigación de la Perspectiva Social del VIH/SIDA (FIPSE Research Meeting on Social Perspectives on HIV/AIDS) (Valencia, Spain, November 26–28, 2006), and appeared in Tratado SET de trastornos adictivos (SET Handbook of Addictive Disorders).Citation135

Disclosure

The authors state that they have been involved in the design, implementation, analysis, and/or reporting of satisfaction survey studies, whether or not cited in the current manuscript. Joan Trujols also declares to be a member of the team of researchers who adapted the Verona Service Satisfaction scale for methadone treatment programs; this adaptation is, in any case, in the public domain. Authors do not consider these facts to constitute actual or potential conflicts of interest with respect to the submitted manuscript but include the information for completeness and transparency. The views expressed are those of the authors and do not necessarily represent nor reflect those of the organizations or institutions in which they work. The authors report no other conflicts of interest in this work.

References

  • IraurgiIEvaluación de Resultados en Trastornos Adictivos: Calidad de Vida Como Indicador y Puntuación Fiable de Cambio Como Estimador [Outcomes Assessment in Addictive Disorders: Quality of Life as an Indicator and Reliable Change Index as an Estimator] [doctoral thesis]Donostia-San SebastiánUniversidad del País Vasco (UPV/EHU)2010 Spanish
  • De MaeyerJVanderplasschenWBroekaertEExploratory study on drug users’ perspectives on quality of life: more than health-related quality of life?Soc Indic Res2009901107126
  • TreloarCHoltMComplex vulnerabilities as barriers to treatment for illicit drug users with high prevalence mental health co-morbiditiesMent Health Subst Use2008118495
  • PulfordJAdamsPSheridanJClient/clinician discrepancies in perceived problem improvement and the potential influence on dropout responseInt J Ment Health Addict200974497505
  • TrujolsJSiñolNIraurgiIBatlleFGuàrdiaJPérez de Los CobosJPatient and clinician’s ratings of improvement in methadone-maintained patients: Differing perspectives?Harm Reduct J2011812321871064
  • BilsburyCDRichmanAA staging approach to measuring patient-centred subjective outcomesActa Psychiatr Scand Suppl200241454012366461
  • RuggeriMTansellaMTo what extent do mental health services meet patients’ needs and provide satisfactory care?Curr Opin Psychiatry2002152193199
  • TrujolsJPérez de los CobosJLa perspectiva de los usuarios sobre los tratamientos de mantenimiento con metadona: Una revisión centrada en la satisfacción con el tratamiento [Users’ views of methadone maintenance treatment: a review focused on satisfaction with treatment]Adicciones2005172181204 Spanish
  • CarlsonMJGabrielRMPatient satisfaction, use of services, and one-year outcomes in publicly funded substance abuse treatmentPsychiatr Serv20015291230123611533398
  • HserYIEvansEHuangDAnglinDMRelationship between drug treatment services, retention, and outcomesPsychiatr Serv200455776777415232015
  • MarchandKIOviedo-JoekesEGuhDBrissetteSMarshDCSchechterMTClient satisfaction among participants in a randomized trial comparing oral methadone and injectable diacetylmorphine for long-term opioid-dependencyBMC Health Serv Res20111117421791093
  • RiesRKJaffeCComtoisKAKitchellMTreatment satisfaction compared with outcome in severe dual disordersCommunity Ment Health J199935321322110401891
  • CrowRGageHHampsonSThe measurement of satisfaction with healthcare: implications for practice from a systematic review of the literatureHealth Technol Assess2002632124412925269
  • LehmanAFZastownyTRPatient satisfaction with mental health services: a meta-analysis to establish normsEval Program Plann198363–426527410267254
  • KoesterSAndersonKHofferLActive heroin injectors’ perceptions and use of methadone maintenance treatment: cynical performance or self-prescribed risk reduction?Subst Use Misuse199934142135215310573308
  • NingAMGames of truth: rethinking conformity and resistance in narratives of heroin recoveryMed Anthropol200524434938216249138
  • GuichardALertFBrodeurJMRichardLRapports des usagers au Subutex®: de la reconquête de l’autonomie à la spirale de l’échec [Drug users’ relationships with Subutex®: from restored independence to the downward spiral of failure]Sci Soc Sante2006244543 French
  • KaymanDJGoldsteinMFDerenSRosenblumAPredicting treatment retention with a brief “opinions about methadone” scaleJ Psychoactive Drugs20063819310016681180
  • KellySMBrownBSKatzECA comparison of attitudes toward opioid agonist treatment among short-term buprenorphine patientsAm J Drug Alcohol Abuse201238323323822242643
  • SchwartzRPKellySMO’GradyKEAttitudes toward buprenorphine and methadone among opioid-dependent individualsAm J Addict200817539640118770082
  • StancliffSMyersJESteinerSDruckerEBeliefs about methadone in an inner-city methadone clinicJ Urban Health200279457157812468676
  • GuichardALertFBrodeurJMRichardLBuprenorphine substitution treatment in France: drug users’ views of the doctor-user relationshipSoc Sci Med200764122578259317442473
  • LillyRQuirkARhodesTStimsonGVJuggling multiple roles: staff and client perceptions of keyworker roles and the constraints on delivering counselling and support services in methadone treatmentAddict Res Theory199974267289
  • QuirkALillyRRhodesTStimsonGNegotiating a script: the dynamics of staff/client relationshipsToberGStrangJMethadone Matters: Evolving Community Methadone Treatment of Opiate AddictionLondonMartin Dunitz20033343
  • MaddenALeaTBathNWinstockARSatisfaction guaranteed? What clients on methadone and buprenorphine think about their treatmentDrug Alcohol Rev200827667167819378450
  • TrujolsJGarijoISiñolNdel PozoJPortellaMJPérez de los CobosJPatient satisfaction with methadone maintenance treatment: the relevance of participation in treatment and social functioningDrug Alcohol Depend20121231–3414722071121
  • BryantJSaxtonMMaddenABathNRobinsonSConsumers’ and providers’ perspectives about consumer participation in drug treatment services: is there support to do more? What are the obstacles?Drug Alcohol Rev200827213814418264873
  • FischerJNealeJInvolving drug users in treatment decisions: an exploration of potential problemsDrugs Educ Prev Policy2008152161175
  • March CerdáJCMartín-RuizEOviedo-JoekesERivadeneira SiciliaARodríguez ReinadoCPercepción de usuarios de los programas de tratamiento con metadona sobre la accesibilidad y atención recibida de los equipos terapéuticos [Methadone treatment programme users’ perception of the accessibility and care received from the therapeutic teams]Adicciones2006184359369 Spanish
  • Apantaku-OlajideTDucrayKByrnePSmythBPPerception of unmet needs and association with benzodiazepine misuse among patients on a methadone maintenance treatment programmePsychiatrist2012365169174
  • FountainJStrangJGriffithsPPowisBGossopMMeasuring met and unmet need of drug misusers: integration of quantitative and qualitative dataEur Addict Res2000629710310899736
  • Pérez de los CobosJFidelGEscuderGA satisfaction survey of opioid-dependent clients at methadone treatment centres in SpainDrug Alcohol Depend200473330731315036553
  • KellySMO‘GradyKEBrownBSMitchellSGSchwartzRPThe role of patient satisfaction in methadone treatmentAm J Drug Alcohol Abuse201036315015420465372
  • KellySMO‘GradyKEMitchellSGBrownBSSchwartzRPPredictors of methadone treatment retention from a multi-site study: a survival analysisDrug Alcohol Depend20111172–317017521310552
  • VillafrancaSWMcKellarJDTraftonJAHumphreysKPredictors of retention in methadone programs: a signal detection analysisDrug Alcohol Depend200683321822416384657
  • BellJQuality improvement for methadone maintenance treatmentSubst Use Misuse20003512–141735175611138706
  • McLellanATChalkMBartlettJOutcomes, performance, and quality: what’s the difference?J Subst Abuse Treat200732433134017481456
  • CasasMCallaoRCañellasJIndicadors de qualitat per a l’avaluació externa de centres d’atenció i seguiment en drogodependències [Quality indicators for an external evaluation of drug treatment services]BarcelonaDirecció General de Drogodependències i Sida del Departament de Sanitat i Seguretat Social de la Generalitat de Catalunya2001 Spanish
  • Substance Abuse and Mental Health Services AdministrationFederal guidelines for opioid treatment (Revision draft)Rockville, MDSubstance Abuse and Mental Health Services Administration2013 Available from: http://www.dpt.samhsa.gov/pdf/FederalGuidelinesforOpioidTreatment5-6-2013revisiondraft_508.pdfAccessed July 25, 2013
  • BallJCGraffHSheehanJJThe heroin addicts’ view of methadone maintenanceBr J Addict Alcohol Other Drugs197469189954532022
  • HuntGBarkerJCDrug treatment in contemporary anthropology and sociologyEur Addict Res19995312613210460976
  • MontagneMAppreciating the user’s perspective: listening to the “methadonians”Subst Use Misuse200237456557012064438
  • TrujolsJSalazarJISalazarILos usuarios de drogas como ciudadanos: Los programas de reducción de daños [Drug users as citizens: the harm reduction programmes]BecoñaERodríguezASalazarIDrogodependencias V. Avances [Drug dependence V Advances]Santiago de CompostelaUniversidad de Santiago de Compostela1999343378 Spanish
  • TreloarCFraserSValentineKValuing methadone takeaway doses: the contribution of service-user perspectives to policy and practiceDrugs Educ Prev Policy20071416174
  • CellaDYountSRothrockNPROMIS Cooperative GroupThe Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two yearsMed Care2007455 Suppl 1S3S1117443116
  • HiltonTFThe promise of PROMIS® for addictionDrug Alcohol Depend2011119322923422238781
  • PilkonisPAYuLColditzJItem banks for alcohol use from the Patient-Reported Outcomes Measurement Information System (PROMIS): use, consequences, and expectanciesDrug Alcohol Depend20131301–316717723206377
  • HellerDMcCoyKCunninghamCAn invisible barrier to integrating HIV primary care with harm reduction services: philosophical clashes between the harm reduction and medical modelsPublic Health Rep20041191323915147647
  • TreloarCHoltMDeficit models and divergent philosophies: service providers’ perspectives on barriers and incentives to drug treatmentDrugs Educ Prev Policy2006134367382
  • Australian Injecting and Illicit Drug Users LeagueTreatment service users project: Phase two final reportCanberraAustralian Injecting and Illicit Drug Users League2011 Available from: https://csrh.arts.unsw.edu.au/media/NCHSRFile/9_AIVL_TSU_Project_Phase_Two_Final_Report_2011.pdfAccessed July 25, 2013
  • BryantJSaxtonMMaddenABathNRobinsonSConsumer participation in the planning and delivery of drug treatment services: the current arrangementsDrug Alcohol Rev200827213013718264872
  • SchulteSMoringJMeierPSBarrowcloughCUser involvement and desired service developments in drug treatment: service user and provider viewsDrugs Educ Prev Policy2007143277287
  • SimpsonELHouseAOUser and carer involvement in mental health services: from rhetoric to scienceBr J Psychiatry20031832899112893657
  • MarsdenJNizzoliUCorbelliCNew European instruments for treatment outcome research: reliability of the maudsley addiction profile and treatment perceptions questionnaire in Italy, Spain and PortugalEur Addict Res20006311512211060475
  • MarsdenJStewartDGossopMAssessing client satisfaction with treatment for substance use problems and the development of the treatment perceptions questionnaire (TPQ)Addict Res Theory200085455470
  • BarryDTMooreBAPantalonMVPatient satisfaction with primary care office-based buprenorphine/naloxone treatmentJ Gen Intern Med200722224224517356993
  • de los CobosJValeroSHaroGDevelopment and psychometric properties of the Verona Service Satisfaction Scale for methadone-treated opioid-dependent patients (VSSS-MT)Drug Alcohol Depend200268220921412234650
  • MarkezIIraurgiIPóoMProgramas de mantenimiento con metadona en el País Vasco: dispositivos específicos y oficinas de farmacia [Methadone maintenance programs in the Basque Country: specific centers and pharmacy offices]Trastornos Adictivos200243171180 Spanish
  • ZhangZGersteinDRFriedmannPDPatient satisfaction and sustained outcomes of drug abuse treatmentJ Health Psychol200813338840018420772
  • KumarMRRajwalMSurvey of client satisfaction with methadone maintenance programmesPsychiatrist20063011618
  • StoneEFletcherKUser views on supervised methadone consumptionAddict Biol200381454812745415
  • FiellinDAO’ConnorPGChawarskiMPakesJPPantalonMVSchottenfeldRSMethadone maintenance in primary care: a randomized controlled trialJAMA2001286141724173111594897
  • DeeringDHornJFramptonCMClients’ perceptions of opioid substitution treatment: an input to improving the quality of treatmentInt J Ment Health Nurs201221433033922564199
  • KingVLKidorfMSStollerKBSchwartzRKolodnerKBroonerRKA 12-month controlled trial of methadone medical maintenance integrated into an adaptive treatment modelJ Subst Abuse Treat200631438539317084792
  • WardJThe Case of Community Methadone Treatment ProgramsWorld Health OrganizationWorkbook 6 Client Satisfaction EvaluationsGenèveWorld Health Organization20003238 Available from: http://www.emcdda.europa.eu/attachements.cfm/att_5868_EN_6_client_satisfaction_evaluations.pdfAccessed November 7, 2013
  • CrawfordMJKesselASNot listening to patients – the use and misuse of patient satisfaction studiesInt J Soc Psychiatry19994511610443244
  • FischerBChinATKuoIKirstMVlahovDCanadian illicit opiate users’ views on methadone and other opiate prescription treatment: an exploratory qualitative studySubst Use Misuse200237449552212064431
  • NealeJDrug users’ views of prescribed methadoneDrugs Educ Prev Policy1998513345
  • WilliamsBPatient satisfaction: a valid concept?Soc Sci Med19943845095168184314
  • AndrewSSalamonsonYEverettBHalcombEJDavidsonPMBeyond the ceiling effect: using a mixed methods approach to measure patient satisfactionInt J Mult Res Approaches2011515263
  • SofaerSFirmingerKPatient perceptions of the quality of health servicesAnn Rev Public Health20052651355915760300
  • CollinsKNicolsonPThe meaning of ‘satisfaction’ for people with dermatological problems: reassessing approaches to qualitative health psychology researchJ Health Psychol20027561562922113145
  • EdwardsCStaniszewskaSAccessing the user’s perspectiveHealth Soc Care Community20008641742411560712
  • TrujolsJSiñolNde los CobosJPMethadone maintenance treatment: the need to distinguish between holding dose, dose adequacy, satisfaction with methadone as a medication, and satisfaction with treatmentJ Clin Psychopharmacol2010301959620075667
  • TrujolsJIraurgiISiñolNPortellaMJPérezVPérez de los CobosJSatisfaction with methadone as a medication: psychometric properties of the Spanish version of the treatment satisfaction questionnaire for medicationJ Clin Psychopharmacol2012321697422198457
  • BathNMaddenAWhen you can’t see the wood for the trees: what does drug treatment consumer satisfaction really tell us?Psychol Subst Use Newsl20066235 Available from: http://www.groups.psychology.org.au/Assets/Files/psu_newsletter_july2006.pdfAccessed November 27, 2013
  • DawsonRSprossJAJablonskiESHoyerDRSellersDESolomonMZProbing the paradox of patients’ satisfaction with inadequate pain managementJ Pain Symptom Manage200223321122011888719
  • WilliamsBCoyleJHealyDThe meaning of patient satisfaction: an explanation of high reported levelsSoc Sci Med1998479135113599783878
  • EdwardsCStaniszewskaSCrichtonNInvestigation of the ways in which patients’ reports of their satisfaction with health care are constructedSociol Health Illn200426215918315027983
  • AvisMIncorporating patients’ voices in the audit processQual Health Care199762869110173261
  • BartuAClient satisfaction: why bother?J Subst Use1996112026
  • HarrisonSMortMWhich champions, which people? Public and user involvement in health care as a technology of legitimationSoc Policy Adm19983216070
  • HodgeSParticipation, discourse and power: a case study in service user involvementCrit Soc Policy2005252164179
  • AttkissonCCGreenfieldTKThe UCSF client satisfaction scales: I. The client satisfaction questionnaire-8MaruishMEThe Use of Psychological Testing for Treatment Planning and Outcomes Assessment2nd edMahwah, NJLawrence Erlbaum199913331346
  • HudakPLWrightJGThe characteristics of patient satisfaction measuresSpine (Phila Pa 1976)200025243167317711124733
  • RuggeriMLasalviaADall’AgnolaRDevelopment, internal consistency and reliability of the Verona Service Satisfaction Scale – European Version. EPSILON Study 7. European Psychiatric Services: inputs linked to outcome domains and needsBr J Psychiatry Suppl200039s41s4810945077
  • WeaverMPatrickDLMarksonLEMartinDFredericIBergerMIssues in the measurement of satisfaction with treatmentAm J Manag Care19973457959410169526
  • BrusterSSeeking the views of consumers using quantitative measures: patient experience surveysBurrJNicolsonPResearching Health Care Consumers: Critical ApproachesBasingstokePalgrave Macmillan20055570
  • ClearyPDEdgman-LevitanSHealth care quality. Incorporating consumer perspectivesJAMA199727819160816129370508
  • BlankertzLHazemDAssessing consumer program needs: advantages of a brief unstructured formatCommunity Ment Health J200238427728612166915
  • EisenSVPatient satisfaction and perceptions of careIsHakWWBurtTSedererLIOutcome Measurement in Psychiatry: A Critical ReviewWashington, DCAmerican Psychiatric Publishing2002303320
  • FitzpatrickRCapturing what matters to patients when they evaluate their hospital careQual Saf Health Care200211430612468687
  • JenkinsonCCoulterABrusterSThe Picker patient experience questionnaire: development and validation using data from in-patient surveys in five countriesInt J Qual Health Care200214535335812389801
  • LarsenDLAttkissonCCHargreavesWANguyenTDAssessment of client/patient satisfaction: development of a general scaleEval Program Plann19792319720710245370
  • ReisingerHSSchwartzRPMitchellSGPremature discharge from methadone treatment: patient perspectivesJ Psychoactive Drugs200941328529619999682
  • MazorKMClauserBEFieldTYoodRAGurwitzJHA demonstration of the impact of response bias on the results of patient satisfaction surveysHealth Serv Res20023751403141712479503
  • PernegerTVChamotEBovierPANonresponse bias in a survey of patient perceptions of hospital careMed Care200543437438015778640
  • SitziaJWoodNResponse rate in patient satisfaction research: an analysis of 210 published studiesInt J Qual Health Care19981043113179835247
  • StuderJBaggioSMohler-KuoMExamining non-response bias in substance use research – are late respondents proxies for non-respondents?Drug Alcohol Depend20131321–231632323535061
  • GillespieRManufacturing Knowledge: A History of the Hawthorne ExperimentsCambridgeCambridge University Press1991
  • SitziaJWoodNPatient satisfaction: a review of issues and conceptsSoc Sci Med19974512182918439447632
  • SprangersMASchwartzCEIntegrating response shift into health-related quality of life research: a theoretical modelSoc Sci Med199948111507151510400253
  • WilsonIBClinical understanding and clinical implications of response shiftSoc Sci Med199948111577158810400258
  • Villar LópezJLizán TudelaLSoto AlvarezJPeiró MorenoSLa satisfacción con el tratamiento [Treatment satisfaction]Aten Primaria20094111637645 Spanish19660842
  • MetrebianNQuirkAStimsonGVA model of consumer audit in substance misuse servicesJ Subst Use199724222227
  • SixmaHJKerssensJJCampenCVPetersLQuality of care from the patients’ perspective: from theoretical concept to a new measuring instrumentHealth Expect199812829511281863
  • ClarkCCScottEABoydellKMGoeringPEffects of client interviewers on client-reported satisfaction with mental health servicesPsychiatr Serv199950796196310402622
  • CoulterAAfter Bristol: putting patients at the centreQual Saf Health Care200211218618812469698
  • TrujolsJPortellaMJNot all PROMs reflect patients’ perspectivesBMJ2013346f155223512449
  • HagellPReimerJNybergPWhose quality of life? Ethical implications in patient-reported health outcome measurementValue Health200912461361719900259
  • PatersonCSeeking the patient’s perspective: a qualitative assessment of EuroQol, COOP-WONCA charts and MYMOPQual Life Res200413587188115233501
  • FraserJMethadone clinic culture: the everyday realities of female methadone clientsQual Health Res199771121139
  • KolindTForm or content: the application of user perspectives in treatment researchDrugs Educ Prev Policy2007143261275
  • FraserSValentineKSubstance and Substitution: Methadone Subjects in Liberal SocietiesBasingstokePalgrave Macmillan2008
  • FriedmanJAliceaMSurviving Heroin: Interviews With Women in Methadone ClinicsGainesville, FLUniversity Press of Florida2001
  • GourlayJRicciardelliLRidgeDUsers’ experiences of heroin and methadone treatmentSubst Use Misuse200540121875188216419562
  • GómezJLatorreASánchezMFlechaRMetodología Comunicativa Crítica [Critical Communicative Methodology]BarcelonaEl Roure2006 Spanish
  • GómezAPuigvertLFlechaRCritical communicative methodology: informing real social transformation through researchQual Inquiry2011173235245
  • SordéTOjalaMActos comunicativos dialógicos y actos comunicativos de poder en la investigación [Dialogic communicative acts and communicative acts of power in research]Rev Signos201043Suppl 2377391 Spanish
  • ElbeckMPatient contribution to the design and meaning of patient satisfaction for quality assurance purposes: the psychiatric caseHealth Care Manage Rev199217191951548125
  • Lozano RojasOMBilbao AcedosIGonzález SaizFBallesta GómezRDimensiones emergentes para la creación de una escala de percepción del tratamiento con sustitutivos opiáceos [Emergent dimensions for the construction of an opiate substitute treatment perception scale]Adicciones20082011926 Spanish18299778
  • TrujolsJPortellaMJIraurgiICampinsMJSiñolNde los CobosJPPatient-reported outcome measures: are they patient-generated, patient-centred or patient-valued?J Ment Health201322655556223323928
  • MiraJJSatisfecho, sí gracias... pero ahora qué? [Satisfied, yes thanks … but now what?]Rev Calidad Asistencial2003187567569 Spanish
  • ArnsteinSRA ladder of citizen participationJ Am Inst Plann1969354216224
  • FriedmanSRNeaigusAClattsMMyths about competence: “Drug users are not competent, public health agencies are”Paper presented at: 8th International Conference on the Reduction of Drug Related HarmMarch 1997Paris, France
  • KerrTSmallWPeeaceWDouglasDPierreAWoodEHarm reduction by a “user-run” organization: a case study of the Vancouver Area Network of Drug Users (VANDU)Int J Drug Policy20061726169
  • WoodEKerrTSpittalPMAn external evaluation of a peer-run “unsanctioned” syringe exchange programJ Urban Health200380345546412930883
  • AranaXGermánIDelimitación del Status Jurídico del Ciudadano ‘Consumidor de Drogas’. Propuesta de Carta de Derechos de los Usuarios de Drogas [Delimiting the Legal Status of the Drug-User Citizen. Proposal of a Drug Users’ Bill of Rights]VitoriaDirección de Drogodependencias del Gobierno Vasco2004 Spanish
  • HamiltonSDale-PereraAEfthimiou-MordauntAFryMGetting Drug Users Involved: Good Practice in Local Treatment and PlanningLondonStanding Conference on Drug Abuse1997 Available from: http://www.drugscope.org.uk/Resources/Drugscope/Documents/PDF/Good%20Practice/Gettinginvolved.pdfAccessed July 25, 2013
  • CouplandHMaherLEnriquezJClients or colleagues? Reflections on the process of participatory action research with young injecting drug usersInt J Drug Policy2005163191198
  • SingerMWhy is it easier to get drugs than drug treatment in the United States?CastroASingerMUnhealthy Health Policy: A Critical Anthropological ExaminationWalnut Creek, CAAltaMira Press2004287301
  • CollinsJAFauserBCBalancing the strengths of systematic and narrative reviewsHum Reprod Update200511210310415618290
  • PrilleltenskyIPrólogo. Validez psicopolítica: el próximo reto de la psicología comunitaria [Foreword. Psychopolitical validity: the next challenge for community psychology]MonteroMIntroducción a la Psicología Comunitaria: Desarrollo, Conceptos y Procesos [Introduction to Community Psychology: Development, Concepts and Processes]Buenos AiresPaidós2004518 Spanish
  • PrilleltenskyIPrilleltenskyOVoorheesCPsychopolitical validity in the helping professions: applications to research, interventions, case conceptualization, and therapyCohenCITimimiSLiberatory Psychiatry: Philosophy, Politics, and Mental HealthCambridgeCambridge University Press2008105130
  • TrujolsJDispositivos, intervenciones y dinámica asistencial: La perspectiva de los usuarios [Substance abuse facilities, interventions and the dynamics of healthcare: The user perspective]Pérezde los Cobos JCValderramaJCCerveraGRubioGTratado SET de trastornos adictivos [SET Handbook of Addictive Disorders]MadridMédica Panamericana2006463467 Spanish