Publication Cover
Ethnopolitics
Formerly Global Review of Ethnopolitics
Volume 16, 2017 - Issue 5
2,728
Views
2
CrossRef citations to date
0
Altmetric
Articles

Comparative Analysis of State and Civil Society Discourse on Human Rights Implementation and the Position of Roma in the Former Yugoslav Space

ORCID Icon

Abstract

This study analyses the position of Roma people in the former Yugoslavia using state and civil society discourse on human rights implementation. It reveals that states are failing to give sufficient prioritisation to tackling longstanding discrimination and oppression. Instead of positive the effects predicted by complementarity theory, the findings reveal ‘frame dis-alignment’ between political elites and NGOs. This raises questions of legitimation and performativity in human rights practice. States’ failure to fully engage with NGOs’ policy claims effectively renders Roma people ‘semi-citizens’. Systemic reform by government is required in order to promote equal citizenship through civil society engagement in rights implementation.

Introduction

This study analyses the position of Roma people in the former Yugoslavia using state and civil society discourse on human rights implementation. Approximately, one million Roma are resident in the Former Republic of Yugoslavia (FYR) (CoE, Citation2015). The myriad identities and rich diversity of people now described by the umbrella term ‘Roma’ make it one of the largest minority groups in the EU (Tremlett, Citation2014).Footnote1 European integration processes are transforming governance practices in the region. For some, the emergence of multi-level political structures and governing elites’ espousal of rights may have had a positive impact on contemporary citizenship in the FYR (Castles, Citation2005). Yet for others, significant questions remain as to whether political rhetoric is matched by lived-reality: ‘the predicament of Roma minorities as citizens of different European states is still one of the daunting challenges for scholars as well as policy makers’ (Sardelić, Citation2013, p. 1). Historically, their position worsened with the fall of the socialist state system (Barany, Citation2002; Ringold, Orenstein, & Wilkens, Citation2005). Yet, of late they have borne the brunt of ‘a new wave of “anti-Gypsism”’, enduring ‘severe poverty, racial hostility, the obliteration of their culture, and exclusion from public life’ (Kostadinova, Citation2011, p. 163; see also Petr, Citation2004; Poucki & Bryan, Citation2014; Simeunović Bajić, Citation2011). This malaise has manifold causes (O’Higgins, Citation2010; Stauber & Vago, Citation2013) and has been compounded by the legacy of the Yugoslav Wars 1991–2001 (French & Nikolic-Novakovic, Citation2012; Glenny, Citation1993; Latham, Citation1999). It has led to the Roma being described as ‘the most discriminated ethnic minority’ in the EU (Marin Thornton, Citation2014, p. 106), something that FYR countries have yet to address. Thus, as Sardelić (Citation2015, p. 159) observes,

the position of Roma minorities in the light of citizenship regime transformations after the disintegration of the former Socialist Yugoslavia … not only manifests in the rights dimension, but also in uneven access to citizenship with regard to the new polities.

The aim of this paper is to engage with these concerns and better understand how discriminatory pathologies endure despite a raft of human rights laws designed to offer protection. The research questions are: How can we characterise policy framing and issue-salience in state and civil society human rights discourse? What contrasts and commonalities exist? How does state-civil society input into human rights monitoring relate to policy theory on collaborative policy implementation? And, what do the findings tell us about civil society and Roma representation at the beginning of the twenty-first century?

The study findings reveal the discursive processes associated with human rights implementation contribute to the enduring failure to address Roma oppression. The following analysis provides evidence of conflict rather than consensus. Expressed in social theory terms, ‘frame dissonance’ is a feature of government and civil society discourse. As will be explained, in turn this raises questions over performativity and legitimation in human rights practice. The underlying problem is that state and civil society actors have contrasting priorities. Notably, civil society organisations emphasise the ‘representation’ frame. This is instructive and tells us much about the position of Roma and the nature of contemporary civil society in the FYR. In particular, it underlines how governments are not affording NGOs sufficient opportunities to input their views on human rights implementation, as well as public decision-making more generally. Instead, governing elites are placing rhetorical emphasis on ‘soft’ discursive rights and generally failing to detail effective implementation measures.

To explore the foregoing issues in further detail the remainder of this paper is structured thus: following an outline of the policy context and the methodology, attention then moves to the findings with comparative analysis of the discourse in state and civil society implementation reports. This first explores framing, before examining issue-salience. The conclusion offers theoretically informed reflection on the implications of the study findings for human rights implementation and the position of Roma people in the FYR.

Policy Context

Post-1991 Europeanisation has been accompanied by the development of a broad range of human rights instruments covering the FYR states. These include: the European Convention on Human Rights (Article 14); The Charter of Fundamental Rights of the European Union (with explicit reference to preventing discrimination linked to ‘membership of a national minority’); the Employment Equality Directive (2000/78/EC); Racial Equality Directive (2000/43/EC); CoE Resolution 366 (2014) (‘Empowering Roma youth through participation’); CoE Resolution 249 (1993) (‘Gypsies in Europe: the role and responsibility of local and regional authorities’) and the United Nations Convention on the Elimination of All Forms of Racial Discrimination.

Despite this, the latest survey data show: ‘many Roma still face severe poverty, profound social exclusion, discrimination and barriers to exercising their fundamental rights’ (European Union Agency for Fundamental Rights, Citation2014, p. 4). This paper therefore makes a timely contribution on rights implementation by providing critical discourse analysis of the reports submitted in 2013–2015 to the second cycle UN universal periodic review (UPR). This is the evaluation process that emerged in the wake of the 2006 UN General Assembly resolution (60/251) designed to assess progress in upholding human rights law. It is a procedure conducted under the auspices of the human rights council (HRC) (see Cochrane & McNeilly, Citation2013).

Crucially, both human rights law and the UPR are explicit in emphasizing the foundational role of civil society. This matters, for as McGarry and Agarin (Citation2014, p. 1972) outline, ‘addressing the multiple and inter-connected issues facing Roma communities across Europe requires the full participation of Roma in social, economic and political life’. Thus, official EU guidance requires states to: ‘invite non-governmental organisations and other civil society institutions … to participate in its Fundamental Rights Platform’.Footnote2 Moreover, the Council of Europe’s Fundamental Principles (CoE, Citation2002, p. 3) stress ‘the importance and value of NGOs’ contribution’. In turn, these principles have informed the UPR. It provides the opportunity for states and NGOs to submit formal written submissions to be considered by the HRC as part of the review process.

Method

Both the interpretive school of policy analysis (Hajer, Citation2003; Yanow, Citation1999) and the literature on social constructivism (Kukla, Citation2000) place emphasis on the political use of language in order to reveal policy actors’ beliefs, values and understanding of social issues (Eden & Ackermann, Citation2004). These factors lie at the heart of policy analysis. Applied to the present research topic, as Tremlett and McGarry (Citation2013, p. 20) observe, ‘discourses surrounding Roma minorities are fundamental to understanding wider notions of social inclusion and cohesion’ (cf. Imre, Citation2009; Nordberg, Citation2005). However, critical discourse analysis (CDA) has not previously been applied to the study of human rights implementation and Roma in the FYR. This is a key lacuna because CDA is concerned with ‘the way social power, dominance, and inequality are enacted, reproduced, and resisted by text and talk in the social and political context’ (Van Dijk, Citation2001, p. 352). Thus, making it is ideally suited to addressing the present study aims.

CDA was operationalised here by focusing on two aspects of language use, ‘framing’ and ‘issue salience’. The former derives from the work of Goffman (Citation1974, p. 21) and refers to a ‘schemata of interpretation’. As Snow (Citation1986, p. 464) notes, ‘by rendering events or occurrences meaningful, frames function to organise experience and guide action, whether individual or collective’. In short, they ‘shape and structure cooperative action by stressing specific values, facts and other considerations, endowing them with greater apparent relevance to the issue than they might appear to have under an alternative frame’ (Nelson & Oxleya, Citation1999, p. 75). In this way they are pivotal to understanding rights implementation involving a range of actors spanning the public and civil spheres.

This study’s selection and use of coding frames builds on established mixed methods analysis. It uses deductive coding (Bowen, Citation2009; Joffe & Yardley, Citation2003; Sandana, Citation2012). This involves identifying incidences of key themes or ‘frames’ in the text of policy documents (Finfgeld-Connett, Citation2013). Thus, the initial coding frame (or list of themes) was grounded in the key literature on Roma people in the Yugoslav space (e.g. European Union Agency for Fundamental Rights, Citation2014; Jungić, Palić, Halitović, & Sivić, Citation2014; Kostadinova, Citation2011; Sardelić, Citation2013, Citation2015; for a full listing—see References). Examples of the initial frames include: ‘equality’, ‘participation’, ‘rights’, ‘discrimination’, ‘inclusion’, ‘citizenship’, ‘representation’ and ‘participation’. Others, such as ‘protection’, were added during the coding process (see ). This approach is both responsive and adaptable in the way it allows further analytical categories to emerge from the data. It is therefore capable of linking the analysis to wider debates whilst being sensitive enough to incorporate factors specific to a given context. In this way, it maximises the validity of associated findings (for a discussion see for e.g. Hannes & Macaitis, Citation2012; Wasserman, Michael-Clair & Wilson, Citation2009).

Table 1. Comparison of state and NGO framing on the implementation of UN human rights treaties in second cycle universal periodic review (percentage of quasi-sentences in each frame, by state) (N = 1,908)

In addition to frame analysis, the texts were also coded a second time according to ‘issue-salience’—or, the number of references to different policy issues (e.g. education, children, housing, employment, poverty, language, health, etc.). Both phases of the coding process were undertaken using electronic versions of the policy documents and appropriate software. The incidence of frames and number of references to different policy areas (issue salience) were logged into a database. Two statistical techniques were applied to the data: Chi squared and F-tests (two samples for variances).Footnote3 Their purpose was to establish whether any differences in state and NGO framing in the human rights discourse were random, or statistically significant. Two key data sources were used in the study: 1. States’ reports submitted to the United Nations 2013–2014—as part of the second cycle UPR and 2. Forty-nine reports on the implementation of human rights treaty obligations from a purposive sample of standalone civil society organisations and networks of non-governmental organisations across the region.

State and Civil Society Discourse on Human Rights Implementation

Analysis of the UPR data shows statistically significant differences in the framing of state and civil society discourse (P ≤ .001) ().Footnote4 This is a key finding and points to a major shortcoming in rights implementation for Roma people in the region. From a strategic perspective, it reveals that governments are prioritising contrasting issues and following different agendas to civil society organisations. Policy theory is instructive and sets out four ways in which this shapes human rights outcomes. First, issue-prioritisation is key to raising public awareness of discrimination and oppression. For example, it may boost the number of policy actors willing to address a given issue (increased ‘buy-in’) and lever-in additional resources, thereby increasing the likelihood of effective outcomes (Heath & Palenchar, Citation1997). Second, state-civil society divergence can lead to a number of policy pathologies (Hogwood & Gunn, Citation1984). These are wide-ranging and include the inefficient use of resources (for interventions are uncoordinated) and diminution of community trust and understanding (as policies lack apparent relevance and strategic direction).

Third, in epistemological terms, state actors’ failure to respond to civil society policy claims raises the prospect of implementation being an elite and technocratic exercise (Lowi, Citation1970). Again, this is problematic because it is not government but civil society organisations that possess necessary ‘situated knowledge’—or first-hand experience of the inequalities and oppression facing Roma people in FYR communities. Such contextualised knowledge increases the potential for reflexive, policy learning that responds to local circumstances and addresses discrimination and inequality in an effective manner (Weible & Sabatier, Citation2009).

The fourth concern is democracy. Notwithstanding the political rhetoric on participation and engagement (OHCHR, Citation2011), failure to fully embrace and respond to civil society views means contemporary practice is lacking what the policy literature dubs ‘input legitimacy’ (Papadopoulos & Warin, Citation2007). With these issues in mind, attention now turns to comparison of state and civil society discourse. First in relation to framing and then policy areas (or ‘issue salience’).

(i) Framing

Discrimination is the (joint) first-ranked frame in the NGO discourse. In comparison, it is fifth ranked in the state discourse (). This disparity is emblematic of the longstanding oppression and inequality experienced by Roma people in the former Yugoslavia and beyond (Fekete, Citation2014). As existing studies attest, it is an issue that not only pervades social attitudes across the region, but has a negative impact on public service delivery. For example, ‘practice in the field of social work with minority ethnic groups is often racist, especially when social service users are members of the Roma ethnic group’ (Urh, Citation2008, p. 117). Whilst the current data reveal official acknowledgement of such shortcomings (e.g. ‘the fight against social exclusion and discrimination of Roma … has been a priority area of concern’, Government of Bosnia & Herzegovina, Citation2014, p. 8)—state discourse is less forthcoming on measures to address the issue.

Table 2. Comparative ranking of frames: state and NGO discourse compared

In contrast, the civil society discourse is highly critical of those in power: ‘most persons reporting ethnic discrimination were Roma … which the Government should take steps to address’ (ERRC & MRCCS, Citation2013, p. 1). In turn, the Civil Society Organizations' (CSO) reports detail how discrimination is manifest across policy areas. For example, ‘Roma continue to face problems accessing health care due to registration restrictions, have lower education enrolment than other groups, and face discrimination in employment’ (HRWBiH, Citation2014, p. 3). Notably, the discourse alludes to institutional discrimination: ‘lack of prevention of discrimination against Roma remains a systemic problem owing to ineffective human rights framework’ (AIS, Citation2014, p. 2). This is significant for it points to the way that discrimination is deep-rooted in state services across the region (McCrudden, Citation1982). In response CSOs are explicit in their call to political elites to implement ‘targeted measures to reduce institutional discrimination against Roma’ (IATRNE & RNCCP, Citation2014, p. 5).

‘Rights’ were first ranked in the state discourse and third ranked by NGOs. The key difference is that the state discourse focuses on the generic espousal of ‘soft’ rights—(e.g. ‘the development of minority rights’—Montenegro, Citation2014, p. 6). As Trubek and Trubek (Citation2005, p. 343) observe, these ‘often have no legally binding force [instead they offer a … ] normative system employ[ing] non-binding objectives and guidelines to bring about change in social policy and other areas’. In contrast, the civil society reports look beyond these rhetorical devices to emphasise ‘hard’ rights. In other words, enforceable legal instruments. For example,

it is difficult to argue that [… Macedonia] conducts systematic efforts towards harmonisation of the national legislation with international human rights instruments… [government needs to] act upon the recommendation to accomplish progressively the human rights goals as set forth in Human Rights Council resolution 9/12,3. (CRPRC et al. Citation2014, p. 8)

A further key contrast is evident in the ‘representation/ participation’ frame. Instructively, this was joint first ranked by civil society organisations, yet just fourth ranked in the state discourse. This underlines the ‘disconnect’ between state rhetoric on Roma engagement and contemporary rights implementation in the region. It also signals a failure to adhere to UN, EU and CoE policy protocols on civil society input. The CSO discourse repeatedly alludes to this and paints a bleak picture of exclusion. For example, ‘there are currently no procedures in place to ensure consultation with the affected population on the forthcoming resettlement, as international standards provide’ (AIM, Citation2014, p. 2), and ‘the controversy of the consultation process on the draft-text was the exclusion of relevant CSOs from the process’ (CRPRC, Citation2014, p. 2).

Further dis-alignment is evident in the ‘protection’ and ‘inclusion’ frames (the third and sixth ranked, and second and fourth in the state and CSO discourse, respectively). Textual analysis reveals that the government discourse exhibits complacency: ‘visible progress has been made and the challenges involving their full social inclusion have been identified’ (Government of Montenegro, Citation2013, p. 4). Whereas, the civil society discourse is forthright in condemning state failings. For example: ‘apart from the formal establishment the National Roma Inclusion Strategy 2013–2020… not much progress was made in the establishment and functioning of an integrated monitoring system’ (IATRNE, Citation2014, p. 3). Here, governments’ framing of ‘protection’ is noteworthy. It resonates with the literature on minority language rights (May, Citation2012, p. 18; Sasse, Citation2008). Specifically, the distinction between active and passive protection. Analysis of the state discourse shows when applied to Roma communities its connotation is invariably passive. Implicit is the idea that whilst governments may seek to offer protection, the status quo will be maintained. There will be no diminution in rights, yet crucially there will be no gains or transformation in the position of this national minority. In short, it conveys a sense of protection without empowerment. Expressed in terms of equalities theory (Fraser, Citation1997), there is an element of recognition yet thoroughgoing rights and redistribution (of power and resources) are overlooked.

The discourse under the ‘citizenship’ frame underlines ongoing failure to extend full and equal rights to Roma across the region. The emerging narrative lends empirical support to Gëzim’s (Citation2015, p. 197) warning that: ‘despite the legally enshrined promise of equality [… the FYR is witness to] the emergence of hierarchical citizenship, in which some groups [… are] more equal than the others’. Thus, the state discourse tends to be generalised and declaratory in nature, as well as short on immediate measures, instead promising future action (e.g. ‘intensive activities are expected in terms of addressing the issues that predominantly involve legal status’, Government of Montenegro, Citation2013, p. 6). In contrast, civil society discourse concentrates on the immediacies of statelessness and needs of internally displaced people. Many of the latter are those forced to move as a result of the post-1991 conflict. CSOs repeatedly highlight key policy failures and the barriers facing such people. For example: ‘there are obstacles to obtaining such [legal citizenship] status for the Roma and Ashkali displaced from Kosovo. Few possess personal documentation, such as passports, required to obtain residency’ (AIM, Citation2013, p. 2), and ‘since Roma often lack personal identity documents, those who are stateless have found it difficult to meet the requirements to obtain Croatian citizenship by naturalization’ (HRWC, Citation2013, p. 5).

Amongst the remaining frames, compared to the FYR governments, NGOs place greater emphasis on ‘integration’ (fifth ranked compared to eighth). A key difference is the fact that the state discourse is principally concerned with normative statements. In other words, describing a desired situation or ideal yet to be achieved. For example, ‘working towards Roma inclusion [and] enhanced possibilities for integration in the labour market’ (Government of Macedonia, Citation2014, p. 3), and ‘the objective of this spatial planning policy is comprehensive integration of Roma into the Slovenian society’ (Government of Slovenia, Citation2014, p. 5). In contrast, civil society language is both critical and practical in orientation. Examples include: ‘institutions at the same or different levels of authority were often not familiar with each other’s implementation of certain Roma integration measures. They usually acted in an uncoordinated manner’ (IATRNE, Citation2014, p. 5); and ‘the situation of Roma in Montenegro… there still are complex problems related to their integration, combating poverty and addressing their social, economic and cultural rights’ (MIC, Citation2014, p. 7).

In the UPR data both states and civil society organisations make limited direct reference to Roma people in terms of ‘equality’ (seventh- and ninth-ranked frames, respectively). However, a key difference is that, in contrast to NGOs, states make repeated reference to affirmative action (and to a lesser degree equal treatment). As an extensive literature attests (cf. Bagilhole, Citation2009), this is problematic. For whilst such approaches may secure short-term gains, they fail to address the underlying structural and cultural causes of inequality. For example: ‘RE [Roma and Egyptian] children have been enrolled in city schools in order to eliminate segregation in education… mainly following the affirmative action principle’ (Government of Montenegro, Citation2013, p. 4).

(ii) Issue-salience

Analysis reveals that, when state and civil society organisations are compared, there are also statistically significant differences in ‘issue salience’. In other words, the level of attention afforded to different policy areas (P ≤ .001) ().Footnote5 This matters because it shows that, compared to those representing Roma communities, governing elites in the FYR hold a differing view of the issues that need to be addressed (). For example, the lead frame in the state discourse was education. Whereas for NGOs it was employment. This is significant for labour market discrimination contributes to widespread poverty amongst Roma families (see Fischer, Citation2011; Jungić et al., Citation2014; Vladisavljev & Kiers, Citation2004). As one NGO notes, ‘despite measures, funds and efforts invested by Croatia in improving the economic status of the Roma to increase their employment, satisfactory results have not been achieved’ (CCC, Citation2014, p. 7). Thus, governments’ lower prioritisation of the employment reflects a failure to adequately address the deep-set inequalities faced by Roma people in a context where jobless rates are as high as 80%.

Table 3. Issue salience of policy areas: state and NGO discourse compared (percentage of quasi-sentences in each frame, by state) (N = 1,800)

Table 4. Comparative ranking of policy areas: state and NGO discourse compared

However, states’ prioritisation of education does at least indicate official awareness of its foundational role in tackling discrimination. Notably, this takes place by breaking the inter-generational transfer of prejudice through citizenship education that emphasises tolerance and cultural respect. This is of key importance for, as Posavec and Hrvatic’s (Citation2000, p. 97) work in Croatia reveals, there is ‘limited acceptance of the Roma culture (language, art, history, customs) [… and a strong] need for intercultural education for all pupils’. In the FYR, educational inequalities have been exacerbated by systemic or institutional practices that largely go unaddressed in the state discourse. Thus, as a broad literature attests, Roma children’s lower educational attainment, poor attendance and early school leaving have been attributed to institutional prejudice. As De Beco, Hyll-Larsen and Balsera (Citation2009, p. 10) conclude ‘their education is of inferior quality and that the assessments on the basis of which they are transferred to “special schools” are in direct violation of the prohibition of non-discrimination’ (see also, Jugović & Doolan, Citation2013, p. 364; Macura-Milovanović, Munda, & Peček, Citation2013; Sunčica & Mojca, Citation2013, p. 83). Such issues are given prominent attention in the NGO discourse. For example: ‘an ongoing problem is the overrepresentation of Roma pupils in special education… where children are isolated from the rest of the school population and offered a substandard curriculum that does not prepare them for educational success or employment’ (ERRA & NRCCM, Citation2014, p. 3).

The current analysis of the UPR discourse shows that there is broad state-NGO concordance in the level of attention to children’s policy (second and third ranked, respectively). This is welcome, for existing studies provide an extensive litany of problems facing Roma children in the region. These include: failings in relation to adoption services (Ahern, & Rosenthal, Citation2008, p. 102), meeting the health and care needs of Roma children exposed to war (Barenbaum, Ruchkin, & Schwab-Stone, Citation2004), vulnerability to human trafficking (Poucki & Bryan, Citation2014), malnutrition (Machel, Citation2001) and poverty (UNICEF, Citation2012, p. 219). Yet despite these profound challenges the state discourse remains predominantly descriptive in nature. Often it outlines broad policy goals rather than specifying the means by which they will be achieved. For example, ‘we will extend support for children on the streets, […leading to the] improvement of the situation of Roma children’ (Government of Bosnia Herzegovina, Citation2014, p. 12). In contrast, the NGO discourse is more critical, often offering an indictment of governments’ failure to secure progress. For example, ‘the lack of awareness of specific risks and their consequences, and needs of children from vulnerable groups is evident… It was especially evident in the case of Roma children’ (CMCRS, Citation2014, p. 6).

As Stambolieva’s (Citation2015, p. 379) account underlines, variable welfare provision in the region is an inheritance from the past and a function of the transitional context presented by the former Yugoslav republics. It can also best be understood in relation to democratisation and the challenges posed by internationalisation. These factors combine to create a context in which the Roma are often subject to inferior or subordinate modes of welfare citizenship. As Milcher’s work (Citation2006, p. 127) notes, ‘besides socio-economic determinants of welfare, the Roma identity significantly influences welfare [uptake] levels in Southeast Europe’. Health policy has long been an area of concern (Antic, Citation2005). It was second ranked in the NGO discourse, yet only sixth in the state discourse. Civil society organisations identify a range of related issues and challenges. For example:

one of the greatest areas of concern is the exercise of the right to health for Roma people. The number of Roma medical practitioners is still very low, as is the number of primary healthcare services close to Roma settlements. (ROMA et al., Citation2014, p. 4)

Housing is another aspect of welfare where ‘members of the Roma population stand out as the most vulnerable population’ (UNICEF, Citation2012, p. 71). Again, the state discourse is overly descriptive. Often it downplays or ignores implementation details. For example: ‘the Law on Social Housing recognises the Roma as a particularly vulnerable social group with the right of priority to the resolution of the housing situation’ (Government of Serbia, Citation2013, p. 16) and ‘the Government Commission approved the concept of modernising Roma settlements’ (Government of Slovenia, Citation2014, p. 6).

The current analysis also reveals that ‘access to justice’ has a higher priority in the civil society discourse (fifth ranked) compared the state discourse (seventh). Under this frame a prominent, reoccurring issue is justice for Roma women who have been victims of domestic violence. Here again, there are concerns about systemic inequalities and oppression of national minorities. For example, one NGO alluded to ‘institutional discrimination of marginalized women who are victims of domestic violence. [In particular,] the rejection of women under the age of 18 to be admitted at shelters, most prominent [are] young Roma women in underage marriages’ (AHC Citation2014, p. 6).

States’ UPR discourse is notable for the dearth of attention given to intersectionality. In other words, the multiple and simultaneous identities of Roma people crosscut by age, sex, (dis)ability and so on (see, for example, Crenshaw, Citation2000). As Woodcock (Citation2010) such essentialising of the Roma often leads to reductive and negative stereotyping. For example, one NGO alluded to how, ‘Roma women continue to be exposed to multiple discrimination both from mainstream society and from members of their own communities, particularly in marginalized and non-urbanized communities’ (IATRNE, Citation2014, p. 7). Another referred to how ‘the position of multiply discriminated groups of women (Roma, elderly, rural women, women with disabilities, lesbians, single mothers, etc.) is particularly difficult. The mechanisms for independent monitoring of implementation of state policies are undeveloped’ (AWC, Citation2014, p. 2).

Discussion

The foregoing analysis shows that states’ implementation of human rights law in the Former Yugoslavia is centred on three main frames: ‘rights’, ‘inclusion’ and ‘protection’.Footnote6 In contrast, civil society organisations give principal attention to ‘discrimination’ and ‘representation’.Footnote7 This is significant because it not only reveals a disjuncture between NGOs and governments; it also underlines that FYR states are giving insufficient priority to tackling the discrimination and oppression faced by Roma in the region. The overall effect is ‘institutional de-coupling’—or, the situation in public administration whereby political elites pronounce one thing but practice another (see Dahlström, Citation2004; Meyer & Rowan, Citation1991). In the words of one NGO report, ‘lack of prevention of discrimination against Roma remains a systemic problem owing to ineffective human rights framework’ (AIS, Citation2014, p. 6).

The disjuncture between state and civil society discourse is evident across frames. For example, in the case of ‘rights’, the foregoing analysis shows that whilst state reports generally espouse ‘soft’ rights, civil society organisations give greater accent to ‘hard’ rights. The former are symbolic, rhetorical devices, the latter are enforceable legal instruments. The state-civil society ‘disconnect’ is also evident in references to welfare; with states failing to match civil society organisations’ prioritisation of issues such as employment and health. Moreover, the analysis shows governments across the region giving insufficient attention to labour market discrimination, with concomitant negative effects on Roma well-being and economic status. All of this supports Kostadinova’s observation (Citation2011, p. 163) that, whilst anti-discrimination laws may ‘address Roma recognition issues via provisions related to minority physical existence… […They] lack redistribution provisions per se’. Thus, there is a need to strengthen human rights implementation in order to deliver equitable welfare for Roma people in the FYR.

On political citizenship the findings also resonate with Sardelić’s analysis (Citation2013, p. 5) that, ‘even when Roma minorities are included in the body of citizenry, such inclusion is often marked by discrimination and inequality in accessing certain rights and participating in political communities’. The current study findings supports this. ‘Representation’ is joint first-ranked frame in the civil society discourse, yet fourth ranked in the state reports. This tells us much about the nature of civil society and Roma representation at the beginning of the twenty-first century. As Devic (Citation2006, p. 257) notes, ‘the tendency in transnationally exported definitions of the practices of a “good” civil society is to neglect the limits imposed by the local context’. Accordingly, the key human rights issues revealed in this study need to be seen in the context of an extended history of marginalisation and its impact on Roma associative life and mobilisation. Prior to 1991 civil society in the Socialist Federal Republic of Yugoslavia was suppressed by authoritarian rule (Križan, Citation1989; Trajkovski, Citation1999). In the wake of the Socialist Republic, a transitional or hybrid civil society has emerged. Whilst it exhibits features familiar elsewhere, it also has singular aspects. Notably, it lacks elements of the mobilising structures and criticality seen in more established liberal democracies (Gordon & Durst, Citation2004). Crucially, for Roma people, as the present findings suggest, there is a need for ‘strengthening advocacy and campaigning skills [amongst CSOs]… and providing inputs into public policy, all of which will assist them to impact positively on nationally-led development policies’ (Sterland, Citation2006, p. 2; see also Bosanac & Zdravković, Citation2012).

In particular, as Marin Thornton (Citation2014, p. 117) explains, in order to secure effective representation and ‘be less discriminated against, the Roma need to amass more power by acceding to key political and social positions’. Yet, as the locus for such action, civil society in the FYR presents formidable challenges. Not least, because, as a series of analyses underline, there’s a need to ensure that the most vocal civil society organisations on Roma matters actually represent the communities they purport to speak for. For example, Trehan (Citation2001, p. 134) underlines that, ‘for a number of reasons, some of the most high profile [NGOs] whose work primarily focuses on Roma communities in the region lack grass-roots constituencies’. In a similar vein, Kóczé (Citation2012, p. 19) refers to ‘civil society development as a project of the elite’ and refers to ‘formal’ and ‘informal’ sides of the Roma movement. With the former being ‘more procedural driven. Particularly, concerning the funding and supportive framework… [whereas, the latter] is closer to the local community’ (p. 20; see also Kóczé & Rövid, Citation2012). Gheorghe (Citation2013, p. 28) puts this in stark terms, ‘there is a dramatically widening gulf between the “clubs” of Roma political elites—both at national and transnational levels—and the communities they are supposed to represent’. It is in this context that the current analysis makes a timely contribution. It provides empirical data showing the nature and extent of the disconnect between political elites and Roma CSOs when the views of a broad cross section of small standalone NGOs and alliances and networks of civil society organisations are analysed. In short, it underlines Trehan’s (Citation2010, p. 53) observation that Roma representation needs to be seen in the context of: ‘subaltern counterpublics’ stemming from ‘the multiplicities of public spheres [… for] civil society is not a monolithic entity, but represents a site of contestation of multiple, criss-crossing communities and publics’.

The present analysis of state-civil society perspectives on human rights implementation can also be usefully related to theory on collaborative policy implementation. In conceptual terms, instead of the synergies predicted by complementarity theory (Klijn & Skelcher, Citation2008), as noted, the disjuncture in state and civil society discourse associated with the second phase UPR shows that governments are not affording NGOs sufficient opportunities to input their views on rights implementation. This is consonant with Bachrach and Baratz’s (Citation1962) classic work on how political elites may exclude, ignore or downplay exogenous policy claims. Thus, the present findings provide a further example of how states can undermine NGO advocacy for minorities (see also Schnellbach, Citation2012, p. 510). In the words of Sardelić (Citation2015, p. 159), this may effectively render Roma people as ‘semi-citizens’.

In social theory terms, the study findings also engage with the distinction between legitimacy, legitimation and performativity. In the former case, as Rawls (Citation2003, p. 185) notes, ‘political legitimacy aims for a public basis of justification and appeals to free public reason, and hence to all citizens viewed as reasonable and rational’. It is the approach sought by the United Nations whose normative vision of ‘legitimate’ human rights implementation is one shaped by civil society policy claims. In contrast, ‘legitimation involves communicative actions aimed at managing the public’s perception that government actions are effective in promoting their desired ends, whether that is in fact true’ (Moore, Citation2001, p. 707). It is a scenario is also captured by the term ‘performativity’. In other words, the situation when government practices seek to give the impression of responsiveness to external policy demands (Price & Shildrick, Citation1999, p. 241). As the present analysis shows, contemporary practice in the FYR tends to reflect the latter approach.

The current study suggests an agenda for future research. In particular, it will be useful to explore organisational practices, contestation and the internal power dynamics within both state and civil society organisations, as managers and leaders seek to set priorities for implementing human rights in the FYR. Furthermore, future research needs to examine the interplay of intersectionality, institutionalism and human rights for Roma people. In particular, the way that both government and NGOs mediate claims-making in ways that are simultaneously concerned with ethnicity and a combination of other ‘protected characteristics’ (such as sex, sexual orientation, faith (and non-belief), age and (dis-)ability).

In summary, this study highlights a number of key issues and challenges in human rights implementation for Roma people in the Former Yugoslavia. Whilst there is a need for strengthening a range of civil society capacities, on the part of government, there is an urgent need for systemic reform in order to better promote engagement and greater responsiveness to claims-making by civil society organisations acting for Roma communities. Such action is imperative in order to address differentiated citizenship in the region: an enduring pathology stemming from the deep-set, continuing patterns and processes of discrimination facing Roma people in the former Yugoslav space.

Acknowledgements

The author gratefully acknowledges the helpful and constructive feedback of three anonymous referees when revising an earlier draft of this paper.

Additional information

Funding

Grant funding by the ESRC under Award No. ES/L009099/1 is gratefully acknowledged.

Notes

1. The precise number of Roma people in the former Yugoslavia is unknown. Official estimates suggest the following: Bosnia and Herzegovina 58,000 (1.84%); Croatia 35,000 (0.79%); FYR Macedonia 197,000 (9.56%); Slovenia 8,500 (0.41%), and approximately 20,000 (1.37%) in Montenegro. In addition, there are 600,000 in Serbia (8.23%). Whilst in Kosovo 2.35% of the population or 37,500 people are estimated to be Roma (CoE, Citation2015).

2. http://fra.europa.eu/en/cooperation/civil-society/how-to-participate [last accessed 25.10. 2015].

3. .

4. χ2 = 141.201, P = 0.00015889, df = 8.

5. χ2 = 484.657, P = 0.00012271, df = 8.

6. 56% of quasi-sentences.

7. 55% of quasi-sentences.

8. F = 19.2735, P(F ≤ f) one-tail = 3.11135E-05.

9. F = 42.6216, P(F ≤ f) one-tail = 7.38553E-07.

10. F = 6.34373, P(F ≤ f) one-tail = 0.00365417.

11. F = 120.115, P(F ≤ f) one-tail = 4.70315E-09, F Critical one-tail = 2.97823.

12. F = 1306.57, P(F ≤ f) one-tail = 3.28799E-14, F Critical one-tail = 2.97823.

13. F = 5.05977, P(F ≤ f) one-tail = 0.00857, F Critical one-tail =  = 2.97823.

References

  • Ad hoc Coalition of 22 Civil Society Organizations. (2014). Parallel report to the human rights council, universal periodic review. Skopje: Author.
  • Ahern, L., & Rosenthal, E. (2008). Torment not treatment: Serbia’s segregation and abuse of children and adults with disabilities. Washington, DC: Mental Disability Rights International.
  • Amnesty International Montenegro. (2013). Submission to the UN universal periodic review 15th session of the UPR working group, January–February 2013. Podgorica: Author.
  • Amnesty International Submission Slovenia. (2014). Parallel report to the human rights council, universal periodic review. Ljubljana: Author.
  • Antic, B. (2005). Roma and right to health care in Serbia. Belgrade: Minority Rights Center.
  • Autonomous Women’s Centre. (2014). Parallel report to the human rights council, universal periodic review. Belgrade: Author.
  • Bachrach, P., & Baratz, M. (1962). The two faces of power. American Political Science Review, 57, 947–952. doi: 10.2307/1952796
  • Bagilhole, B. (2009). Understanding Equal Opportunities and Diversity. Bristol: Policy Press.
  • Barany, Z. (2002). The East European Gypsies: Regime change, marginality, and ethnopolitics. Cambridge: Cambridge University Press.
  • Barenbaum, J., Ruchkin, V., & Schwab-Stone, M. (2004). The psychosocial aspects of children exposed to war: Practice and policy initiatives. Journal of Child Psychology and Psychiatry, 45(1), 41–62. doi: 10.1046/j.0021-9630.2003.00304.x
  • de Beco, G., Hyll-Larsen, P., & Ron Balsera, M. (2009). The Right to Education: Human Rights Indicators and the Right to Education of Roma Children in Slovenia, Background paper prepared for the Education for All Global Monitoring Report 2010 - Reaching the marginalized. Paris: UNESCO. Retrieved July 12, 2016, from http://unesdoc.unesco.org/images/0018/001866/186604e.pdf
  • Bosanac, B., & Zdravković, L. (2012). Imagination castrated: Critical rethinking of the civil society (organisation) in contemporary society. Ljubljana: Peace Institute.
  • Bowen, G. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. doi: 10.3316/QRJ0902027
  • Castles, S. (2005). Hierarchical citizenship in a world of unequal nation-states. Political Science and Politics, 38, 689–692. doi: 10.1017/S1049096505050353
  • Centre for Regional Policy Research and Cooperation ‘Studiorum’; Roma Organization for Multicultural Affirmation S.O.S.; & Association of Education Workers and Protection of the Rights of Women and Children ‘LIL’. (2014). Parallel report to the human rights council, universal periodic review. Skopje: Author.
  • Civil society coalition incorporating the Institute of the Association for Transitional Researches & Roma National Council. (2014). Parallel report to the human rights council, universal periodic review. Zagreb: Author.
  • Coalition for Monitoring Child Rights in Serbia. (2014). Parallel report to the human rights council, universal periodic review. Belgrade: Author.
  • Cochrane, L., & McNeilly, K. (2013). The United Kingdom, the United Nations human rights council and the first cycle of the universal periodic review. The International Journal of Human Rights, 17(1), 152–177. doi: 10.1080/13642987.2012.720571
  • Council of Europe. (2002). Fundamental principles on the status of non-governmental organisations in Europe and explanatory memorandum fundamental principles on the status of non-governmental organisations in Europe. Strasbourg: CoE.
  • Council of Europe. (2015). Official estimates. Retrieved October 10, 2015, from http://www.coe.int/en/web/portal/roma
  • Crenshaw, K. (2000). Gender-related aspects of race discrimination. New York, NY: United Nations.
  • Dahlström, C. (2004). Rhetoric, practice & the dynamics of institutional change: Immigrant policy in Sweden 1964–2000. Scandinavian Political Studies, 27(3), 287–310. doi: 10.1111/j.1467-9477.2004.00107.x
  • Devic, A. (2006). Transnationalization of civil society in Kosovo: International and local limits of Peace and multiculturalism. Ethnopolitics, 5(3), 257–273. doi: 10.1080/17449050600911067
  • Eden, C., & Ackermann, F. (2004). Cognitive mapping expert views for policy analysis in the public sector. European Journal of Operational Research, 152(1), 615–630. doi: 10.1016/S0377-2217(03)00061-4
  • European Roma Rights Centre and Minority Rights Centre, Concerning Serbia. (2013). Parallel report to the human rights council, universal periodic review. Belgrade: Author.
  • European Roma Rights Centre and National Roma Centrum, Concerning Macedonia. (2014). Parallel report to the human rights council, universal periodic review. Skopje: Author.
  • European Union Agency for Fundamental Rights. (2014). Roma survey – Data in focus poverty and employment: The situation of Roma in 11 EU member states. Vienna: Author.
  • Fekete, L. (2014). Europe against the Roma. Race & Class, 55(3), 60–70. doi: 10.1177/0306396813509196
  • Finfgeld-Connett, D. (2013). Use of content analysis to conduct knowledge-building and theory-generating qualitative systematic reviews. Qualitative Research, 14(3), 341–352. doi: 10.1177/1468794113481790
  • Fischer, M. (2011). On labour market discrimination against Roma in south east Europe. Papers in Regional Science, 90(4), 773–788. doi: 10.1111/j.1435-5957.2011.00354.x
  • Fraser, N. (1997). Justice interruptus, critical reflections on the ‘postsocialist’ condition. London: Routledge.
  • French, L., & Nikolic-Novakovic, L. (2012). War trauma and its aftermath: An international perspective on the Balkan and gulf wars. Lanham, MD: University Press of America.
  • Gëzim, K. (2015). Equal citizens, uneven communities: Differentiated and hierarchical citizenship in Kosovo. Ethnopolitics, 14(2), 197–217. doi: 10.1080/17449057.2014.991152
  • Gheorghe, N. (2013). Choices to be made and prices to be paid: Potential roles and consequences in Roma activism and policy-making. In W. Guy (Ed.), From victimhood to citizenship – The path of Roma integration (pp. 79–91). Budapest: Kossuth Press/CEU Press.
  • Glenny, M. (1993). The fall of Yugoslavia: The third Balkan War. New York, NY: Penguin.
  • Goffman, E. (1974). Frame analysis. Cambridge: Havard University Press.
  • Gordon, D., & Durst, D. (2004). Civil society in southeast Europe. Amsterdam: Editions Rodopi B.V.
  • Government of Bosnia & Herzegovina. (2014). National report submitted in accordance with paragraph 5 of the annex to human rights council resolution 16/21 (Human Rights Council Working Group on the Universal Periodic Review, Twentieth session). A/HRC/WG.6/20/BIH/1. Sarajevo, NY: OHCHR.
  • Government of Montenegro. (2013). National report submitted in accordance with paragraph 5 of the annex to human rights council resolution 16/21 (Human Rights Council Working Group on the Universal Periodic Review, Twentieth session). A/HRC/WG.6/15/MNE/1. NY: OHCHR.
  • Government of Serbia. (2013). National report submitted in accordance with paragraph 5 of the annex to human rights council resolution 16/21 (Human Rights Council Working Group on the Universal Periodic Review, Twentieth session). Belgrade: Government of Serbia. A/HRC/WG.6/15/SRB/1. NY: OHCHR.
  • Government of Slovenia. (2014). National report submitted in accordance with paragraph 5 of the annex to human rights council resolution 16/21 (Human Rights Council Working Group on the Universal Periodic Review, Twentieth session). A/HRC/WG.6/20/SVN/1. Belgrade, NY: OHCHR.
  • Hajer, M. (2003). Policy without polity? Policy analysis and the institutional void. Policy Sciences, 36(1), 175–195. doi: 10.1023/A:1024834510939
  • Hannes, K., & Macaitis, K. (2012). A move to more systematic and transparent approaches in qualitative evidence synthesis: Update on a review of published papers. Qualitative Research, 12(4), 402–442. doi: 10.1177/1468794111432992
  • Heath, R., & Palenchar, M. (1997). Strategic issues management: Organizations and public policy challenges. Thousand Oaks, CA: Sage.
  • Hogwood, B., & Gunn, L. (1984). Policy analysis for the real world. Oxford: Oxford University Press.
  • Human Rights Watch Bosnia and Herzegovina. (2014). Parallel report to the human rights council, universal periodic review. Sarajevo: Author.
  • Human Rights Watch Croatia. (2013). Parallel report to the human rights council, universal periodic review. Zagreb: Author.
  • Imre, A. (2009). Identity games: Globalization and the transformation of media cultures in the new Europe. Cambridge: MIT Press.
  • Institute of the Association for Transitional Researches and National Education; Institute of the Association for Transitional Researches and National Education – STINA; Roma National Council; and Centre for Peace, Legal Advice and Psychosocial Assistance. (2014). Parallel report to the human rights council, universal periodic review. Zagreb.
  • Joffe, D., & Yardley, H. (2003). Content and thematic analysis. In D. Marks, & H. Yardley (Eds.), Research methods for clinical and health psychology (pp. 86–98). London: Sage.
  • Jugović, I., & Doolan, K. (2013). Is there anything specific about early school leaving in southeast Europe? A review of research and policy. European Journal of Education, 48(3), 363–377. doi: 10.1111/ejed.12041
  • Jungić, Ž., Palić, T., Halitović, S., & Sivić, L. (2014). The condition of the Roma population in Bosnia and Herzegovina. Chapter 4. In A. Rosenbloom, C. Parkes, & M. Gudic (Eds.), Socially responsible organizations and the challenge of poverty (Vol. 1, pp. 153–159). Sheffield: Greenleaf.
  • Klijn, E., & Skelcher, C. (2008). Democracy and governance networks: Compatible or not? Four conjectures and their implications for theory and practice. Public Administration, 85(3), 587–608. doi: 10.1111/j.1467-9299.2007.00662.x
  • Kóczé, A. (2012). Civil society, civil involvement and social inclusion of the Roma. In A. Ivanov & J. Kling (eds.), Roma inclusion working papers. Bratislava: United Nations Development Programme. Retrieved July 9, 2016, from http://www.eurasia.undp.org/content/dam/rbec/docs/Civil-society-civil-involvement-and-social-inclusion-of-the-Roma.pdf
  • Kóczé, A., & Rövid, M. (2012). Pro-Roma global civil society: Acting for, with or instead of Roma? Chapter 7. In M. Kaldor, H. L. Moore, & S. Selchow (Eds.), Global civil society 2012: Ten years of critical reflection (pp. 110–122). Basingstoke: Palgrave Macmillan.
  • Kostadinova, G. (2011). Minority rights as a normative framework for addressing the situation of Roma in Europe. Oxford Development Studies, 39(2), 163–183. doi: 10.1080/13600818.2011.570864
  • Križan, M. (1989). Of “civil society” and socialism in Yugoslavia. Studies in Soviet Thought, 37(4), 287–306. doi: 10.1007/BF01044468
  • Kukla, A. (2000). Social constructivism and the philosophy of science. London: Routledge.
  • Latham, J. (1999). Roma of the former Yugoslavia. Nationalities Papers, 27(2), 205–226. doi: 10.1080/009059999109037
  • Lowi, T. (1970). Decision making vs. policy making: Toward an antidote for technocracy. Public Administration Review, 30(3), 314–325. doi: 10.2307/974053
  • Machel, G. (2001). The impact of war on children. London: Hurst & Company.
  • Macura-Milovanović, S., Munda, M., & Peček, M. (2013). Roma pupils’ identification with school in Slovenia and Serbia: Case studies. Educational Studies, 39(5), 483–502. doi: 10.1080/03055698.2013.801768
  • Marin Thornton, G. (2014). The outsiders: Power differentials between Roma and non-Roma in Europe. Perspectives on European Politics and Society, 15(1), 106–119. doi: 10.1080/15705854.2013.873260
  • May, S. (2012). Language and minority rights ethnicity, nationalism and the politics of language. Abingdon: Routledge.
  • McCrudden, C. (1982). Institutional discrimination. Oxford Journal of Legal Studies, 2(3), 303–367. doi: 10.1093/ojls/2.3.303
  • McGarry, A., & Agarin, T. (2014). Unpacking the Roma participation puzzle: Presence, voice and influence. Journal of Ethnic and Migration Studies, 40(12), 1972–1990. doi: 10.1080/1369183X.2014.897599
  • Meyer, J., & Rowan, B. (1991). Institutionalized organisations: Formal structure as myth & ceremony. Chapter 4. In W. Powell, & P. DiMaggio (Eds.), The new institutionalism in organisational analysis (pp. 212–243). Chicago, IL: University of Chicago Press.
  • Micher, S. (2006). Poverty and the determinants of welfare for Roma and other vulnerable groups in south-eastern Europe. Comparative Economic Studies, 48(1), 20–35. doi: 10.1057/palgrave.ces.8100148
  • Montenegro Informal Coalition of non-governmental organizations for Children Rights. (2014). Parallel report to the human rights council, universal periodic review. Podgorica: Author.
  • Moore, L. (2001). Legitimation issues in the state-nonprofit relationship. Nonprofit and Voluntary Sector Quarterly, 30(1), 707–719. doi: 10.1177/0899764001304005
  • Nelson, T., & Oxleya, Z. (1999). Issue framing effects on belief importance and opinion. The Journal of Politics, 61(4), 1040–1067. doi: 10.2307/2647553
  • Nordberg, C. (2005). Integrating a traditional minority into a Nordic society: Elite discourse on Finnish roma. Social Work & Society, 3(2), 158–173.
  • Office of the High Commissioner for Human Rights. (2011). Information note for NHRIs regarding the Universal Periodic Review Mechanism. Retrieved August 12, 2015, from http://www.ohchr.org/EN/HRBodies/UPR/Pages/NoteNHRIS.aspx
  • O’Higgins, N. (2010). It’s not that I’m a racist, it’s that they are Roma: Roma discrimination and returns to education in south Eastern Europe. International Journal of Manpower, 31(2), 163–187. doi: 10.1108/01437721011042250
  • Papadopoulos, Y., & Warin, P. (2007). Are innovative, participatory and deliberative procedures in policy making democratic and effective? European Journal of Political Research, 46(1), 445–472. doi: 10.1111/j.1475-6765.2007.00696.x
  • Petr, K. (2004). Information needs of the Romany minority in eastern Croatia: Pilot-study. New Library World, 105(9-10), 357–369. doi: 10.1108/03074800410557312
  • Posavec, K., & Hrvatic, N. (2000). Intercultural education and Roma in Croatia. Intercultural Education, 11(1), 93–105. doi: 10.1080/14675980050005424
  • Poucki, B., & Bryan, N. (2014). Vulnerability to human trafficking among the Roma population in Serbia: The role of social exclusion and marginalization. Journal of Intercultural Studies, 35(2), 145–162. doi: 10.1080/07256868.2014.885417
  • Price, J., & Shildrick, M. (1999). Feminist theory and the body: A reader. London: Routledge.
  • Rawls, J. (2003). The domain of the political and overlapping consensus. In D. Matravers, & J. Pike (Eds.), Debates in contemporary political philosophy (pp. 142–168). London: Routledge.
  • Ringold, D., Orenstein, M., & Wilkens, E. (2005). Roma in an expanding Europe: Breaking the poverty cycle. Washington, DC: The World Bank.
  • Roma Organization for Multicultural Affirmation S.O.S., Association of Education Workers and Protection of the Rights of Women and Children ‘LIL’& Centre for Regional Policy Research and Cooperation ‘Studiorum’. (2014). Parallel report to the human rights council, universal periodic review. Skopje: Author.
  • Sandana, J. (2012). The coding manual for qualitative researchers. Thousand Oaks, CA: Sage.
  • Sardelić, J. (2013). Roma Minorities on the Margins of Post-Yugoslav Citizenship Regimes, The Europeanisation of Citizenship in the Successor States of the Former Yugoslavia (CITSEE). University of Edinburgh, School of Law, Working Paper 2013/31.
  • Sardelić, J. (2015). Roma minorities and uneven citizenship access in the post-Yugoslav space. Ethnopolitics, 14(2), 159–179. doi: 10.1080/17449057.2014.991154
  • Sasse, G. (2008). The politics of EU conditionality: The norm of minority protection during and beyond EU accession. Journal of European Public Policy, 15(6), 842–860. doi: 10.1080/13501760802196580
  • Schnellbach, C. (2012). The role of NGOs in promoting minority rights in the enlarged European Union. Perspectives on European Politics and Society, 13(4), 497–512. doi: 10.1080/15705854.2012.731937
  • Simeunović Bajić, N. (2011). Roma in Serbia after the collapse of Yugoslavia: Political implications and media silence on racial violence. European Journal of Interdisciplinary Studies, 3(2), 87–93.
  • Snow, D., Rochford, E., Worden, S., & Benford, R. (1986). Frame alignment processes, micromobilization, and movement participation. American Sociological Review, 51(4), 464–481. doi: 10.2307/2095581
  • Stambolieva, M. (2015). Welfare state change and social citizenship in the post-Yugoslav states. European Politics and Society, 16(3), 379–394. doi: 10.1080/23745118.2015.1061775
  • Stauber, R., & Vago, R. (2013). The Roma: A minority in Europe: Historical, political and social perspectives. Budapest: Central European University Press.
  • Sterland, B. (2006). Civil society capacity building in post-conflict societies: The experience of Bosnia and Herzegovina and Kosovo. Oxford: INTRAC.
  • Sunčica, M., & Mojca, P. (2013). Attitudes of Serbian and Slovenian student teachers towards causes of learning underachievement amongst Roma pupils. International Journal of Inclusive Education, 17(6), 629–645. doi: 10.1080/13603116.2012.703247
  • Trajkovski, H. (1999). Macedonia – Civil society in transition. New York: UNDP.
  • Trehan, N. (2001). In the name of the Roma? The role of private foundations and NGOs. In W. Guy (Ed.), Between past and future: The Roma of central and Eastern Europe (pp. 134–149). Hatfield: University of Hertfordshire Press.
  • Trehan, N. (2010). The Roma subaltern within neoliberal European civil society: NGOization of human rights and silent voices, Chapter 3. In N. Trehan, & N. Sigona (Eds.), Roma politics in contemporary Europe: Poverty, ethnic mobilization, and the neo-liberal order (pp. 51–71). Houndmills: Palgrave Macmillan.
  • Tremlett, A. (2014). Making a difference without creating a difference: Super-diversity as a new direction for research on Roma minorities. Ethnicities, 14(6), 830–848. doi: 10.1177/1468796814542183
  • Tremlett, A., & McGarry, A. (2013). Challenges facing researchers on Roma Minorities in contemporary Europe: Notes towards a Research Program, ECMI Working Paper #62, European Centre for Minority Issues, Flensburg.
  • Trubek, D., & Trubek, L. (2005). Hard and soft social Europe: The role of the open method of Co-ordination. European Law Journal, 11(3), 343–364. doi: 10.1111/j.1468-0386.2005.00263.x
  • United Nations Children’s Fund. (2012). Child poverty in Montenegro report. Belgrade: Author.
  • Urh, S. (2008). The development of an ethnically sensitive approach in social work in Slovenia. European Journal of Social Work, 11(2), 117–129. doi: 10.1080/13691450701532016
  • Van Dijk, T. A. (2001). Critical discourse analysis, Chapter 18. In D. Tannen, D. Schiffrin, & H. Hamilton (Eds.), Handbook of discourse analysis (pp. 18–59). Oxford: Blackwell.
  • Vladisavljev, N., & Kiers, J. (2004). Roma access to employment, Serbia and Montenegro. Belgrade: Council of Europe.
  • Wasserman, J., Clair, M., & Wilson, K. (2009). Problematics of grounded theory: Innovations for developing an increasingly rigorous qualitative method. Qualitative Research, 9(3), 355–381. doi: 10.1177/1468794109106605
  • Weible, C., & Sabatier, P. (2009). Coalitions, science, and belief change: Comparing adversarial and collaborative policy subsystems. Policy Studies Journal, 37(2), 195–212. doi: 10.1111/j.1541-0072.2009.00310.x
  • Woodcock, S. (2010). Gender as catalyst for violence against Roma in contemporary Italy. Patterns of Prejudice, 44(5), 469–488. doi: 10.1080/0031322X.2010.527444
  • Yanow, D. (1999). Conducting interpretive policy analysis. Thousand Oaks, CA: Sage.