6,416
Views
1
CrossRef citations to date
0
Altmetric
Review Article

The effects of the leader–member exchange relationship on rater accountability: A conceptual approach

ORCID Icon | (Reviewing Editor)
Article: 1400416 | Received 26 Jul 2017, Accepted 27 Oct 2017, Published online: 15 Nov 2017

Abstract

In contemporary organizational psychology research, the effect of the leader–membership exchange (LMX) relationship on rater accountability has received little attention. The current study seeks to fill this gap in the literature by explaining how the quality of the LMX relationship between the rater and the audience of appraisal affects rater accountability. Moreover, this paper examines how the upward strategies of both the rater and the ratee influence LMX relationships in the appraisal context. Employee resistance in performance appraisal is assumed to moderate the relationship between LMX and rater accountability. A conceptual model depicting the relationship between upward influence tactics, LMX relationship quality, rater accountability and performance rating is presented.

Public Interest Statement

In organizational psychology research, the dyadic relationship between a leader and followers in an organization is called the leader–membership exchange (LMX) relationship. The LMX can be divided into high- and low-quality relationships. Followers are incentivized to engage in high-quality LMX relationships with their supervisor because the members of this relationship enjoy positive features such as trust, liking and a favourable position towards each other. The LMX can influence supervisors’ evaluation of subordinates to assign performance ratings. Specifically, LMX can affect the rater accountability of supervisors because raters tend to evaluate ratees who are engaged in high-quality LMX relationships with them. Therefore, the subordinates, as ratees, attempt to construct high-quality relationships by exercising upward influence tactics such as ingratiation and self-promotion. The current study examines the relationship between ratees’ upward influence behaviours, the LMX relationship and rater accountability.

Competing Interests

The authors declare no competing interest.

1. Introduction

A popular topic in contemporary organizational psychology research includes the felt accountability of performance raters. In general, accountability “involves an actor or agent in a social context who potentially is subject to observation and evaluation by some audience(s), including one’s self” (Frink & Klimoski, Citation2004, p. 3; Hall et al., Citation2003). Thus far, the main interest of accountability research has been to examine the role perceived accountability plays in determining individual behaviour and performance (Mero, Guidice, & Werner, Citation2014). In the performance appraisal context, in which felt accountability is regarded as rater accountability, the accountability of raters to the audiences (e.g. ratee, rater’s supervisor) in the performance appraisal process affects the accuracy of the appraisal (Park, Citation2016).

Ample evidence in the literature shows that raters who feel more accountable tend to comply with the audience’s view in making appraisal decisions by either following the audience’s view or preparing to justify the accuracy of the performance rating to the audience (Mero & Motowidlo, Citation1995; Mero, Motowidlo, & Anna, Citation2003). As a result, although studies on the relationship between rater accountability and performance appraisal have flourished, research on the antecedents of rater accountability have received relatively little attention. Only a few scholars, such as Mero et al. (Citation2014), have conducted studies on the antecedents of perceived accountability, including managerial monitoring behaviour. For that reason, in the rater accountability literature, there is no specific stream of research that addresses the antecedents of rater accountability because the literature assumes that accountability is formed as a reaction to the view of the audience. This assumption fails to consider the possibility of the quality of the relationship between the rater and the audiences of appraisal. Although raters may respond to the view of the audience, their level of perceived accountability may vary depending on the level of quality (e.g. high or low) of the relationship with each audience.

The current study seeks to fill this gap in the literature by proposing the quality of relationship between the rater and audiences as the antecedent of rater accountability. The audience of the appraisal process is defined as the ratee and rater’s supervisor. The rater’s supervisor is one type of audience because the supervisor is ultimately responsible for the appraisal decisions made by the rater. Other parties such as colleagues are excluded, as they do not have a direct interest in the appraisal process and are not allowed to attain information about the ratee’s appraisal results and ratings.

The current study is conducted in the following order. First, the current study provides a brief literature review of rater accountability and leader–member exchange (LMX) theory. Next, it presents a conceptual model representing the relationship between the LMX relationship and rater accountability. In this process, it also illustrates how the upward tactics of both the rater and the ratee influence LMX relationships in the appraisal context. Lastly, theoretical contributions and organizational implications are suggested.

2. Rater accountability

Rater accountability is a construct that depicts felt accountability in the performance appraisal context. Past organizational psychology research has defined felt accountability as “an implicit or explicit expectation that one’s decisions or actions will be subject to evaluation by some salient audience(s) (including oneself), with the belief that there exists the potential for either rewards or sanctions based on this expected evaluation” (Frink & Klimoski, Citation2004; Hall et al., Citation2006, p. 88; Tetlock, Citation1985, Citation1992). Therefore, contemporary organizational accountability research (Breaux, Munyon, Hochwarter, & Ferris, Citation2009; Frink & Klimoski, Citation2004; Mero, Guidice, & Brownlee, Citation2007) has shown that the felt accountability of employees is rooted in the expectations of the audiences to whom the individuals are potentially held accountable. The audiences and the employees held accountable form a social system that sets shared expectations between the audiences and accountable employees (Frink & Klimoski, Citation1998; Tetlock, Citation1985, Citation1992). These shared expectations are crucial for maintaining the social system; thus, organizations establish formal mechanisms, such as a formal supervision relationship, performance appraisal, and a financial incentive system, to manage employee accountability (Frink & Klimoski, Citation2004).

Rater accountability is similar to the definitions and concepts of felt accountability, but its application is limited to the performance appraisal context. Levy and Williams (Citation2004, p. 887) define rater accountability as “the extent to which a rater is held answerable to someone else for his or her ratings of another employee.” Raters prepare for the potential possibility of being held accountable for the ratings and tend to make appraisal decisions that are most acceptable to the audiences, including the rater’s subordinate (ratee) and supervisor (Klimoski & Inks, Citation1990; Park, Citation2014). The rater’s response in the appraisal process differs depending on the audience to which they may be held accountable. The ratee is the audience with the highest interest in the performance appraisal outcome. Raters, as supervisors, have the duty to provide annual or other periodic feedback to the ratees regarding their performance appraisal results. In the feedback process, whether the feedback takes the form of a face-to-face discussion or a written document, justification or rationale for the performance rating is required. Consequently, without exception, raters tend to feel accountable to ratees. Research indicates that raters are motivated to adjust the performance ratings of poor performers when raters must confront poor performers about their low performance (Klimoski & Inks, Citation1990; Levy & Williams, Citation2004; Shore & Tashchian, Citation2002). Therefore, if ratees are the audience, facing the possibility of being held accountable by the ratee results in raters providing more positive ratings to reduce the chances of having to justify their appraisal to the ratees and to increase the acceptance of the rating by the ratee (Katz & Kahn, Citation1978; Mero et al., Citation2007; Murphy & Cleveland, Citation1995; Park, Citation2016).

If the rater’s supervisor is the audience, raters provide more accurate ratings when they know their supervisors prefer accurate ratings and more positive ratings when the supervisors express favourability for higher ratings (Mero & Motowidlo, Citation1995; Mero et al., Citation2007). However, some scholars contend that even though raters’ supervisors are ultimately responsible for the final ratings assigned by the raters, the supervisors rarely object to or disagree with the ratings (Bernardin & Villanova, Citation1986; Harris, Citation1994).

Despite the abundant work on the audiences of appraisal, the majority of extant research has conducted experimental studies using student populations (non-working samples) to observe rater behaviour (Park, Citation2016). For that reason, the effect of the task environment in the appraisal context has been neglected because students have been instructed to respond to a simulated setting in which they were asked to justify their decisions to others (Mero et al., Citation2014). In those simulated settings, participants who perform the role of raters do not share work relationships with the ratees as they have never actually worked together. In practice, the performance rater is likely to form unique relationships with each member of the audience, and this relationship can affect the task environment represented by the performance appraisal process. Furthermore, past research has not yet considered the relationship between audiences as a determinant of rater accountability. Few scholars, such as Harris (Citation1994), have noted that the rater’s supervisor may have a particular position (e.g. positive or negative) about the ratee that may decrease accuracy, but these studies have not advanced to discuss the relationship between the rater’s supervisor and the ratee.

In sum, until now, rater accountability research has not addressed the influence of the relationship between the rater and audiences with regard to accountability. From the above discussion, the current study draws on the basic premises for rater accountability before presenting the conceptual model. First, rater accountability is a mediator between relationships with the audience and the performance rating. For audiences (the ratee and the rater’s supervisor) to hold the rater accountable, the actual result of the performance rating is required for the audience to judge the accuracy and for the raters to justify their rating decision. Second, both good and poor performers are defined as audiences because all employees receive performance ratings from their supervisor and may request justification for their ratings. Lastly, accountable raters may intend to please the audiences rather than merely attempting to be as objective as possible in performance appraisals.

The current study seeks to expand the rater accountability literature by introducing the LMX theory to propose that the quality of the relationships among the rater, the ratee, and the rater’s supervisor may affect rater accountability.

3. The leader–member exchange theory (LMX) of leadership

The basic premise of the LMX theory is that the relationship between the supervisor and the subordinate is dyadic and that each supervisor–subordinate dyadic exchange relationship is unique (Elicker, Levy, & Hall, Citation2006; Graen & Uhl-Bien, Citation1995). Supervisors construct unique relationships with each subordinate by differentiating their interactions with each subordinate (Dulebohn, Bommer, Liden, Brouer, & Ferris, Citation2011). The unique exchange relationship between the supervisor and the subordinate varies depending on the relationship quality and can be divided into two categories of relationship groups: high-quality and low-quality LMX relationships (Graen & Cashman, Citation1975; Graen, Novak, & Sommerkamp, Citation1982). According to the social network perspective on LMX, high-quality LMX relationships represent “commitment to one another, a willingness to support one another, and confidence in the other’s loyalty” (Goodwin, Bowler, & Whittington, Citation2009, p. 957). Supervisors and subordinates in low-quality LMX relationships tend to have fewer positive features of the high-quality LMX relationship. The supervisor and subordinate who share a high-quality LMX relationship experience “mutual trust, liking, loyalty, professional respect, and reciprocal behaviours that benefit their supervisor” (Rosen, Harris, & Kacmar, Citation2011, p. 822). Subordinates in the high-quality LMX group have more positive interactions with their supervisors (leaders) and receive more attention, information and resources than do low-quality LMX members (Elicker et al., Citation2006; Graen et al., Citation1982). For this reason, low-quality LMX members tend to experience more negative consequences and interactions than do high-quality LMX members (Rosen et al., Citation2011).

One topic that has gained increasing interest in the current LMX literature is how LMX relationship quality affects the performance appraisal process between rater and ratee pairs across all levels of the organization. Elicker et al. (Citation2006, pp. 533–534) proposed several focal points regarding the comparison between high- and low-quality LMX relationships in the appraisal context. First, ratees in high-quality LMX relationships participate in performance appraisal sessions with a high level of trust and a positive attitude due to receiving more work-related resources and attention from their supervisor (Liden, Wayne, & Stilwell, Citation1993). Second, high-quality LMX relationship ratees have more voice, which means “the opportunity to present one’s point of view,” in the appraisal process and can influence the final appraisal decision using that voice. Lastly, high-quality LMX ratees possess more relevant information about the performance appraisal session based on frequent prior communication with the supervisor and can receive better treatment in the appraisal process.

Based on the discussion above and accepting the existence of high- and low-quality LMX relationships, the current study focuses on the determinants of the quality of LMX relationships. Specifically, upward influence behaviour, a type of employee political skill that is well known as an antecedent of LMX, is used in the performance appraisal context (Dulebohn et al., Citation2011). Political skill in organizations is often defined as “the ability to effectively understand others at work and to use such knowledge to influence others to act in ways that enhance one’s personal and/or organizational objectives” (Ferris et al., Citation2007, p. 291). Ferris et al. (Citation2007, p. 306) proposed an interpersonal process approach to conceptualize the effect of political skill on others at work. They suggested the concept of upward appeal, which “involves obtaining the support of individuals higher up in the organization hierarchy.” Similarly, LMX research views such upward appeal as “upward influence behaviour,” which illustrates the purposeful behaviour of followers to make leaders form positive perceptions of them and to enhance the quality of LMX relationships (Dienesch & Liden, Citation1986; Dulebohn et al., Citation2011, p. 10; Lord, Citation1985; Schriesheim, Castro, & Yammarino, Citation2000).

To conduct influence behaviour, one must use interpersonal influence tactics to effectively exert influence on persons with authority. The categorization of influence tactics began with the work of Kipnis, Schmidt, and Wilkinson (Citation1980), which included eight influence tactics. This categorization was refined by Kipnis and Schmidt (Citation1988) to six tactics (Higgins, Judge, & Ferris, Citation2003). According to Higgins et al. (Citation2003, p. 91), these tactics include the following:

(1) assertiveness: using a forceful manner to get what one wants, (2) ingratiation: using behaviours designed to increase the target’s liking of oneself or to make oneself appear friendly in order to get what one wants, (3) rationality: using data and information to make a logical argument supporting one’ request, (4) exchange: making an explicit offer to do something for another in exchange for their doing what one wants, (5) upward appeals: relying on the chain of command, calling in superiors to help get one’s way, (6) coalitions: mobilizing others to help in persuading the target individual.

The early work on influence tactics has been revised for application to the upward influence behaviour context by Dulebohn et al. (Citation2011, p. 10). These authors offer three upward influence tactics: (1) ingratiation: efforts to attain liking through increasing friendliness; (2) self-promotion: efforts to be regarded as competent by emphasizing one’s accomplishments; and (3) assertiveness: aggressive and persistent efforts in making requests to attain what one wants. More specifically, Yukl and Falbe (Citation1990) define ingratiation tactics as the attempt of an individual to put others in a good mood or to produce a favourable perception towards the individual before asking others to do something. If these influence tactics are successful, the result is that leaders’ perception of followers becomes more positive, and supervisors, whether consciously or subconsciously, remember the ratee’s proactive behaviours and use this information to evaluate subordinates’ behaviours, such as task performance (Dulebohn et al., Citation2011, p. 10; Lam, Huang, & Snape, Citation2007; Liden & Mitchell, Citation1988).

Building on the early work on LMX (Graen & Cashman, Citation1975; Graen et al., Citation1982), the social network view of LMX, and the upward influence tactics theory (Dulebohn et al., Citation2011), the current study assumes that high-quality LMX ratees have a greater possibility of receiving more favourable performance appraisals than do low-quality LMX ratees. The rationale is that more interaction and liking and higher reciprocal dependency between the high-quality LMX rater and the ratee will make the rater feel more accountable and favourable to the high-quality LMX ratee.

Based on the discussion of rater accountability and LMX theory in the previous sections, the current study proposes a conceptual model and propositions that depicts the relationship between LMX relationships and rater accountability.

4. The conceptual model

The conceptual model of the current study is composed of four relationships. First is the relationship between upward influence behaviour and LMX relationships. Rater–ratee, rater’s supervisor–ratee and rater’s supervisor–rater LMX relationships are discussed because the audiences of the appraisal process are the ratees and the rater’s supervisor. Second, after the LMX relationships are formed, they affect rater accountability. High-quality LMX is assumed to positively affect rater accountability, whereas low-quality LMX is considered to have a weaker or no effect on rater accountability. Third is the relationship between rater accountability and performance rating. The final rating is assumed to directly reflect the level of rater accountability. Last, the performance rating generates feedback to the rater, ratee and rater’s supervisor in assessing their LMX relationship quality. Figure presents the comprehensive model of the current study.

Figure 1. Effect of upward influence behaviour and leader–member exchange relationships on rater accountability.

Figure 1. Effect of upward influence behaviour and leader–member exchange relationships on rater accountability.

4.1. Upward influence tactics and the quality of LMX relationships

In the conceptual model of the current study, Dulebohn et al.’s (Citation2011) three types of upward influence tactics are used to explain the effect of the upward influence behaviour of raters and ratees on the quality of LMX relationships. The basic assumption is that both raters and ratees aim to attain high-quality LMX with their supervisor and that they will use upward influence tactics in the process. Although followers’ ingratiation and self-promotion tactics positively affect LMX relationships, assertive tactics by followers tend to form low-quality LMX relationships because assertive tactics make leaders feel uncomfortable and lose trust in the follower (Colella & Varma, Citation2001; Dulebohn et al., Citation2011; Krishnan, Citation2004; Lam et al., Citation2007). Therefore, the current study uses ingratiation and self-promotion tactics to explain the behaviour of raters and ratees. Despite almost no research investigating the influence of ingratiation and self-promotion tactics on LMX in the performance appraisal context, a recent meta-analysis by Dulebohn et al. (Citation2011) provides some empirical support. According to Dulebohn et al. (Citation2011), ingratiation tactics (21 studies, N = 3,749, supervisor and subordinate reported data combined) and self-promotion tactics (4 studies, N = 1,132) showed a positive relationship with LMX quality.

For that reason, the current study assumes that such relationship can be applied to the appraisal context.

Ratees form LMX relationships with the rater and the rater’s supervisor with the clear goal of attaining a positive appraisal, which can lead to higher performance ratings. Ratees attempt to attain the rater’s favour towards the ratee and emphasize their achievements during the period of performance evaluation. Ratees also invest effort in improving the relationship with the rater’s supervisor. As the rater’s supervisor is the person who eventually approves the rater’s evaluation of the ratee, ratees may want to form high-quality LMX relationships with the rater’s supervisor as well. Raters also form LMX relationships with their supervisor. Thus, raters follow the same pattern of subordinate-to-supervisor upward influence tactics. One key difference is that whereas ratees aim to receive positive ratings, raters care more about managing their work-unit performance because it composes a large portion of the rater’s performance review by the rater’s superior (Murphy & Cleveland, Citation1995).

Proposition 1: The ratee’s ingratiation tactics positively affect the quality of LMX relationships with the rater and the rater’s supervisor.

Proposition 2: The ratee’s self-promotion tactics positively affect the quality of LMX relationships with the rater and the rater’s supervisor

Proposition 3: The rater’s ingratiation tactics positively affect the quality of the LMX relationship with the rater’s supervisor.

Proposition 4: The rater’s self-promotion tactics positively affect the quality of the LMX relationship with the rater’s supervisor.

4.2. LMX relationships and rater accountability

The upward influence tactics performed by the rater and the ratee result in two types of outcomes: high-quality LMX relationships and low-quality LMX relationships. Raters and ratees who perform successful upward influence tactics construct high-quality LMX relationships, whereas less successful attempts are likely to result in low-quality LMX relationships. Although no empirical study has directly tested the relationship between LMX relationship and rater accountability, past findings indicate that LMX relationship does have a significant impact on the performance appraisal process. For example, Elicker et al. (Citation2006), using the survey data of 188 employees, found that the quality of the rater–ratee LMX relationship is positively associated with the opportunity to express the ratee’s view and provide relevant information to the rater during the appraisal session.

In the current study, the quality of the LMX relationship is expected to affect rater accountability on several occasions. First, ratees engaged in high-quality LMX relationships with the rater and the rater’s supervisor will receive more precise or favourable performance ratings than low-quality LMX ratees. Second, ratees in high-quality LMX relationships have advantages over low-quality LMX members in both the objective and subjective dimensions of performance appraisal. Ratees with high-quality LMX have more interactions with raters and rater’s supervisors and can attain more information about their objective achievements. Thus, if raters fail to recognize some portion of the ratee’s achievements, high-quality LMX ratees, in their frequent interactions with their rater, may fill in the gap of unrecognized objective achievements, whereas low-quality LMX members have lower chances of doing so. For the subjective dimension, supervisors and subordinates in high-quality LMX relationships share the emotion of liking and have mutual dependence on each other, which generates increased affect between them (Chi & Lo, Citation2003; Dulebohn et al., Citation2011; Ferris et al., Citation2009). Consequently, raters perceive higher rater accountability to high-quality LMX ratees than to low-quality LMX ratees.

Third, the effect of the rater and the rater’s supervisor LMX relationship on rater accountability also differs according to the relationship quality. In high-quality LMX relationships, the rater is likely to follow the preference of the supervisor. Based on frequent communication in the past and reciprocal liking, the rater’s motivation is to comply with the supervisor’s view of the appraisal. If the supervisor has a stake in the performance appraisal, such as affection for a specific ratee, the rater is likely to perceive accountability to assign a more positive rating. If the supervisor prefers an accurate appraisal, the rater is expected to conduct an accurate appraisal to prepare for possible justification of the rating. For low-quality LMX relationships, the rater and the rater’s supervisor are likely to have had little interaction, meaning that the rater may not be sure of the supervisor’s position towards the appraisal. In this case, the rater is likely to engage in “pre-emptive self-criticism” and to conduct accurate appraisals to prepare for audiences (supervisors) with unknown views (Lerner & Tetlock, Citation1999; Park, Citation2016). Drawing from the arguments above, raters in high-quality LMX relationships with their supervisors are expected to incorporate the supervisor’s interest in the performance appraisal more than in the case of low-quality LMX relationships.

The current study assumes that ratees’ resistance can moderate the relationship between LMX relationship quality and rater accountability. During the performance appraisal process, ratees may refuse to accept the rater’s negative evaluation of their performance. Tepper et al. (Citation2006) argues that ratees would either refuse to accept the performance evaluation or attempt to negotiate with the rater to receive a better evaluation. Past research has revealed that raters rated lower quality LMX ratees more strictly regardless of the form of resistance, whereas higher quality LMX ratees were rated more favourably if the ratees used negotiation for resistance (Tepper et al., Citation2006). Thus, LMX quality was assumed to moderate the relationship between ratee resistance and the rater’s performance evaluation. However, the current study proposes that employee resistance moderates the relationship between LMX quality and rater accountability because, based on the notion of rater accountability, the quality of the LMX relationship is a fixed condition prior to perceiving accountability, and employee resistance occurs between the appraisal session held with ratees already engaged in certain types of LMX relationships with the rater. Furthermore, employee resistance towards performance appraisal results can be interpreted as the opinion of the audiences of appraisal, which affects rater accountability.

Proposition 5: The rater and ratee LMX relationship quality positively affects rater accountability.

Proposition 6: The rater’s supervisor and the ratee’s LMX relationship quality positively affects rater accountability.

Proposition 7: The rater’s supervisor and the rater’s LMX relationship quality positively affects rater accountability.

Proposition 8: Ratee resistance will moderate the relationship between LMX relationship quality and rater accountability.

4.3. Performance rating and feedback

Performance rating is generated as the final outcome of the appraisal process. Ratings typically consist of a five-point scale of “outstanding,” “above average,” “average,” “below average” and “poor,” but they vary by the appraisal system in each organization. The performance rating generates feedback in the form of information provision to the ratee and the rater’s supervisor, and these audiences evaluate the rater’s justification for the result of performance appraisals based on the performance ratings. The performance rating provides information to the audiences of the appraisal about whether their LMX relationships with the rater are of high or low quality. If the ratee believes that the performance rating is acceptable and satisfactory, the ratee will acknowledge that the LMX relationship with the rater is high quality. In the case of the rater’s supervisor, depending on the supervisor’s preference (e.g. accurate rating or lenient rating), the perceived LMX relationship quality of the supervisor can change based on how satisfied the rater’s supervisor is with the rater’s decision to incorporate the supervisor’s preference. Raters are likely to evaluate the LMX relationship quality through their interaction with the audiences after the appraisal process and assess whether they met the expectations of the audience to maintain or enhance the quality of the LMX. In sum, the feedback produced by providing performance ratings reorganizes the LMX relationship quality between the rater and the audiences of appraisal and provides the basis for another round of the appraisal process that begins with the participants of the appraisal process investing effort to build high-quality relationships with their superiors.

5. Conclusion

This article has potential theoretical contributions for the organizational psychology research in several aspects. First, this paper provides a preliminary step in assessing the effects of LMX relationship quality on rater accountability in the performance appraisal context. Thus far, past research has merely assumed that each audience affects rater accountability without consider the relationship between the audiences. Second, until now, no research has considered the upward influence tactics of both the ratee and rater during the appraisal process. Contrary to the traditional approach of accounting for the supervisor–subordinate relationship in the appraisal process, the current study suggests three dyadic pairs (ratee–rater, ratee–rater’s supervisor rater–rater’s supervisor) of relationships for the first time in the literature. Lastly, the current study provides a new approach of identifying LMX relationship quality in appraisal using the performance rating. The idea is that the audiences of the appraisal process can evaluate their LMX relationship quality with the rater using the objective measure of the performance rating assigned to the ratees.

6. Implications for research and practice

The current study explores how upward influence tactics form LMX relationships in the appraisal context and describes how these relationships affect rater accountability. The current study offers several implications for future research and practice.

First, almost all organizations are aware that performance ratings are the most commonly used measure of employee performance and contribution to the organization (Rosen, Kacmar, Harris, Gavin, & Hochwarter, Citation2017). Based on the propositions of the current study, human resource managers and management may consider that supervisors who conduct performance appraisals face many factors, such as appraisal audiences, which deter them from making the most accurate appraisal. In this sense, future research may want to account for the existence of relationships among the audiences of appraisal. Simply framing accountability as a construct determined by various audiences that independently affect the rater neglects the possibility of the relationship dynamics among the audiences. Although the current study addressed only the ratee and the rater’s supervisor, more audiences, such as colleagues and human resource departments, can take part in the appraisal process. Second, studies related to conscious distortion in performance appraisal may include LMX relationship quality as a determinant of rating distortion because raters consciously favour ratees in high-quality LMX relationships. One of the most recent and extensive works in this stream of research was the work by Spence and Keeping (Citation2011), in which the authors presented politics and impression management as independent variables that affect rater bias in appraisal. Thus, including LMX theory as one of the determinants of rating bias and seeking solutions to mitigate those biases may be a topic of interest for the expansion of rating distortion studies.

Third, the current study can be a valuable addition to the rater motivation theory (RMT) literature (Harris, Citation1994; Murphy & Cleveland, Citation1995). In the RMT literature, the rater perceives the incentives and disincentives of making an appraisal and manipulates the accuracy of the appraisal to gain positive results (e.g. work-unit performance increase) and avoid negative consequences (e.g. dissatisfaction from delivering negative feedback) (Park, Citation2014). However, no rater motivation literature has directly acknowledged maintaining the quality of LMX relationships as an independent variable that can encourage raters to adjust ratings.

Fourth, the current study has implications for research in the rater training literature and practice. Contemporary rater training research can be represented by the frame-of-reference (FOR) training approach (Roch, Woehr, Mishra, & Kieszczynska, Citation2012). According to Roch et al. (Citation2012, p. 2), FOR training increases rating accuracy by “helping raters understand what behaviours constitute specific levels of performance on specific dimensions” and “establishing performance prototypes that allow raters to counteract normal information loss (i.e. forgetting) by categorizing ratee performance.” Nevertheless, FOR training does not provide information or standard procedures to prepare for ratees’ upward influence tactics presented in the current paper. Including such counteraction methods for these tactics in the FOR may enable raters to establish standards for performance and to prepare for ratees’ behaviours to influence the raters to provide higher ratings.

Fifth, research in performance management by employee engagement can benefit from the current study. In the contemporary literature on employee engagement performance management, employee engagement is stimulated by effective job design, coaching and social support, training, and trust and justice during performance appraisal (Gruman & Saks, Citation2011). In these approaches, LMX relationship quality is offered as a way for leaders to increase employee engagement. However, the possibility of followers using a high-quality LMX relationship to alter the appraisal outcome and advance their interest has not been addressed. Future research in employee engagement is encouraged to consider that employees may engage in performance management-related activities not only to improve organizational performance but also to fulfil their self-interest of attaining high ratings by forming high-quality LMX relationships with their superiors.

Lastly, organizations interested in improving appraisal accuracy may benefit from the conceptual model and propositions in the current study. Management and human resource managers should recognize that an employee’s performance rating is affected by interactions prior to the appraisal period because ratees constantly exercise upward influence tactics and attempt to build high-quality LMX relationships. Therefore, future research and organizations may consider developing more objective measures of performance appraisal that would result in similar appraisal results regardless of successful upward influence tactics and high-quality LMX relationships.

Despite the possible contributions and implications of the current study, it faces several limitations. Although the conceptual model of study is proposed for the first time in the literature, the model needs empirical testing to be validated. In future studies, research using survey data needs to be conducted to test the propositions. For that reason, the current study serves the purpose of offering a preliminary model.

Funding

The authors received no direct funding for this research.

Additional information

Notes on contributors

Seejeen Park

Seejeen Park is an assistant professor in the Department of Public Administration at Kwangwoon University, Seoul, Korea. He received his MPA from Syracuse University and his PhD from Florida State University. His research interests include human resource management, organization theory, and organizational psychology.

References

  • Bernardin, H. J., & Villanova, P. (1986). Performance appraisal. In E. A. Locke (Ed.), Generalizing from laboratory to field settings (pp. 43–62). Lexington, MA: Lexington Books.
  • Breaux, D. M., Munyon, T. P., Hochwarter, W. A., & Ferris, G. R. (2009). Politics as a moderator of the accountability – job satisfaction relationship: Evidence across three studies. Journal of Management, 35, 307–326. doi:10.1177/0149206308318621
  • Chi, S. C., & Lo, H. H. (2003). Taiwanese employees’ justice perceptions of co-workers’ punitive events. The Journal of Social Psychology, 143, 27–42.10.1080/00224540309598429
  • Colella, A., & Varma, A. (2001). The impact of subordinate disability on leader-member exchange relationships. Academy of Management Journal, 44, 304–315. doi:10.2307/3069457
  • Dienesch, R. M., & Liden, R. C. (1986). Leader-member exchange model of leadership: A critique and further development. Academy of Management Review, 11, 618–634. doi:10.5465/amr.1986.4306242
  • Dulebohn, J. H., Bommer, W. H., Liden, R. C., Brouer, R. L., & Ferris, G. R. (2011). A meta-analysis of antecedents and consequences of leader-member exchange: Integrating the past with an eye toward the future. Journal of Management, 38, 1715–1759. doi:10.1177/0149206311415280
  • Elicker, J. D., Levy, P. E., & Hall, R. J. (2006). The role of leader-member exchange in the performance appraisal process. Journal of Management, 32, 531–551. doi:10.1177/0149206306286622
  • Ferris, G. R., Liden, R. C., Munyon, T. P., Summers, J. K., Basik, K. J., & Buckley, M. R. (2009). Relationships at work: Toward a multidimensional conceptualization of dyadic work relationships. Journal of Management, 35, 1379–1403. doi:10.1177/0149206309344741
  • Ferris, G. R., Treadway, D. C., Perrewé, P. L., Brouer, R. L., Douglas, C., & Lux, S. (2007). Political skill in organizations. Journal of Management, 33, 290–320. doi:10.1177/0149206307300813
  • Frink, D. D., & Klimoski, R. J. (2004). Advancing accountability theory and practice: Introduction to the human resource management review special edition. Human Resource Management Review, 14(1), 1–17. doi:10.1016/j.hrmr.2004.02.001
  • Goodwin, V. L., Bowler, W. M., & Whittington, J. L. (2009). A social network perspective on LMX relationships: Accounting for the instrumental value of leader and follower networks. Journal of Management, 35, 954–980. doi:10.1177/0149206308321555
  • Graen, G. B., & Cashman, J. E. (1975). A role making model of leadership in formal organizations: A developmental approach. In J. G. Hunt & L. L. Larson (Eds.), Leadership frontiers (pp. 143–165). Kent, OH: Kent State University Press
  • Graen, G., Novak, M. A., & Sommerkamp, P. (1982). The effects of leader – member exchange and job design on productivity and satisfaction: Testing a dual attachment model. Organizational Behavior and Human Performance, 30(1), 109–131. doi:10.1016/0030-5073(82)90236-7
  • Graen, G. B., & Uhl-Bien, M. (1995). Relationship-based approach to leadership: Development of leader-member exchange (LMX) theory of leadership over 25 years: Applying a multi-level multi-domain perspective. The Leadership Quarterly, 6, 219–247. doi:10.1016/1048-9843(95)90036-5
  • Gruman, J. A., & Saks, A. M. (2011). Performance management and employee engagement. Human Resource Management Review, 21(2), 123–136. doi:10.1016/j.hrmr.2010.09.004
  • Hall, A., Frink, D., Ferris, G., Hochwarter, W., Kacmar, C., & Bowen, M. (2003). Accountability in human resources management. In C. Schriesheim & L. Neider (Eds.), New directions in human resource management (pp. 29–63). Greenwich, CT: Information Age Publishing.
  • Hall, A. T., Royle, M. T., Brymer, R. A., Perrewé, P. L., Ferris, G. R., & Hochwarter, W. A. (2006). Relationships between felt accountability as a stressor and strain reactions: The neutralizing role of autonomy across two studies. Journal of Occupational Health Psychology, 11(1), 87–99. doi:10.1037/1076-8998.11.1.87
  • Harris, M. (1994). Rater motivation in the performance appraisal context: A theoretical framework. Journal of Management, 20, 737–756. doi:10.1016/0149-2063(94)90028-0
  • Higgins, C. A., Judge, T. A., & Ferris, G. R. (2003). Influence tactics and work outcomes: A meta-analysis. Journal of Organizational Behavior, 24(1), 89–106. doi:10.1002/job.181
  • Katz, D., & Kahn, R. L. (1978). The social psychology of organizations (2nd ed.). New York, NY: John Wiley.
  • Kipnis, D., & Schmidt, S. M. (1988). Upward-influence styles: Relationship with performance evaluations, salary, and stress. Administrative Science Quarterly, 33, 528–542. doi:10.2307/2392642
  • Kipnis, D., Schmidt, S. M., & Wilkinson, I. (1980). Intraorganizational influence tactics: Explorations in getting one’s way. Journal of Applied Psychology, 65, 440–452. doi:10.1037/0021-9010.65.4.440
  • Klimoski, R., & Inks, L. (1990). Accountability forces in performance appraisal. Organizational Behavior and Human Decision Processes, 45(2), 194–208. doi:10.1016/0749-5978(90)90011-w
  • Krishnan, V. R. (2004). Impact of transformational leadership on followers’ influence strategies. Leadership & Organization Development Journal, 25(1), 58–72. doi:10.1108/01437730410512778
  • Lam, W., Huang, X., & Snape, E. (2007). Feedback-seeking behavior and leader-member exchange: Do supervisor-attributed motives matter? Academy of Management Journal, 50, 348–363. doi:10.5465/amj.2007.24634440
  • Lerner, J. S., & Tetlock, P. E. (1999). Accounting for the effects of accountability. Psychological Bulletin, 125, 255–275. doi:10.1037//0033-2909.125.2.255
  • Levy, P. E., & Williams, J. R. (2004). The social context of performance appraisal: A review and framework for the future. Journal of Management, 30, 881–905. doi:10.1016/j.jm.2004.06.005
  • Liden, R. C., & Mitchell, T. R. (1988). Ingratiatory behaviors in organizational settings. The Academy of Management Review, 13, 572–585. doi:10.2307/258376
  • Liden, R. C., Wayne, S. J., & Stilwell, D. (1993). A longitudinal study on the early development of leader member exchanges. Journal of Applied Psychology, 78, 662–674. doi:10.1037//0021-9010.78.4.662
  • Lord, R. G. (1985). An information processing approach to social perceptions, leadership and behavioral measurement in organizations. In L. L. Cummings & B. M. Staw (Eds.), Research in organizational behavior (Vol. 7, pp. 87–128). Greenwich, CT: JAI Press.
  • Mero, N. P., Guidice, R. M., & Brownlee, A. L. (2007). Accountability in a performance appraisal context: The effect of audience and form of accounting on rater response and behavior. Journal of Management, 33, 223–252. doi:10.1177/0149206306297633
  • Mero, N. P., Guidice, R. M., & Werner, S. (2014). A field study of the antecedents and performance consequences of perceived accountability. Journal of Management, 40, 1627–1652. doi:10.1177/0149206312441208
  • Mero, N. P., & Motowidlo, S. J. (1995). Effects of rater accountability on the accuracy and the favorability of performance ratings. Journal of Applied Psychology, 80, 517–524. doi:10.1037//0021-9010.80.4.517
  • Mero, N. P., Motowidlo, S. J., & Anna, A. L. (2003). Effects of accountability on rating behavior and rater accuracy. Journal of Applied Social Psychology, 33, 2493–2514. doi:10.1111/j.1559-1816.2003.tb02777.x
  • Murphy, K. R., & Cleveland, J. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Thousand Oaks, CA: SAGE Publications.
  • Park, S. (2014). Motivation of public managers as raters in performance appraisal. Public Personnel Management, 43, 387–414. doi:10.1177/0091026014530675
  • Park, S. (2016). Measuring accountability in the performance appraisal context: Rater status and organization culture as determinants of rater accountability. Current Psychology, Advance Online Publication. doi:10.1007/s12144-016-9499-y
  • Roch, S. G., Woehr, D. J., Mishra, V., & Kieszczynska, U. (2012). Rater training revisited: An updated meta-analytic review of frame-of-reference training. Journal of Occupational and Organizational Psychology, 85, 370–395. doi:10.1111/j.2044-8325.2011.02045.x
  • Rosen, C. C., Harris, K. J., & Kacmar, K. M. (2011). LMX, context perceptions, and performance: An uncertainty management perspective. Journal of Management, 37, 819–838. doi:10.1177/0149206310365727
  • Rosen, C. C., Kacmar, K. M., Harris, K. J., Gavin, M. B., & Hochwarter, W. A. (2017). Workplace politics and performance appraisal: A two-study, multilevel field investigation. Journal of Leadership & Organizational Studies, 24(1), 20–38. doi:10.1177/1548051816661480
  • Schriesheim, C. A., Castro, S. L., & Yammarino, F. J. (2000). Investigating contingencies: An examination of the impact of span of supervision and upward controllingness on leader-member exchange using traditional and multivariate within- and between-entities analysis. Journal of Applied Psychology, 85, 659–677. doi:10.1037//0021-9010.85.5.659
  • Shore, T. H., & Tashchian, A. (2002). Accountability forces in performance appraisal: Effects of self-appraisal information, normative information, and task performance. Journal of Business and Psychology, 17, 261–274. doi:10.1023/A:1019689616654
  • Spence, J. R., & Keeping, L. (2011). Conscious rating distortion in performance appraisal: A review, commentary, and proposed framework for research. Human Resource Management Review, 21(2), 85–95. doi:10.1016/j.hrmr.2010.09.013
  • Tepper, B. J., Uhl-Bien, M., Kohut, G. F., Rogelberg, S. G., Lockhart, D. E., & Ensley, M. D. (2006). Subordinates’ resistance and managers’ evaluations of subordinates' performance. Journal of Management, 32(2), 185–209. doi:10.1177/0149206305277801
  • Tetlock, P. E. (1985). Accountability: The neglected social context of judgment and choice. Greenwich, CT: JAI Press.
  • Tetlock, P. E. (1992). The impact of accountability on judgment and choice: Toward a social contingency model. New York, NY: Academic Press.
  • Frink, D. D., & Klimoski, R. J. (1998). Toward a theory of accountability in organizations and human resource management. In G. R. Ferris (Ed.), Research in personnel and human resources management (Vol. 16, pp. 1–51). Stamford, CT: JAI Press.
  • Yukl, G., & Falbe, C. M. (1990). Influence tactics and objectives in upward, downward, and lateral influence attempts. Journal of Applied Psychology, 75(2), 132–140. doi:10.1037/0021-9010.75.2.132