Interrater agreement in judgments of listening competency: An item‐based analysis of the organizational listening survey

This research provides two independent examinations of interrater agreement between multiple individual's ratings of a co‐workers listening competency. Sample 1 was drawn from a corporate population (i.e., members of a large petroleum refining corporation); Sample 2 was drawn from staff members at a small liberal arts college. In both samples, the Organizational Listening Survey (Cooper & Husband, 1993) was used to assess the listening competency of the worker's immediate supervisor. Agreement among these ratings were analyzed and compared using the r_wg index (James, Demaree & Wolf, 1993). The results showed strong overall levels of agreement among multiple raters of listening competency skills as well as differences in agreement between the corporate and college samples.