10
Views
10
CrossRef citations to date
0
Altmetric
Articles

The Construction of Rating Instruments for Faculty Evaluation

A Review of Methodological Issues

Pages 650-669 | Published online: 01 Nov 2016

References

  • Attneave, F. “A Method of Graded Dichotomies for the Scaling of Judgments.” Psychological Review, 56(1949), 334–40.
  • Bejar, I. I. “A Survey of Selected Administrative Practices Supporting Student Evaluation of Instruction Programs.” Research in Higher Education, 3(1975), 77–86.
  • Bendig, A. W. “A Factor Analysis of Student Ratings of Psychology Instructors on the Purdue Scale.” Journal of Educational Psychology, 45(1954), 385–93.
  • Bendig, A. W. “Reliability and the Number of Rating Scale Categories.” Journal of Applied Psychology, 38(1954), 38–40.
  • Berk, R. A. “Empirical Evaluation of Formulae for Correction of Item-Total Point-Biserial Correlations.” Educational and Psychological Measurement, 38(1978), 647–52.
  • Berk, R. A., and H. A. Griesemer. “ITEMAN: An Item Analysis Program for Tests, Questionnaires, and Scales.” Educational and Psychological Measurement, 36(1976), 189–91.
  • Bohrnstedt, G. W., and R. T. Campbell. “An Item Analysis Package for Likert Scales.” Educational and Psychological Measurement, 32(1972), 181–83.
  • Cattell, R. B. “The Meaning and Strategic Use of Factor Analysis.” In Handbook of Multivariate Experimental Psychology, edited by R. B. Cattell. Chicago: Rand-McNally, 1966.
  • Champney, H. “The Measurement of Parent Behavior.” Child Development, 12(1941), 131–66.
  • Conklin, E. S. “The Scale of Values Method for Studies in Genetic Psychology.” University of Oregon Publications, 2(1923).
  • Costin, F., W. T. Greenough, and R. J. Menges. “Student Ratings of College Teaching: Reliability, Validity, and Usefulness.” Review of Educational Research, 41(1971), 511–35.
  • Cronbach, L. J. “Coefficient Alpha and the Internal Structure of Tests.” Psychometrika, 16(1951), 297–334.
  • Cureton, E. E. “Corrected Item-Test Correlations.” Psychometrika, 31(1966), 93–96.
  • Deshpande, A. S., S. C. Webb, and E. Marks. “Student Perceptions of Engineering Instructor Behaviors and Their Relationships to the Evaluation of Instructors and Courses.” American Educational Research Journal, 7(1970), 289–305.
  • Doyle, K. O., Jr., and S. Wattawa. “Programs for the Construction and Analysis of Custom Questionnaires and Rating Scales.” Educational and Psychological Measurement, 37(1977), 237–39.
  • Dressel, P. L. “Evaluation of the Environment, the Process, and the Results of Higher Education.” In Handbook of College and University Administration, edited by A. Knowles. New York: McGraw-Hill, 1970.
  • Edwards, A. L. “The Scaling of Stimuli by the Method of Successive Intervals.” Journal of Applied Psychology, 36(1952), 118–22.
  • Edwards, A. L. Techniques of Attitude Scale Construction. New York: Appleton-Century-Crofts, 1957.
  • Edwards, A. L. The Measurement of Personality Traits by Scales and Inventories. New York: Holt, Rinehart and Winston, 1970.
  • Edwards, A. L., and L. L. Thurstone. “An Internal Consistency Check for Scale Values Determined by the Method of Successive Intervals.” Psychometrika, 17(1952), 169–80.
  • Ferguson, L. W. “A Study of the Likert Technique of Attitude Scale Construction.” Journal of Social Psychology, 13(1941), 51–57.
  • Finkbeiner, C. T., J. S. Lathrop, and J. M. Schuerger. “Course and Instructor Evaluation: Some Dimensions of a Questionnaire.” Journal of Educational Psychology, 64(1971), 159–63.
  • Finn, R. H. “Effects of Some Variations in Rating Scale Characteristics on the Means and Reliabilities of Ratings.” Educational and Psychological Measurement, 32(1972), 255–65.
  • Foa, U. G. “New Developments in Facet Design and Analysis.” Psychological Review, 72(1965), 262–74.
  • Foa, U. G. “Three Kinds of Behavioral Changes.” Psychological Bulletin, 70(1968), 460–73.
  • Frey, P., D. Leonard, and W. Beatty. “Student Ratings of Instruction: Validation Research.” American Educational Research Journal, 12(1975), 435–77.
  • Garner, W. R., and H. W. Hake. “The Amount of Information in Absolute Judgments.” Psychological Review, 58(1951), 445–59.
  • Guilford, J. P. “The Correlation of an Item with a Composite of the Remaining Items in a Test.” Educational and Psychological Measurement, 13(1953), 87–93.
  • Guilford, J. P. Psychometric Methods. New York: McGraw-Hill, 1954.
  • Guion, R. M. Personnel Testing. New York: McGraw-Hill, 1965.
  • Gustad, J. W. “Policies and Practices in Faculty Evaluation.” Educational Record, 42(1961), 194–211.
  • Guttman, L. “A Basis for Scaling Qualitative Data.” American Sociological Review, 9(1944), 139–50.
  • Guttman, L. “The Cornell Technique for Scale and Intensity Analysis.” Educational and Psychological Measurement, 7(1947), 247–80.
  • Guttman, L. “The Basis for Scalogram Analysis.” In Measurement and Prediction, edited by S. A. Stouffer et al., pp. 60–90. Princeton, N.J.: Princeton University Press, 1950.
  • Guttman, L. “Introduction to Facet Design and Analysis.” In Proceedings of the Fifteenth International Congress of Psychology, Brussels—1957, pp. 130–32. Amsterdam: North-Holland Publishing Co., 1959.
  • Guttman, L. “A Structural Theory for Intergroup Beliefs and Actions.” American Sociological Review, 24(1959), 318–28.
  • Guttman, L. “Measurement as Structural Theory.” Psychometrika, 36(1971), 329–47.
  • Harmon, H. H. Modern Factor Analysis (2nd ed.). Chicago: University of Chicago Press, 1967.
  • Isaacson, R. L., W. J. McKeachie, J. E. Milholland, Y. G. Lin, M. Hofeller, J. W. Baerwaldt, and K. L. Zinn. “Dimensions of Student Evaluations of Teaching.” Journal of Educational Psychology, 55(1964), 344–51.
  • Jordan, J. E. “Construction of a Guttman Facet Designed Cross-Cultural Attitude-Behavior Scale toward Mental Retardation.” American Journal of Mental Deficiency, 76(1971), 201–19.
  • Kaiser, H. F. “The Varimax Criterion for Analytic Rotation in Factor Analysis.” Psychometrika, 23(1958), 187–200.
  • Kaiser, H. F., S. Hunka, and J. C. Bianchini. “Relating Factors between Studies Based on Different Individuals.” Multivariate Behavioral Research, 6(1971), 409–14.
  • Kim, Y. C., J. E. Jordan, and H. Horn. “The Facet Theory Approach in Attitude-Behavior Research.” Journal of Educational Research, 11(1972), 26–36.
  • Kohr, R. L. “An Item Analysis and Scoring Program for Summated Rating Scales.” Educational and Psychological Measurement, 31(1971), 769–70.
  • Komorita, S. S. “Attitude Content, Intensity, and the Neutral Point on a Likert Scale.” Journal of Social Psychology, 61(1963), 327–34.
  • Komorita, S. S., and W. K. Graham. “Number of Scale Points and the Reliability of Scales.” Educational and Psychological Measurement, 4(1965), 987–95.
  • Likert, R. “A Technique for the Measurement of Attitudes.” Archives of Psychology, 140(1932).
  • Lissitz, R. W., and S. B. Green. “Effect of Number of Scale Points on Reliability: A Monte Carlo Approach.” Journal of Applied Psychology, 60(1975), 10–13.
  • Masters, J. R. “The Relationship between Number of Response Categories and Reliability of Likert-Type Questionnaires.” Journal of Educational Measurement, 11(1974), 49–53.
  • Matell, M. S., and J. Jacoby. “Is there an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity.” Educational and Psychological Measurement, 31(1971), 657–74.
  • McGee, R. K. “Response Style as a Personality Variable: By What Criterion?” Psychological Bulletin, 59(1962), 284–95.
  • Meredith, G. M. “Dimensions of Faculty-Course Evaluation.” Journal of Psychology, 73(1969), 27–32.
  • Miller, G. A. “The Magical Number Seven, Plus or Minus Two: Some Limits on our Capacity for Processing Information.” Psychological Review, 63(1956), 81–97.
  • Nunnally, J. C. Psychometric Theory. New York: McGraw-Hill, 1978.
  • Osgood, C. E., C. J. Suci, and P. H. Tannenbaum. The Measurement of Meaning. Urbana, Ill.: University of Illinois Press, 1957.
  • Payne, S. L. The Art of Asking Questions. Princeton, N.J.: Princeton University Press, 1951.
  • Peabody, D. “Two Components in Bipolar Scales: Direction and Extremeness.” Psychological Review, 69(1962), 65–73.
  • Rorer, L. G. “The Great Response-Style Myth.” Psychological Bulletin, 63(1965), 129–56.
  • Ryans, D. G. “Assessment of Teacher Behavior and Instruction.” Review of Educational Research, 33(1963), 415–41.
  • Saffir, M. A. “A Comparative Study of Scales Constructed by Three Psycho-Physical Methods.” Psychometrika, 2(1937), 179–98.
  • Schneewind, K. A., and R. B. Cattell. “Zum Problem der Faktoridentifikation: Verteilungen und Vertrauensintervalle von Kongruenz Koeffizienten für Persönlichkeitsfactoren im Bereich objektivanalytischer Tests.” Psychologische Beiträge (Sonderdruck), 12(1971), 214–26.
  • Schutz, H. G., and M. H. Rucker. “A Comparison of Variable Configurations across Scale Lengths: An Empirical Study.” Educational and Psychological Measurement, 35(1975), 319–24.
  • Selltiz, C., L. S. Wrightsman, and S. W. Cook. Research Methods in Social Relations (2nd ed.). New York: Holt, Rinehart and Winston, 1976.
  • Shaw, M. E., and J. M. Wright. Scales for the Measurement of Attitudes. New York: McGraw-Hill, 1967.
  • Shepard, R. N., A. K. Romney, and S. B. Nerlove, (eds.). Multidimensional Scaling: Theory and Applications in the Behavioral Sciences, Vol. I. New York: Seminar Press, 1972.
  • Solomon, D. “Teacher Behavior Dimensions, Course Characteristics, and Student Evaluations of Teachers.” American Educational Research Journal, 3(1966), 34–47.
  • Stephenson, W. The Study of Behavior. Chicago: University of Chicago Press, 1953.
  • Symonds, P. M. “On the Loss of Reliability in Ratings Due to Coarseness of the Scale.” Journal of Experimental Psychology, 7(1924), 456–61.
  • Tetenbaum, T. “The Factor Invariance of Student Ratings of Instruction under Three Sets of Directions.” Research in Higher Education, 6(1977), 11–23.
  • Thurstone, L. L. “A Law of Comparative Judgment.” Psychological Review, 34(1927), 273–86.
  • Thurstone, L. L. “The Method of Paired Comparisons for Social Values.” Journal of Abnormal and Social Psychology, 21(1927), 384–400.
  • Thurstone, L. L. “Theory of Attitude Measurement.” Psychological Review, 36(1929), 222–41.
  • Thurstone, L. L. “The Measurement of Social Attitudes.” Journal of Abnormal and Social Psychology, 26(1931), 249–69.
  • Thurstone, L. L., and E. J. Chave. The Measurement of Attitude. Chicago: University of Chicago Press, 1929.
  • Wang, K. A. “Suggested Criteria for Writing Attitude Statements.” Journal of Social Psychology, 3(1932), 367–73.
  • Warwick, D. P., and C. A. Lininger. The Sample Survey: Theory and Practice. New York: McGraw-Hill, 1975.
  • Whitely, S. E., and K. O. Doyle, Jr. “Implicit Theories in Student Ratings.” American Educational Research Journal, 13(1976), 241–53.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.