Effects of Rater Accountability on the Accuracy and the Favorability of Performance Ratings

• Published in: Journal of applied psychology Vol. 80; no. 4; pp. 517 - 524
• Main Authors: Mero, Neal P, Motowidlo, Stephan J
• Format: Journal Article
• Language: English
• Published: Washington, DC American Psychological Association 01-08-1995; American Psychological Association, etc
• Subjects: Accountability; Accuracy; Biological and medical sciences; Decision making; Evaluation techniques; Experimental psychology; Factors; Fundamental and applied biological sciences. Psychology; Human; Job Performance; Occupational psychology; Orientation. Selection. Evaluation; Performance appraisal; Personnel Evaluation; Psychological aspects; Psychology; Psychology. Psychoanalysis. Psychiatry; Psychology. Psychophysiology; Rating accuracy; Ratings & rankings; Simulation; Social research; Studies; Subordinates; Human; Professional performance; Validity; Accuracy; Adult; Cognition; Justification; Responsibility; Professional evaluation; Cognitive bias; Judgment
• ISSN: 0021-9010; 1939-1854
• DOI: 10.1037/0021-9010.80.4.517

The authors tested the effects of holding raters accountable for their performance ratings on the accuracy and the favorability of those ratings. Undergraduate research participants (
N
= 247) completed an inbasket exercise and observed a videotaped simulation during 2 sessions over a 2-week period. The simulation presented performance information on 4 simulated subordinates portrayed through videotaped vignettes. True performance scores were manipulated by varying the proportion of positive and negative performance vignettes presented for each subordinate. Participants who were made to feel accountable by having to justify their ratings to the experimenter in writing rated their simulated subordinates more accurately. In another experimental condition, accountable raters who were told their subordinates' previous performance ratings were too low rated their subordinates more favorably than did raters in the same experimental condition who were not accountable.