A Field Study of Pretest and Posttest Reactions to a Paper-and-Pencil and a Computerized In-Basket Exercise

• Published in: Human performance Vol. 25; no. 2; pp. 95 - 113
• Main Authors: Oostrom, Janneke K., Bos-Broekema, Lineke, Serlie, Alec W., Born, Marise Ph, van der Molen, Henk T.
• Format: Journal Article
• Language: English
• Published: Philadelphia Taylor & Francis Group 01-04-2012; Routledge, Taylor & Francis Group
• Subjects: Cognition & reasoning; Comparative analysis; Field study; Perceptions; Tests
• ISSN: 0895-9285; 1532-7043
• DOI: 10.1080/08959285.2012.658928

The present field study compared pretest and posttest face validity perceptions, predictive validity perceptions, and fairness perceptions regarding a paper-and-pencil version and a computerized version of an in-basket exercise. Furthermore, the nature of these reactions and their relationship with test performance were examined. Data were collected among 205 applicants. Contrary to our expectations, minimal differences were found between applicant reactions to the computerized version and the paper-and-pencil version of the in-basket exercise. Results from structural equation modeling showed that applicants' general beliefs in tests affected pretest reactions. Applicants' test performance influenced posttest reactions via self-assessed test performance. Theoretical and practical implications of these results are discussed.