An Application of Multidimensional Vertical Scaling

• Published in: Measurement (Mahwah, N.J.) Vol. 16; no. 3; pp. 139 - 154
• Main Author: Weeks, Jonathan P.
• Format: Journal Article
• Language: English
• Published: Routledge 03-07-2018
• Subjects: Basic Skills; Effect Size; Factor Structure; Goodness of Fit; Grade 6; Grade 7; Grade 8; Grade 9; Multidimensional Scaling; Multidimensional vertical scaling; Reading Comprehension; Reading Skills; Reading Tests; Value Added Models; value-added subscores
• ISSN: 1536-6367; 1536-6359
• DOI: 10.1080/15366367.2018.1502005

Vertical scales are widely used in educational assessment as a basis for considering grade-to-grade changes in student performance. Typically, the underlying construct is assumed to be essentially unidimensional; however, if there is a change in the measured construct across grades, this assumption may be untenable. Developing a multidimensional vertical scale in these instances provides a potential solution to this problem. This paper uses empirical data from four parallel forms of a test designed to measure six foundational reading skills-administered to students in grades 6-9-to address issues in the development of a multidimensional vertical scale. The defensibility of the multidimensional structure, value-added subscores, and the stability of the scale are considered. Student growth based on unidimensional versus multidimensional estimates of ability is also presented with particular attention to implications associated with potential construct shift.