Validating Two Questions in the Force Concept Inventory with Subquestions

• Published in: Physical review special topics. Physics education research Vol. 9; no. 1; pp. 010113 - 10119
• Main Authors: Yasuda, Jun-ichiro, Taniguchi, Masa-aki
• Format: Journal Article
• Language: English
• Published: American Physical Society 05-04-2013
• Subjects: College Students; Foreign Countries; Japan; Physics; Science Tests; Scientific Concepts; Test Items; Test Validity; Japan
• ISSN: 1554-9178; 1554-9178
• DOI: 10.1103/PhysRevSTPER.9.010113

In this study, we evaluate the structural validity of Q.16 and Q.7 in the Force Concept Inventory (FCI). We address whether respondents who answer Q.16 and Q.7 correctly actually have an understanding of the concepts of physics tested in the questions. To examine respondents' levels of understanding, we use subquestions that test them on concepts believed to be required to answer the actual FCI questions. Our sample size comprises 111 respondents; we derive false-positive ratios for prelearners and postlearners and then statistically test the difference between them. We find a difference at the 0.05 significance level for both Q.16 and Q.7, implying that it is possible for postlearners to answer both questions without an understanding of the concepts of physics tested in the questions; therefore, the structures of Q.16 and Q.7 are invalid. In this study, we only evaluate the validity of these two FCI questions; we do not assess the validity of previous studies that have compared total FCI scores. (Contains 4 tables and 4 figures.)