Search Results - "Clauser, Brian E"

Investigation of answer changes on the USMLE® Step 2 Clinical Knowledge examination by Ouyang, Wenli, Harik, Polina, Clauser, Brian E, Paniagua, Miguel A

“…Examinees often believe that changing answers will lower their scores; however, empirical studies suggest that allowing examinees to change responses may…”
Get full text

A Demonstration of the Impact of Response Bias on the Results of Patient Satisfaction Surveys by Mazor, KathleenM, Clauser, BrianE, Field, Terry, Yood, RobertA, Gurwitz, JerryH

“…Objectives. The purposes of the present study were to examine patient satisfaction survey data for evidence of response bias, and to demonstrate, using…”
Get full text

Examining ChatGPT Performance on USMLE Sample Items and Implications for Assessment by Yaneva, Victoria, Baldwin, Peter, Jurich, Daniel P, Swygert, Kimberly, Clauser, Brian E

“…In late 2022 and early 2023, reports that ChatGPT could pass the United States Medical Licensing Examination (USMLE) generated considerable excitement, and…”
Get full text

Historical Perspectives on Score Comparability Issues Raised by Innovations in Testing by Baldwin, Peter, Clauser, Brian E.

“…While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery,…”
Get full text

An Examination of Rater Drift Within a Generalizability Theory Framework by Harik, Polina, Clauser, Brian E., Grabovsky, Irina, Nungester, Ronald J., Swanson, Dave, Nandakumar, Ratna

“…The present study examined the long-term usefulness of estimated parameters used to adjust the scores from a performance assessment to account for differences…”
Get full text

Assessing the validity of test scores using response process data from an eye-tracking study: a new approach by Yaneva, Victoria, Clauser, Brian E., Morales, Amy, Paniagua, Miguel

“…Understanding the response process used by test takers when responding to multiple-choice questions (MCQs) is particularly important in evaluating the validity…”
Get full text

An experimental comparison of multiple-choice and short-answer questions on a high-stakes test for medical students by Mee, Janet, Pandian, Ravi, Wolczynski, Justin, Morales, Amy, Paniagua, Miguel, Harik, Polina, Baldwin, Peter, Clauser, Brian E.

“…Recent advances in automated scoring technology have made it practical to replace multiple-choice questions (MCQs) with short-answer questions (SAQs) in…”
Get full text

Using Eye‐Tracking Data as Part of the Validity Argument for Multiple‐Choice Questions: A Demonstration by Yaneva, Victoria, Clauser, Brian E., Morales, Amy, Paniagua, Miguel

“…Eye‐tracking technology can create a record of the location and duration of visual fixations as a test‐taker reads test questions. Although the cognitive…”
Get full text

Automated Scoring of Short-Answer Questions: A Progress Report by Clauser, Brian E., Yaneva, Victoria, Baldwin, Peter, An Ha, Le, Mee, Janet

“…Multiple-choice questions have become ubiquitous in educational measurement because the format allows for efficient and accurate scoring. Nonetheless, there…”
Get full text

Exploring the Relationships Between USMLE Performance and Disciplinary Action in Practice: A Validity Study of Score Inferences From a Licensure Examination by Cuddy, Monica M., Young, Aaron, Gelman, Andrew, Swanson, David B., Johnson, David A., Dillon, Gerard F., Clauser, Brian E.

“…PURPOSEPhysicians must pass the United States Medical Licensing Examination (USMLE) to obtain an unrestricted license to practice allopathic medicine in the…”
Get full text

Using Natural Language Processing to Predict Item Response Times and Improve Test Construction by Baldwin, Peter, Yaneva, Victoria, Mee, Janet, Clauser, Brian E., Ha, Le An

“…In this article, it is shown how item text can be represented by (a) 113 features quantifying the text's linguistic characteristics, (b) 16 measures of the…”
Get full text

A Natural-Language-Processing-Based Procedure for Generating Distractors for Multiple-Choice Questions by Baldwin, Peter, Mee, Janet, Yaneva, Victoria, Paniagua, Miguel, D’Angelo, Jean, Swygert, Kimberly, Clauser, Brian E.

“…One of the most challenging aspects of writing multiple-choice test questions is identifying plausible incorrect response options—i.e., distractors. To help…”
Get full text

Examining the Precision of Cut Scores Within a Generalizability Theory Framework: A Closer Look at the Item Effect by Clauser, Brian E., Kane, Michael, Clauser, Jerome C.

“…An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability…”
Get full text

Evaluating Validity Evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: Does Performance Predict History-Taking and Physical Examination Ratings for First-Year Internal Medicine Residents? by Cuddy, Monica M, Winward, Marcia L, Johnston, Mary M, Lipner, Rebecca S, Clauser, Brian E

“…PURPOSETo add to the small body of validity research addressing whether scores from performance assessments of clinical skills are related to performance in…”
Get full text

The Choice of Response Probability in Bookmark Standard Setting: An Experimental Study by Baldwin, Peter, Margolis, Melissa J., Clauser, Brian E., Mee, Janet, Winward, Marcia

“…Evidence of the internal consistency of standard‐setting judgments is a critical part of the validity argument for tests used to make classification decisions…”
Get full text

An Experimental Study of the Internal Consistency of Judgments Made in Bookmark Standard Setting by Clauser, Brian E., Baldwin, Peter, Margolis, Melissa J., Mee, Janet, Winward, Marcia

“…Validating performance standards is challenging and complex. Because of the difficulties associated with collecting evidence related to external criteria,…”
Get full text

A Comparison of Experimental and Observational Approaches to Assessing the Effects of Time Constraints in a Medical Licensing Examination by Harik, Polina, Clauser, Brian E., Grabovsky, Irina, Baldwin, Peter, Margolis, Melissa J., Bucak, Deniz, Jodoin, Michael, Walsh, William, Haist, Steven

“…Test administrators are appropriately concerned about the potential for time constraints to impact the validity of score interpretations; psychometric efforts…”
Get full text

A novel workplace-based assessment for competency-based decisions and learner feedback by Hicks, Patricia J., Margolis, Melissa J., Carraccio, Carol L., Clauser, Brian E., Donnelly, Kathleen, Fromme, H. Barrett, Gifford, Kimberly A., Poynter, Sue E., Schumacher, Daniel J., Schwartz, Alan

“…Background: Increased recognition of the importance of competency-based education and assessment has led to the need for practical and reliable methods to…”
Get full text

A multilevel analysis of examinee gender and USMLE step 1 performance by Cuddy, Monica M, Swanson, David B, Clauser, Brian E

“…To examine the effects of (1) examinee gender on United States Medical Licensing Examination (USMLE) Step 1 performance, (2) examinee gender on the…”
Get full text

The relationship between communication scores from the USMLE Step 2 Clinical Skills examination and communication ratings for first-year internal medicine residents by Winward, Marcia L, Lipner, Rebecca S, Johnston, Mary M, Cuddy, Monica M, Clauser, Brian E

“…This study extends available evidence about the relationship between scores on the Step 2 Clinical Skills (CS) component of the United States Medical Licensing…”
Get full text