A Sensitivity Analysis and Opportunity Cost Evaluation of the Surgical Council on Resident Education Curriculum

• Published in: Journal of surgical education Vol. 73; no. 1; pp. 24 - 30
• Main Authors: Falcone, John L., MD, MS, Feinn, Richard S., PhD
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01-01-2016
• Subjects: American Board of Surgery; Clinical Competence - economics; Costs and Cost Analysis; Curriculum; general surgery; Internship and Residency - economics; Medical Knowledge; Professionalism; qualifying examination; SCORE; Sensitivity and Specificity; Specialties, Surgical - education; Specialty Boards; Surgery; Surgical Council on Resident Education; Systems-Based Practice; United States; qualifying examination; SCORE; Medical Knowledge; Surgical Council on Resident Education; Systems-Based Practice; general surgery; Professionalism; American Board of Surgery
• ISSN: 1931-7204; 1878-7452
• DOI: 10.1016/j.jsurg.2015.09.009

Objective The study purpose is to evaluate the Surgical Council on Resident Education (SCORE) Curriculum regarding American Board of Surgery Qualifying Examination (ABS QE) outcomes. The goal is to perform effect size analyses, sensitivity analyses, and sample size analyses with opportunity cost estimates required to favor the SCORE Curriculum subscription regarding ABS QE outcomes. Methods Published data were used to construct 2 × 2 matrices regarding ABS QE outcome (pass/fail) and SCORE subscription status (subscriber/nonsubscriber). Post hoc analyses of effect sizes and sample sizes, with opportunity cost estimates, were performed to evaluate ABS QE outcomes favoring SCORE subscription (2-tailed and 1-tailed tests) using an α = 0.05. Results The absolute risk increase of SCORE subscription on ABS QE outcome was 1.6% (number needed to treat = 63). Sensitivity analyses showed that a pass rate difference of 4.9% to 7.5% was required to favor SCORE subscription (all p < 0.05). Sample size analyses required an 8- to 18-fold increase to favor SCORE subscription to achieve statistical significance with an opportunity cost of $6.0 to $13.5 million ($30,000-$67,000/program), not adjusting for inflation. Conclusions The number needed to treat and pass rate differences required to favor SCORE subscription are large. The opportunity costs of SCORE subscription are substantial. Residency programs with more limited resources should determine if the subscription costs are financially sound.