Multicentre external validation of IOTA prediction models and RMI by operators with varied training

• Published in: British journal of cancer Vol. 108; no. 12; pp. 2448 - 2454
• Main Authors: Sayasneh, A, Wynants, L, Preisler, J, Kaijser, J, Johnson, S, Stalder, C, Husicka, R, Abdallah, Y, Raslan, F, Drought, A, Smith, A A, Ghaem-Maghami, S, Epstein, E, Van Calster, B, Timmerman, D, Bourne, T
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 25-06-2013; Nature Publishing Group
• Subjects: Adult; Biological and medical sciences; Biomedical and Life Sciences; Biomedicine; Cancer Research; Carcinoma, Ovarian Epithelial; Clinical Competence; Clinical Study; Cross-Sectional Studies; Drug Resistance; Education, Medical; Epidemiology; Female; Female genital diseases; Gynecology; Gynecology. Andrology. Obstetrics; Health Status Indicators; Hospitals; Humans; Internationality; Medical research; Medical sciences; Medicin och hälsovetenskap; Middle Aged; Models, Theoretical; Molecular Medicine; Multiple tumors. Solid tumors. Tumors in childhood (general aspects); Neoplasms, Glandular and Epithelial - diagnosis; Neoplasms, Glandular and Epithelial - diagnostic imaging; Neoplasms, Glandular and Epithelial - epidemiology; Neoplasms, Glandular and Epithelial - etiology; Observer Variation; Obstetrics; Oncology; Ovarian cancer; Ovarian Neoplasms - diagnosis; Ovarian Neoplasms - diagnostic imaging; Ovarian Neoplasms - epidemiology; Ovarian Neoplasms - etiology; Pathology; Patients; Prevalence; Prognosis; R&D; Regression analysis; Research & development; Risk Assessment; Tumors; Ultrasonic imaging; Ultrasonography; Womens health; United Kingdom > UK; Belgium; Biomarkers; ovarian neoplasm; decision support techniques; ovarian cancer; ultrasonography; CA125 antigen; Ovary cancer; Biological marker; Ovary; Cancerology; Female genital system; Sonography; Validation; Decision making; Prediction; Malignant tumor; Decision; Female genital diseases; Ovarian diseases; Echography; External; CA 125 antigen; Models; Technique; Predictive factor; Cancer
• ISSN: 0007-0920; 1532-1827; 1532-1827
• DOI: 10.1038/bjc.2013.224

Background:
Correct characterisation of ovarian tumours is critical to optimise patient care. The purpose of this study is to evaluate the diagnostic performance of the International Ovarian Tumour Analysis (IOTA) logistic regression model (LR2), ultrasound Simple Rules (SR), the Risk of Malignancy Index (RMI) and subjective assessment (SA) for preoperative characterisation of adnexal masses, when ultrasonography is performed by examiners with different background training and experience.
Methods:
A 2-year prospective multicentre cross-sectional study. Thirty-five level II ultrasound examiners contributed in three UK hospitals. Transvaginal ultrasonography was performed using a standardised approach. The final outcome was the surgical findings and histological diagnosis. To characterise the adnexal masses, the six-variable prediction model (LR2) with a cutoff of 0.1, the RMI with cutoff of 200, ten SR (five rules for malignancy and five rules for benignity) and SA were applied. The area under the curves (AUCs) for performance of LR2 and RMI were calculated. Diagnostic performance measures for all models assessed were sensitivity, specificity, positive and negative likelihood ratios (LR+ and LR−), and the diagnostic odds ratio (DOR).
Results:
Nine-hundred and sixty-two women with adnexal masses underwent transvaginal ultrasonography, whereas 255 had surgery. Prevalence of malignancy was 29% (49 primary invasive epithelial ovarian cancers, 18 borderline ovarian tumours, and 7 metastatic tumours). The AUCs for LR2 and RMI for all masses were 0.94 (95% confidence interval (CI): 0.89–0.97) and 0.90 (95% CI: 0.83–0.94), respectively. In premenopausal women, LR2−RMI difference was 0.09 (95% CI: 0.03–0.15) compared with −0.02 (95% CI: −0.08 to 0.04) in postmenopausal women. For all masses, the DORs for LR2, RMI, SR+SA (using SA when SR inapplicable), SR+MA (assuming malignancy when SR inapplicable), and SA were 62 (95% CI: 27–142), 43 (95% CI: 19–97), 109 (95% CI: 44–274), 66 (95% CI: 27–158), and 70 (95% CI: 30–163), respectively.
Conclusion:
Overall, the test performance of IOTA prediction models and rules as well as the RMI was maintained in examiners with varying levels of training and experience.