Image‐scoring system for crown–rump length measurement

• Published in: Ultrasound in obstetrics & gynecology Vol. 44; no. 6; pp. 649 - 654
• Main Authors: Wanyonyi, S. Z., Napolitano, R., Ohuma, E. O., Salomon, L. J., Papageorghiou, A. T.
• Format: Journal Article
• Language: English
• Published: Chichester, UK John Wiley & Sons, Ltd 01-12-2014; Wiley Subscription Services, Inc
• Subjects: Crown-Rump Length; Databases, Factual; Decision Support Techniques; Female; Humans; image scoring; objective evaluation; Observer Variation; Pregnancy; reproducibility; Reproducibility of Results; Single-Blind Method; subjective evaluation; Ultrasonography, Prenatal; objective evaluation; image scoring; subjective evaluation; reproducibility; crown-rump length
• ISSN: 0960-7692; 1469-0705
• DOI: 10.1002/uog.13376

ABSTRACT
Objective
To develop and evaluate an objective image‐scoring system for crown–rump length (CRL) measurements and to determine how this compares with subjective assessment.
Methods
A total of 125 CRL ultrasound images were selected from the database of the International Fetal and Newborn Growth Consortium for the 21st Century study group. Two reviewers, who were blinded to the operators' and to each others' results, evaluated all images both subjectively and objectively. Subjective evaluation consisted of rating an image as acceptable or unacceptable, while objective evaluation was based on six criteria. Reviewer differences for both the subjective and objective evaluations were compared using percentage of agreement and adjusted kappa values.
Results
The distribution of individual scores and differences between subjective and objective evaluation for the two reviewers was similar. Overall agreement between the reviewers was higher for objective evaluation (95.2%; adjusted κ, 0.904), than for subjective evaluation (77.6%; adjusted κ, 0.552). There was a high level of agreement for horizontal position (κ = 0.951), magnification (κ = 0.919), visualization of crown and rump (κ = 0.806) and caliper placement (κ = 0.756), while agreement for mid‐sagittal section (κ = 0.629) and neutral position (κ = 0.565) were moderate and poor, respectively.
Conclusion
The proposed six‐point scoring system for CRL image rating is more reproducible than is subjective evaluation and should be considered as a method of quality assessment and audit. Copyright © 2014 ISUOG. Published by John Wiley & Sons Ltd.