Hippocampus and amygdala volumes from magnetic resonance images in children: Assessing accuracy of FreeSurfer and FSL against manual segmentation

• Published in: NeuroImage (Orlando, Fla.) Vol. 129; pp. 1 - 14
• Main Authors: Schoemaker, Dorothee, Buss, Claudia, Head, Kevin, Sandman, Curt A., Davis, Elysia P., Chakravarty, M. Mallar, Gauthier, Serge, Pruessner, Jens C.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01-04-2016; Elsevier Limited
• Subjects: Amygdala; Amygdala - anatomy & histology; Automation; Behavior; Child; Fear & phobias; Female; FreeSurfer; FSL-FIRST; Hippocampus; Hippocampus - anatomy & histology; Humans; Image Processing, Computer-Assisted - methods; Magnetic Resonance Imaging - methods; Male; Methods; Neuroimaging - methods; Pediatric population; Pediatrics; Psychopathology; Quality control; Segmentation techniques; Software; Standard deviation; FSL-FIRST; Amygdala; Pediatric population; Segmentation techniques; FreeSurfer; Hippocampus
• ISSN: 1053-8119; 1095-9572
• DOI: 10.1016/j.neuroimage.2016.01.038

The volumetric quantification of brain structures is of great interest in pediatric populations because it allows the investigation of different factors influencing neurodevelopment. FreeSurfer and FSL both provide frequently used packages for automatic segmentation of brain structures. In this study, we examined the accuracy and consistency of those two automated protocols relative to manual segmentation, commonly considered as the “gold standard” technique, for estimating hippocampus and amygdala volumes in a sample of preadolescent children aged between 6 to 11years. The volumes obtained with FreeSurfer and FSL-FIRST were evaluated and compared with manual segmentations with respect to volume difference, spatial agreement and between- and within-method correlations.
Results highlighted a tendency for both automated techniques to overestimate hippocampus and amygdala volumes, in comparison to manual segmentation. This was more pronounced when using FreeSurfer than FSL-FIRST and, for both techniques, the overestimation was more marked for the amygdala than the hippocampus. Pearson correlations support moderate associations between manual tracing and FreeSurfer for hippocampus (right r=0.69, p<0.001; left r=0.77, p<0.001) and amygdala (right r=0.61, p<0.001; left r=0.67, p<0.001) volumes. Correlation coefficients between manual segmentation and FSL-FIRST were statistically significant (right hippocampus r=0.59, p<0.001; left hippocampus r=0.51, p<0.001; right amygdala r=0.35, p<0.001; left amygdala r=0.31, p<0.001) but were significantly weaker, for all investigated structures. When computing intraclass correlation coefficients between manual tracing and automatic segmentation, all comparisons, except for left hippocampus volume estimated with FreeSurfer, failed to reach 0.70. When looking at each method separately, correlations between left and right hemispheric volumes showed strong associations between bilateral hippocampus and bilateral amygdala volumes when assessed using manual segmentation or FreeSurfer. These correlations were significantly weaker when volumes were assessed with FSL-FIRST. Finally, Bland–Altman plots suggest that the difference between manual and automatic segmentation might be influenced by the volume of the structure, because smaller volumes were associated with larger volume differences between techniques.
These results demonstrate that, at least in a pediatric population, the agreement between amygdala and hippocampus volumes obtained with automated FSL-FIRST and FreeSurfer protocols and those obtained with manual segmentation is not strong. Visual inspection by an informed individual and, if necessary, manual correction of automated segmentation outputs are important to ensure validity of volumetric results and interpretation of related findings.
•In a pediatric sample, we compare hippocampus and amygdala volumes from FSL-FIRST and FreeSurfer to manual segmentation•We examine discrepancies, associations, and biases between automatic and manual segmentation volumes•In the studied pediatric population, the agreement between manual segmentation, FreeSurfer and FSL is questionable•Associations between manual segmentation and FreeSurfer were stronger than with FSL-FIRST•Associations between manual segmentation and automatic techniques were stronger for hippocampus than amygdala volumes