Fast and Efficient Root Phenotyping via Pose Estimation

Image segmentation is commonly used to estimate the location and shape of plants and their external structures. Segmentation masks are then used to localize landmarks of interest and compute other geometric features that correspond to the plant's phenotype. Despite its prevalence, segmentation-...

Full description

Saved in:

Bibliographic Details
Published in:	Plant phenomics Vol. 6; p. 0175
Main Authors:	Berrigan, Elizabeth M, Wang, Lin, Carrillo, Hannah, Echegoyen, Kimberly, Kappes, Mikayla, Torres, Jorge, Ai-Perreira, Angel, McCoy, Erica, Shane, Emily, Copeland, Charles D, Ragel, Lauren, Georgousakis, Charidimos, Lee, Sanghwa, Reynolds, Dawn, Talgo, Avery, Gonzalez, Juan, Zhang, Ling, Rajurkar, Ashish B, Ruiz, Michel, Daniels, Erin, Maree, Liezl, Pariyar, Shree, Busch, Wolfgang, Pereira, Talmo D
Format:	Journal Article
Language:	English
Published:	United States AAAS 01-01-2024 American Association for the Advancement of Science (AAAS)
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Image segmentation is commonly used to estimate the location and shape of plants and their external structures. Segmentation masks are then used to localize landmarks of interest and compute other geometric features that correspond to the plant's phenotype. Despite its prevalence, segmentation-based approaches are laborious (requiring extensive annotation to train) and error-prone (derived geometric features are sensitive to instance mask integrity). Here, we present a segmentation-free approach that leverages deep learning-based landmark detection and grouping, also known as pose estimation. We use a tool originally developed for animal motion capture called SLEAP (Social LEAP Estimates Animal Poses) to automate the detection of distinct morphological landmarks on plant roots. Using a gel cylinder imaging system across multiple species, we show that our approach can reliably and efficiently recover root system topology at high accuracy, few annotated samples, and faster speed than segmentation-based approaches. In order to make use of this landmark-based representation for root phenotyping, we developed a Python library ( ) for trait extraction directly comparable to existing segmentation-based analysis software. We show that pose-derived root traits are highly accurate and can be used for common downstream tasks including genotype classification and unsupervised trait mapping. Altogether, this work establishes the validity and advantages of pose estimation-based plant phenotyping. To facilitate adoption of this easy-to-use tool and to encourage further development, we make , all training data, models, and trait extraction code available at: https://github.com/talmolab/sleap-roots and https://osf.io/k7j9g/.
Bibliography:	ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23
ISSN:	2643-6515 2643-6515
DOI:	10.34133/plantphenomics.0175