Benchmarking quantitative label-free LC–MS data processing workflows using a complex spiked proteomic standard dataset

• Published in: Journal of proteomics Vol. 132; pp. 51 - 62
• Main Authors: Ramus, Claire, Hovasse, Agnès, Marcellin, Marlène, Hesse, Anne-Marie, Mouton-Barbosa, Emmanuelle, Bouyssié, David, Vaca, Sebastian, Carapito, Christine, Chaoui, Karima, Bruley, Christophe, Garin, Jérôme, Cianférani, Sarah, Ferro, Myriam, Van Dorssaeler, Alain, Burlet-Schiltz, Odile, Schaeffer, Christine, Couté, Yohann, Gonzalez de Peredo, Anne
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 30-01-2016; Elsevier
• Subjects: Benchmarking - methods; Benchmarking - standards; Biochemistry, Molecular Biology; Chromatography, Liquid - standards; Computational proteomics; Genomics; Label-free quantification; Life Sciences; Mass Spectrometry - standards; MS signal analysis; NanoLC–MS/MS; Proteome - analysis; Proteome - standards; Proteomic standard; Reproducibility of Results; Sensitivity and Specificity; Software; Software Validation; Spectral counting; Staining and Labeling; Workflow; Computational proteomics; MS signal analysis; NanoLC–MS/MS; Spectral counting; Proteomic standard; Label-free quantification; proteomic standard; nanoLC-MS/MS; spectral counting; label-free quantification; computational proteomics
• ISSN: 1874-3919; 1876-7737
• DOI: 10.1016/j.jprot.2015.11.011

Proteomic workflows based on nanoLC–MS/MS data-dependent-acquisition analysis have progressed tremendously in recent years. High-resolution and fast sequencing instruments have enabled the use of label-free quantitative methods, based either on spectral counting or on MS signal analysis, which appear as an attractive way to analyze differential protein expression in complex biological samples. However, the computational processing of the data for label-free quantification still remains a challenge. Here, we used a proteomic standard composed of an equimolar mixture of 48 human proteins (Sigma UPS1) spiked at different concentrations into a background of yeast cell lysate to benchmark several label-free quantitative workflows, involving different software packages developed in recent years. This experimental design allowed to finely assess their performances in terms of sensitivity and false discovery rate, by measuring the number of true and false-positive (respectively UPS1 or yeast background proteins found as differential). The spiked standard dataset has been deposited to the ProteomeXchange repository with the identifier PXD001819 and can be used to benchmark other label-free workflows, adjust software parameter settings, improve algorithms for extraction of the quantitative metrics from raw MS data, or evaluate downstream statistical methods.
Bioinformatic pipelines for label-free quantitative analysis must be objectively evaluated in their ability to detect variant proteins with good sensitivity and low false discovery rate in large-scale proteomic studies. This can be done through the use of complex spiked samples, for which the “ground truth” of variant proteins is known, allowing a statistical evaluation of the performances of the data processing workflow. We provide here such a controlled standard dataset and used it to evaluate the performances of several label-free bioinformatics tools (including MaxQuant, Skyline, MFPaQ, IRMa-hEIDI and Scaffold) in different workflows, for detection of variant proteins with different absolute expression levels and fold change values. The dataset presented here can be useful for tuning software tool parameters, and also testing new algorithms for label-free quantitative analysis, or for evaluation of downstream statistical methods.
[Display omitted]
•We provide a proteomic dataset generated from samples spiked with different amounts of recombinant proteins•We benchmarked several label-free quantitative workflows based either on spectral counting or on peptide ions MS intensity•We evaluated their performances for detection of variant proteins with different abundance and fold change values