The Cancer Genomics Hub (CGHub): overcoming cancer through the power of torrential data

The Cancer Genomics Hub (CGHub) is the online repository of the sequencing programs of the National Cancer Institute (NCI), including The Cancer Genomics Atlas (TCGA), the Cancer Cell Line Encyclopedia (CCLE) and the Therapeutically Applicable Research to Generate Effective Treatments (TARGET) proje...

Full description

Saved in:
Bibliographic Details
Published in:Database : the journal of biological databases and curation Vol. 2014; p. bau093
Main Authors: Wilks, Christopher, Cline, Melissa S, Weiler, Erich, Diehkans, Mark, Craft, Brian, Martin, Christy, Murphy, Daniel, Pierce, Howdy, Black, John, Nelson, Donavan, Litzinger, Brian, Hatton, Thomas, Maltbie, Lori, Ainsworth, Michael, Allen, Patrick, Rosewood, Linda, Mitchell, Elizabeth, Smith, Bradley, Warner, Jim, Groboske, John, Telc, Haifang, Wilson, Daniel, Sanford, Brian, Schmidt, Hannes, Haussler, David, Maltbie, Daniel
Format: Journal Article
Language:English
Published: England Oxford University Press 29-09-2014
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The Cancer Genomics Hub (CGHub) is the online repository of the sequencing programs of the National Cancer Institute (NCI), including The Cancer Genomics Atlas (TCGA), the Cancer Cell Line Encyclopedia (CCLE) and the Therapeutically Applicable Research to Generate Effective Treatments (TARGET) projects, with data from 25 different types of cancer. The CGHub currently contains >1.4 PB of data, has grown at an average rate of 50 TB a month and serves >100 TB per week. The architecture of CGHub is designed to support bulk searching and downloading through a Web-accessible application programming interface, enforce patient genome confidentiality in data storage and transmission and optimize for efficiency in access and transfer. In this article, we describe the design of these three components, present performance results for our transfer protocol, GeneTorrent, and finally report on the growth of the system in terms of data stored and transferred, including estimated limits on the current architecture. Our experienced-based estimates suggest that centralizing storage and computational resources is more efficient than wide distribution across many satellite labs. Database URL: https://cghub.ucsc.edu.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
Citation details: Wilks,C., Cline,M.S., Weiler,E., et al. The Cancer Genomics Hub (CGHub): overcoming cancer through the power of torrential data. Database (2014) Vol. 2014: article ID bau093; doi:10.1093/database/bau093
ISSN:1758-0463
1758-0463
DOI:10.1093/database/bau093