Richard Wilton1, Sarah J Wheelan2,3, Alexander S Szalay1,4, Steven L Salzberg3,4,5,6. 1. Department of Physics and Astronomy, Johns Hopkins University, Baltimore, MD, USA. 2. Department of Oncology, Johns Hopkins University School of Medicine, Baltimore, MD, USA. 3. Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA. 4. Department of Computer Science, Johns Hopkins University School of Medicine, Baltimore, MD, USA. 5. Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, USA. 6. Center for Computational Biology, McKusick-Nathans Institute of Genetic Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
Abstract
MOTIVATION: DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. RESULTS: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly. AVAILABILITY AND IMPLEMENTATION: Public access to the Terabase Search Engine database is available at http://tse.idies.jhu.edu. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
MOTIVATION: DNA sequencing archives have grown to enormous scales in recent years, and thousands of human genomes have already been sequenced. The size of these data sets has made searching the raw read data infeasible without high-performance data-query technology. Additionally, it is challenging to search a repository of short-read data using relational logic and to apply that logic across samples from multiple whole-genome sequencing samples. RESULTS: We have built a compact, efficiently-indexed database that contains the raw read data for over 250 human genomes, encompassing trillions of bases of DNA, and that allows users to search these data in real-time. The Terabase Search Engine enables retrieval from this database of all the reads for any genomic location in a matter of seconds. Users can search using a range of positions or a specific sequence that is aligned to the genome on the fly. AVAILABILITY AND IMPLEMENTATION: Public access to the Terabase Search Engine database is available at http://tse.idies.jhu.edu. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Authors: Sergio Lifschitz; Edward H Haeusler; Marcos Catanho; Antonio B de Miranda; Elvismary Molina de Armas; Alexandre Heine; Sergio G M P Moreira; Cristian Tristão Journal: BioTech (Basel) Date: 2022-07-30