James Holt1, Leonard McMillan1. 1. Department of Computer Science, 201 S. Columbia St. UNC-CH, Chapel Hill, NC 27599, USA.
Abstract
MOTIVATION: The throughput of genomic sequencing has increased to the point that is overrunning the rate of downstream analysis. This, along with the desire to revisit old data, has led to a situation where large quantities of raw, and nearly impenetrable, sequence data are rapidly filling the hard drives of modern biology labs. These datasets can be compressed via a multi-string variant of the Burrows-Wheeler Transform (BWT), which provides the side benefit of searches for arbitrary k-mers within the raw data as well as the ability to reconstitute arbitrary reads as needed. We propose a method for merging such datasets for both increased compression and downstream analysis. RESULTS: We present a novel algorithm that merges multi-string BWTs in [Formula: see text] time where LCS is the length of their longest common substring between any of the inputs, and N is the total length of all inputs combined (number of symbols) using [Formula: see text] bits where F is the number of multi-string BWTs merged. This merged multi-string BWT is also shown to have a higher compressibility compared with the input multi-string BWTs separately. Additionally, we explore some uses of a merged multi-string BWT for bioinformatics applications.
MOTIVATION: The throughput of genomic sequencing has increased to the point that is overrunning the rate of downstream analysis. This, along with the desire to revisit old data, has led to a situation where large quantities of raw, and nearly impenetrable, sequence data are rapidly filling the hard drives of modern biology labs. These datasets can be compressed via a multi-string variant of the Burrows-Wheeler Transform (BWT), which provides the side benefit of searches for arbitrary k-mers within the raw data as well as the ability to reconstitute arbitrary reads as needed. We propose a method for merging such datasets for both increased compression and downstream analysis. RESULTS: We present a novel algorithm that merges multi-string BWTs in [Formula: see text] time where LCS is the length of their longest common substring between any of the inputs, and N is the total length of all inputs combined (number of symbols) using [Formula: see text] bits where F is the number of multi-string BWTs merged. This merged multi-string BWT is also shown to have a higher compressibility compared with the input multi-string BWTs separately. Additionally, we explore some uses of a merged multi-string BWT for bioinformatics applications.
Authors: Jonathan Butler; Iain MacCallum; Michael Kleber; Ilya A Shlyakhter; Matthew K Belmonte; Eric S Lander; Chad Nusbaum; David B Jaffe Journal: Genome Res Date: 2008-03-13 Impact factor: 9.043
Authors: David A Rasko; M J Rosovitz; Garry S A Myers; Emmanuel F Mongodin; W Florian Fricke; Pawel Gajer; Jonathan Crabtree; Mohammed Sebaihia; Nicholas R Thomson; Roy Chaudhuri; Ian R Henderson; Vanessa Sperandio; Jacques Ravel Journal: J Bacteriol Date: 2008-08-01 Impact factor: 3.490
Authors: Hajime Kanamori; Christian M Parobek; Jonathan J Juliano; David van Duin; Bruce A Cairns; David J Weber; William A Rutala Journal: Antimicrob Agents Chemother Date: 2017-01-24 Impact factor: 5.191
Authors: Andrew P Morgan; J Matthew Holt; Rachel C McMullan; Timothy A Bell; Amelia M-F Clayshulte; John P Didion; Liran Yadgary; David Thybert; Duncan T Odom; Paul Flicek; Leonard McMillan; Fernando Pardo-Manuel de Villena Journal: Genetics Date: 2016-07-02 Impact factor: 4.562
Authors: Andrew P Morgan; John P Didion; Anthony G Doran; James M Holt; Leonard McMillan; Thomas M Keane; Fernando Pardo-Manuel de Villena Journal: G3 (Bethesda) Date: 2016-12-07 Impact factor: 3.154
Authors: Anuj Srivastava; Andrew P Morgan; Maya L Najarian; Vishal Kumar Sarsani; J Sebastian Sigmon; John R Shorter; Anwica Kashfeen; Rachel C McMullan; Lucy H Williams; Paola Giusti-Rodríguez; Martin T Ferris; Patrick Sullivan; Pablo Hock; Darla R Miller; Timothy A Bell; Leonard McMillan; Gary A Churchill; Fernando Pardo-Manuel de Villena Journal: Genetics Date: 2017-06 Impact factor: 4.562
Authors: John R Shorter; Maya L Najarian; Timothy A Bell; Matthew Blanchard; Martin T Ferris; Pablo Hock; Anwica Kashfeen; Kathryn E Kirchoff; Colton L Linnertz; J Sebastian Sigmon; Darla R Miller; Leonard McMillan; Fernando Pardo-Manuel de Villena Journal: G3 (Bethesda) Date: 2019-05-07 Impact factor: 3.154
Authors: Kathie Y Sun; Daniel Oreper; Sarah A Schoenrock; Rachel McMullan; Paola Giusti-Rodríguez; Vasyl Zhabotynsky; Darla R Miller; Lisa M Tarantino; Fernando Pardo-Manuel de Villena; William Valdar Journal: Genetics Date: 2021-05-17 Impact factor: 4.562