Literature DB >> 32550561

Splice2Deep: An ensemble of deep convolutional neural networks for improved splice site prediction in genomic DNA.

Somayah Albaradei1,2, Arturo Magana-Mora1,3, Maha Thafar1,4, Mahmut Uludag1, Vladimir B Bajic1, Takashi Gojobori1,5, Magbubah Essack1, Boris R Jankovic1.   

Abstract

BACKGROUND: The accurate identification of the exon/intron boundaries is critical for the correct annotation of genes with multiple exons. Donor and acceptor splice sites (SS) demarcate these boundaries. Therefore, deriving accurate computational models to predict the SS are useful for functional annotation of genes and genomes, and for finding alternative SS associated with different diseases. Although various models have been proposed for the in silico prediction of SS, improving their accuracy is required for reliable annotation. Moreover, models are often derived and tested using the same genome, providing no evidence of broad application, i.e. to other poorly studied genomes.
RESULTS: With this in mind, we developed the Splice2Deep models for SS detection. Each model is an ensemble of deep convolutional neural networks. We evaluated the performance of the models based on the ability to detect SS in Homo sapiens, Oryza sativa japonica, Arabidopsis thaliana, Drosophila melanogaster, and Caenorhabditis elegans. Results demonstrate that the models efficiently detect SS in other organisms not considered during the training of the models. Compared to the state-of-the-art tools, Splice2Deep models achieved significantly reduced average error rates of 41.97% and 28.51% for acceptor and donor SS, respectively. Moreover, the Splice2Deep cross-organism validation demonstrates that models correctly identify conserved genomic elements enabling annotation of SS in new genomes by choosing the taxonomically closest model.
CONCLUSIONS: The results of our study demonstrated that Splice2Deep both achieved a considerably reduced error rate compared to other state-of-the-art models and the ability to accurately recognize SS in other organisms for which the model was not trained, enabling annotation of poorly studied or newly sequenced genomes. Splice2Deep models are implemented in Python using Keras API; the models and the data are available at https://github.com/SomayahAlbaradei/Splice_Deep.git.
© 2020 Published by Elsevier B.V.

Entities:  

Keywords:  AUC, area under curve; AcSS, acceptor splice site; Acc, accuracy; Bioinformatics; CNN, convolutional neural network; CONV, convolutional layers; DL, deep learning; DNA, deoxyribonucleic acid; DT, decision trees; Deep-learning; DoSS, donor splice site; FC, fully connected layer; ML, machine learning; NB, naive Bayes; NN, neural network; POOL, pooling layer; Prediction; RF, random forest; RNA, ribonucleic acid; ReLU, rectified linear unit layer; SS, splice site; SVM, support vector machine; Sn, sensitivity; Sp, specificity; Splice sites; Splicing

Year:  2020        PMID: 32550561      PMCID: PMC7285987          DOI: 10.1016/j.gene.2020.100035

Source DB:  PubMed          Journal:  Gene X        ISSN: 2590-1583


Background

Variability in intron-exon boundaries enables alternative splicing. Alternative splicing affords eukaryotic organisms the ability to generate various transcripts and encode multiple proteins from the same gene locus. During the transcription process, introns are spliced out, and different combinations of exons join together to form mature RNA. When mature RNA contains information for protein synthesis, we denote it as a messenger RNA (mRNA). Thus, the accurate annotation of the exon and intron boundaries, referred to as splice sites (SS), is critical for the correct annotation of genes contained in a genomic DNA sequence. The SS at the exon/intron boundary corresponds to the donor site (DoSS), while the SS at the intron/exon boundary is the acceptor site (AcSS). The DoSS and AcSS are characterized in most cases by canonical GT and AG dinucleotides in DNA (Burset et al., 2000), respectively. In silico detection of SS facilitates delineating the internal structure of multi-exon genes, functional annotation of new genomes, and finding alternative SS linked to aberrant organism phenotype and diseases (Leegwater et al., 2016; Roshon et al., 2003; Morrison et al., 2013; Kurmangaliyev and Gelfand, 2008; Iso-Touru et al., 2019; Buckley et al., 2009; Sahakyan and Balasubramanian, 2016). Current computational approaches for SS detection implement different strategies for feature extraction and deploy various machine learning (ML) methods to build classifiers. Although some approaches implemented methods based on probabilistic models (Pertea et al., 2001; Zhang et al., 2010), the majority of the implemented methods are based on ML techniques. Feature extraction and feature selection are among the main challenges for deriving robust ML models for SS prediction. Several feature extraction techniques were proposed to characterize SS. For example, as a pre-processing step, Markov models are used to extract nucleotide dependencies and sequence compositional features surrounding SS in terms of probabilistic parameters that were used as features to characterize the SS (Baten et al., 2006; Goel et al., 2015). Information related to mono/di/trinucleotide distribution surrounding the SS in DNA sequences is also used as features to characterize the sequences surrounding the SS (Wei et al., 2013; Huang et al., 2006), as well as the chemical properties of each nucleotide, and positional and density information (Bari et al., 2014). A combination of features based on dinucleotide association score, nucleotide dependency, and positions was also used to describe SS (Meher et al., 2016a). Notably, some of the extracted features may be irrelevant or redundant in the SS prediction task and could result in an unnecessarily more complex ML model. Therefore, feature selection is a common step that follows feature extraction (Bengio et al., 2012; Bins, 2002; Magana-Mora and Bajic, 2017; Alshahrani et al., 2017). For example, feature selection based on the F-score was used to identify informative features for improving model performance (Wei et al., 2013). Different ML techniques that use such “manually-crafted” features as inputs are then applied to perform the SS prediction task; examples are, support vector machine (SVM) (Baten et al., 2006; Goel et al., 2015; Wei et al., 2013; Huang et al., 2006; Bari et al., 2014; Chen and Lin, 2006; Dror et al., 2004; Li et al., 2017; Meher et al., 2016b; Sonnenburg et al., 2007), random forest (RF) (Meher et al., 2016a), decision trees (DT) (Lopes et al., 2007), and naïve Bayes (NB) (Kamath et al., 2014) models. Despite the great success of these ML techniques, the extraction and selection of features from raw data are not straightforward. The main problem remains in difficulty associated with extracting sufficiently discriminative information from raw data. As a consequence, recent approaches used deep learning (DL) techniques to avoid the limitations associated with the “manually-crafted” features. The use of DL models has achieved exceptional results in different genomic-related studies (Zeng et al., 2016; Nguyen et al., 2016; Leung et al., 2014; Alipanahi et al., 2015; Quang and Xie, 2016; Sønderby et al., 2015; Lee and Yoon, 2015; Albalawi et al., 2019; Kalkatawi et al., 2019; Magana-Mora et al., 2017). Concerning SS, DL models have been used for automatic feature extraction and detection of SS in RNA (Zhang et al., 2016) and DNA (Zuallaert et al., 2018; Du et al., 2018). DeepSS (Du et al., 2018) is a recent DL model trained and tested on Homo sapiens and Caenorhabditis elegans datasets to predict SS. It consists of two stacked convolution-pooling layers followed by two fully-connected layers, where the last layer performs a SoftMax function that outputs a prediction score. DeepSS outperformed different previously proposed state-of-the-art models (Goel et al., 2015; Meher et al., 2016b; Meher et al., 2014). Another recent DL model, Splicerover (Zuallaert et al., 2018), was trained and tested on H. sapiens and Arabidopsis thaliana datasets for SS prediction. This model implements several alternating convolutional pooling layers followed by a fully-connected layer with a SoftMax function that outputs a prediction score. Splicerover also outperformed several state-of-the-art models (Bari et al., 2014; Sonnenburg et al., 2007; Lee and Yoon, 2015; Degroeve et al., 2004). Although considerable improvements have been achieved using DL models, there is a need to further improve SS characterization to increase the accuracy of the models and improve models that detect splice junctions (Jaganathan et al., 2019; Zhang et al., 2018). The DL models that predict SS were also developed based on a limited number of selected organisms. In this study, we derived independent models for five different organisms, namely, H. sapiens, A. thaliana, Oryza sativa japonica, Drosophila melanogaster, and C. elegans. We then performed cross-organism validation to assess the capability of the models to accurately predict SS in other organisms, not explicitly used to train the models. Therefore, the models can be used to annotate SS in new genomes by choosing the SS detection model trained on the most closely related organism. Finally, it is essential to mention that our model, Splice2Deep, aims to recognize the SS in the primary DNA genomic sequence that would be transcribed into donor/acceptor sites in the corresponding RNA, although we may not always make that distinction explicitly in the text.

Results

The main contribution of this study is the development of Splice2Deep that consists of an ensemble of DL models for the improved and generic detection of SS. To evaluate the performance of Splice2Deep, we derived separate models. We computed the statistical measures shown in Table 1 for the five considered organisms, namely: H. sapiens, A. thaliana, O. sativa japonica, D. melanogaster, and C. elegans. Moreover, we also report the results using the area under the receiver operating characteristic curve (AUC). Table 2 shows the performance obtained for the five different considered organisms using 60%, 15%, and 25% of the data as training, validation, and testing, respectively.
Table 1

Statistical measures used to assess the performance of the models.

MeasureEquation
Accuracy (Acc)TP+TNTP+FN+TN+FP
Specificity (Sp)TNTN+FP
Sensitivity (Sn)TPTP+FN
F1 Score (F1)2×TP2×TP+FP+FN
Error rate1 − Accuracy
Table 2

Performance metrics for the detection of donor and acceptor SS by Splice2Deep on five organisms.

OrganismAccSpSnF1AUC
AcSSHomo sapiens96.9197.8095.6196.9198.69
Arabidopsis thaliana95.2194.8695.5395.2298.31
Oryza sativa japonica93.8993.6294.1693.9297.52
Drosophila melanogaster94.0795.0494.0994.0798.16
Caenorhabditis elegans98.0897.7898.3898.0999.49
DoSSHomo sapiens97.3898.8395.9396.3899.10
Arabidopsis thaliana95.5995.6795.5095.5898.69
Oryza sativa japonica94.3394.4194.2594.3398.30
Drosophila melanogaster90.5293.7190.4691.5296.56
Caenorhabditis elegans97.6897.7497.6397.6999.48
Statistical measures used to assess the performance of the models. Performance metrics for the detection of donor and acceptor SS by Splice2Deep on five organisms.

Comparing Splice2Deep to other SS detection models

To gain more insight into the performance and value of Splice2Deep, we compared its accuracy to that of other available tools, namely: GeneSplicer (Pertea et al., 2001), SplicePredictor (Brendel et al., 2004), DeepSS (Du et al., 2018), and Splicerover (Zuallaert et al., 2018). Table 3 shows the accuracy obtained from the tools using the same testing data used to evaluate Deep2Splice. Some of the considered organisms were not used to train the existing tools, and a method was not provided to re-train the model. These cases are indicated using N/A (see Table 3). We also provide the results for additional statistical measures, such as Sp and Sn (see Additional file 1: Table S1).
Table 3

Comparing the SS prediction accuracy of Splice2Deep and state-of-the-art tools using five well-studied organisms. Results in bold represent the best performing model. N/A indicates that the tool has not and cannot be trained for that specific organism.

OrganismGene-SplicerSplice-PredictorDeepSSSpliceroverSplice2Deep
AcSSHomo sapiens83.3188.0194.8595.3596.91
Arabidopsis thaliana87.7692.13N/A94.3595.21
Oryza sativa japonica84.2189.42N/AN/A93.89
Drosophila melanogaster88.6688.69N/AN/A94.07
Caenorhabditis elegansN/AN/A93.32N/A98.08
DoSSHomo sapiens79.4888.294.7696.1897.38
Arabidopsis thaliana90.8592.49N/A94.2595.59
Oryza sativa japonica86.1787.5N/AN/A94.33
Drosophila melanogaster90.1988.79N/AN/A90.52
Caenorhabditis elegansN/AN/A94.01N/A97.68
Table 4 provides a comparison of the error rate, defined as error rate = 1 − Acc, and the relative improvement of the error rate compared to the best performing tool for each organism. The Splice2Deep model consistently reduced the relative error rate compared to the other state-of-the-art models.
Table 4

Relative error rates associated with SS detection when using Splice2Deep and the best performing SS prediction tools.

Splice siteOrganismBest performing modelError rate of the best performing model (%)Error rate of Deep2Splice (%)Relative error rate reduction (%)
AcSSHomo sapiensSplicerover4.653.0933.55
Arabidopsis thalianaSplicerover5.654.7915.22
Oryza Sativa japonicaSplicePredictor10.586.1142.25
Drosophila melanogasterSplicePredictor11.315.9347.57
Caenorhabditis elegansDeepSS6.681.9271.26
Average41.97
DoSSHomo sapiensSplicerover3.822.6245.80
Arabidopsis thalianaSplicerover5.754.4123.30
Oryza Sativa japonicaSplicePredictor12.505.6754.64
Drosophila melanogasterSplicePredictor9.819.483.36
Caenorhabditis elegansDeepSS5.955.0315.46
Average28.51
Comparing the SS prediction accuracy of Splice2Deep and state-of-the-art tools using five well-studied organisms. Results in bold represent the best performing model. N/A indicates that the tool has not and cannot be trained for that specific organism. Relative error rates associated with SS detection when using Splice2Deep and the best performing SS prediction tools.

Discussion

To make Splice2Deep generic, we trained the incorporated models on five well-studied organisms, and performed cross-organism model validation. For each of the five considered organisms, we developed two independent DL models: one to predict AcSS and the other to predict DoSS. Independent DL models were used to characterize the local upstream flanking region, local downstream flanking region, and the region surrounding the SS to derive an ensemble of DL models. In other words, we extracted features from two local windows and one window surrounding the SS to improve the performance of the DL models. We also exploit the fact that exons (if they contain a portion of the protein-coding sequence) typically exhibit a periodicity of three, where this appeared upstream of DoSS and downstream of AcSS. From the results shown in Table 3, Deep2Splice consistently outperformed the state-of-the-art models for the five different considered organisms and was able to reduce the relative error rate by 41.97% and 28.51% compared to the best performing model for AcSS and DoSS, respectively (Table 4). Thus, Deep2Splice providing more accurate SS prediction should enable better characterization of the internal structure of multi-exon genes and should be useful for finding alternative SS linked to aberrant organism phenotype and diseases. However, the real advantage of Deep2Splice is its proven ability for SS cross-organism prediction, which demonstrates it could be used to annotate organisms beyond the well-studied ones. Accuracy results obtained from the cross-organism model validation. A–E) Cross-organism validation results for the prediction of AcSS, F–J) cross-organism validation results for the prediction of DoSS. Evaluating the performance of the models for the annotation of poorly studied organisms is not possible as we do not have any reference to compare or compute any statistical measure of performance. On the other hand, by performing cross-organism model testing, i.e., testing the model with data from an organism for which it was not trained, we may approximately estimate the generalization capabilities of the model for annotating diverse organisms. For example, a cross-organism validation consists of testing a model derived from A. thaliana on the other four genomes for which it was not trained (H. sapiens, C. elegans, O. sativa japonica, and D. melanogaster) and perform the same test with other tools that are applicable (i.e., that were trained on A. thaliana as well). We performed this cross-organism validation for each of the five derived models for each organism. Fig. 1 shows the accuracy results for the cross-organism model validation, and Additional file 2: Table S2, Additional file 3: Table S3, Additional file 4: Table S4, Additional file 5: Table S5, Additional file 6: Table S6: Tables S2–S6 show the results for the other considered performance measures. Interestingly, in some cases, Splice2Deep trained on organism X and tested on organism Y achieved better results than other tools trained on organism Y and tested on the same organism Y. For instance, Splice2Deep model trained on C. elegans achieved an accuracy of 94.07% when tested on D. melanogaster (Fig. 1E), compared to 88.69% achieved by SplicePredictor model trained and tested on D. melanogaster (Fig. 1D). Similarly, Splice2Deep model trained on C. elegans achieved an accuracy of 91.19% when tested on O. sativa japonica (Fig. 1E), compared to 89.42% achieved by SplicePredictor model trained and tested on O. sativa japonica (Fig. 1C). These results demonstrate that Splice2Deep is more adapt to annotate the poorly studied or newly sequenced genomes than the other models.
Fig. 1

Accuracy results obtained from the cross-organism model validation. A–E) Cross-organism validation results for the prediction of AcSS, F–J) cross-organism validation results for the prediction of DoSS.

Conclusions

Interest in the prediction of genomic signals goes far beyond model organisms. Therefore, a critical problem associated with many genomic signal prediction tools is that predicting SS in genomes that were not used to train the models may not be sufficiently accurate. The lack of evidence for the broader application of such models limits its use despite the conceptual promise such models hold. In this study, we addressed this problem of practical usability by firstly deriving more accurate prediction models using DL; and secondly, by developing five different models broadly tested in a cross-organism manner. The results showed that our models were able to capture conserved splicing mechanisms. Splice2Deep exhibits an average error rate reduction of 41.97% for AcSS and 28.51% for DoSS relative to the current state-of-the-art models. Moreover, Splice2Deep allows users to select the taxonomically closest organism of interest, making our models both accurate as well as useful. One possible avenue for further improvement of the usability of Splice2Deep would be to add additional organism models, which could be a subject of future work.

Methods

Datasets

In this study, we extracted genomic DNA sequences surrounding the SS from five different organisms (H. sapiens, A. thaliana, O. sativa japonica, D. melanogaster, and C. elegans), using their respective gene annotation available at Ensembl (Zerbino et al., 2018). Table 5 describes the used annotation for each organism and the number of positive (true) SS samples. For each annotated AcSS and DoSS, bedtools (Quinlan and Hall, 2010) were used to extract the surrounding DNA sequences of the considered SS. We extracted from both upstream and downstream flanking segments of SS 300 nucleotides. This resulted in a sequence of 602 nucleotides (300-SS-300). Sequences with false SS (i.e., those dinucleotides that are the same as SS but are not involved in the splice site machinery) were extracted. In accordance to previous studies for the detection of genomic signals (Albalawi et al., 2019; Kalkatawi et al., 2019; Magana-Mora et al., 2017; Xie et al., 2013; Ashoor et al., 2011; Magana-Mora et al., 2013; Kalkatawi et al., 2012; Kalkatawi et al., 2013), we selected the number of false SS to match the number of the true SS as determined by the available genome annotation (i.e., equal to the number of positive samples). False SS (negative) samples were mined from the chromosomes whose average GC content is most close to the average GC content of the considered genome. Therefore, false SS were thus obtained from chromosomes 21, 2, 1, 2L, and I from H. sapiens, A. thaliana, O. sativa japonica, D. melanogaster, and C. elegans, respectively.
Table 5

Annotation for each organism and the number of positive and negative SS samples.

OrganismNumber of sequencesAssembly & Genebuild reference
DoSSHomo sapiens250,400 (true)250,400 (false)GRCh38.p12 (Zerbino et al., 2018)
Arabidopsis thaliana110,299 (true)110,299 (false)TAIR10 (Cheng et al., 2016)
Oryza sativa japonica103,426 (true)103,426 (false)IRGSP-1.0 (Sakai et al., 2013)
Drosophila melanogaster30,118 (true)30,118 (false)BDGP6.22 (Thurmond et al., 2019)
Caenorhabditis elegans77,387 (true)77,387 (false)WBcel235 (Lee et al., 2017)
AcSSHomo sapiens248,150 (true)248,150 (false)GRCh38.p12 (Zerbino et al., 2018)
Arabidopsis thaliana112,318 (true)112,318 (false)TAIR10 (Cheng et al., 2016)
Oryza sativa japonica104,028 (true)104,028 (false)IRGSP-1.0 (Sakai et al., 2013)
Drosophila melanogaster28,703 (true)28,703 (false)BDGP6.22 (Thurmond et al., 2019)
Caenorhabditis elegans77,763 (true)77,763 (false)WBcel235 (Lee et al., 2017)
Annotation for each organism and the number of positive and negative SS samples.

The Splice2Deep method

In what follows, we explain the most important facets of developing a robust DL model. We explain the strategy of selecting the appropriate data representation, determining the configuration of the DL model, as well as search strategy within the large hyperparameter space aiming to find the optimized set of model parameters.

Representation of data

In order to develop a reliable model, we first represent each sequence window with appropriate embedding based on whether this window is found within an exon or intron region. Therefore, we assumed that the upstream region of a DoSS frequently contains coding sequences, while its downstream region consists of non-coding sequences. Conversely, the upstream region of an AcSS consists of non-coding sequences, while its downstream region frequently contains coding sequences. Based on this consideration, in the case of a candidate DoSS, we embedded the upstream window sequence in a two-dimensional (2D) space with trinucleotides, while embedding the downstream window sequence (a non-coding region) in a 2D space with single nucleotides. For AcSS, we embedded the upstream window sequence (a non-coding region) in a 2D space with single nucleotides, while embedding the downstream window sequence in a 2D space with trinucleotides. Finally, we embedded the surrounding window sequence in a 2D space with single nucleotides. This embedding process is shown in Fig. 2A. The 2D space embedding for mononucleotide is a 4 ×  matrix, where L is the length of the window. Each nucleotide is encoded as 4 × 1 vector e.g., A [1,0,0,0], C [0,1,0,0], G [0,0,1,0], and T [0,0,0,1]. The 2D space embedding for trinucleotide is a matrix with 64 × (), and each trinucleotide is represented as 64 × 1 vector, e.g., AAA [1,0, …,0], AAC [0,1, …,0], …, and TTT [0,0, …,1]. Because we cannot be certain that reading frames are not interrupted by intron/exon boundaries (Tomita et al., 1996), the trinucleotides are formed in an overlapping manner, where we scan the whole sequence in a window and shift only one nucleotide each time until (similar to overlapped k-mers where k = 3). For example, the AACGTT sequence would result in AAC, ACG, CGT, and GTT trinucleotides.
Fig. 2

Data representation. A) Mononucleotide embedding with length (4 × L), and B) trinucleotide embedding with length (64 × L).

Data representation. A) Mononucleotide embedding with length (4 × L), and B) trinucleotide embedding with length (64 × L).

Deep learning model and parameter tuning

The Splice2Deep model receives as input a DNA sequence as raw data and performs feature extraction and feature selection using DL from the flanking regions described above. That is, given a sequence S, our model computes a score () based on a deep convolutional neural network (CNN), which consists of stacking a sequence of layers: 1) sequence encoding, 2) convolutional layers (CONV), 3) rectified linear unit layer (ReLU), 4) pooling layer (POOL), 5) fully connected layer (FC), and 6) SoftMax layer. The outputs from the CNN models are then used as inputs to an artificial neural network (NN) binary classifier to predict whether the given sequence represents a true or false SS. The structure of Splice2Deep method is shown in Fig. 3.
Fig. 3

Splice2Deep model overview. Local and surrounding windows. ‘SS’ refers to splice site and ‘N’ to nucleotides.

Splice2Deep model overview. Local and surrounding windows. ‘SS’ refers to splice site and ‘N’ to nucleotides. The CONV layer is the core building block of a CNN. Each of the DL models consists of k CONV layers (motif detectors) that capture motifs important for SS detection. The size of each filter depends on the encoded input. In each CONV layer, we scan the embedded sequence with the assigned filter, a stride of one and zero paddings to extract features. The CONV layers provide inputs to a nonlinear layer that contains a rectified linear unit (ReLU) as activation function (Glorot et al., 2011), defined as f(x) = max (0, x), where x is the output of the CONV layer. The POOL layer is used to select the best features obtained from the previous layer. Then a dropout layer added to each POOL layer to avoid overfitting by randomly removing some neurons during the training of the DL model. The outputs from all CONV layers are concatenated and flattened as a vector to make it suitable for an FC layer that uses a conventional NN with 500 neurons. The output classification layer that has two output neurons with SoftMax activation functions, receives inputs from the FC layer. To improve generalization performance on the testing set, we applied an early stopping technique, which monitors the validation error rate and stops the training if the error is not decreasing for five consecutive epochs. This DL model structure allows our network to learn richer features as the sequence progresses through the network. The structure of CNN is depicted in Fig. 4. One critical step in developing DL models is the hyperparameter selection. For this, we considered a grid search technique to select the best combination of different parameters. We used Keras (Chollet, 2015) library in python to construct our DL model. The best performing parameters based on the validation set were used to derive the final DL model. Table 6 shows the search space for the CNN models with the best performing parameters highlighted in bold. The outputs of each of the three CNN models (resulting from using the downstream, upstream, and surrounding regions) are used as features for the NN model that serves as the final binary classifier for candidate SS (Fig. 3). We used Python MLPclassifier from Scikit-learn (Pedregosa et al., 2011) to derive the NN model. The resulting NN has an input layer with three inputs (CNN outputs), a hidden layer with two nodes and a single output node. We used a grid search technique to select the best parameter combinations for the NN model. Table 6 shows the search space for the NN with the best performing parameters in bold.
Fig. 4

Splice2Deep learning model. It takes DNA sequence as input embedded in 2D (either 4 × L or 64 × L), apply k motif detectors (filters), max pooling, flatten, fully connected layer using SoftMax to output scores.

Table 6

Grid search space for the tuning of the CNN and NN hyperparameters.

CNN model hyperparametersSearch space
Activation function[tanh, relu]
Number of neurons on FC layer[128, 250, 512, 1024]
Initialization mode[uniform, glorot_normal]
Batch size[16, 32, 64, 128]
Dropout rate[0.01, 0.1, 0.2, 0.3, 0.4, 0.5]
Optimizer[SGD, Adam, Nadam]
4 × L embeddingNumber of filters[16, 32, 64]
Filter length[1, 2, 3, 4, 5, 6, 7, 8, 9]
Filter width[4]
64 × L embeddingNumber of filters[16, 32, 64]
Filter length[3, 5, 10, 21, 31, 41, 50, 61]
Filter width[64]



Splice2Deep learning model. It takes DNA sequence as input embedded in 2D (either 4 × L or 64 × L), apply k motif detectors (filters), max pooling, flatten, fully connected layer using SoftMax to output scores. Grid search space for the tuning of the CNN and NN hyperparameters. The following are the supplementary data related to this article.

Additional file 1: Table S1

Sensitivity (Sn) and specificity (Sp) comparison of Splice2Deep and the state-of-the- art tools for the prediction of SS on the five selected organisms. N/A indicates that the tool is not available for that specific organism.

Additional file 2: Table S2

Accuracy (Acc), sensitivity (Sn), and specificity (Sp) from the cross-organism validation obtained by using the Homo sapiens model and testing on the other organisms. N/A indicates that the tool is not available for that specific organism.

Additional file 3: Table S3

Accuracy (Acc), sensitivity (Sn), and specificity (Sp) from the cross-organism validation obtained by using the Arabidopsis thaliana model and testing on the other organisms. N/A indicates that the tool is not available for that specific organism.

Additional file 4: Table S4

Accuracy (Acc), sensitivity (Sn), and specificity (Sp) from the cross-organism validation obtained by using the Oryza sativa japonica model and testing on the other organisms. N/A indicates that the tool is not available for that specific organism.

Additional file 5: Table S5

Accuracy (Acc), sensitivity (Sn), and specificity (Sp) from the cross-organism validation obtained by using the Drosophila melanogaster model and testing on the other organisms. N/A indicates that the tool is not available for that specific organism.

Additional file 6: Table S6

Accuracy (Acc), sensitivity (Sn), and specificity (Sp) from the cross-organism validation obtained by using the Caenorhabditis elegans model and testing on the other organisms. N/A indicates that the tool is not available for that specific organism.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Availability of data and materials

The datasets generated and/or analyzed during the current study are publicly available online at https://github.com/SomayahAlbaradei/Splice_Deep.git.

Funding

VBB has been supported by the (KAUST) Base Research Fund (BAS/1/1606-01-01); ME has been supported by Office of Sponsored Research (OSR) Award no. FCC/1/1976-17-01. TG has also been supported by the (KAUST) Base Research Fund (BAS/1/1059-01-01).

Authors' contributions

The study is conceptualized by VBB and design made by VBB and SA. SA developed the models. SA, AMM, BJ, MT, ME, TG, and VBB analyzed the data. AMM performed data extraction and data curation. SA and AMM wrote the manuscript (with support from BRJ). SA, AMM, BRJ, MU, MT, ME, and VBB contributed to the discussion. ME and VBB reviewed/edited the manuscript. All authors read and approved the final manuscript.

Declaration of competing interest

The authors declare the following financial interests/personal relationships which may be considered as potential competing interests.
  41 in total

1.  Dragon PolyA Spotter: predictor of poly(A) motifs within human genomic DNA sequences.

Authors:  Manal Kalkatawi; Farania Rangkuti; Michael Schramm; Boris R Jankovic; Allan Kamau; Rajesh Chowdhary; John A C Archer; Vladimir B Bajic
Journal:  Bioinformatics       Date:  2013-04-15       Impact factor: 6.937

2.  Accurate identification of alternatively spliced exons using support vector machine.

Authors:  Gideon Dror; Rotem Sorek; Ron Shamir
Journal:  Bioinformatics       Date:  2004-11-05       Impact factor: 6.937

3.  Predicting Splicing from Primary Sequence with Deep Learning.

Authors:  Kishore Jaganathan; Sofia Kyriazopoulou Panagiotopoulou; Jeremy F McRae; Siavash Fazel Darbandi; David Knowles; Yang I Li; Jack A Kosmicki; Juan Arbelaez; Wenwu Cui; Grace B Schwartz; Eric D Chow; Efstathios Kanterakis; Hong Gao; Amirali Kia; Serafim Batzoglou; Stephan J Sanders; Kyle Kai-How Farh
Journal:  Cell       Date:  2019-01-17       Impact factor: 41.582

4.  Rice Annotation Project Database (RAP-DB): an integrative and interactive database for rice genomics.

Authors:  Hiroaki Sakai; Sung Shin Lee; Tsuyoshi Tanaka; Hisataka Numa; Jungsok Kim; Yoshihiro Kawahara; Hironobu Wakimoto; Ching-chia Yang; Masao Iwamoto; Takashi Abe; Yuko Yamada; Akira Muto; Hachiro Inokuchi; Toshimichi Ikemura; Takashi Matsumoto; Takuji Sasaki; Takeshi Itoh
Journal:  Plant Cell Physiol       Date:  2013-01-07       Impact factor: 4.927

5.  Splice site identification using probabilistic parameters and SVM classification.

Authors:  A K M A Baten; B C H Chang; S K Halgamuge; Jason Li
Journal:  BMC Bioinformatics       Date:  2006-12-18       Impact factor: 3.169

6.  A method for identifying alternative or cryptic donor splice sites within gene and mRNA sequences. Comparisons among sequences from vertebrates, echinoderms and other groups.

Authors:  Katherine M Buckley; Liliana D Florea; L Courtney Smith
Journal:  BMC Genomics       Date:  2009-07-16       Impact factor: 3.969

7.  Dragon TIS Spotter: an Arabidopsis-derived predictor of translation initiation sites in plants.

Authors:  Arturo Magana-Mora; Haitham Ashoor; Boris R Jankovic; Allan Kamau; Karim Awara; Rajesh Chowdhary; John A C Archer; Vladimir B Bajic
Journal:  Bioinformatics       Date:  2012-10-30       Impact factor: 6.937

8.  Gene trap mutagenesis of hnRNP A2/B1: a cryptic 3' splice site in the neomycin resistance gene allows continued expression of the disrupted cellular gene.

Authors:  Michael Roshon; James V DeGregori; H Earl Ruley
Journal:  BMC Genomics       Date:  2003-01-20       Impact factor: 3.969

9.  Discerning novel splice junctions derived from RNA-seq alignment: a deep learning approach.

Authors:  Yi Zhang; Xinan Liu; James MacLeod; Jinze Liu
Journal:  BMC Genomics       Date:  2018-12-27       Impact factor: 3.969

Review 10.  FlyBase 2.0: the next generation.

Authors:  Jim Thurmond; Joshua L Goodman; Victor B Strelets; Helen Attrill; L Sian Gramates; Steven J Marygold; Beverley B Matthews; Gillian Millburn; Giulia Antonazzo; Vitor Trovisco; Thomas C Kaufman; Brian R Calvi
Journal:  Nucleic Acids Res       Date:  2019-01-08       Impact factor: 16.971

View more
  5 in total

1.  Splice Junction Identification using Long Short-Term Memory Neural Networks.

Authors:  Kevin Regan; Abolfazl Saghafi; Zhijun Li
Journal:  Curr Genomics       Date:  2021-12-30       Impact factor: 2.689

Review 2.  From shallow to deep: some lessons learned from application of machine learning for recognition of functional genomic elements in human genome.

Authors:  Boris Jankovic; Takashi Gojobori
Journal:  Hum Genomics       Date:  2022-02-18       Impact factor: 4.639

Review 3.  Principles and correction of 5'-splice site selection.

Authors:  Florian Malard; Cameron D Mackereth; Sébastien Campagne
Journal:  RNA Biol       Date:  2022-01       Impact factor: 4.766

Review 4.  A review of deep learning applications in human genomics using next-generation sequencing data.

Authors:  Wardah S Alharbi; Mamoon Rashid
Journal:  Hum Genomics       Date:  2022-07-25       Impact factor: 6.481

Review 5.  How artificial intelligence might disrupt diagnostics in hematology in the near future.

Authors:  Wencke Walter; Claudia Haferlach; Niroshan Nadarajah; Ines Schmidts; Constanze Kühn; Wolfgang Kern; Torsten Haferlach
Journal:  Oncogene       Date:  2021-06-08       Impact factor: 9.867

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.