Literature DB >> 32449934

ASAP 2020 update: an open, scalable and interactive web-based portal for (single-cell) omics analyses.

Fabrice P A David1,2,3, Maria Litovchenko1,2, Bart Deplancke1,2, Vincent Gardeux1,2.   

Abstract

Single-cell omics enables researchers to dissect biological systems at a resolution that was unthinkable just 10 years ago. However, this analytical revolution also triggered new demands in 'big data' management, forcing researchers to stay up to speed with increasingly complex analytical processes and rapidly evolving methods. To render these processes and approaches more accessible, we developed the web-based, collaborative portal ASAP (Automated Single-cell Analysis Portal). Our primary goal is thereby to democratize single-cell omics data analyses (scRNA-seq and more recently scATAC-seq). By taking advantage of a Docker system to enhance reproducibility, and novel bioinformatics approaches that were recently developed for improving scalability, ASAP meets challenging requirements set by recent cell atlasing efforts such as the Human (HCA) and Fly (FCA) Cell Atlas Projects. Specifically, ASAP can now handle datasets containing millions of cells, integrating intuitive tools that allow researchers to collaborate on the same project synchronously. ASAP tools are versioned, and researchers can create unique access IDs for storing complete analyses that can be reproduced or completed by others. Finally, ASAP does not require any installation and provides a full and modular single-cell RNA-seq analysis pipeline. ASAP is freely available at https://asap.epfl.ch.
© The Author(s) 2020. Published by Oxford University Press on behalf of Nucleic Acids Research.

Entities:  

Year:  2020        PMID: 32449934      PMCID: PMC7319583          DOI: 10.1093/nar/gkaa412

Source DB:  PubMed          Journal:  Nucleic Acids Res        ISSN: 0305-1048            Impact factor:   16.971


INTRODUCTION

Single-cell omics is a recent field that started to bloom in 2013–15 with the advent of commercially available single-cell RNA-seq (scRNA-seq) protocols (1,2). At its origin, platforms could process hundreds of cells at a time, whose corresponding transcriptomes could still be handled by traditional bulk RNA-seq bioinformatics tools. In a very short amount of time, however, sample sizes exploded (3). This is exemplified by recent efforts aiming to create ‘cell atlases’ for entire tissues (4,5) or organisms (6–9) at resolutions and scales that are more difficult to handle computationally (>100k or even millions of cells and thus transcriptomes). As the field evolves, so are the underlying analytical approaches and tools, making it increasingly more difficult to see ‘the forest through the methodological trees’ and to select the proper analysis pipeline (10,11). The latter is also in part dictated by the size of the focal dataset, with powerful tools now emerging that aim to handle single-cell omics datasets in a scalable manner (12). However, these tools have yet to take firm root in the field, especially with researchers who have so far been accustomed to working with smaller-sized datasets (∼1–10k cells). The urgency for these tools to become widely implemented is illustrated by recent cell atlasing projects, which clearly demonstrate the need for both scalable computing power and analytical approaches (10). Finally, novel single-cell omics approaches such as single-cell ATAC-seq (scATAC-seq) are rapidly emerging, posing additional problems in terms of data management and integration (13). To reduce the complexity of single-cell omics analyses, we developed ASAP (14), enabling standardized analyses that can be run in minutes by any user without requiring significant computing power. The entire, canonical scRNA-seq pipeline is available in ASAP, and can be summarized into 8 consecutive steps: (i) filtering low quality cells and lowly expressed genes, (ii) normalization across cells, (iii) scaling and covariate removal (such as read depth, mitochondrial content, etc.), (iv) computing highly variable genes of interest, (v) performing dimension reduction using PCA followed by high dimensional methods such as t-SNE or UMAP, (vi) clustering of cells to identify subpopulations, (vii) differential expression analysis to identify marker genes of identified subpopulations and (viii) functional enrichment of these marker genes into pathways or cell types. Of course, all these steps are parametrizable, and we acknowledge that it may be difficult to find one fixed pipeline that will fit all dataset types (10). A trained bioinformatician tends to therefore tune the parameters to the dataset of interest. Given this, ASAP allows users to choose from a panel of tools, thereby providing guiding tutorials to help researchers with their selection of the correct tools or parametrization for their datasets. Here, we report a major ASAP upgrade, with several substantial improvements such as a completely remodeled user interface, a fully Dockerized (15,16) system, and the internal implementation of the .loom file format. We chose this format since it substantially increased the scalability of the tools used to perform out-of-RAM computations, allowing the analysis of high-dimensional datasets of virtually any size. This new format also enhances the communication between existing portals such as SCope (17), the Human Cell Atlas (7), and many others that are adopting the same file format for storing complete analyses into one single file.

RESULTS AND METHODS

Implementation overview

ASAP is now using the Docker technology (15,16) to make the whole platform modular and versioned (Figure 1). Docker containers separate the main website (the Ruby-on-rails web server code) from the running jobs (R, Python and Java bioinformatics tools), enabling jobs to run on a different machine than the main server hosting the web application. Moreover, this architecture allows the asap_run container (hosting the versioned bioinformatics tools) to be dispatched to many external machines for enhanced computing power, and maybe in the future, to the cloud.
Figure 1.

ASAP architecture. The ASAP application is a docker-compose-based Ruby-on-Rails application. ASAP implements web-sockets (using Redis and Cable containers) for an interactive display of results at the client end. Analyses launched by users are submitted to a scheduler that will run third party software (Python, R, Java) in versioned docker containers ASAP_run:vM, enabling scalability and reproducibility of the platform. The scheduler also ensures that the number of cores that are used on the machine and the level of RAM used on the machine are not exceeding hardware capacities. The ASAP_core database stores users, projects and job stats (for benchmarking the tools) and is thus not versioned. A versioned ASAP_data_vN (currently v5) database stores external public data on genes, gene sets and future ontologies. Results of analyses are written on a fast-access disk (NVME) shared by the Ruby-on-Rails and the ASAP_run:vM docker containers. Projects that are not accessed for a long period are automatically saved on an object storage system (through a CRON job) for saving space on the fast access NVME disk.

ASAP architecture. The ASAP application is a docker-compose-based Ruby-on-Rails application. ASAP implements web-sockets (using Redis and Cable containers) for an interactive display of results at the client end. Analyses launched by users are submitted to a scheduler that will run third party software (Python, R, Java) in versioned docker containers ASAP_run:vM, enabling scalability and reproducibility of the platform. The scheduler also ensures that the number of cores that are used on the machine and the level of RAM used on the machine are not exceeding hardware capacities. The ASAP_core database stores users, projects and job stats (for benchmarking the tools) and is thus not versioned. A versioned ASAP_data_vN (currently v5) database stores external public data on genes, gene sets and future ontologies. Results of analyses are written on a fast-access disk (NVME) shared by the Ruby-on-Rails and the ASAP_run:vM docker containers. Projects that are not accessed for a long period are automatically saved on an object storage system (through a CRON job) for saving space on the fast access NVME disk. Since the single-cell community is very active, and new methods appear or are upgraded almost on a monthly basis, this architecture allows an easier versioning of the portal with each asap_run container encapsulating its own tool versions. This will enhance reproducibility and retro-compatibility with previous studies. The Dockerized architecture also keeps all tool versions fixed for a given global version of ASAP, thus all listed tools are embedded at a fixed version and correspond to a single versioned Docker.

.loom files

.loom files represent a standardized file format for storing/handling single-cell datasets. It was proposed and developed by the Linnarsson Lab (http://loompy.org/). .loom files are HDF5 (Hierarchical Data Format) files following certain constraints in terms of group/dataset names and types. They allow for very efficient computation and access to row/columns of datasets, thus greatly enhancing the scalability of computational methods. The matrices can be chunked, which allows out-of-RAM computation by processing the data ‘chunk by chunk’. The new version of ASAP now internally handles .loom files for every project. When a user submits a dataset (plain text, archive, 10×, etc.), it is automatically transformed into a .loom file during the parsing step. This step also computes basic statistics (number of detected genes, ratio mitochondrial content, depth, etc.) that are immediately added to the parsed .loom file and available downstream, such as for example when coloring plots during visualization.

Web application

The ASAP web application is developed with Ruby-on-Rails (RoR). The backend is implemented as a PostgreSQL relational database. The frontend uses different JavaScript libraries and is set to enable front-end scalability with big datasets. Specifically, (i) scattergl plots from plotly.js (18) to render dimension reduction plots scalable; (ii) pako-inflate.js (https://github.com/nodeca/pako) to compress big integer arrays between the client and the server and (iii) an adapted version of JQuery (https://jquery.com/) file input for scalable file uploads. Other important javascript libraries that are used include Cytoscape.js (19,20) to generate a graphical display of the analysis pipeline composition or of Jquery autocomplete for gene selection in the visualization tool. As mentioned previously (see Figure 1), the ASAP web application runs in a Docker container called asap_web. Together with other containers for the (i) websockets (Cable, Redis containers), (ii) PostgreSQL server and (iii) Puma web server, they are embedded in a docker-compose that guarantees independence with respect to the hosting system and that could facilitate further migration / deployment of the system.

Reproducibility

The ASAP server incorporates a versioning system that ensures full reproducibility of the analyses that are carried out on the web application. This release handles new projects and retro-compatibility of old projects starting from version 4 (v4). When starting a project, users have the option to use the stable version of their choice (i.e. v4 or v5 at the moment). Version stability is enabled by two key components of the system: (i) all external (project-independent) data are stored in a versioned PostgreSQL relational database asap_data_vN; and (ii) all scripts and executables are installed with the necessary dependencies in an r-base docker container asap_run:vM that is available on Dockerhub (https://hub.docker.com/r/fabdavid/asap_run/tags). Note that for a given global ASAP version, versions of the docker container and of the relational database M and N can be different, since the database or the docker container are not necessarily updated each time. For every run, we also provide the user with the exact list of commands that was used to produce the output (using the Docker module). Therefore, all steps are completely reproducible, and a default pipeline can be readily implemented using Docker and the scripts generated by ASAP. A global script is also dynamically generated for each project, so users can reproduce their complete analysis locally on their machine/server. The script loads the right version of the docker container and of the relational database and runs the whole pipeline, as designed by the users.

Execution of analyses

On the ASAP server, the different analysis scripts and executables are run within the asap_run_vN docker containers by a scheduler that evaluates if the system can accept a new analysis at a given time. The scheduler assesses the status of the system (checking the load on the machine and the number of free CPUs). For each analysis, the amount of RAM required, and the execution time are monitored and stored; this information is then available to the users through the interface. Operations requiring a minimal amount of resources, such as unarchiving projects, are directly launched (without waiting) on a queue through DelayedJob, a RoR module that allows to run a piece of code asynchronously.

Referencing and searching ASAP projects

Identifiers from GEO (21) or ArrayExpress (22) can be associated manually to an ASAP project. If users publish the results of an ASAP analysis, they can also provide the PubMed ID of the article (at the same time as setting the project as ‘public’). If a project is loaded from the Human Cell Atlas (HCA) Data Coordination Platform (DCP), then GEO and ArrayExpress identifiers are automatically associated to the ASAP project. From these identifiers (assigned manually or automatically), information from GEO, ArrayExpress and BioProject (23) (mainly literature references, description and identifiers) is automatically extracted and associated to the ASAP project. In addition, an instance of SunSpot/SolR runs on the RoR application and provides an efficient search engine to retrieve lists of projects that are associated with any GEO, ArrayExpress or BioProject project, based on identifiers or free-text descriptions.

Input

ASAP can handle read/UMI count matrices in several formats: (i) plain-text files (compressed or not), (ii) archives of text files (compressed or not), (iii) .loom files or (iv) .h5 files produced by the 10× CellRanger pipeline (https://github.com/10XGenomics/cellranger). When the data finishes uploading on the server, ASAP starts to parse the file and shows a snapshot (preview) of the dataset (10 first rows, 10 first columns) as well as cell/gene names (Figure 2). This allows the user to change some parsing options, such as the separator or the column id containing the gene names, without having to re-upload the dataset.
Figure 2.

Dataset preview after its upload in ASAP. After uploading a file (of any type), ASAP shows a preview of the main count matrix (10 first rows/columns), as well as genes and cell names. It also shows an icon with the type of file that is recognized automatically. Therefore, the user has the possibility to change the parsing options if needed (delimiter, header, …). In this page, the user can name the project, choose an organism from the ∼500 organisms available from Ensembl, and choose the version to run on (here, v4 is the latest stable version (default) and v5 is still in beta).

Dataset preview after its upload in ASAP. After uploading a file (of any type), ASAP shows a preview of the main count matrix (10 first rows/columns), as well as genes and cell names. It also shows an icon with the type of file that is recognized automatically. Therefore, the user has the possibility to change the parsing options if needed (delimiter, header, …). In this page, the user can name the project, choose an organism from the ∼500 organisms available from Ensembl, and choose the version to run on (here, v4 is the latest stable version (default) and v5 is still in beta). Users can also choose to create a new project from data hosted by the HCA DCP. This feature uses an API provided by the HCA (Matrix Service API) to query the available datasets. The user can choose specific datasets for import into ASAP, and the HCA API will automatically generate a .loom file containing all selected cells (Figure 3). Finally, a new project is created on ASAP with the imported .loom file, with which the user can start analysis and visualization.
Figure 3.

Dataset download from the Human Cell Atlas Matrix Service API. Users can query the Matrix Service API of the Human Cell Atlas (HCA) from the ASAP ‘New Project’ page. They will see a list of projects from which the Matrix Service can generate count matrices in the form of .loom files (.fastq and other raw sequencing files are automatically filtered out). The user can then choose a project and the HCA API will automatically send a .loom file to ASAP. The latter file will be parsed automatically, thus creating a ‘ready to analyze’ project in ASAP. Importantly, all metadata sent from the HCA are automatically imported along with the .loom file, and will be readily available in ASAP (such as sequencing platform, tissue of origin, etc.).

Dataset download from the Human Cell Atlas Matrix Service API. Users can query the Matrix Service API of the Human Cell Atlas (HCA) from the ASAP ‘New Project’ page. They will see a list of projects from which the Matrix Service can generate count matrices in the form of .loom files (.fastq and other raw sequencing files are automatically filtered out). The user can then choose a project and the HCA API will automatically send a .loom file to ASAP. The latter file will be parsed automatically, thus creating a ‘ready to analyze’ project in ASAP. Importantly, all metadata sent from the HCA are automatically imported along with the .loom file, and will be readily available in ASAP (such as sequencing platform, tissue of origin, etc.). Internally, all inputs are transformed into .loom files as a common format for all steps. Of course, the users can download the .loom files for their projects and also load them into R (using loomR, https://github.com/mojaveazure/loomR) or Python (using loompy, http://loompy.org/). Of note, since .loom files are essentially normed HDF5 files, they can potentially be loaded with any other programming language as well.

Ensembl and gene set database

In its last version (v5), ASAP incorporates information from the Ensembl (24) ‘vertebrates’ database v54 to v99 and from Ensembl ‘genomes’ v5 to v46. The ASAP_data_v5 database contains 16 734 890 genes with unique Ensembl identifiers for 551 different species. During file parsing, all genes are mapped to the database version chosen by the user (v4 or v5), with the latest stable one always being pre-selected. This mapping is not necessary for most of the steps included in ASAP, but can provide additional information in the result tables, or when hovering on the dynamic plots. It is mostly needed during the last step of the analysis (cell type annotation/functional enrichment), when ASAP needs to relate differentially expressed genes (or marker genes) to gene sets such as GO (25), KEGG (26), Drugbank (27) or cell type annotation databases (28–30).

Available tools, bioinformatics scripts and executables

Since the initial implementation of ASAP, several tools were added, and obsolete tools were removed for this major upgrade. Currently, ASAP hosts tools in Python, R, and Java. The parsing and filtering steps are performed in Java, which we found to be both much faster than R or Python as well as scalable to any dataset (implemented to take advantage of the .loom format and the chunking of the count matrices). In addition, for the Cell Filtering step, we implemented dynamic plots for selecting the best thresholds according to major QC metrics: number of detected genes, number of UMIs/reads, ratio of reads mapping to protein-coding genes, ratio of mitochondrial reads, and ratio of ribosomal reads (Figure 4). The user can see the plots, select the best thresholds for each of them, and visualize the resulting number of filtered cells interactively, prior to validation, which will produce a novel .loom file filtered according to the different thresholding parameters.
Figure 4.

Interactive cell filtering step enables users to set various thresholds for QC. The cell filtering step features interactive plots for filtering out outlier cells that do not pass certain quality controls (QC). In all panels, a point is a cell. Of note, when a threshold is selected in one of the five panels, all other panels are automatically refreshed so the user can see the retained cells (green) and the ones that were filtered out (grey). A recap of the final number of selected vs. filtered out genes is available in the top bar. (A) Number of UMI/read counts per cell (sorted in descending order). This plot is similar to the plot generated by CellRanger in the 10x pipeline. Users can select a minimum number of UMI/reads per cell. (B) Number of UMIs/Read counts vs number of detected genes. (C). Ratio of reads that maps to mitochondrial genes (vs all mapped reads). This feature uses the Ensembl database to know on which chromosome the genes are mapping, so only genes that are mapped to our Ensembl database are considered. (D, E) Similar to C. but using the biotype of the genes from Ensembl to know if the reads map to a protein-coding gene (D), or to a ribosomal gene (E).

Interactive cell filtering step enables users to set various thresholds for QC. The cell filtering step features interactive plots for filtering out outlier cells that do not pass certain quality controls (QC). In all panels, a point is a cell. Of note, when a threshold is selected in one of the five panels, all other panels are automatically refreshed so the user can see the retained cells (green) and the ones that were filtered out (grey). A recap of the final number of selected vs. filtered out genes is available in the top bar. (A) Number of UMI/read counts per cell (sorted in descending order). This plot is similar to the plot generated by CellRanger in the 10x pipeline. Users can select a minimum number of UMI/reads per cell. (B) Number of UMIs/Read counts vs number of detected genes. (C). Ratio of reads that maps to mitochondrial genes (vs all mapped reads). This feature uses the Ensembl database to know on which chromosome the genes are mapping, so only genes that are mapped to our Ensembl database are considered. (D, E) Similar to C. but using the biotype of the genes from Ensembl to know if the reads map to a protein-coding gene (D), or to a ribosomal gene (E). The highly variable gene calculation is using tools from three packages: M3Drop (31), Seurat (32) and Scanpy (12). Of note, only the one from Scanpy is scalable to >100k cells. Also, for these methods, the user is able to see the resulting curve and highlight genes of interest by hovering on the cell (Figure 5). In the subsequent visualization step, PCA (Incremental PCA) is implemented in Python and is parallelized and scalable. The UMAP (33) and t-SNE (34) methods from Seurat are implemented as well and are scalable when run on the results of the PCA. A parallelized version of t-SNE was also added from the Scanpy package in ASAP v5.
Figure 5.

Calculation and interactive visualization of Highly Variable Genes and M3Drop. Different methods in ASAP are available to select highly variable genes. All methods produce an interactive plot where the user can hover the cells to see their characteristics (rectangle box tooltip). Here, we see the output of two methods. On the left panel, highly variable genes are calculated from Seurat (v2) using the Brennecke et al. method (50). On the right panel is the output of the M3Drop method, more specifically the Depth-Adjusted Negative Binomial (DANB) model, which is tailored for datasets quantified using unique molecular identifiers (UMIs).

Calculation and interactive visualization of Highly Variable Genes and M3Drop. Different methods in ASAP are available to select highly variable genes. All methods produce an interactive plot where the user can hover the cells to see their characteristics (rectangle box tooltip). Here, we see the output of two methods. On the left panel, highly variable genes are calculated from Seurat (v2) using the Brennecke et al. method (50). On the right panel is the output of the M3Drop method, more specifically the Depth-Adjusted Negative Binomial (DANB) model, which is tailored for datasets quantified using unique molecular identifiers (UMIs). Many clustering methods are implemented, mostly in R (Seurat, SC3 (35), k-means) and should be run on the results of the PCA for scalability purposes. Similarly, many differential expression methods were implemented in R (Seurat, limma (36), DESeq2 (37)) or re-implemented by us in Java for the purpose of scalability (Wilcoxon-ASAP). Only Seurat and our homemade Wilcoxon methods are scalable. Finally, we have also developed in Java the functional enrichment step using a simple Fisher's Exact Test, thereby considering the correct background for not inflating the resulting P-values. This method is scalable as well to any dataset.

Outputs

For most steps, the main output is a newly annotated .loom file. For example, when generating a dimension reduction output, the initial .loom file is modified with an additional column attribute containing the ‘cells vs. components’ result matrix. In addition, the user can visualize this data directly in the browser as an interactive plot. Internally, the server will extract the column attributes from the .loom file and generate a JSON file that will be sent to the client and that can be visualized using plotly.js scattergl. The WebGL version was chosen because it allows the plotting of millions of cells in a timely manner. Different steps have different outputs. For some steps, such as detecting highly variable genes, the output is a filtered .loom file and a dynamic plot showing the interpolation that was produced during the calculation. Other steps such as the differential expression or the functional enrichment steps produce sorted tables of statistically significant genes/gene sets. These tables have dynamic links to external databases such as GO (25) or Ensembl (24). The main visualization step is the dimension reduction (using PCA, t-SNE (34) or UMAP (33)). This step allows the user to visualize the dataset in 2D or 3D. The 2D view can be tuned in different ways. First, the user can color the cells according to external metadata (such as sex, library type, depth, batch etc.), clustering results, or gene expression (Figure 6). The plot is also dynamic, so the user can select cells of interest to create new metadata on which additional operations can be performed, such as a novel differential expression calculation. Finally, the user can also annotate the clusters according to marker genes (with a cell type for example), either from this view or directly from the ‘Marker Gene’ view in the differential expression step.
Figure 6.

UMAP visualization of an HCA public project involving 780k cells with coloring options. After dimension reduction, the user can see 2D and 3D plots of the dataset. Here, we show an ASAP project that was created using the HCA Matrix service feature (see Figure 3) involving ∼780k cells from human bone marrow + cord blood. The pipeline was run until the UMAP step which is what is visualized in the top and bottom panels. In each panel, on the right, we opened the ‘Controls’ view which allows the user to change the appearance of the plot (size of the points, colors, etc..) and to manage any clustering results (and eventually annotate clusters). (A) Here, we show coloring by the number of detected genes. This shows a region which seems to have much more detected/expressed genes which can be a biological result or may represent doublets. (B) Here, the cells are colored using an annotation that was imported from the HCA: ‘derived_organ_parts_ontology’. We can clearly see the coloring of the two organ parts that compose the dataset: bone marrow and cord blood, which highlights a need for better integration of both datasets. One way would be to use Seurat or MNN methods to remove the batch effect between the two organ parts, this is currently in development (see Discussion).

UMAP visualization of an HCA public project involving 780k cells with coloring options. After dimension reduction, the user can see 2D and 3D plots of the dataset. Here, we show an ASAP project that was created using the HCA Matrix service feature (see Figure 3) involving ∼780k cells from human bone marrow + cord blood. The pipeline was run until the UMAP step which is what is visualized in the top and bottom panels. In each panel, on the right, we opened the ‘Controls’ view which allows the user to change the appearance of the plot (size of the points, colors, etc..) and to manage any clustering results (and eventually annotate clusters). (A) Here, we show coloring by the number of detected genes. This shows a region which seems to have much more detected/expressed genes which can be a biological result or may represent doublets. (B) Here, the cells are colored using an annotation that was imported from the HCA: ‘derived_organ_parts_ontology’. We can clearly see the coloring of the two organ parts that compose the dataset: bone marrow and cord blood, which highlights a need for better integration of both datasets. One way would be to use Seurat or MNN methods to remove the batch effect between the two organ parts, this is currently in development (see Discussion).

Estimation of time and RAM for each tool

With this new version, we developed a novel tool to predict the computing time and maximum RAM that will be required by a job, before running it. To achieve this, we store certain characteristics of jobs that were run by users in a separate versioned database. These include the size of the dataset (number of cells/rows) that was used as input and the time/RAM that was required by the job, providing the run was successful. Currently, the prediction is only made based on the size of the dataset, but in the future, we may consider adding method parameters as well (in case they have a strong effect on the overall computing time and RAM usage predictions). We use two simple linear models that are trained on these datasets for every tool that is present in ASAP: (i) time ∼ nbcells * nbgenes and (ii) ram ∼ nbcells * nbgenes. These models are recomputed daily using a CRON task and are stored as .Rdata files for fast prediction in the UI.

Project sharing

A key feature of our upgraded ASAP web application is the interactivity and collaboration possibilities. To implement this, we established a project sharing system, allowing concurrent access to the same project. Users can share their projects with other ASAP users (or send an email to a novel user who will need to register) to allow accessing the same project simultaneously. We set up right permissions, so that the owner of a project can control his/her projects in terms of visibility, modification, and further sharing. There is also the possibility to render a project public, or to clone a project. Public projects are associated with a unique ASAP-ID that can be listed in a publication and that can be used for enhanced reproducibility in published papers. Symmetrically, the PMID of the published work can be entered in the details of the ASAP project and the reference will then be displayed on the project page. Once a project is open, any change in the status of analyses is transmitted to the user through Websockets (ActiveCable in Ruby-on-Rails). This feature enables interactive, collaborative projects, since any modification to a project by any of the sharing users is indicated to the others in real time.

DISCUSSION AND FUTURE IMPLEMENTATIONS

Single-cell omics technologies are increasingly applied in both biological as well as clinical research to identify new cell types and to uncover cellular dynamics during development or disease (e.g. tumor heterogeneity). Conventional pipelines tend to require hours/days of work by a trained bioinformatician to deliver meaningful results. ASAP’s main goal is to aid with the interpretation of these data since the whole pipeline can be run in minutes, providing on-the-go visualization, identification of new cell or disease populations by clustering, differential expression analysis and enrichment. With ASAP, we strive to build a centralized platform to store single-cell projects and their complete analyses in a shareable and reproducible fashion. The interface of ASAP is designed to be user-friendly and provides versatility with a library of state-of-the-art tools that are documented. Tutorials thereby guide the user through the different steps of the analysis. Users can easily upload their dataset and readily start working with it through interactive plots and output tables without previous analysis experience. Given the desire of the research community at large to render single-cell analyses more accessible, several other interactive visualization tools or platforms have been developed in parallel (38). Building on a recent pre-print overviewing these tools (38), we compared the new version of ASAP (2020) presented in this manuscript to the original one (ASAP 2017) (14), and to the other state-of-the art tools that are currently available (see Table 1). Here, we mostly focused on tools with a web interface, thus disregarding (i) software such as the BioTuring Single-Cell Browser (Bbrowser) or the Loupe cell browser, and (ii) packages such as Seurat (32) or scanpy (12). Other portals, such as the Single-Cell Expression Atlas (39) are only meant to visualize public datasets, and thus are not designed for user-specific datasets. Conversely, we can also mention two Galaxy servers that simplify the processing pipeline but do not support an interactive visualization of the results: (a) a common server providing a single-cell analysis workflow (https://singlecell.usegalaxy.eu/), (b) and another one specifically designed for the analysis of data from the Human Cell Atlas initiative (https://humancellatlas.usegalaxy.eu/). The latter is connected to the HCA Matrix service to import datasets, and relies on the UCSC Cell Browser (Table 1) or the Single-cell Expression Atlas (39) for visualization.
Table 1.

Overview of state-of-the-art web portals supporting single-cell RNA-seq data analysis and interactive visualization. Two versions of ASAP were compared to state-of-the-art tools. Docker indicates whether a docker image with the tool is provided by the developers. HCA: Human Cell Atlas. Benchmarking tools: The ability to monitor all the tools on the platform for computing time and/or RAM usage. Cell-type annotation: The ability to interactively annotate clusters/cell types

*A remote website was also available but seemed to mostly serve as an example, since no job queuing system was implemented, the website became inaccessible every time a step was launched

**SingleCellExplorer ‘Click here to Launch’ remote server was not functioning at the time of this paper

Overview of state-of-the-art web portals supporting single-cell RNA-seq data analysis and interactive visualization. Two versions of ASAP were compared to state-of-the-art tools. Docker indicates whether a docker image with the tool is provided by the developers. HCA: Human Cell Atlas. Benchmarking tools: The ability to monitor all the tools on the platform for computing time and/or RAM usage. Cell-type annotation: The ability to interactively annotate clusters/cell types *A remote website was also available but seemed to mostly serve as an example, since no job queuing system was implemented, the website became inaccessible every time a step was launched **SingleCellExplorer ‘Click here to Launch’ remote server was not functioning at the time of this paper As we can see in Table 1, ASAP is amongst the first portals that are directly linked to the Human Cell Atlas (7). In addition, most portals are in essence visualization tools that require external pipelines to analyze a dataset, which can then be visualized in the respective portal (see ‘NO precomputed results’ in Table 1). Few portals therefore support a complete end-to-end analysis of the data within a web user interface, and the ones that do tend to require a local or cloud installation. In contrast, and as indicated in (38): ‘ASAP is a comprehensive hosting platform and as such it does not require a local or cloud installation’. Consequently, and contrary to most available portals, ASAP users can perform all the desired analyses directly within the portal, and do not have to consider installation prerequisites. Moreover, given ASAP’s multi-user functionalities, users can share their analysis projects with others in an interactive and modular fashion, which is currently unique to ASAP (see Table 1, ‘Sharing system’). We are also currently working with the Fly Cell Atlas (FCA) consortium (https://flycellatlas.org/) to generate a central repository for atlas-like initiatives. In particular, we are collaborating with the Scope (17) portal to develop new methods for crowd annotation of clusters into cell types. Indeed, we believe that the next important demand in the single-cell field will be the ability to implement accurate cell annotations (40,41). Currently, this is still a great, outstanding challenge that requires hours of manual annotation and literature review. To address this, we plan to use the available user base of ASAP and SCope to create a crowd-based annotation of cells though an individual curation and voting system, thereby reinforcing correct cluster annotations. This will lead to the creation of a public database that will record cell identity features (such as marker genes) from personal projects as well as from those hosted by atlas-like initiatives (such as the HCA or the FCA). Thereafter, we plan to use this database for the interactive and automated annotation of cells. Finally, we would like to point out that scATAC-seq datasets from 10x (CellRanger output) can in principle also be loaded into ASAP. For now, they can only be processed with the same scRNA-seq pipeline, i.e. no specific methods have so far been added such as cisTopic (42) or other motif enrichment analysis tools. However, the user can still perform UMAP/t-SNE and/or clustering, which can already be insightful. This shows the modular capacity of ASAP, which potentially offers a platform that will be able to include a more specific scATAC-seq data analysis workflow in the future. We also plan to add an integration feature with the goal of integrating datasets and of correcting for batch effects. We are aware of existing techniques that support such integration, such as MNN (43) or Seurat (32,44), and are benchmarking them on high-dimensional datasets to select the most relevant method.

DATA AVAILABILITY

ASAP is freely available at https://asap.epfl.ch. It is an open source software whose source code is deposited in two GitHub repositories: (i) the R/Python/Java scripts are deposited in https://github.com/DeplanckeLab/ASAP and are available as a ready-to-use Docker container at https://hub.docker.com/r/fabdavid/asap_run/tags and (ii) the server code is available at https://github.com/fabdavid/asap2_web.
  42 in total

1.  PanglaoDB: a web server for exploration of mouse and human single-cell RNA sequencing data.

Authors:  Oscar Franzén; Li-Ming Gan; Johan L M Björkegren
Journal:  Database (Oxford)       Date:  2019-01-01       Impact factor: 3.451

2.  NCBI GEO: archive for high-throughput functional genomic data.

Authors:  Tanya Barrett; Dennis B Troup; Stephen E Wilhite; Pierre Ledoux; Dmitry Rudnev; Carlos Evangelista; Irene F Kim; Alexandra Soboleva; Maxim Tomashevsky; Kimberly A Marshall; Katherine H Phillippy; Patti M Sherman; Rolf N Muertter; Ron Edgar
Journal:  Nucleic Acids Res       Date:  2008-10-21       Impact factor: 16.971

3.  Cytoscape Web: an interactive web-based network browser.

Authors:  Christian T Lopes; Max Franz; Farzana Kazi; Sylva L Donaldson; Quaid Morris; Gary D Bader
Journal:  Bioinformatics       Date:  2010-07-23       Impact factor: 6.937

4.  ArrayExpress--a public repository for microarray gene expression data at the EBI.

Authors:  Alvis Brazma; Helen Parkinson; Ugis Sarkans; Mohammadreza Shojatalab; Jaak Vilo; Niran Abeygunawardena; Ele Holloway; Misha Kapushesky; Patrick Kemmeren; Gonzalo Garcia Lara; Ahmet Oezcimen; Philippe Rocca-Serra; Susanna-Assunta Sansone
Journal:  Nucleic Acids Res       Date:  2003-01-01       Impact factor: 16.971

5.  Integrating single-cell transcriptomic data across different conditions, technologies, and species.

Authors:  Andrew Butler; Paul Hoffman; Peter Smibert; Efthymia Papalexi; Rahul Satija
Journal:  Nat Biotechnol       Date:  2018-04-02       Impact factor: 54.908

6.  Granatum: a graphical single-cell RNA-Seq analysis pipeline for genomics scientists.

Authors:  Xun Zhu; Thomas K Wolfgruber; Austin Tasato; Cédric Arisdakessian; David G Garmire; Lana X Garmire
Journal:  Genome Med       Date:  2017-12-05       Impact factor: 11.117

7.  ASAP: a web-based platform for the analysis and interactive visualization of single-cell RNA-seq data.

Authors:  Vincent Gardeux; Fabrice P A David; Adrian Shajkofci; Petra C Schwalie; Bart Deplancke
Journal:  Bioinformatics       Date:  2017-10-01       Impact factor: 6.937

8.  SCANPY: large-scale single-cell gene expression data analysis.

Authors:  F Alexander Wolf; Philipp Angerer; Fabian J Theis
Journal:  Genome Biol       Date:  2018-02-06       Impact factor: 13.583

9.  Single Cell Explorer, collaboration-driven tools to leverage large-scale single cell RNA-seq data.

Authors:  Di Feng; Charles E Whitehurst; Dechao Shan; Jon D Hill; Yong G Yue
Journal:  BMC Genomics       Date:  2019-08-27       Impact factor: 3.969

10.  A Single-Cell Transcriptome Atlas of the Aging Drosophila Brain.

Authors:  Kristofer Davie; Jasper Janssens; Duygu Koldere; Maxime De Waegeneer; Uli Pech; Łukasz Kreft; Sara Aibar; Samira Makhzami; Valerie Christiaens; Carmen Bravo González-Blas; Suresh Poovathingal; Gert Hulselmans; Katina I Spanier; Thomas Moerman; Bram Vanspauwen; Sarah Geurs; Thierry Voet; Jeroen Lammertyn; Bernard Thienpont; Sha Liu; Nikos Konstantinides; Mark Fiers; Patrik Verstreken; Stein Aerts
Journal:  Cell       Date:  2018-06-18       Impact factor: 41.582

View more
  7 in total

Review 1.  Tutorial: guidelines for annotating single-cell transcriptomic maps using automated and manual methods.

Authors:  Zoe A Clarke; Tallulah S Andrews; Jawairia Atif; Delaram Pouyabahar; Brendan T Innes; Sonya A MacParland; Gary D Bader
Journal:  Nat Protoc       Date:  2021-05-24       Impact factor: 13.491

2.  Fly Cell Atlas: A single-nucleus transcriptomic atlas of the adult fruit fly.

Authors:  Hongjie Li; Jasper Janssens; Maxime De Waegeneer; Sai Saroja Kolluru; Kristofer Davie; Vincent Gardeux; Wouter Saelens; Fabrice P A David; Maria Brbić; Katina Spanier; Jure Leskovec; Colleen N McLaughlin; Qijing Xie; Robert C Jones; Katja Brueckner; Jiwon Shim; Sudhir Gopal Tattikota; Frank Schnorrer; Katja Rust; Todd G Nystul; Zita Carvalho-Santos; Carlos Ribeiro; Soumitra Pal; Sharvani Mahadevaraju; Teresa M Przytycka; Aaron M Allen; Stephen F Goodwin; Cameron W Berry; Margaret T Fuller; Helen White-Cooper; Erika L Matunis; Stephen DiNardo; Anthony Galenza; Lucy Erin O'Brien; Julian A T Dow; Heinrich Jasper; Brian Oliver; Norbert Perrimon; Bart Deplancke; Stephen R Quake; Liqun Luo; Stein Aerts; Devika Agarwal; Yasir Ahmed-Braimah; Michelle Arbeitman; Majd M Ariss; Jordan Augsburger; Kumar Ayush; Catherine C Baker; Torsten Banisch; Katja Birker; Rolf Bodmer; Benjamin Bolival; Susanna E Brantley; Julie A Brill; Nora C Brown; Norene A Buehner; Xiaoyu Tracy Cai; Rita Cardoso-Figueiredo; Fernando Casares; Amy Chang; Thomas R Clandinin; Sheela Crasta; Claude Desplan; Angela M Detweiler; Darshan B Dhakan; Erika Donà; Stefanie Engert; Swann Floc'hlay; Nancy George; Amanda J González-Segarra; Andrew K Groves; Samantha Gumbin; Yanmeng Guo; Devon E Harris; Yael Heifetz; Stephen L Holtz; Felix Horns; Bruno Hudry; Ruei-Jiun Hung; Yuh Nung Jan; Jacob S Jaszczak; Gregory S X E Jefferis; Jim Karkanias; Timothy L Karr; Nadja Sandra Katheder; James Kezos; Anna A Kim; Seung K Kim; Lutz Kockel; Nikolaos Konstantinides; Thomas B Kornberg; Henry M Krause; Andrew Thomas Labott; Meghan Laturney; Ruth Lehmann; Sarah Leinwand; Jiefu Li; Joshua Shing Shun Li; Kai Li; Ke Li; Liying Li; Tun Li; Maria Litovchenko; Han-Hsuan Liu; Yifang Liu; Tzu-Chiao Lu; Jonathan Manning; Anjeli Mase; Mikaela Matera-Vatnick; Neuza Reis Matias; Caitlin E McDonough-Goldstein; Aaron McGeever; Alex D McLachlan; Paola Moreno-Roman; Norma Neff; Megan Neville; Sang Ngo; Tanja Nielsen; Caitlin E O'Brien; David Osumi-Sutherland; Mehmet Neset Özel; Irene Papatheodorou; Maja Petkovic; Clare Pilgrim; Angela Oliveira Pisco; Carolina Reisenman; Erin Nicole Sanders; Gilberto Dos Santos; Kristin Scott; Aparna Sherlekar; Philip Shiu; David Sims; Rene V Sit; Maija Slaidina; Harold E Smith; Gabriella Sterne; Yu-Han Su; Daniel Sutton; Marco Tamayo; Michelle Tan; Ibrahim Tastekin; Christoph Treiber; David Vacek; Georg Vogler; Scott Waddell; Wanpeng Wang; Rachel I Wilson; Mariana F Wolfner; Yiu-Cheung E Wong; Anthony Xie; Jun Xu; Shinya Yamamoto; Jia Yan; Zepeng Yao; Kazuki Yoda; Ruijun Zhu; Robert P Zinzen
Journal:  Science       Date:  2022-03-04       Impact factor: 63.714

Review 3.  Methods and tools for spatial mapping of single-cell RNAseq clusters in Drosophila.

Authors:  Stephanie E Mohr; Sudhir Gopal Tattikota; Jun Xu; Jonathan Zirin; Yanhui Hu; Norbert Perrimon
Journal:  Genetics       Date:  2021-04-15       Impact factor: 4.562

4.  GranatumX: A Community-engaging, Modularized, and Flexible Webtool for Single-cell Data Analysis.

Authors:  David G Garmire; Xun Zhu; Aravind Mantravadi; Qianhui Huang; Breck Yunits; Yu Liu; Thomas Wolfgruber; Olivier Poirion; Tianying Zhao; Cédric Arisdakessian; Stefan Stanojevic; Lana X Garmire
Journal:  Genomics Proteomics Bioinformatics       Date:  2021-12-30       Impact factor: 7.691

5.  Molecular profiling of stem cell-derived retinal pigment epithelial cell differentiation established for clinical translation.

Authors:  Sandra Petrus-Reurer; Alex R Lederer; Laura Baqué-Vidal; Iyadh Douagi; Belinda Pannagel; Irina Khven; Monica Aronsson; Hammurabi Bartuma; Magdalena Wagner; Andreas Wrona; Paschalis Efstathopoulos; Elham Jaberi; Hanni Willenbrock; Yutaka Shimizu; J Carlos Villaescusa; Helder André; Erik Sundstrӧm; Aparna Bhaduri; Arnold Kriegstein; Anders Kvanta; Gioele La Manno; Fredrik Lanner
Journal:  Stem Cell Reports       Date:  2022-06-14       Impact factor: 7.294

6.  scWizard: A web-based automated tool for classifying and annotating single cells and downstream analysis of single-cell RNA-seq data in cancers.

Authors:  Jinfen Wei; Qingsong Xie; Yimo Qu; Guanda Huang; Zixi Chen; Hongli Du
Journal:  Comput Struct Biotechnol J       Date:  2022-08-27       Impact factor: 6.155

7.  Transient astrocyte-like NG2 glia subpopulation emerges solely following permanent brain ischemia.

Authors:  Denisa Kirdajova; Lukas Valihrach; Martin Valny; Jan Kriska; Daniela Krocianova; Sarka Benesova; Pavel Abaffy; Daniel Zucha; Ruslan Klassen; Denisa Kolenicova; Pavel Honsa; Mikael Kubista; Miroslava Anderova
Journal:  Glia       Date:  2021-07-27       Impact factor: 8.073

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.