In spite of continuous development of gene therapy vectors with thousands of drug candidates in clinical drug trials there are only a small number approved on the market today stressing the need to have characterization methods to assist in the validation of the drug development process. The level of packaging of the vector capsids appears to play a critical role in immunogenicity, hence an objective quantitative method assessing the content of particles containing a genome is an essential quality measurement. As transmission electron microscopy (TEM) allows direct visualization of the particles present in a specimen, it naturally seems as the most intuitive method of choice for characterizing recombinant adeno-associated virus (rAAV) particle packaging. Negative stain TEM (nsTEM) is an established characterization method for analysing the packaging of viral vectors. It has however shown limitations in terms of reliability. To overcome this drawback, we propose an analytical method based on CryoTEM that unambiguously and robustly determines the percentage of filled particles in an rAAV sample. In addition, we show that at a fixed number of vector particles the portion of filled particles correlates well with the potency of the drug. The method has been validated according to the ICH Q2 (R1) guidelines and the components investigated during the validation are presented in this study. The reliability of nsTEM as a method for the assessment of filled particles is also investigated along with a discussion about the origin of the observed variability of this method.
In spite of continuous development of gene therapy vectors with thousands of drug candidates in clinical drug trials there are only a small number approved on the market today stressing the need to have characterization methods to assist in the validation of the drug development process. The level of packaging of the vector capsids appears to play a critical role in immunogenicity, hence an objective quantitative method assessing the content of particles containing a genome is an essential quality measurement. As transmission electron microscopy (TEM) allows direct visualization of the particles present in a specimen, it naturally seems as the most intuitive method of choice for characterizing recombinant adeno-associated virus (rAAV) particle packaging. Negative stain TEM (nsTEM) is an established characterization method for analysing the packaging of viral vectors. It has however shown limitations in terms of reliability. To overcome this drawback, we propose an analytical method based on CryoTEM that unambiguously and robustly determines the percentage of filled particles in an rAAV sample. In addition, we show that at a fixed number of vector particles the portion of filled particles correlates well with the potency of the drug. The method has been validated according to the ICH Q2 (R1) guidelines and the components investigated during the validation are presented in this study. The reliability of nsTEM as a method for the assessment of filled particles is also investigated along with a discussion about the origin of the observed variability of this method.
After decades of research and development, gene therapy is nowadays a mature field allowing versatility for the treatment and curation of a broad range of severe and life-threatening diseases [1]. Thanks to this versatility several gene therapy products have been approved by the European Medicines Agency (EMA) and the Food and Drug Administration (FDA) [2, 3] the last few years while thousands of drug candidates are still undergoing clinical trials [4, 5]. However, continuous development relating to the efficiency and safety of the strategies is still required [6], implying that there is a demand for objective characterization methodologies.Recombinant adeno-associated viruses (rAAV) represent one of the most widely used classes of vectors used in gene therapy for the encapsulation and delivery of a genetic sequence of interest [7, 8]. The objective is to; replace a mutated gene with its healthy version, inactivate or repress the expression of mutated genes, edit genes in order to repair defects, or introduce new genes to gain function in cells that help in fighting disease. rAAV vectors have become a prominent vehicle for this purpose as they provide the advantages of a low immune response and are not known to be pathogenic. Clinical trials are currently ongoing for a broad range of diseases using rAAV [5]. For example, Haemophilia B represents an ideal target for which rAAV gene therapy has proven to lead to promising results [9-11], with several drug candidates currently undergoing clinical trials. Small and large animal models can recapitulate this monogenic disease and clinical results have shown a good correlation between the level of blood clotting factor and severity of disease [12-14]. Indeed, rAAV mediated expression of coagulation factor IX (FIX) of one or more percent in plasma as compared to normal already shifts the patient’s Haemophilia B status from severe to moderate. Taking into account that a severe haemophilia patient profile corresponds to <1% clotting factor level [15], a clotting factor level increase of 1 to 2 percent in treated patients can be considered therapeutic. Clinical grade rAAV vectors consist of mixtures of empty and filled virions present in variable ratios, varying along the drug manufacturing process. The role of empty particles is not yet fully grasped. Some studies suggest that they can facilitate the gene transfer [16-18] while protocols are developed to reduce their presence as they are commonly considered as contaminants [19], with a potential immunotoxic risk [20, 21] or inhibiting transduction [22-24]. These dichotomies highlight the need for a robust method to quantify the occurrence of each of the particle populations in a gene therapy drug to objectively elucidate their respective roles [25].For more than two decades now, negative stain transmission electron microscopy (nsTEM) has been used as one of the methods of choice for the assessment of rAAV packaging [26]. This approach allows for direct observation of the particles and a clear discrimination between different particle populations as they appear in the image. More recent studies however have been questioning the reliability and robustness of this method [27-29] and are pointing out inconsistencies of the obtained results [27] due, among others, to the presence of intermediate dense particles [28]. Other analytical methods, such as optical density measurements [30], ion exchange chromatography (IEX) [28], ddPCR [31], qPCR combined with ELISA [32, 33] size exclusion chromatography with multi-angle light scattering detection (SEC-MALS) [34], Analytical Ultracentrifugation (AUC) [35, 36] and more recently charge detection Mass Spectrometry [37, 38] have shown to provide promising results for this assessment. Each of these techniques has its unique strengths and limitations. Some even allow discrimination of sub-populations such as partially filled capsids or capsids with dimeric DNA species. No methodology allowing the separation and identification of these sub-populations has been described using Cryogenic Transmission Electron Microscopy (CryoTEM) yet, and the method introduced in this study only focuses on a binary discrimination of empty and full particle populations. However, in contrast to several of the other aforementioned methods, CryoTEM is considered a platform method, meaning that it is almost not affected by changes in serotype, packaged transgene or composition of the sample matrix. This versatility allows applying the same method without any modifications for different Gene Therapy products which is helpful in the comparative assessment of vector quality and anticipating immunogenic potential by leveraging (pre-)clinical data from Gene Therapy products at more advanced stages of development. As the method is based on a direct visualization of the internal features of particles, CryoTEM in combination with image analysis allows an unambiguous discrimination between the particles containing a genome and the particles lacking it, as recently reported for the characterization of rAAV particle packaging [39].Table 1 provides an overview of methods commonly used for detecting full and empty capsid particles. A recent comparison of these techniques demonstrated good correlation between the listed methods [40]. Within this set of orthogonal methods, AUC is a popular technique due to its capability of discriminating the population of partially filled capsids, a population that is gaining more and more interest in the industry. This species is known to be heterogenous and is subject to further characterization typically trough next generation sequencing or even long read sequencing techniques.
Table 1
Comparison of orthogonal techniques commonly used to quantitate the relative contents of full and empty AAV capsids.
4 No or only limited availability of cGMP compliant data analysis software
1Throughput: Low: ≤ 2 samples/day; Medium: 3–10 samples/day; High: ≥ 10 samples/day2%RSD— = > 20%; +/- = 10–20%; + = < 10%3 Medium with ≥ 8-place rotor4 No or only limited availability of cGMP compliant data analysis softwareHowever, this study focuses on analytical methods for the release of clinical grade AAV vectors. Such methods need to fulfil the stringent cGMP requirements, which demands an analysis software that ensures full data integrity and 21CFR part 11 compliance. In this respect AUC is still suffering significant limitations. Since cryoTEM is often applied in research settings, corresponding analysis software typically lack cGMP compliance. In contrast, the cryoTEM method presented here overcomes these limitations and applies a fully validated and 21CFR part 11 compliant software.In the comparison of orthogonal methods that are commonly used to quantitate the relative content of full and empty capsids in AAV preparations in Table 1, the assessment was based on the experience the authors have gained with these techniques. Some of the parameters evaluated herein might be subjected to evolution as the techniques undergo further developments. Depending on the exact assay set-up the assessment may differ slightly between different laboratories. Due to the lack of an international reference standard for AAV with assigned relative content of full and empty particles, a statement on method accuracy is challenging. In the absence of such a reference standard, an assessment on the alignment and correlation between orthogonal techniques adds valuable information on method reliability.In the present study, we introduce a complete analytical method based on CryoTEM for quantification of the packaging ratio of a gene therapy drug composed of rAAV8 vectors. The scope of the study is restrained to the rAAV8 serotype, with a focus on proposing a broad set of experiments on a single type of specimen. The CryoTEM images are subjected to image analysis where the rAAV particles are segmented and classified based on their internal density. A CryoTEM correlation study between the derived packaging ratio and the potency of the drug is performed, validating the importance of the packaging measurement and the presented method. The method is then directly compared with results obtained by nsTEM, where the advantages of CryoTEM in terms of robustness and reliability are highlighted.This method has been validated according to the principles of Validation of Analytical Procedures, ICH Q2 (R1) [41] and can be used as a quality control in a Good Manufacturing Practice (GMP) workflow. It hence provides an analytical method compatible with established production methodologies and regulatory requirements [27]. Specificity, precision, intermediate precision, linearity, dilutional accuracy, and robustness as defined in ICH Q2 (R1) are assessed. It is the only successfully validated TEM method for the assessment of the percentage of filled particles in an rAAV gene carrier used for gene therapy, hence validating CryoTEM as the method of choice for vector packaging analysis.
Materials and methods
For this study two types of sample material were investigated. Sample set 1 refers to purified ultracentrifugation fractions with varying degree of full and empty capsids that were directly withdrawn from the production process. For sample set 2 an empty capsid preparation (reference empty) produced by purifying the ultracentrifugation fraction containing primarily empty capsids was mixed at predefined ratio with a preparation containing a high degree of full capsids (reference full) to generate samples with intermediate percentage of full capsids.
Sample set 1
AAV production
For this study, HEK293 cells adapted to growth in suspension and cultivated in chemically defined serum-free media (FreeStyle™ F17, ThermoFisher, NY, USA), were used to produce rAAV8 vectors. Batch cultures were cultivated in 10 L bioreactors at 37°C in a humidified atmosphere containing 5% carbon dioxide and with constant stirring at 235 rpm. Transient transfection of HEK293 cells with three plasmids containing Adenovirus 5 Helper genes, Rep2Cap8 and human FIX Padua sequence, respectively, was carried out with Polyethylenimine (Merck KGaA, Darmstadt, Germany) following the supplier transfection protocol. Five days after transfection, the fermentation broth containing rAAV8 particles was separated from cell debris with a clarification step, followed by ultrafiltration and diafiltration step for product concentration and buffer exchange while also reducing impurities. AEX chromatography was used to continue reducing negatively charged impurities followed by a second ultrafiltration and diafiltration step to further concentrate the product and remove protein impurities. The concentrated and diafiltrated intermediate containing rAAV8 was subsequently processed with an ultracentrifugation step according to a Takeda proprietary buffer and protocol, for separation of full and empty particles.
Sample preparation
Applying Takeda’s proprietary ultracentrifugation process (WO 2018/128688 A1) full rAAV8 particles were isolated from the empty particles and collected separately: The ultracentrifugation step was performed using a core filled with 50% product + 50% TBS/sucrose buffer) for 6 hours at target rotation speed of 35000 rpm. The AAV8 particles contained in the starting material move into the TBS/sucrose buffer gradient until they reach a point at which their density matches the density of the surrounding gradient. As full and empty capsids differ in their density, this feature is used for the separation of full and empty virus capsids.For sample set 1, the gradient after centrifugation was subdivided in several fractions with decreasing density. Each fraction was further purified by Ion exchange chromatography and subsequently analysed by cryoTEM, qPCR, and ELISA. Table 2 allows for direct comparison of full and empty capsid analysis through cryoTEM and calculation of the ratio of vector genomes (vg) as determined by qPCR and capsid particles (cp) as quantified by ELISA. However, while both methods show the same trend there is not a one-to-one correlation between the methods. This meets the expectations as both methods rely on different technologies for determining the percentage of full and empty capsids.
Table 2
Sample set 1.
Sample ID
cryoTEM [%Full capsids]
FIX-qPCR [vg/fraction]
AAV8 ELISA [cp/fraction]
qPCR/ ELISA ratio[%Full capsids]
S1.1
2
1.79E+14
3.49E+15
5
S1.2
5
1.73E+14
3.75E+15
5
S1.3
10
1.28E+14
1.35E+15
9
S1.4
11
1.42E+14
8.50E+14
17
S1.5
18
1.16E+14
5.25E+14
22
S1.6
26
7.24E+13
2.89E+14
25
S1.7
43
4.25E+13
6.19E+13
69
S1.8
59
5.40E+13
6.47E+13
84
S1.9
70
7.81E+13
1.06E+14
74
S1.10
79
4.59E+14
3.81E+14
120
Sample set 2
For this study, HEK293 cells adapted to growth in suspension and cultivated in chemically defined serum-free media (FreeStyle™ F17, ThermoFisher, NY, USA), were used to produce rAAV8 vectors. Batch cultures were cultivated in 10L bioreactors at 37°C in a humidified atmosphere containing 5% carbon dioxide and with constant stirring at 235 rpm. Transient transfection of HEK293 cells with three plasmids containing Adenovirus 5 Helper genes, Rep2Cap8 and human FIX Padua sequence, respectively, was carried out with Polyethylenimine (Merck KGaA, Darmstadt, Germany) following the supplier transfection protocol. Five days after transfection, the fermentation broth containing rAAV8 particles was separated from cell debris with a clarification step, followed by ultrafiltration and diafiltration step for product concentration and buffer exchange while also reducing impurities. AEX chromatography was used to continue reducing negatively charged impurities followed by a second ultrafiltration and diafiltration step to further concentrate the product and remove protein impurities. The concentrated and diafiltrated intermediate containing rAAV8 particles was subsequently processed with an ultracentrifugation step according to a Takeda proprietary buffer and protocol, for separation of full and empty particles. While for samples S2.1 and S2.6 ultracentrifugation fractions with high degree of full particles were collected, for sample S2.5 fractions with mainly empty capsids were pooled for further processing.Subsequently, product fractions (S2.1, S2.5, S2.6) were further purified by Ion exchange chromatography and IEX Eluates for samples S2.1 and S2.5 were nanofiltrated. The resulting starting materials for the spiking (S2.1 “reference full” and S2.5 “reference empty”) were thoroughly analysed. The mixed samples with intermediate degrees of full particles (S2.2—S2.4) were prepared based on the AAV ELISA titres as well as on an initial CryoTEM result. The “reference empty” material was prediluted to adjust for differences in particle concentration followed by the mixing with the “reference full” sample to yield the theoretical degree of full capsids with a nominal value of 40%, 60% and 70% full particles. The list of specimens analysed in this study are summarised in Table 3.
Table 3
Samples used for the specificity, linearity and comparative studies.
Theoretical value calculations are described in section 4 of the Supplementary information.
Sample ID
Theoretical percentage of full particles
In-vitro BP [rel. BPU]
In-vivo BP [IU/mL]
Imaging method
Type of analysis
S2.1
79.32% (reference full)
1.61
7.70
CryoTEM
Specificity / Linearity
S2.2
71.30%
1.33
6.63
CryoTEM
Specificity / Linearity
S2.3
61.28%
1.37
6.07
CryoTEM
Specificity / Linearity
S2.4
41.24%
0.74
3.15
CryoTEM
Specificity / Linearity
S2.5
1.17% (reference empty)
0.00
0.20
CryoTEM / nsTEM
Specificity / Linearity / Method comparison
S2.6
n/a; rich in full particles
n.d.
n.d.
nsTEM
Method comparison
Specimen S2.1 was used as the “full reference” specimen, and specimen S2.5 as the “empty reference.” Specimens S2.2, S2.3 and S2.4 were prepared by mixing specimen S2.1 “reference full” and S2.5 “reference empty.” Specimens S2.5 and S2.6 were rich in empty and full particles, respectively, and used for directly comparing CryoTEM and nsTEM.
Samples used for the specificity, linearity and comparative studies.
Theoretical value calculations are described in section 4 of the Supplementary information.Specimen S2.1 was used as the “full reference” specimen, and specimen S2.5 as the “empty reference.” Specimens S2.2, S2.3 and S2.4 were prepared by mixing specimen S2.1 “reference full” and S2.5 “reference empty.” Specimens S2.5 and S2.6 were rich in empty and full particles, respectively, and used for directly comparing CryoTEM and nsTEM.
AAV8 ELISA
The commercially available enzyme-linked immunosorbent assay (ELISA; Progen AAV8 titration ELISA kit, cat. No. PRAAV8) uses a monoclonal antibody (ADK8) specific for a conformational epitope on assembled AAV8 capsids. This plate-immobilized antibody captures AAV-8 particles from the specimen. Captured particles are then detected by the binding of biotinylated anti-AAV8 ADK8 since the epitope targeted is repeatedly expressed on the assembled AAV8 capsid. Streptavidin peroxidase and a peroxidase substrate is then used for measuring bound anti-AAV8 and thus the concentration of AAV8 capsid. The color reaction was measured photometrically at 450 nm. The kit contains an AAV2/8 particle preparation as calibration standard with a labelled AAV8 particle concentration. However, an internal reference standard was used for quantification of capsid particles. This standard was assigned a μg/mL value based on densitometric analysis of a Coomassie stained SDS-PAGE. The assigned μg/mL value was then correlated against the ATCC recombinant Adeno-associated virus 8 (VR-1816) standard, which led to a conversion factor of 8.5E+13 cp/mg.
FIX-qPCR
Samples were treated with DNAse (NEB) to remove extraneous ITR target sequences. After treatment with Proteinase K (NEB) the AAV genome is released from the capsid. Subsequent restriction enzyme digest with BssHII (NEB) was performed to resolve AAV ITR T-shape structures. For quantification, a Taqman-based method with FIX-specific primers and probe was used.Forward primer: 5’-CCG GTA CGT GAA CTG GAT CAA-3’ Thermo Fisher ScientificReverse primer: 5’-CAG CGA GCT CTA GGC ATG CT-3’ Thermo Fisher ScientificProbe 5’-6FAM-AAA CCA AGC TGA CCT GAT MGB-3’ Thermo Fisher ScientificPlasmid encoding for FIX transgene as well as regulatory elements was linearized by ScaI (NEB) restriction digest, separated on Agarose Gel, and the band specific for full length vector genome was purified from gel (QIAquick Gel Extraction Kit) to serves as reference standard.
Biopotency assays
For the determination of in vitro biopotency, HepG2 cells were infected in duplicates with AAV8 vector carrying FIX transgene as described previously [42]. Subsequently, the chromogenic activity of FIX in the supernatant was measured using the Rox Factor IX kit (Rossix AB, Moelndal, Sweden). The results are given as biopotency unit (BPU) representing the relative FIX activity at a dose of 3.27 x 103 capsid particles (cp) per cell. In the course of the in vivo biopotency assay, 2.47 x 1011 cp/kg of FIX encoding AAV8 particles were infused intravenously into seven hFIX-knockout mice (B6;129P2-F9tm1Dws) per group [43] that were bred by Charles River GmbH (Sulzfeld, Germany) and kept as described [44]. Human FIX activity in mouse citrate plasma drawn at day 14 was tested by a one-stage activated partial thromboplastin time (APTT) assay using human FIX-deficient plasma as substrate as already described [43]. Results refer to a human plasma standard which was calibrated against an international standard.
TEM specimen preparation and imaging
CryoTEM
400 mesh copper grids coated with a carbon film, overlaid with a Formvar® film (TedPella, Inc., CA, USA) were hydrophilized using a glow discharger (Pelco EasiGlow™, TedPella Inc., CA, USA). A glow discharged grid was mounted on a vitrification robot (Vitrobot™ Mark II, FEI, OR, USA). 3 μL of sample were placed onto the grid in the specimen chamber of the vitrification robot, under temperature and humidity-controlled conditions (16°C, 99% relative humidity (rH)). After an adsorption time of ca. 10 sec, the grid was blotted-off and subsequently plunge-frozen in liquid ethane. The specimen was then stored in liquid nitrogen until insertion in the microscope.The frozen specimen was mounted onto a Gatan 626 single tilt cryo holder (Gatan Inc., CA, USA) under cryogenic conditions and subsequently inserted in a CM200 electron microscope (Phillips N.V., Eindhoven, The Netherlands) equipped with a Field Emission Gun operating at 200 kV. The grid was visually assessed and several areas containing thin amorphous ice, suitable for imaging, were identified. Low-dose images were acquired in areas representative of the sample, i.e. areas containing AAV particles with minimal presence of ice contaminant and a homogenous spreading of particles in thin amorphous ice. The images were acquired at a resolution of 2048 x 2048 pixels using a TVIPS F224HD camera (Tietz Video and Image Processing Systems GmbH, Gauting, Germany).
Negative stain TEM
400 mesh copper grids coated with a carbon film, overlayed with a Formvar® film (TedPella, Inc., CA, USA) were hydrophilized using a glow discharger (Pelco EasiGlow™, TedPella Inc., CA, USA). A glow discharged grid was mounted on tweezers and 3 μL of sample were placed onto the grid. After an adsorption time of ca. 10 sec, the excess of liquid present on grid was blotted-off using Grade 1 filter paper pre-wetted with 12 μL of water and immediately washed with 3 μL of distilled water. Excessive liquid was then blotted-off after ca. 10 sec and 3 μL of Uranyl acetate 2% (Electron Microscopy Sciences, PA, USA) was immediately added to the grid and blotted-off after ca. 10 sec. The grid was then inserted in a Tecnai G2 Spirit BioTwin electron microscope (FEI, OR, USA) equipped with a tungsten filament operating at 100 kV. The grid was visually screened and areas suitable for imaging were identified. Representative images were subsequently acquired at a resolution of 2048 x 2048 pixels using a Veleta CCD camera (Olympus, Tokyo, Japan).
Image analysis
Particle detection
The acquired images were analysed using VAS (Vironova Analyzer Software, Vironova AB, Stockholm, Sweden), a 21CFR part 11 compliant validated software. The particle detection settings used are shown in S4 and S5 Tables. Briefly, potential rAAV particles within a size range of 18–28 nm and 25–35 nm for the CryoTEM and nsTEM images respectively, were detected by local ellipse detection in the gradient magnitude image. The difference in the size range used between the two analysis methods can be explained by hypotheses such as the presence of stain in nsTEM surrounding the particle, thus increasing the apparent size, by the changes in osmotic effects due to the stain, inducing a swelling of the particles or by a flattening of the AAV particles on the support in nsTEM upon embedding in the stain. A minimum of 3 images per sample were processed until at least 1500 particles were detected. Manual curation and verification of the images and detected particles were performed to remove falsely detected particles and add non-detected particles.
Particle classification
Principal component analysis (PCA) was performed on the particles’ radial density profiles (RDPs), i.e. the mean intensity at each radial distance from a particle’s centre. In a 2-D scatter plot of the two principal components, two separable clusters are observed, one corresponding to full particles, the other one corresponding to empty particles. A particle class (“Full” or “Empty”) was attributed to each of the clusters by selecting manually the particles of one cluster on the displayed plot and assigning them the corresponding class. Particles for which the classification was not unambiguous were attributed the class “Uncertain”. The corresponding data was extracted from the plot and used for the analyses. Intermediate results from the different steps of the image analysis workflow are shown in section 5 of the Supplementary information.
Results
Characterization of the particle populations present in the specimen
Recombinant AAV vectors of serotype 8 (rAAV8) containing a gene coding for FIX were analysed by CryoTEM. Visual analysis of the rAAV preparation S2.1 images reveal that two main populations of particles can be observed in the specimen. A first population exhibits a distinct outer layer with a minute internal density, appearing as dark circles in the images, while a second population of particles displays a uniform inner density with no clear distinction between the inner core and the edges of the particles, appearing in the images as homogenous dark disks. This second population supposedly represents full particles, i.e. particles filled with material, hence the higher internal density, while the particles appearing as circles are empty particles (Fig 1a). Note that in most of the samples analysed, a small proportion of the observed particles appear as incomplete or improperly assembled (Fig 1b). Particles sharing features of both classes, which could represent intermediately filled particles, were seldom observed in this study, as shown with the high confidence interval displayed in the image analysis. As the characterization of such particles is not unambiguous, they are however classified as “uncertain” in the image analyses.
Fig 1
CryoTEM images of specimen S2.1.
(a) Representative CryoTEM image of specimen S2.1, containing filled AAV particles (black arrow) and empty AAV particles (white arrow). (b) CryoTEM image of S2.1 in which incomplete particles (black arrowhead) as well as improperly assembled particles (white arrowhead) are observed. (c) Representative CryoTEM image of AAV specimen S2.5, reference empty. Scale bar represents 100 nm.
CryoTEM images of specimen S2.1.
(a) Representative CryoTEM image of specimen S2.1, containing filled AAV particles (black arrow) and empty AAV particles (white arrow). (b) CryoTEM image of S2.1 in which incomplete particles (black arrowhead) as well as improperly assembled particles (white arrowhead) are observed. (c) Representative CryoTEM image of AAV specimen S2.5, reference empty. Scale bar represents 100 nm.Representative sets of images were acquired for each sample and subjected to image analysis to evaluate the percentage of full particles according to the above definitions present in the specimen. A population of at least 1500 particles was included in each dataset, this value having been evaluated to provide robust statistical relevance (See supplementary section 7). For the experiments in which replicates were used, the mean value of the analyses is reported for each population. Note that the particles identified as broken or incomplete, representing a neglectable amount of the observed particles were not included in the image analysis. Indeed, adding such particles to the analysis would induce a bias towards the empty population as some particles putatively fully can lose their cargo upon breakage while empty particles remain empty upon breakage. Moreover, the discrimination between broken particles and other specimen debris might lead to erroneous interpretation. Including such particles in the analysis might be relevant for the evaluation of the stability of AAV particles or the resistance to stress between the particle types, but this is not within the scope of this study, hence the exclusion of such particles. For the same reasons, particles appearing as broken AAV doublets or triplets were not included in the analysis.
Correlation of CryoTEM results to biopotency assays and qPCR/ELISA quantification
First, we investigated the correlation of the biopotency and the degree of full rAAV capsid particles as determined by CryoTEM. For this purpose, samples with intermediate ratios of full and empty capsids were prepared by mixing a rAAV preparation containing mostly empty capsids with one containing predominantly full capsids (S2 samples). In vitro biopotency results refer to the infection of 3.27 x 103 cp/cell, and in vivo dosing was performed at a dose of 2.47 x1011 cp/kg. Both the in vitro and in vivo experiments demonstrated that the biopotency of the drug per capsid particle increases with the percentage of full particles. The results, presented in Fig 2, suggest a clear correlation between biopotency of the drug and the percentage of full particles observed by CryoTEM. This observation underlines the reliability of the results generated by cryoTEM and emphasizes the importance of controlling the ratio of filled particles for reaching consistent biopotency at consistent level of empty particles.
Fig 2
Correlation between CryoTEM and biopotency.
Correlation between the in-vitro biopotency (a) and in-vivo biopotency (b) of the drug and the percentage of full particles as detected by CryoTEM for a set of specimens with varying ratios of full particles.
Correlation between CryoTEM and biopotency.
Correlation between the in-vitro biopotency (a) and in-vivo biopotency (b) of the drug and the percentage of full particles as detected by CryoTEM for a set of specimens with varying ratios of full particles.Furthermore, good correlation of CryoTEM data with the orthogonal determination of full and empty capsids by calculation of the ratio of vector genomes and total particles was demonstrated and is shown in Fig 3. However, it should be noted that the latter approach bears the risk of inaccurate (e.g. significant over- or underestimation of the full and empty ratio) data due to the nature of the underlying methods (e.g. dependency of PCR based methods on location of amplification target or dependency on reference standards). This potential inaccuracy of qPCR and ELISA based methods is a possible explanation to that the slope of the linear regression as depicted in Fig 3 is > 1.
Fig 3
Correlation between CryoTEM and qPCR/ELISA.
Sample Set 2 with increasing degrees of full capsids were purified from ultracentrifugation fractions. Vector genomes per capsid particle titres were calculated from qPCR and AAV8 capsid particle ELISA results and correlated to the CryoTEM data.
Correlation between CryoTEM and qPCR/ELISA.
Sample Set 2 with increasing degrees of full capsids were purified from ultracentrifugation fractions. Vector genomes per capsid particle titres were calculated from qPCR and AAV8 capsid particle ELISA results and correlated to the CryoTEM data.This indicates that the vg/cp ratio finds higher percentage of full capsids compared to cryoTEM and that this is (more pronounced for preparations with higher degree of full capsids. Another reason for this observation may be the presence of a population of AAV vectors that are detected in PCR based techniques but not in cryoTEM. Such a population may come from AAVs packaged with incomplete transgenes of relatively small size and therefore detected as empty by cryoTEM but still carrying the PCR target sequence.
Repeatability and linearity
The reliability of the CryoTEM method was evaluated by performing a repeatability study. Six grids of the same sample were consecutively prepared and imaged, aiming to assess the analytical method variance under the same operating conditions over a short interval of time. The results show a relative standard deviation of 0.6% (see S2 Table), suggesting a robust repeatability of the method with a low variance. These results are comparable to the values for AUC, where a standard deviation of 0.7% corresponding to a calculated relative standard deviation of 1.8% is reported [35].The linearity of the method within a range was then evaluated to assess the ability to obtain test results which are directly proportional to the percentage of filled particles in the sample by CryoTEM. Two AAV preparations, used as reference were mixed to obtain a set of specimens with intermediate contents of full particles. AAV preparation S2.1 was used as the reference full specimen, packed with the best achievable ratio of full particles, containing 79.3 ± 0.8% of full particles and referred to as “reference full” while preparation S2.5, containing 1.17 ± 0.37% of full particles was used as the reference empty specimen, containing the lowest achievable ratio of full particles and referred to as “reference empty” (Fig 1, S1 Appendix). Since CryoTEM is the first validated method as per ICH Q2 (R1) guidelines, no orthogonal method was available for accuracy assessment, hence the linearity experiments are based on dilution series and the accuracy limited by dilutional accuracy.A total of 6 grids were prepared for CryoTEM and imaged for each of the 5 samples (S2.1—S2.5) investigated. Fig 4 shows the correlation between the data obtained experimentally and the estimated theoretical values (see section 4 in Supplementary information). The method appears to display a robust linearity, with the two particle populations being detected to a same extent regardless of their respective concentration in solution, and is therefore deemed reliable within the range evaluated, i.e., at least up to percentages of 79% of full particles present in the specimen. As the image analysis implies a binary discrimination between two well identified populations, with no overlap of the 99% confidence interval from the principal component analysis of the radial density profile the of the two classes, one can postulate that the linearity of this method could be extrapolated to be valid up to specimen containing exclusively full particles. This assumption, however, remains to be confirmed experimentally.
Fig 4
Relation between the theoretical filled values and the obtained experimental data.
Each data point from the plot corresponds to the mean value of twelve repeats (cf. S3 Table), with the error bars corresponding to the standard deviation of each population.
Relation between the theoretical filled values and the obtained experimental data.
Each data point from the plot corresponds to the mean value of twelve repeats (cf. S3 Table), with the error bars corresponding to the standard deviation of each population.
Comparison between CryoTEM and nsTEM
Negative stain transmission electron microscopy (nsTEM) has been routinely used for the assessment of the ratio of filled AAV particles for more than two decades [26]. Unlike in CryoTEM where the specimen is quickly plunge-frozen into a cryogen, allowing its conservation and observation in a near native hydrated state, the preparation in nsTEM involves a staining step, where a salt containing electron rich elements is added, acting both as a contrasting agent and as an embedding agent. The preparation involves drastic local osmotic and pH changes which might affect the particles integrity, and the conservation of the prepared specimen is then done at room temperature which might result in dehydration in areas of the support where the embedding agent was not efficiently spread. As this method is routinely used for the quantification of the percentage of full particles, it was therefore evaluated in the early stages of the drug development of the rAAV8 particles described in this study. When assessing results obtained by nsTEM and CryoTEM, discrepancies were observed. The results presented in Fig 5 suggest that the population of particles appearing as bright with a smooth surface, typically referred to as “full” [22], are over-represented in the nsTEM images, constituting the main population in all samples analysed, with values of 98% for compound S2.6 and 100% for compound S2.5, when CryoTEM results show that specimen S2.1 contains 83% “full” particles while compound S2.5 contains mainly empty particles, with only 6% of the particles identified as full.
Fig 5
Comparison of specimens in CryoTEM and nsTEM.
(a) CryoTEM image of specimen S2.1, rich in AAV particles carrying a genome. (b) nsTEM image of specimen S2.6. (c) CryoTEM image of specimen S2.5, rich in empty particles. (d) nsTEM image of specimen S2.5. Scale bar represents 200 nm. (e) Comparison on the assessment of the percentage of full particles between nsTEM and CryoTEM. The population of full particles in specimen S.2.5, rich in empty particles, is overrepresented in nsTEM. Scale bar represents 200 nm.
Comparison of specimens in CryoTEM and nsTEM.
(a) CryoTEM image of specimen S2.1, rich in AAV particles carrying a genome. (b) nsTEM image of specimen S2.6. (c) CryoTEM image of specimen S2.5, rich in empty particles. (d) nsTEM image of specimen S2.5. Scale bar represents 200 nm. (e) Comparison on the assessment of the percentage of full particles between nsTEM and CryoTEM. The population of full particles in specimen S.2.5, rich in empty particles, is overrepresented in nsTEM. Scale bar represents 200 nm.
Discussions
The CryoTEM results presented herein relate to characterizing particle populations, linearity and repeatability of full particles in a rAAV preparation. The proposed CryoTEM method has been validated according to the principles of Validation of Analytical Procedures, ICH Q2 (R1)) as used in a GMP workflow [41], for the assessment of the percentage of full particles in a rAAV8 preparation. As no other validated methods were available at the time of the study, the assessment of the method accuracy was challenging. However, this study can now facilitate the validation of any new methodology, as it will be possible to use CryoTEM analysis as an orthogonal method.Observations of discrepancy between nsTEM and other orthogonal methods e.g. AUC have been reported [29], without further insights on the origin of these disparities. One hypothesis to explain the differences observed between nsTEM and CryoTEM in this study resides in the way the particles are identified and defined. In nsTEM, the particles that display an inner density either contain stain or could be collapsed particles with stain deposited on top of them, indicating that they do not contain a gene and are thereof indeed empty, as per the commonly reported definitions. On the other hand, particles with an even density do not contain any stain and are not collapsed, indicating that they are intact, are commonly referred to as full. However, their apparent intactness does not provide information about their content, for a particle could be intact and packed with a gene (i.e. full), or still be intact but empty, but with the current definitions, both would be classified as full. On the contrary, in CryoTEM, no stain is added, and the specimen is preserved in a hydrated native state [45], enabling a direct correlation of the inner density of the particles to their packaging level. An AAV particle containing a gene will be electronically denser than an empty one, hence appearing darker on the image. The proposed hypothesis is therefore that in the case of the sample analysed here by nsTEM, the evaluation of the content of full particles might be biased by an incorrect classification of the particles, resulting in an over-expression of the population of full rAAV particles, leading to significant divergences between CryoTEM and nsTEM when the particles are well embedded in stain as observed in Fig 5. For these reasons, nsTEM was not chosen as a method of choice in the case of the specimen studied herein.The results presented in this study demonstrate the relevance of CryoTEM as a robust and reliable method for the assessment of the percentage of filled particles in a recombinant rAAV8 gene delivery drug product. The repeatability, linearity and robustness of the method demonstrates the suitability of this method as a method of choice that can be used during the different phases of the drug development process as well as validation and quality control in the production phase. Although the scope of the study was restrained to the rAAV8 serotype, available data from CryoTEM analyses of other serotypes (e.g. AAV9) have indicated that findings within the scope of this study can likely be leveraged to other serotypes as well (See S2 Fig). In the presented comparison, nsTEM proved to be a poor technique for the assessment of the content of filled particles for this sample type. Potency data are in line with the results obtained by CryoTEM, reinforcing the reliability of the method. Further studies to broaden the scope of the method to other rAAV serotypes and other types of carriers could prove valuable. More developments could also be performed using CryoTEM, exploring new approaches to allow the discrimination of several levels of particle packaging, including partially filled rAAV particles, both from a preparation and an image analysis perspective. Such advances would benefit the methods in place for the characterization of rAAV drug products.
Specificity study data.
(PDF)Click here for additional data file.
Repeatability study data.
(PDF)Click here for additional data file.
Linearity study data.
(PDF)Click here for additional data file.
VAS detection settings for the image analysis of CryoTEM AAV particles.
(PDF)Click here for additional data file.
VAS detection settings for the image analysis of nsTEM AAV particles.
(PDF)Click here for additional data file.
Intermediate results in the image analysis workflow.
(PDF)Click here for additional data file.
Packaging assessment on AAV9 particles by CryoTEM.
(PDF)Click here for additional data file.
Determination of the theoretical values of the percentage of full particles (%F) in the specimen used for the linearity assessment.
(PDF)Click here for additional data file.
In silico study for the determination of a statistically relevant number of detected particles.
A graphical representation of the standard deviation for each sample size and theoretical full ratio.(PDF)Click here for additional data file.21 Feb 2022
PONE-D-21-40321
Assessment of the Percentage of Full Recombinant Adeno-Associated Virus Particles in a Gene Therapy Drug Using CryoTEM
PLOS ONE
Dear Dr. Colomb-Delsuc,Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.Please submit your revised manuscript by Apr 07 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.Please include the following items when submitting your revised manuscript:
A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.We look forward to receiving your revised manuscript.Kind regards,Chen Ling, Ph.D.Academic EditorPLOS ONEJournal Requirements:When submitting your revision, we need you to address these additional requirements.1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found athttps://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf andhttps://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.We will update your Data Availability statement to reflect the information you provide in your cover letter.3. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.[Note: HTML markup is below. Please do not edit.]Reviewers' comments:Reviewer's Responses to Questions
Comments to the Author1. Is the manuscript technically sound, and do the data support the conclusions?The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: YesReviewer #2: Partly********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: YesReviewer #2: No********** 3. Have the authors made all data underlying the findings in their manuscript fully available?The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: YesReviewer #2: No********** 4. Is the manuscript presented in an intelligible fashion and written in standard English?PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: YesReviewer #2: No********** 5. Review Comments to the AuthorPlease use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: In this manuscript, titled “Assessment of the Percentage of Full Recombinant Adeno-Associated Virus Particles in a Gene Therapy Drug Using CryoTEM”, Colomb-Delsuc and coworkers describe an analytical workflow of quantifying E/F ratios in various rAAV preparations using a cryogenic TEM workflow. The authors highlight the purported advantages of cryoTEM over other more commonly employed methods of quantifying E/F ratios, with a particular focus placed on negative stain TEM (nsTEM). The analytical method proposed by the authors would certainly be interesting to their target audience and thus deserving of publication.However - while the manuscript contains a substantial quantity of numerical results, the subsequent analysis and interpretation of these data in some places (particularly when comparing cryoTEM results to other, non-nsTEM methods) seem somewhat superficial. The manuscript, as well as potential readers, would thus greatly benefit from a more detailed interpretation and analysis of the presented results.Specific points:1) One important aspect of any analysis method that is not discussed in the manuscript is the speed of analysis (i.e. throughput) vs. accuracy/resolution. Compared to other methods (e.g. chromatography or even nsTEM), how fast is the proposed cryoTEM method? How much sample is required compared to other analytical methods?2) The comparison of cryoTEM to other analytical methods for E/F determination is presented in vague, superficial terms, such that it is difficult for the reader to assess the relative strengths/weaknesses of each approach (e.g. Page 4).Which specific methods allow discrimination of sub-populations? Moreover, other analytical methods are also unaffected by serotype changes, transgene identity, etc. and could be explicitly stated. A noteworthy example of such a technique that is not at all mentioned in the manuscript are mass measurement-based approaches (e.g. charge detection mass spectrometry with recent examples PMID: 34631929 and PMID: 34977271). Would be good to discuss that as well.3) Figure 2: The linear curve fit to the in vitro biopotency data in panel 2A is unusual in that it has a surprisingly large, non-zero y-intercept value (0.15), implying that even rAAV preparations containing no genome are biologically active. Can the authors comment on this unusual behaviour? As the figure uses E/F ratios obtained via cryoTEM, is it possible that there may be inaccuracies/biases in this method versus, for example AUC or vg/cp? It would be highly informative if the authors explicitly compared their biopotency data with E/F ratios for each sample derived from AUC or vg/cp, as already listed in Table 1, with a direct comparison with respect to e.g. linearity of the correlation.4) Figure 3: The correlation between cryoTEM and vg/cp titre is presented here in a confusing manner. As both these methods fundamentally determine the same property (the proportion of filled and empty capsids), the x- and y-axes should be normalized to the same scaling (e.g. 0 – 100%, or 0.0 – 1.0). In an ideal case, the slope of this plot would then be exactly 1 (i.e. a perfect correspondence between cryoTEM and vg/cp). As is evident from the presented results, this is not the case, and could be further elaborated.5) The authors include a nicely detailed discussion as to biases inherent to nsTEM that may complicate E/F quantitation using that technique. However, an analogous, equally important discussion for the other tested methods (e.g. AUC, vg/cp) is not present. While it is appreciated that the authors state that these discrepancies have already been previously observed in literature “without further insight”, the rAAV community would greatly benefit from a similarly thorough analysis as was presented for nsTEM.Reviewer #2: This manuscript describes a validated method, based on cryo-electron microscopy, to quantify the composition of recombinant adeno associated virus preparations. This work is an important contribution to the increasingly important field of gene therapy approaches using viral vectors, and could also be applied to other viral systems without significant modification. The work describes a reliable approach to distinguish empty from full particles, by counting single molecules and arriving at an acceptable standard deviation of ~0.6 from repeat experiments with multiple grids. An important advantage of this approach is derived from the additional electron density imparted by the DNA cargo of filled particles. The ability to be able to clearly and visually distinguish filled from empty particles makes this approach very convincing and compelling. The statistical treatment of the cryo-TEM results is sound an credible. Alternative methods have well documented drawbacks. The discussion focused on discrepancies between cryo-TEM and nsTEM explains well potential reasons for the shortcomings of nsTEM.As expected, comparison of cryo-TEM with other methods falls short, both in quantitation and in statistical consistency, except the correlation with in-vivo potency, which was a good test to include. I agree with the authors that the reasons for consistent comparisons are related to the well documented lack of reliability associated with the other methods chosen for comparison (qPCR, ELISA assays, etc). However, the gold standard characterization, when done correctly, is AUC, and it should provide a close to 100% correlation with the cryo-TEM results, at least when partially filled particles, contaminants, and aggregates are excluded from the comparison, which the authors admit they cannot do reliably with their method.While the authors claim that their results show a good correlation between AUC and cryo-TEM, the results in Table 1 clearly show that this is actually far from fact. It is clear to see from Table 1 that there are big differences between cryo-TEM and AUC, especially when the percentages of full capsids are large. While the trends agree very nicely, the absolute quantification is far off when the relative amount of filled capsids increases. The reason for this discrepancy is never mentioned or discussed, although there is an obvious answer, and it is rooted in the flawed analysis of the AUC data. The correlation could be much better, and I believe, provide close to 100% correlation with the amount of filled capsids.I feel the manuscript would be significantly strengthened if the AUC analysis would have been done correctly. The big flaw here is that the amount of capsids measured by AUC is based on a UV absorbance at 280 nm. The incorrect assumption here is that the concentration of filled, empty and partially filled particles corresponds simply to their extinction at 280 nm. This is clearly not the case, since the *molar* extinction coefficient of each type of particle varies as a function of the amount of loaded DNA cargo, because there is a significant overlap between the DNA and protein absorbance spectra at 280 nm. DNA and protein both absorb strongly at 280 nm (about 50% of the peak absorbance of DNA at ~260 nm), and the molar extinction coefficient of a single particle increases dramatically as the amount of incorporated DNA increases, since the capsid (protein) absorbance of 1 particle of course stays constant.It therefore goes to reason that the absorbance based measurement is unreliable as presented, and since molar extinction corrections are not made, in fact, pretty much impossible in my opinion, this type of analysis cannot be used to accurately compare to the *NUMBERS* of particles (as counted in cryo-TEM) versus the absorbance of particles (as measured by 280 nm absorbance as done in the AUC). The authors are confusing a concentration measurement based on absorbance with a concentration measurement based on molar quantities. Since the cryo-TEM method *counts* particles, it is clear that a *molar* comparison must be used.To fix this manuscript, the correct approach needs to take the differential absorbance of protein and DNA into account by measuring a multi-wavelength AUC experiment and deconvoluting the protein contribution, because ONLY the protein absorbance reflects the true capsid concentration, and those results must be compared to the cryo-TEM results. This was not done here, so the analysis compares apples to oranges. Not surprisingly, the percentage of filled capsids is highly exaggerated in the AUC analysis, and the discrepancy is increasingly distorted with an increase in the relative amount of filled capsids. For example, a 79% count of filled capsids for sample S1.10 compares to 96% filled capsids as measured by AUC (a 17% discrepancy), while the ratio of 2% filled capsids for sample S1.1 matches nicely with the AUC determined 2% when the amount of filled capsid is negligible. This means that AUC peaks corresponding to the filled capsids are exaggerating the amount of filled capsids present without adjustment for molar extinction. Since the molar extinction coefficients of various capsid species vary by serotype, DNA cargo loading, and single- vs. double stranded DNA conformation, molar extinction coefficients are notoriously difficult to obtain (some attempts have been made in this publication, using the same equipment as was used in this study:https://pubmed.ncbi.nlm.nih.gov/34186069/The approach demonstrated in this manuscript would be much more suitable for the comparison between AUC and cryo-TEM.Minor points:1. Why is the ICH Q2 validation procedure not discussed? It would be helpful to get more details on this.2. The data availability statement was not provided. I cannot review primary data for correctness in this review, or access any data presented in this manuscript.3. The use of a fixed frictional ratio of 1.4 for the analysis of all possible species in the mixture (empty, partial, filled) is incorrect for obvious reasons: particles containing different ratios of protein and DNA also have significantly different partial specific volumes, because the density of DNA and protein is very different. This leads to an overall variable partial specific volume, which quite dramatically affects the apparent frictional ratio when the partial specific volume is held constant, as it was done here. The authors should correct this by using a 2-dimensional approach like the C(s,f/f0) method to allow the frictional ratio to vary. While the overall shape of the particle clearly doesn't change as a function of DNA cargo loading, the frictional ratio, a theoretical construct, depends on an accurate partial specific volume value, which a) is not known here, and b) varies for each species. The easiest solution is to allow the frictional ratio to float.4. The manuscript would benefit from improvements in the use of the English language (grammar, word choices, sentence structure). I recommend a revision by a native English speaker.The authors have several choices to fix the manuscript:1. repeat the AUC analysis using multi-wavelength analysis with appropriate 2-dimensional hydrodynamic treatment of the data2. remove the flawed AUC data completely and stick to qPCR and other methods for validation. The cryo-TEM approach can stand on its own and trying to validate it with an improper analysis of AUC data severely detracts from the otherwise high quality of this manuscript, and perpetuates false data as being acceptable in publications. A flawed analysis should not be published, no matter how many other manuscripts make the same mistake.If (1) is not an option, my second preference would be for (2) because the cryo-TEM work is beautifully performed with good linearity in the dilution series, solid statistics, and can stand perfectly on its own without the flawed AUC comparison. I do question the claimed validation according to the ICH Q2 (R1) guidelines without the proper orthogonal comparison to a gold standard AUC analysis, if a multi-wavelength analysis had been used. I realize that multi-wavelength analysis with the XLA is tedious, but for a validated method like cryo-TEM a correctly performed AUC analysis would be much preferred over a method like qPCR or ELISA. A true multi-wavelength analysis would require a repeat of the AUC experiments, and most likely the TEM experiments since the samples are probably no longer available. I therefore would be OK with (2). I would not agree to keeping the current AUC analysis (even if all flaws and mistakes were commented), because it perpetuates a serious problem with AUC analysis that is widespread throughout literature and is apparently tolerated with all its flaws by industry. The cryo-TEM approach represents a major improvement, such that short of a correctly performed AUC analysis, I would prefer it any day over any other method presented in this manuscript.********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.If you choose “no”, your identity will remain anonymous but your review may still be made public.Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Albert J R HeckReviewer #2: No[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.6 May 2022Thank you for the comments and suggestion on our work. We are now please to submit a revised version of the manuscript in which the comments from the reviewers and editors have been addressed. Please see updated version of the cover letter and response to reviewer documents for more details on the changes and updates.Submitted filename: 220506_mcolombdelsuc_response_to_reviewers.docxClick here for additional data file.16 May 2022Assessment of the percentage of full recombinant Adeno-Associated Virus particles in a gene therapy drug using CryoTEMPONE-D-21-40321R1Dear Dr. Colomb-Delsuc,We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.Kind regards,Chen Ling, Ph.D.Academic EditorPLOS ONEAdditional Editor Comments (optional):Reviewers' comments:23 May 2022PONE-D-21-40321R1Assessment of the percentage of full recombinant Adeno-Associated Virus particles in a gene therapy drug using CryoTEMDear Dr. Colomb-Delsuc:I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.If we can help with anything else, please email us at plosone@plos.org.Thank you for submitting your work to PLOS ONE and supporting open access.Kind regards,PLOS ONE Editorial Office Staffon behalf ofDr. Chen LingAcademic EditorPLOS ONE
Authors: Federico Mingozzi; Xavier M Anguela; Giulia Pavani; Yifeng Chen; Robert J Davidson; Daniel J Hui; Mustafa Yazicioglu; Liron Elkouby; Christian J Hinderer; Armida Faella; Carolann Howard; Alex Tai; Gregory M Podsakoff; Shangzhen Zhou; Etiena Basner-Tschakarjan; John Fraser Wright; Katherine A High Journal: Sci Transl Med Date: 2013-07-17 Impact factor: 17.956