Literature DB >> 33141821

Testing structural identifiability by a simple scaling method.

Mario Castro1,2, Rob J de Boer3.   

Abstract

Successful mathematical modeling of biological processes relies on the expertise of the modeler to capture the essential mechanisms in the process at hand and on the ability to extract useful information from empirical data. A model is said to be structurally unidentifiable, if different quantitative sets of parameters provide the same observable outcome. This is typical (but not exclusive) of partially observed problems in which only a few variables can be experimentally measured. Most of the available methods to test the structural identifiability of a model are either too complex mathematically for the general practitioner to be applied, or require involved calculations or numerical computation for complex non-linear models. In this work, we present a new analytical method to test structural identifiability of models based on ordinary differential equations, based on the invariance of the equations under the scaling transformation of its parameters. The method is based on rigorous mathematical results but it is easy and quick to apply, even to test the identifiability of sophisticated highly non-linear models. We illustrate our method by example and compare its performance with other existing methods in the literature.

Entities:  

Mesh:

Year:  2020        PMID: 33141821      PMCID: PMC7665633          DOI: 10.1371/journal.pcbi.1008248

Source DB:  PubMed          Journal:  PLoS Comput Biol        ISSN: 1553-734X            Impact factor:   4.475


This is a PLOS Computational Biology Methods paper.

Introduction

Mathematical models contribute to our understanding of Biology in several ways ranging from the quantification of biological processes to reconciling conflicting experiments [1]. In many cases, this requires formulating a mathematical model and extracting quantitative estimates of its parameters from the experimental data. Parameters are typically unknown constants that change the behavior of the model. While it is usually recognized that parameter estimation requires the availability of sufficient informative data, sometimes it is not possible to estimate all parameters due to the structure of the model (whatever the quantity or quality of the data), even with large amounts of noiseless observations. This inability is referred to as ‘structural identifiability’, a concept introduced decades ago by Bellman and Åström [2, 3], as opposed to the ‘practical identifiability’ that depends on limitations set by the data. Practical identifiability has important consequences that can lead to questionable interpretations of the data leading to some recent controversy around this point [4, 5]. Structural identifiability poses an unsolvable limitation as it is unrelated to the resolution of the experimental data collection or the number of observations. Structural identifiability is a necessary condition for model fitting and should be used before any attempt to extract information about the parameters, and as a test of the applicability of the model itself. Importantly, the quality of the fit does not guarantee that the estimated parameters are meaningful. In practice, this is both uncontrolled and misleading, as many fitting tools provide information about the goodness of fit but do not check sensitivity or identifiability. Structural identifiability can be qualified as global or local [6-10]. Global structural identifiability tests the ability to estimate unique sets of parameters, while local (or simply, structural identifiability) means that parameters can be estimated only in a limited subset of the space of parameters. In practical terms, these definitions can be translated into the language of sensitivity analysis as identifiability requires that (i) the columns of the sensitivity matrix are linearly independent, and (ii) each of its columns has at least one large entry [11, 12]. Traditionally, work primarily focused on linear systems [2, 3, 13] based on ordinary differential equations (ODE). For non-linear models, those methods cannot be applied, so many methods have been proposed in the literature to address structural identifiability. Early attempts were based on power series expansions of the original non-linear system [14], the similarity transformation method [15-17] or the so-called direct-test method proposed by Denis-Vidal and Joly-Blanchard [18, 19]. These methods exploit the definition of identifiability either analytically [18] or numerically [20-25], but they are not generically suitable for high-dimensional problems. Xia and Moog [6, 26] proposed an alternative to these classical methods based on the implicit function theorem, but this method also becomes involved to apply for complex models [27]. Another approach that is becoming mainstream is based on the framework of differential algebra [28-31]. These methods are also difficult to apply, requiring advanced mathematical skills and, in some cases, replace highly non-linear terms by polynomial approximations that simplify the analysis. On the positive side, they are based on rigorous mathematical theories, are suitable for non-linear models and, more importantly, they can be coded using existing symbolic computational libraries. In this regard, it is worth mentioning DAISY [32], GenSSI [33], COMBOS [34] or, more recently, SIAN [35]. In almost all cases, the major disadvantage of these methods is their difficulty to apply them to even a few differential equations, hence requiring advanced mathematical skills and/or dedicated numerical or symbolic software (that is frequently unable to handle the complexity of the problem). This explains why, despite the huge volume of publications in the field of theoretical biology, only a few address parameter identifiability explicitly. In this paper, we introduce a simple method to assess local structural identifiability of ODE models that reduces the complexity of existing methods and can bring identifiability testing to a broader audience. Our method is based on simple scaling transformations, and the solution of simple sparse systems of equations. Identifiability for stochastic models [36] is out of the scope of our work.

Method

A couple of motivating examples

Consider a simple death model in which the death rate is the product of two parameters λ1 and λ2, namely with the solution It is evident that from an experiment only the product λ1λ2 can be inferred, and not any of the two independently. Following the ‘actionable’ definition in Ref. [11], local structural identifiability is directly linked to the linear independence of the columns of the sensitivity matrix, S, of the variable x with respect to parameter λ Here, we will work with a related (dimensionless) quantity called the relative sensitivity, or simply the elasticity matrix K with elements K given by The logarithm in the definition of the elasticity matrix provides a clear-cut interpretation of its coefficients. Thus, if K = 1, a 10% increase in λ implies a 10% increase in x, and if K = 0.5, that very same increase in λ translates only to a 5% increase in x. For Eq (1), the elasticity matrix would be simply a 1 × 2 matrix, with We now propose to multiply λ1 with a generic scale factor u, and to divide λ2 by the same factor, such that the solution remains invariant. Deriving the scaled solution of Eq (2) with respect to that scale factor u, and by the chain rule, and, also, where the last equality follows from Eq (6) Rearranging Eq (7) and dividing by x, so both columns of the elasticity matrix are linearly dependent and, accordingly, λ1 and λ2 are unidentifiable. In this particular case, the exact solution confirms this result: In this case we had complete knowledge of the solution, and consequently, it was straightforward to find the right way to introduce the scaling u. Fortunately, this simple scaling calculation can also be performed directly on Eq (1). Introducing two unknown scaling factors, u1 and u2, into that equation, Requiring that this remains identical (or, more formally, invariant) to Eq (1), i.e., λ1λ2x = u1λ1 u2λ2 x, we conclude that u1 u2 = 1. The fact that u1 and u2 cannot be solved individually, also means that the real values of λ1 and λ2 cannot be determined, namely both parameters are unidentifiable. Next consider a death model with immigration: In this case, to leave the system invariant we need to find u1 and u2 such that for all values of x at any time. Rearranging the latter equation, where the left-hand side of the last equation is a constant and the right-hand side depends on time. Hence the only possible solution to the latter equation is u1 = u2 = 1 implying that both λ1 and λ2 are locally identifiable. Notice the difference with the preceding case, Eq (1), in which an infinite number of combinations of the scaling factors satisfy the invariance condition. These simple examples illustrate how scaling invariance of the model equations can be used to determine whether the parameters are unidentifiable or not. We prove this result more rigorously in S1 Text.

Description of the method

Let us define a general ODE model characterized by the time evolution of n variables, x(t), depending on m parameters λ, where the functions f depend on the specific details of the problem at hand and x are the initial conditions. We need to distinguish between those variables that can be observed (measured) in the experiment, x1 … x, and those which cannot (they are often referred to as latent variables), x … x. As we will prove below, the simplicity of our method relies on the ability to decompose the functions f as a sum of M functional independent summands, f, having the property that f is functionally independent of f for every k ≠ l. For brevity, denote the subset of variables and parameters included in the function f. The notion of linear independent functions and how to test it is summarized in S1 Text. However, a simple definition would be: If f1(x1, x2, …), …, f(x1, x2, …) are linearly independent functions, then the only solution of the equation is a1 = … = a = 0. Typical examples of functionally independent functions are summarized in Table 1. For instance, f11 = ax1, f12 = bx1x3, f13 = (c + x4)−1 are functionally independent, whereas examples of dependent functions would be f11 = ax1x2 and f12 = bx1x2. Note that it is not required that f and f are independent (as they appear in different equations). For instance, in the example in Eq (9) can be decomposed in polynomials of degree 0 (a constant) and 1 (a linear function), namely
Table 1

A collection of frequent linear independent functions: All the functions listed in the Table are independent to each other (of the same or different type).

We assume that λ1 ≠ λ2 in all of the cases.

TypeExamples
Polynomial (one variable)x0, x, x2, x3, …
Polynomial (more than one variable) x1x2,x12x2,x1x2x3,
Rational 1λ+x1,x1λ+x1,1x1+x2,1λ1+x1+x2,1(λ+x1)2,
Exponential eλ1x1,eλ2x1,eλ1x2
Sigmoid 1λ1+e-λ1x1,1λ1+e-λ1x2,1λ1+e-λ2x1,1(λ1+e-λ1x1)2,
Trigonometricsin λ1x1, sin λ1x2 sin λ2x1, cos λ1x1, tan λ1x2, …

A collection of frequent linear independent functions: All the functions listed in the Table are independent to each other (of the same or different type).

We assume that λ1 ≠ λ2 in all of the cases. We summarize our method in Box 1. Scale all parameters and all unobserved variables by unknown scaling factors, u: and substitute them into Eq (15) below. Equate each functionally independent function, f, to its scaled version. Namely, where for 1 ≤ i ≤ r and the prefactor in the right-hand side of the equation comes from the scaling of . From Eq (11) it follows that . From Eq (14), find combinations of the scaling factors u that leave the system invariant. Hereafter, we will denote these as the identifiability equations of the model (see Eq (24) below). Only the parameters λ with a solution are identifiable. Only the variables, x with are observable. Otherwise, parameters whose scaling factors are coupled, form identifiable groups but cannot be identified independently. In summary, our method reduces the complexity of finding identifiable parameters to finding which scaling factors do not satisfy the trivial solution u = 1. In the literature, when a scaling factor is related to one of the latent variables x … x, if , then x is said to be observable [10]. Thus, our method addresses at the same time identifiability and observability. Additionally, irreducible equations involving two or more parameters provide the so-called identifiable groups of variables that cannot be fitted independently. In the case of the pure death model above, the identifiability equation is a signature of the unidentifiable group λ1λ2. This is interesting as groups involving latent variables (for instance, ) would inform future experiments aimed to observe that variable and decouple that group. It is also worth mentioning that our identifiability test (illustrated by example in S1 Text) provides a simple way to find a type of symmetry that is related to scale invariance. More sophisticated methods have been introduced in the literature to address other symmetries [37-39] using the theory of Lie group transformations, however, that approach involves complex calculations assisted by symbolic computations.

Results

The main result

Now we are equipped to prove the main result of the paper. We will proceed in two steps: firstly, we will show how Eq (14) is translated into a set of equations for the scaling factors u. Secondly, we will connect the elasticity matrix with the solution of the identifiability equations and the identifiability of the parameters. Consider a model described by a set of n ordinary differential equations (ODE) where f is functionally independent of f for every k ≠ l (namely, they satisfy the generalized Wronskian theorem; see S1 Text). For the sake of simplicity, we denote and the subset of variables and parameters of function f. Motivated by Eqs (1)–(5), we seek for scaling of the parameters that leave the system invariant. As we prove below, this invariance (or lack of) is related to the identifiability of the parameters. Hence, if we define the following scaling transformation: (where the variables x1 … x are unmodified as we can measure them in the experiment) we can write the following set of re-scaled equations: where M is the number of functional independent summands in the equation. It is convenient to rewrite Eq (19) as to perform the scale invariance analysis below in a simpler way. If the solution is invariant under this transformation, then the right-hand sides of Eq (15) and, consequently Eqs () should be equal. Besides, by the functional linear independence of the functions f we can split each summand. Thus, and This new set of equations is much easier to solve than the one that we would obtain from Eqs (17)–(19) (which would be equivalent to the so-called direct-test method [18]). Eqs (22) and (23) admit the trivial solution . Alternatively, some of the parameters are functionally related to each other. Generically, they can be written as Note that, for each parameter k, the scaling will depend only on a subset of all the scaling factors m1, m2, … We denote Eq (24) the identifiability equations of the model. A third possibility would be that some scaling factors take fixed values different from 1. We discuss that case below. Let us now connect the identifiability equations with the concept of local structural identifiability. If we take the partial derivative of the following (invariant equation) with respect to , by the chain rule, it follows that where, for convenience, we have defined Finally, dividing Eq (25) by x: where K are the elements of the elasticity matrix defined in Eq (4). Eq (26) implies that K can be written as a linear combination of other column(s) of the elasticity matrix. According to our discussion in the Introduction (see also Refs. [11, 12]) this is means that λ is not identifiable. Summarising, for each parameter λ either or it is not identifiable. The adjective “local” follows because the method stems on the continuity of the derivative of x(t) with respect to λ to derive Eq (25). Thus, it is unable to capture any discrete transformations like, for instance, discussed for Model 8 in S1 Text and that, as we anticipated above, is the third possible solution of the identifiability Eq (24).

Example: An unidentifiable nonlinear model [16]

Here we show how to apply our method to a nonlinear model introduced in Ref. [16] (this model is mathematically equivalent to Model 2 in S1 Text). Following Box 1: We re-scale the non-observed variables and parameters: as x1 is observed (so, ). We define the functional linear independent functions: and from Eq (14) and respectively. Manipulating the previous equations: and Hence, the identifiability equations are As the system has more than 1 solution besides the trivial () it follows that the model is unidentifiable. Moreover, Eq (33) allows one to conclude that (i) if x2 were to be observed (), all the parameters would be identifiable, and (ii) the combination is identifiable as, for any scale of x2, the condition is always fulfilled and hence λ2λ3 is an identifiable group.

Comparison with other methods

We have applied the method outlined in Box 1 to 13 different models defined and analyzed in detail in S1 Text. The choice is based on two criteria: on the one hand, models 1-5 are included for pedagogical purposes. They are simple enough to illustrate the novel method and most of the existing methods also provide the same definite answers. Models 6-13 were chosen because they have previously been analyzed using the methods summarized in the Introduction and in Table 2. This allows us to put our method in direct competition with those methods and to highlight their merits and limitations.
Table 2

List of current methods testing structural identifiability.

We introduce here the acronyms referred to in Table 3.

MethodAcronymMain Ref.ProsCons
Direct test methodDT[18, 20]SimpleLimited
Implicit function theoremIFT[26]SoftwareLimited
Taylor series approachTS[14]SimpleComputationally Expensive
Generating series approachGS[13]Simple, SoftwareComputationally Expensive
Similarity TransformationST[16]SoftwareComputationally Expensive
Differential algebraDA[29, 32, 34]Software, ConclusiveLimited, Comp. Expensive
Reaction Network theoryRNT[40, 41]Simple, Hybrid with otherOnly reaction systems
STRIKE-GOLDDSG[9, 22]Powerful, SoftwareComputationally Expensive
Scaling Invariance MethodSIMThis workSimple, Widely applicableOnly Local Identifiability

List of current methods testing structural identifiability.

We introduce here the acronyms referred to in Table 3.
Table 3

Summary of models compared in the literature: The number in brackets in the Model Name column corresponds to the number of observed variables.

Model Numbers correspond to those in Table A in S1 Text. The acronyms for the methods are summarized in Table 2. This table is an extension of Table 1 in Ref. [7].

Model nameMain Ref.Model NumberGlobal Struct. Id.Local Struct. Id.UnidentifiableNot Conclusive Not Applicable
Goodwin model (1)[7]6SG,SIMTS,GS,ST,DT,DA,IFT,RNT
Goodwin model (all)[7]6bisTS,GS,IFT,RNTDA,SG,SIMST,DT
Circadian clock model[42]7TS,GS,RNT,SG,SIMST,DT,DA,IFT
HIV model (1)[6, 43]8All
HIV model (2)[6, 43]8bisDA,IFT,RNTTS,GS,SIMDT,ST
Linear HIV model (1)[6, 43, 44]8terDA,IFT,RNT,SGDT,ST,TS,GS,SIM
Glycolysis model[45]9GS,DA,RNTTS,SIMST,DT
High dimensional model[42]10TS,GS,DA,RNTIFT,SIMST,DT
NF-κ model B (1)[46]11SG, SIMTS,GS,ST,DT,DA,IFT,RNT
NF-κ model B (2)[46]11bisGS,RNTTS,SIMSGST,DT,DA,IFT
Pharmacokinetics model (1)[47]12TS,GS,RNT,SG,SIMST,DT,DA,IFT
Pharmacokinetics model (2)[47]12bisDAGS,SG,SIMST,DT,IFT,RNT
Within-host virus model[27]13DASIMTS,GS,ST,DT,IFT,RANT
The results of this comparison are summarized in Table 3, which is an extension of a similar table in Ref. [7]. The column Not Conclusive/Not Applicable groups different situations in which a particular method do not provide a conclusive answer (or no answer at all). In general, it captures the fact that many of these methods are computationally demanding (after several hours they do not provide any answer) or that the computations do not converge numerically. For instance, in some implementations of the Differential Algebra method [32], when the number of observables is lower than the number of parameters, the computation requires the evaluation of high-order derivatives of the functions f in Eq (11) what can be computationally prohibitive. In other cases, some criterion of applicability is not fulfilled (for instance, the observability rank condition for the similarity transformation method) or the method cannot be solved if it involves the solution of a high-degree polynomial or transcendental equations (Direct Test method). These limitations are summarized succinctly in the Cons column in Table 2.

Summary of models compared in the literature: The number in brackets in the Model Name column corresponds to the number of observed variables.

Model Numbers correspond to those in Table A in S1 Text. The acronyms for the methods are summarized in Table 2. This table is an extension of Table 1 in Ref. [7].

Discussion and conclusions

Table 3 shows that our method can handle any complex model and provides a local structural identifiability criterion that is compatible with those methods capable of producing an answer. Thus, our method is widely applicable. It is worth noting that in several cases where our scaling method comes with a conclusive answer, other more complicated methods cannot address those cases (rightmost column in the table). As any global structural identifiable model is also local, our results are compatible with those methods that can address that difference. Table 3 also highlights the huge discrepancies among methods. These conflicting conclusions are rather discomforting and deserve deeper clarification. The main source of conflict arises when comparing the Taylor series and the Generating series methods, as they transform the original problem into an approximate one. Also, they incorporate (rightly) the initial conditions into the computation while some implementations of the Differential algebra (DA) method do not (see the DAISY implementation [32]), what can lead to different conclusions. Regarding the DA method, in some instances random values are used for the parameters to handle the complexity of some models what, if those parameters are not properly explored, can lead to wrong conclusions. So overall, we can distinguish three sources of discrepancy: local vs global structural identifiability (which is not an incompatibility as Global implies Local and our method is restricted to the latter); conclusive vs not conclusive (which favors our method as it is not limited by any computational constraint) and; the most concerning, incompatible conclusions. Here, our method is compatible with the conclusions of DA and hybrid methods such as Reaction network theory or STRIKE-GOLDD. As we mentioned in the introduction, Differential Algebra methods (and extensions) are considered the most reliable (when computable) and our method either agrees, or provides an answer where the other methods cannot. The discrepancies with other methods are due to limitations or uncontrolled approximations when applied to complex problems and have been already raised by other authors [7]. From viewpoint of performance, it is worth emphasizing that we have performed our test by hand, as illustrated in S1 Text, and that, after some practice (and using some interesting motifs as having sums of different parameters, or the coefficients related to diagonal terms in the system of equations) the calculations can be made in a few minutes. This contrasts with the most sophisticated methods that, by hand, can fill several pages [27] or take hours using symbolic computation packages. Together, broad applicability and simplicity are the main signatures of our method and this may attract the interest of mathematical modelers and spread the culture of checking structural identifiability as a mandatory step when fitting experimental data. We would like to highlight a connection with the so-called Buckingham-Π theorem of dimensional analysis [48]. In some sense, the scale invariance property is related to the principle of dimensional homogeneity, i.e., the constraints on the functional form of the independent variables with the parameters. Our identifiability equations are therefore similar to finding the so-called Π-groups in the theorem. A limitation of the method is that it is restricted to testing local identifiability. This is implicit in the differentiability of the elasticity matrix which, by definition, is a local operation. Discrete symmetries are not captured, and more sophisticated methods (based on Lie group transformations [39]) are required. However, simple manipulation of the equations to remove the latent variables can improve the explanatory power of the method and might capture those discrete symmetries (see Sec. 3.8 of S1 Text). We leave that extension for future developments. Finally, in this work we have chosen to solve the scaling factor equations directly as it is easy to perform with pen and paper. However, if we were to redefine the scaling factors as , the new factors w would obey a linear system of homogeneous equations. It is therefore expected that the problem of identifiability is related to the rank of the matrix defining the linear system of equations. In that regard, the theorems presented in S1 Text could be supplemented with generic results on homogeneous systems of equations. Thus, our results provide a solid ground for the method and indicate a venue for further development in other systems like delay-differential or partial differential equations. Another open question is the identifiability problem of mixed-effect models, where parameters are not fixed quantities for each observation but, rather, they are drawn from a meta-distribution linking different subjects [49]. For instance, if one considers the simple model a and b are not identifiable. However, if they are assumed to be drawn from, say, two exponential distributions with different means μ and μ, then the joint distribution for λ ≡ a − b is given by which is formed by two linearly independent functions (if μ ≠ μ), and so μ and μ are identifiable as the unique solution of the identifiability equations is (because of the exponential). This kind of models need further analysis but they seem to be amenable to our approach. Finally, while we emphasize the simplicity of the method, it is also amenable to be implemented using symbolic computation packages, particularly for systems with a large number of equations/reactions.

In S1 Text we collect the theorems sustaining the method and a catalogue of models with a detailed computation of the identifiability equations that were used to build Table 3.

(TEX) Click here for additional data file. 2 Jul 2020 Dear Dr Castro, Thank you very much for submitting your manuscript "Testing structural identifiability by a simple scaling method" for consideration at PLOS Computational Biology. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations. Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. When you are ready to resubmit, please upload the following: [1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out [2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file). Important additional instructions are given below your reviewer comments. Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments. Sincerely, Miles P. Davenport, MB BS, D.Phil Associate Editor PLOS Computational Biology Douglas Lauffenburger Deputy Editor PLOS Computational Biology *********************** A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately: [LINK] Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: Dear Editor, The manuscript “Testing structural identifiability by a simple scaling method” focuses on an interesting problem regarding structural identifiability of mathematical models, or the ability to uniquely determine all or some of the parameters or parameter combinations based on observed data. The paper presents a concise, simple approach to this problem. It is an interesting article that could be of use in the field of mathematical modelling. I was confused by Table 2, where the authors compared different methods for determining identifiability. Why do different methods arrive at disagreeing results for the same models? Could you explain and clarify how some tests find that the same model is globally structurally identifiable, while others find that the same model is unidentifiable (or locally structurally identifiable)? I found the examples that were discussed and worked out in the supplementary information very useful, so I think that this information could be included in the main text. Minor comments: In the supplement in Section 2.2 in the first sentence, it says “when only x2 is observed”. Should it say “when only x1 is observed”? Typo right after (18) on p. 5 of supplement. It says, “u_x1)1”but should say “u_x1=1”. Typo right before section 2.9 on p. 10 of supplement. The “u_d”s should be “u_\\delta”s. Reviewer #2: the review is uploaded as an attachment Reviewer #3: See attached ********** Have all data underlying the figures and results presented in the manuscript been provided? Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No Figure Files: While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at . Data Requirements: Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5. Reproducibility: To enhance the reproducibility of your results, PLOS recommends that you deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see 10 Aug 2020 Submitted filename: reply.pdf Click here for additional data file. 14 Aug 2020 Dear Dr. Castro, We are pleased to inform you that your manuscript 'Testing structural identifiability by a simple scaling method' has been provisionally accepted for publication in PLOS Computational Biology. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. Best regards, Miles P. Davenport, MB BS, D.Phil Associate Editor PLOS Computational Biology Douglas Lauffenburger Deputy Editor PLOS Computational Biology *********************************************************** 20 Oct 2020 PCOMPBIOL-D-20-00674R1 Testing structural identifiability by a simple scaling method Dear Dr Castro, I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work! With kind regards, Laura Mallard PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol
  29 in total

1.  Parameter identifiability and estimation of HIV/AIDS dynamic models.

Authors:  Hulin Wu; Haihong Zhu; Hongyu Miao; Alan S Perelson
Journal:  Bull Math Biol       Date:  2008-02-05       Impact factor: 1.758

2.  DAISY: a new software tool to test global identifiability of biological and physiological systems.

Authors:  Giuseppina Bellu; Maria Pia Saccomani; Stefania Audoly; Leontina D'Angiò
Journal:  Comput Methods Programs Biomed       Date:  2007-08-20       Impact factor: 5.428

3.  An algorithm for finding globally identifiable parameter combinations of nonlinear ODE models using Gröbner Bases.

Authors:  Nicolette Meshkat; Marisa Eisenberg; Joseph J Distefano
Journal:  Math Biosci       Date:  2009-09-06       Impact factor: 2.144

4.  Sensitivity, robustness, and identifiability in stochastic chemical kinetics models.

Authors:  Michał Komorowski; Maria J Costa; David A Rand; Michael P H Stumpf
Journal:  Proc Natl Acad Sci U S A       Date:  2011-05-06       Impact factor: 11.205

5.  SIAN: software for structural identifiability analysis of ODE models.

Authors:  Hoon Hong; Alexey Ovchinnikov; Gleb Pogudin; Chee Yap
Journal:  Bioinformatics       Date:  2019-08-15       Impact factor: 6.937

6.  Statistical Model for Biochemical Network Inference.

Authors:  Gheorghe Craciun; Jaejik Kim; Casian Pantea; Grzegorz A Rempala
Journal:  Commun Stat Simul Comput       Date:  2012-09-26       Impact factor: 1.118

7.  Modelling genetic networks with noisy and varied experimental data: the circadian clock in Arabidopsis thaliana.

Authors:  J C W Locke; A J Millar; M S Turner
Journal:  J Theor Biol       Date:  2005-01-22       Impact factor: 2.691

8.  What do we mean by identifiability in mixed effects models?

Authors:  Marc Lavielle; Leon Aarons
Journal:  J Pharmacokinet Pharmacodyn       Date:  2015-12-10       Impact factor: 2.745

9.  Structural identifiability of systems biology models: a critical comparison of methods.

Authors:  Oana-Teodora Chis; Julio R Banga; Eva Balsa-Canto
Journal:  PLoS One       Date:  2011-11-22       Impact factor: 3.240

10.  On finding and using identifiable parameter combinations in nonlinear dynamic systems biology models and COMBOS: a novel web implementation.

Authors:  Nicolette Meshkat; Christine Er-zhen Kuo; Joseph DiStefano
Journal:  PLoS One       Date:  2014-10-28       Impact factor: 3.240

View more
  9 in total

1.  Competitive binding of STATs to receptor phospho-Tyr motifs accounts for altered cytokine responses.

Authors:  Stephan Wilmes; Polly-Anne Jeffrey; Jonathan Martinez-Fabregas; Maximillian Hafer; Paul K Fyfe; Elizabeth Pohler; Silvia Gaggero; Martín López-García; Grant Lythe; Charles Taylor; Thomas Guerrier; David Launay; Suman Mitra; Jacob Piehler; Carmen Molina-París; Ignacio Moraga
Journal:  Elife       Date:  2021-04-19       Impact factor: 8.140

2.  Comparison of empirical and dynamic models for HIV viral load rebound after treatment interruption.

Authors:  Ante Bing; Yuchen Hu; Melanie Prague; Alison L Hill; Jonathan Z Li; Ronald J Bosch; Victor De Gruttola; Rui Wang
Journal:  Stat Commun Infect Dis       Date:  2020-08-21

3.  Comparing antiviral strategies against COVID-19 via multiscale within-host modelling.

Authors:  F Fatehi; R J Bingham; E C Dykeman; P G Stockley; R Twarock
Journal:  R Soc Open Sci       Date:  2021-08-11       Impact factor: 2.963

4.  Quantification of Type I Interferon Inhibition by Viral Proteins: Ebola Virus as a Case Study.

Authors:  Macauley Locke; Grant Lythe; Martín López-García; César Muñoz-Fontela; Miles Carroll; Carmen Molina-París
Journal:  Viruses       Date:  2021-12-04       Impact factor: 5.048

5.  The limitations, dangers, and benefits of simple methods for testing identifiability.

Authors:  Mario Castro; Rob J de Boer
Journal:  PLoS Comput Biol       Date:  2021-10-14       Impact factor: 4.475

6.  On testing structural identifiability by a simple scaling method: Relying on scaling symmetries can be misleading.

Authors:  Alejandro F Villaverde; Gemma Massonis
Journal:  PLoS Comput Biol       Date:  2021-10-14       Impact factor: 4.475

7.  Occam's razor gets a new edge: the use of symmetries in model selection.

Authors:  Johannes G Borgqvist; Sam Palmer
Journal:  J R Soc Interface       Date:  2022-08-24       Impact factor: 4.293

8.  A Mathematical Model of Aqueous Humor Production and Composition.

Authors:  Mariia Dvoriashyna; Alexander J E Foss; Eamonn A Gaffney; Rodolfo Repetto
Journal:  Invest Ophthalmol Vis Sci       Date:  2022-08-02       Impact factor: 4.925

9.  Healthy dynamics of CD4 T cells may drive HIV resurgence in perinatally-infected infants on antiretroviral therapy.

Authors:  Sinead E Morris; Renate Strehlau; Stephanie Shiau; Elaine J Abrams; Caroline T Tiemessen; Louise Kuhn; Andrew J Yates
Journal:  PLoS Pathog       Date:  2022-08-15       Impact factor: 7.464

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.