| Literature DB >> 35218290 |
Jon Norberg1, Thorsten Blenckner2, Sarah E Cornell2, Owen L Petchey3, Helmut Hillebrand4.
Abstract
While environmental science, and ecology in particular, is working to provide better understanding to base sustainable decisions on, the way scientific understanding is developed can at times be detrimental to this cause. Locked-in debates are often unnecessarily polarised and can compromise any common goals of the opposing camps. The present paper is inspired by a resolved debate from an unrelated field of psychology where Nobel laureate David Kahneman and Garry Klein turned what seemed to be a locked-in debate into a constructive process for their fields. The present paper is also motivated by previous discourses regarding the role of thresholds in natural systems for management and governance, but its scope of analysis targets the scientific process within complex social-ecological systems in general. We identified four features of environmental science that appear to predispose for locked-in debates: (1) The strongly context-dependent behaviour of ecological systems. (2) The dominant role of single hypothesis testing. (3) The high prominence given to theory demonstration compared investigation. (4) The effect of urgent demands to inform and steer policy. This fertile ground is further cultivated by human psychological aspects as well as the structure of funding and publication systems.Entities:
Keywords: biodiversity-ecosystem functioning; context-dependent; critical transitions; locked-in; policy making; science funding agency; scientific method; thresholds; tipping points
Mesh:
Year: 2022 PMID: 35218290 PMCID: PMC9542146 DOI: 10.1111/ele.13984
Source DB: PubMed Journal: Ecol Lett ISSN: 1461-023X Impact factor: 11.274
FIGURE 1A schematic illustration of the effect of context and perspective on locked‐in debates and ways to overcome these aspects (see text for details). Black circles show the stances of promoters and critics of a given theory. Shaded coloured ovals represent different sources of evidence such as from experimental or theoretical, or different spatio‐temporal scales (perspective) or for different types of systems (context). (a) Promoters and critics of a given theory might use evidence from different contexts, such as observational vs experimental studies, and thus come to divergent conclusions that support locked‐in debate. (b) If additionally the promoters and critics come with different perspectives, their overlap becomes minimal, which solidifies the locked‐in debate. One example of different perspectives can be the scale, e.g. regional vs local scale. (c) The ability of a scientific field or group to avoid locked‐in debates and become more adaptive increases if both proponents and critics broaden their understanding of other scientific contexts and perspectives. Moreover, involving a larger diversity of research(ers) will by itself broaden context and perspective, and allow bridging and moderation among contributory evidence sources. Mediators and brokers can fill roles that link networks of different camps of contexts and perspectives
FIGURE 2In adaptive theory development (left‐hand panel), after the initial conception and demonstration phase (the ‘Eureka phase’), demonstration studies (green) become less and investigation studies (blue) more frequent. Interaction and scientific debate leads to the reduction in variance of the reported outcomes. Consolidated evidence provides a robust basis for recommended policy. In locked‐in theory development (right‐hand panel), proponents and critics of a theory continue to publish selective cases supporting their argumentation, resulting in bimodal evidence distribution. Policy development has to choose from an unconsolidated evidence base
Example strategies for promoting adaptive theory development and avoiding locked‐in debates during different phases and for the main stakeholders
| Phase | Scientists | Publishers and editors | Funding Agencies/proposal reviewers | Policy‐makers |
|---|---|---|---|---|
|
| Avoid contributing to polarisation between groups of researchers. Foster diversity of ideas within rather than between individual researchers by taking multiple perspectives and working with multiple hypotheses |
Let article categories reflect the theory development phases and make this clear in the description of article categories! Require statements of ‘stance taken’ / ‘research tradition’, and alternate ones | Allow for a broad range of project types, also those fostering generality and reproducibility. Carefully measure the amount of focus on novelty and excellence |
Make sure that evidence‐based decisions mean “based on most relevant evidence” and not on dominant evidence Engage in synthesis and assessment‐based science policy platforms such as IPCC and IPBES |
|
The first formulation and presentation of a proposed mechanism that explains an observed pattern |
Single hypothesis, resulting in yes/no answer risk leading to lock‐in debates Open approach: Start with multiple hypotheses; assess support for each. Open development of alternate hypotheses | For submitted novelty papers, strongly encourage presenting alternative ways in which the patterns may be explained. Also, require addressing the role of both external and internal (biodiversity) context dependence for the proposed mechanisms | Beware of context transferring ideas that assume that because something is true in one context it can be applied in another. Risk‐averse deliverable orientation may promote single explanation ideas, rather than multiple possibilities | Clarity about the uncertainty of a newly proposed idea/mechanism/explanation, and alternatives. Awareness of the early phase of an idea |
|
one or a few case studies in support of an idea/model |
To avoid lock‐in / to promote healthy debate: Present your own stance and personal background and predisposition. Be aware of the personal motivation and perspectives for promoting or objecting to an idea. Convince by arguments and try to understand others’ arguments from |
Enforce acknowledgement and presentation of the state of the theory development process of the main idea, the sources of uncertainty, and the alternatives including evidence demonstrating the alternative mechanisms Enforce explicit statement that the demonstration does not say anything about generality, and context‐dependence is strong and common Foster open data and open code to allow re‐analysis by different researchers Publish reviews and replies |
Funding large single PI projects can strongly promote idea lock‐ins! To avoid lock‐in, fund diverse approaches to the development of new ideas, not only the current dogma Foster open processes for proposal development Foster open data and open code to allow re‐analysis by different projects |
Accept changes in scientific knowledge, ensure adaptive policies and management in partnership with science Identify the stances made in academia to make risk evaluations of false positives/negatives for each stance Work with academia to identify the distribution of stances and the development of these over time Decision making under uncertainty: make a cost‐benefit matrix for consequences if the theory is true OR false |
|
systematic and thorough testing of an idea/model |
Start with multiple hypotheses. Collaborate across stances when designing an empirical test protocol. If possible, pre‐register your hypothesis. Reach out to establish an inclusive network. Aggregate around common values and protocols while allowing these to develop When important policy implications are at stake, be aware when both “camps” actually point in the same direction of action even if they have different reasons. (I.e. they agree on what to do, but have different reasons for why that should be done) | Have targeted article categories for theory investigation. These are not only meta‐reviews but also allow articles with either/both non‐significant results and repeating studies. Investigate methods to amplify researcher credits of such less citation‐attracting articles |
Make investigation contracts with different success valuation criteria compared to the development of new ideas Promote international networks that investigate important ideas in different contexts. Explicitly fund projects that reproduce science or include synthesis aspects |
Focus on decision‐making under context‐dependence and uncertainty: avoid panacea solutions In co‐designed projects, request systematic review and other evidence‐based synthesis efforts |
|
A broader agreement on the supported conclusions and their uncertainties |
Detailed analysis, many systems, reviews and special cases are important. Engage in synthesis and modularised studies spanning multiple contexts If you are a brokering/bridging personality, initiate open and inclusive consolidation projects | Require or invite consolidation articles that are produced by a group of researchers spanning the range of stances, perspectives and conclusions | Support stakeholder integration tools such as decision support systems. Continued support of the investigation phase. Credit non‐novel results. The creation and maintenance of synthesis centres such as NCEAS, SESYNC, and iDiv provide one formal way to bring diverging opinions together. Perhaps even targeted invitations to opposing views and people able to build bridges from topics that are becoming locked in by centre leaders is an option |
Identify organisations and groups that are credible to make the consolidation in collaboration with academia Require science funding agencies to provide means for establishing the state of the art consolidation reports on policy‐relevant issues Base decision on broad assessments from science |
FIGURE 3A conceptual illustration of part of the science‐policy interface from the perspective of tipping points. Expected utility (c) is the sum of the utility of each state (b) times the probability of that state as a function of the (human) activity (a). While this expected utility could be a direct driver of policy, in practice it is likely to influence policy alongside, or even subordinately to other factors. Panel a: Scientific inquiry is trying to establish where the position of a tipping point is, the degree of confidence in the estimate of the position, and the likelihood of a particular system to be prone to flip as one increases the level of some human activity. Panel b: The expected utility that society can derive from either the desired or the undesired states are also subject to scientific estimates. The cost of unaccounted externalities (dashed line) depends on both the scientific process, as well as the willingness of decision‐makers to incorporate all stakeholders’ costs. Panel c: The resulting potential outcomes (probabilities times utilities of the different states) are shown in relation to the scenarios presumed by science to the decision‐makers (blue line). The coloured filled circles represent the consequence of scientific misjudgement, that is, if the position was in fact earlier (red), the certainty of the position lower (orange) or the likelihood of a tipping point occurring lower (green) given a target activity that is based on the presumed scenario (blue). The consequence of unaccounted externalities is also shown (corresponding dashed lines and open circles). The vertical lines highlight the difference in expected utility between the scenarios if the management policy at the optimal utility for the presumed scenario is chosen. Note that if the management decisions surpass the optimal activity of the presumed scenario (top of blue line), most alternative scenarios will show a very rapid decline in total utility