Literature DB >> 34982546

Systems Thinking for Effective Interventions in Global Environmental Health.

Martha M McAlister1, Qiong Zhang1, Jonathan Annis2, Ryan W Schweitzer3, Sunny Guidotti4, James R Mihelcic1.   

Abstract

Environmental health risks such as household air pollution due to burning solid fuels, inadequate water, sanitation, and hygiene, and chemical pollution disproportionately affect the poorest and most marginalized populations. While billions of dollars and countless hours of research have been applied toward addressing these issues in both development and humanitarian contexts, many interventions fail to achieve or sustain desired outcomes over time. This pattern points to the perpetuation of linear thinking, despite the complex nature of environmental health within these contexts. There is a need and an opportunity to engage in critical reflection of the dominant paradigms in the global environmental health community, including how they affect decision-making and collective learning. These paradigms should be adapted as needed toward the integration of diverse perspectives and the uptake of systems thinking. Participatory modeling, complexity-aware monitoring, and virtual simulation modeling can help achieve this. Additionally, virtual simulation modeling is relatively inexpensive and can provide a low-stakes environment for testing interventions before implementation.

Entities:  

Keywords:  WASH; chemical pollution; complexity-aware monitoring; household air pollution; participatory modeling; sustainable development goals; virtual simulation modeling

Mesh:

Year:  2022        PMID: 34982546      PMCID: PMC8969763          DOI: 10.1021/acs.est.1c04110

Source DB:  PubMed          Journal:  Environ Sci Technol        ISSN: 0013-936X            Impact factor:   9.028


Introduction

Globally, a significant proportion of the burden of disease (22% of total disability-adjusted life years) is attributable to environmental health risks, which the World Health Organization defines as “all the physical, chemical and biological factors external to a person, and all related behaviors, but excluding those natural environments that cannot reasonably be modified.”[1] The health and well-being of the poorest and most marginalized populations are disproportionately affected by polluted environments.[2] Global health has been defined as, “an area for study, research, and practice that places a priority on improving health and achieving equity in health for all people worldwide.”[3] We use the phrase global environmental health to refer specifically to the improvement of health for all people through the reduction of preventable environmental risks. This aligns with the definition given by the United States National Institute of Environmental Health Services.[4] Some notable areas of global environmental health are inadequate water, sanitation, and hygiene (WASH) services and practices, household air pollution due to the burning of solid fuels, and chemical pollution resulting from industrial malpractice (often in the informal sector[5,6]). These issues are relevant in development, humanitarian response, and environmental justice settings and across multiple scales, from individual behaviors to trans-national policies. Systems thinking is described as an approach,[7] discipline,[8] conceptual framework,[9,10] perspective,[11] or simply a way of thinking[12] that is used to understand patterns of change in terms of underlying, self-organizing interrelationships. Here, the word “system” refers to any network of interacting parts that produces emergent behaviors, from massive systems like the global hydrologic cycle or the global economy to small systems like a latrine or a village council. It is important to note that while concepts such as “enabling environment” and “systems strengthening” incorporate elements of systems thinking (e.g., ref (13)), they are not synonymous. Governments and the global development community use periodic measurements of standard environmental health indicators to gauge national, regional, and global progress toward achieving human development goals (e.g., the WHO/UNICEF Joint Monitoring Program[14]). Systems thinkers recognize that these trends emerge from underlying structural properties. Like the bulk of an iceberg, which lies below the water’s surface, system structures are difficult to “see” using traditional monitoring methods.[15] They are described as the rules, incentives, function, or purpose of a system that produce its outputs and outcomes. For example, if exponential growth is observed in a variable, there must be a reinforcing feedback process driving that growth (e.g., a higher incidence of a communicable disease leads to higher exposure rates, which leads to a higher incidence, and so on). It also must be true that any balancing feedback processes in the system (e.g., deaths) are less significant than the reinforcing feedback. Systems thinkers use trends to formulate hypotheses about system structures by asking “why” and “how” questions. For example, why is the pattern occurring, and how are the relationships between components and across scales resulting in the observed trend? In the past three to four decades of concerted investment in global environmental health, achieving and sustaining desired intervention outcomes has emerged as a recurrent challenge.[16,17] In this paper, we use systems thinking to hypothesize why this is such a persistent trend. Specifically, we focus on structural feedback processes, namely, learning. We suggest expanding the scope of global environmental health research and practice to include the consideration of influential paradigms (which are themselves influenced by historical, cultural, political, and environmental factors). Furthermore, we identify three practical methodologies for incorporating diverse perspectives, accelerating collective learning, and systematically reversing this trend. We start by defining the concept of complex systems and providing evidence that global environmental health systems are complex.

Systems and Complexity

While Western academics began to coalesce their ideas around theoretical frameworks or principles like complex systems theory and complex adaptive systems in the 1970s,[18] holistic conceptual frameworks are recognized in many indigenous knowledge systems, such as those of the Kuna (Panama) and Quechua (Peru).[19] In general, systems thinking offers a means for better understanding complex problems. Systems thinking is often contrasted to reductionist thinking, which is an attempt to understand complex systems by intensely studying their constituent parts in relative isolation from each other. We do not argue that systems thinking should replace reductionist thinking in global environmental health, but rather for the increased uptake of systems thinking to complement the large body of knowledge compiled through reductionist research (see also refs (20 and 21)). Complex systems generally have the following characteristics: (1) they are comprised of a network of many components, (2) these components have nonlinear interactions like sudden transitions and tipping points, and (3) they display emergent structure and behavior which demonstrates relationships between scales. Networks are groups of interconnected or interrelated components (elements, factors, actors, things), and in complex systems those components do not act or change independently of each other, nor are they controlled centrally. As previously defined, global environmental health is an area of study, research, and practice concerned with inequity, particularly related to those human health outcomes which result from environmental risks. In the next few paragraphs, we will provide examples from the literature that help frame this field more holistically and illustrate that global environmental health systems exhibit complexity characteristics. First, networks exist at various scales within global environmental health systems and involve various categories of components. For an individual, environmental risk accumulates via exposure to a variety of hazards through multiple pathways for varying lengths of time.[1,22] Additionally, environmental hazards often result from, and are sustained or removed due to, anthropogenic activities (e.g., artisanal gold mining may involve processing lead-containing ore in or near homes,[5] and the global climate crisis[23]). This demonstrates that social and behavioral elements interact with physical and temporal elements to produce some emergent pattern of health risks and effects. At the community, district, or national level, it is widely thought that for environmental health services or interventions to be effective and sustainable, certain components or “building blocks” (e.g., institutional, monitoring, and financial systems) must be in place and functioning,[24] further demonstrating relationships across multiple domains. Nonlinear behavior occurs when a change in one variable has a disproportionate impact on another variable; for example, dose–response curves often follow an S-shape. In global environmental health interventions, this might mean that certain parameters must be optimized before any significant change is observed in health outcomes. Mellor et al. found this to be the case when assessing water quality interventions; they observed tipping points in intervention efficacy that had to be reached to reduce early childhood diarrhea.[25] In market-based sanitation interventions, latent demand for improved toilets might be “triggered” by a promotional campaign or by the facilitation of connections with service providers, leading to increased uptake of improved toilets.[26] Also, while it seems intuitive that movement up the “energy ladder” (from biomass to cleaner cooking fuels like electricity) would have proportionate effects on health, this linear thinking has several shortcomings[27] and has not been validated by randomized control trials.[28,29] Lastly, patterns of behavior occurring at one scale in global environmental health have implications on the structure and behavior of other scales. As previously mentioned, poor and marginalized individuals are more likely to experience a greater burden of disease than others. This leads to emergent behavior at the national level in which productivity losses due to environmental pollution have been estimated to be up to 1.33% in low-income countries, whereas in high-income countries this estimate is only 0.05%.[2] This could have far-reaching consequences, such as continual underinvestment by governments in measures to reduce environmental health risks (a reinforcing feedback loop). Conversely, reductions in environmental health risks, such as the wide-scale adoption of clean cookstoves, have the potential to benefit many aspects of sustainable development, like health, climate, gender equity, and livelihoods.[30] In practice, a diverse set of tools have been developed in response to an increased awareness of the complexity of global environmental health. Qualitative frameworks like IRC’s and Sanitation and Water for All’s “building blocks” are meant to promote the development of holistic, context-specific interventions to guide WASH program planning. Members of Agenda for Change, the Sustainable WASH Systems Learning Partnership, and the Clean Cooking Alliance use “theories of change” in project and program development to formally outline causal hypotheses, which should in turn inform appropriate sets of monitoring, evaluation, and learning objectives. Monitoring and assessment tools focused on the sustainability of program outcomes include UNICEF’s Bottleneck Analysis Tool for WASH and the U.S. Agency for International Development (USAID)-Rotary International WASH Sustainability Index Tool. A shortcoming of some of these approaches is that they highlight the first aspect of complex systems (they are comprised of a network of many components) and may not be cognizant of nonlinearity and emergent behavior. In the research community, Bayesian network analyses have been conducted to evaluate handpump sustainability in rural Ghana,[31] as well as water system functionality in Nigeria and Tanzania.[32] System dynamics, which includes tools like causal loop diagramming and stock-and-flow modeling, has been used to study the impact of biochar producing stoves on climate change,[33] the adoption of wastewater resource recovery systems in Belize,[34] and the sustainability of rural water services in Timor-Leste.[35] Implementation science, which is gaining traction in global environmental health applications, follows the tenets of systems thinking by emphasizing the “how” and “why” of intervention outcomes.[36,37] However, there is a need for increased documentation of systems approaches in WASH across diverse settings,[38] and in environmental health more broadly.[37] Additionally, few studies using systems methodologies in global environmental health reflect specifically on the design and implementation of interventions themselves (beyond social, environmental, and technical factors), though ref (39) is a notable exception.

Hypothesis

We believe that many global environmental health interventions fail to produce or sustain desired outcomes because they are designed and implemented using linear thinking and single-loop learning, with a limited understanding of dynamic complexity. Linear thinking, a general tendency of most mental models,[40] does not account for the complex system characteristics described above. Mental models are representations of how a person or group believes a system will behave. They are shaped by perceptions, paradigms, and experiences and lead to expectations and decisions. In single-loop learning, advances are made toward reaching a goal, but without significant change to existing mental models.[41] In other words, linear thinking is perpetuated within single-loop learning. Figure illustrates feedback structures which lead to learning. The heavy black arrows represent conventional linear thinking, which we posit has historically been the dominant mode of designing, implementing, and studying interventions. In this mindset, interventions are designed and then implemented, thereby hopefully leading to a change in environmental exposure and some measurable output or outcome. This process improves via a feedback loop (indicated by the blue arrows), in which measured outcomes are evaluated against desired outcomes (goals), and intervention designs are altered to reduce the discrepancy between them. In the 1990s, monitoring and evaluation gained traction as valuable pieces of this single-loop learning process,[42] and more recently, monitoring efforts have become increasingly focused on sustainability and equity.[43] While these changes are evidence of learning within the various communities of practice and research, the process is slow and too often based on trial-and-error, which can lead to unintended consequences.
Figure 1

Evolution of learning in global environmental health research and practice. Arrows indicate influence.

Evolution of learning in global environmental health research and practice. Arrows indicate influence. We suggest that the global environmental health community needs to engage in more reflection and critique of pervasive paradigms and how they affect decision-making. Far from being just conceptualizations or theories, paradigms have practical implications on the design and implementation of environmental health interventions. For example, Workman found that neoliberal development ideologies (such as those leading to the decentralization of water governance) have a profound effect on water committee functionality in Lesotho.[44] Wells et al. discuss competing rationalities (e.g., “environmentality,” conservationism) affecting decision-making in the case of a proposed wastewater system in Belize, and argue for a more inclusive and participatory approach toward situating the infrastructure in the local context.[45] Furthermore, paradigms may lead to biased data collection and analysis, such as underestimating uncertainty, believing that desired outcomes are more likely than undesired outcomes, and selection or confirmation bias.[41] Consider the possible effects of pervasive paradigms in the development sector. Development indicators are often collected at the household level (e.g., Demographic and Health Surveys and Multiple Indicator Cluster Surveys), ignoring intrahousehold disparities, assuming a universally accepted definition of household, and omitting significant portions of the population like those on the move in fragile states (e.g., displaced people, migrants, pastoralists)[46] and people everywhere living in informal settlements. We are primarily concerned with widely held or shared paradigms, those mindsets that are pervasive within the development, humanitarian, and governance sectors, because they are the most likely to have a systematic effect on intervention efficacy. By acknowledging the effects of paradigms, three additional feedback loops are created (thin orange arrows in Figure ), increasing the potential for learning and adaptation. These feedback processes allow for the reframing of paradigms and for changes to underlying principles, known as double- and triple-loop learning, respectively.[47] For the purposes of this paper, we will refer to these processes as multiloop learning. Finally, we incorporate virtual simulation in the diagram (using dashed green arrows) to illustrate how it accelerates learning by bypassing real-world interventions, which may take many years to implement and many more years to fully evaluate their sustainability. Importantly, virtual simulation is also much cheaper than an actual intervention and allows for experimentation that might be unethical in the real world.

Opportunities

Here, we identify three practical approaches which can be used to facilitate accelerated learning in the context of global environmental health: (1) participatory modeling, (2) complexity-aware monitoring, and (3) virtual simulation modeling.

Participatory Modeling

As previously stated, mental models are representations of a person’s assumptions and expectations regarding a system’s behavior. Participatory modeling involves engaging a group of stakeholders in sharing their unique mental models and cocreating a formalized representation about a particular system or problem.[48] The underlying theory behind participatory modeling suggests that the process leads to collaborative learning and commitment to action.[49−51] Participatory modeling employs numerous methods and tools, including those which elicit stakeholder knowledge (e.g., interviews, surveys), those used to build models (e.g., cognitive mapping, social network analysis, agent-based modeling), and those which facilitate the process (e.g., role playing games, brainstorming).[48] Participatory methodologies can help practitioners and researchers address power imbalances in the application of their work, given that the methods are accessible to all stakeholders[52,53] and that the facilitators employ mitigation techniques to prevent the perpetuation of systemic oppression.[54] Furthermore, participatory modeling can help participants (including facilitators) gain insight about complex systems.[55] For example, Valcourt et al. implemented a participatory factor mapping method in Ethiopia and Uganda that elicits stakeholders’ ideas about the relative influence of various factors on the sustainability of WASH services.[56] They found that, by engaging in the process, stakeholders’ understanding of WASH systems shifted to include more elements of complexity.[57]

Complexity-Aware Monitoring

Complexity-aware monitoring approaches are more likely to include data collection that is appropriate for complex systems, thereby leading to an increased awareness of the complexity in those systems (a reinforcing feedback loop). Some principles for complexity-aware monitoring include setting appropriate boundaries, matching the pace of change in a system, and being flexible enough to capture unexpected changes and emergent behaviors.[58,59] Additionally, to improve accountability with stakeholders, monitoring data should be relevant to causal theories of change and reported in a timely manner.[60] In short, monitoring should not be performed just for the sake of tracking progress, but rather as a tool for gaining a more holistic understanding of the structural aspects of a given system. To this end, monitoring and evaluation approaches often benefit from the use of mixed quantitative and qualitative methods. System mapping tools can be used at the start and iteratively throughout an intervention to select appropriate indicators for monitoring systemic change, to the extent possible given financial and human resources. For example, social, organizational, and other network analyses illuminate influential actors or critical components within an interconnected system (see refs (32 and 61) for examples of this in global environmental health). Those actors or components can then become the focus of intensive monitoring efforts. Similarly, causal loop diagrams, which map causal relationships, can reveal influential variables such as those that are included in multiple feedback loops. A particular advantage of these tools is their ability to synthesize both quantitative and qualitative data, which may be especially important when considering how and why different actors make decisions or relate to other actors.[62] Complexity-aware monitoring also requires an awareness of the influence of time, including an understanding that effects can occur long after their causes due to buffers (accumulations of stocks) and delays. The depth of this awareness dictates the frequency of data collection and the time horizon over which an evaluation is conducted. Snapshots or singular data points do not contribute much to an understanding of systemic structure or complexity. Likewise, comparisons of before and after data points (think baseline and end-line surveys) hint only at linear trends, not the nonlinear behavior of complex systems. In general, dynamic awareness requires more frequent sampling, but this should be tailored to the specific goals of an intervention and targeted at components with high degrees of influence as described previously.

Virtual Simulation Models

Models are never perfect, being limited by the modelers’ perspective, the quality and quantity of available data, and in the case of virtual models, software and hardware capabilities. However, within these limitations, modeling presents an alternative to costly, lengthy, and potentially harmful real-world experimentation.[41] In this paper, “virtual simulation model” refers to any type of digitized and quantified model that addresses complexity and can be simulated over time (e.g., stock-flow, agent-based). The primary purpose of virtual simulation in the context of global environmental health is to test model assumptions and potential strategies in a low-stakes environment and learn from the results to design better interventions. With respect to virtual simulations, perhaps the greatest learning occurs when models reveal nonintuitive results. Dynamic models are built by defining relationships or rules between individual components or actors, not by imposing a predetermined outcome. As these relationships are simulated over time, unexpected behavior can emerge. In the real world, decision-makers are often surprised when an intervention not only fails but leads to worse conditions (a tendency of complex systems known as policy resistance). For instance, increased use of antibiotics leads to drug-resistant pathogens and poorly targeted subsidization schemes sometimes lower users’ willingness to pay for services in the future (see ref (41) for a longer list). Simulations of intervention strategies using dynamic models are also prey to unintended consequences, but unlike real systems, the rules and structure of a model are completely known to the modeler, making it easier to point to the cause of the resistance. Flight simulators allow pilots to “experience” the consequences of their actions in a controlled setting. Similarly, management flight simulators are used to improve understanding of the complex dynamics of business and markets by allowing managers to see possible long-term outcomes of decisions.[63] In global environmental health, virtual simulation models can be used to test strategies or policies in a low-stakes environment. For example, Dianati et al. implemented a participatory model building exercise concerning household air pollution in informal settlements in which different policies were evaluated using a virtual stock-and-flow model.[64] They found that diverting available funds to air quality monitoring and health impact assessments would make the problem more visible and thus a higher priority for the local government, as well as other reinforcing effects. In another example using system dynamics modeling, Chalise et al. simulated intervention strategies for the sustained use of clean cooking systems in rural India.[39] They found that implementing consistent technical support for new technologies may be a key piece of the transition to cleaner cooking fuels. Mellor et al. used agent-based model simulations to understand the efficacy and compounding effects of WASH interventions in South Africa, finding that combinations of interventions may be necessary to significantly improve household water quality.[25] These examples illustrate the potential value of virtual simulation modeling as an in silico testing ground for environmental health intervention strategies.

Conclusion

Global environmental health systems are complex, displaying network attributes, nonlinear behavior, and relationships between scales. Therefore, to sustainably achieve desired environmental health outcomes, interventions must be designed, implemented, and monitored using systems thinking. We hypothesize that the consistent failure of global environmental health interventions can be traced to structural learning processes which have perpetuated linear thinking and pervasive humanitarian, development, and governance paradigms. Evolving these processes to promote systems thinking and critical reflection of influential paradigms can be achieved with three practical methodologies: (1) participatory modeling, (2) complexity-aware monitoring, and (3) virtual simulation modeling. The first two facilitate holistic and dynamic data collection, and participatory modeling can also help participants learn and practice systems thinking. Virtual simulation modeling leads to greater understanding of complexity by challenging what are often linear assumptions. Furthermore, virtual simulations can accelerate the pace of learning and help reduce unintended consequences when they are used to test intervention strategies before they are implemented.
  22 in total

Review 1.  Designing resilient, sustainable systems.

Authors:  Joseph Fiksel
Journal:  Environ Sci Technol       Date:  2003-12-01       Impact factor: 9.028

2.  Towards a common definition of global health.

Authors:  Jeffrey P Koplan; T Christopher Bond; Michael H Merson; K Srinath Reddy; Mario Henry Rodriguez; Nelson K Sewankambo; Judith N Wasserheit
Journal:  Lancet       Date:  2009-06-01       Impact factor: 79.321

3.  Factors Influencing Water System Functionality in Nigeria and Tanzania: A Regression and Bayesian Network Analysis.

Authors:  Ryan Cronk; Jamie Bartram
Journal:  Environ Sci Technol       Date:  2017-09-21       Impact factor: 9.028

4.  Health and Economic Consequences of Lead Exposure Associated with Products and Services Provided by the Informal Economy.

Authors:  Adaline M Buerck; Michal Usowicz; Jeffrey A Cunningham; Mahmooda Khaliq; Luke John Paul Barrett; Lova Rakotoarisoa; Rinah Rakotondrazaka; Katherine Alfredo; Silvia Sommariva; James R Mihelcic
Journal:  Environ Sci Technol       Date:  2021-05-21       Impact factor: 9.028

Review 5.  The Lancet Commission on pollution and health.

Authors:  Philip J Landrigan; Richard Fuller; Nereus J R Acosta; Olusoji Adeyi; Robert Arnold; Niladri Nil Basu; Abdoulaye Bibi Baldé; Roberto Bertollini; Stephan Bose-O'Reilly; Jo Ivey Boufford; Patrick N Breysse; Thomas Chiles; Chulabhorn Mahidol; Awa M Coll-Seck; Maureen L Cropper; Julius Fobil; Valentin Fuster; Michael Greenstone; Andy Haines; David Hanrahan; David Hunter; Mukesh Khare; Alan Krupnick; Bruce Lanphear; Bindu Lohani; Keith Martin; Karen V Mathiasen; Maureen A McTeer; Christopher J L Murray; Johanita D Ndahimananjara; Frederica Perera; Janez Potočnik; Alexander S Preker; Jairam Ramesh; Johan Rockström; Carlos Salinas; Leona D Samson; Karti Sandilya; Peter D Sly; Kirk R Smith; Achim Steiner; Richard B Stewart; William A Suk; Onno C P van Schayck; Gautam N Yadama; Kandeh Yumkella; Ma Zhong
Journal:  Lancet       Date:  2017-10-19       Impact factor: 79.321

6.  Using Feedback to Improve Accountability in Global Environmental Health and Engineering.

Authors:  Evan Thomas; Joe Brown
Journal:  Environ Sci Technol       Date:  2020-12-11       Impact factor: 9.028

7.  Systems Thinking in Practice: Participatory Modeling as a Foundation for Integrated Approaches to Health.

Authors:  Raphaël Duboz; Pierre Echaubard; Panomsak Promburom; Margaret Kilvington; Helen Ross; Will Allen; John Ward; Guillaume Deffuant; Michel de Garine-Wichatitsky; Aurélie Binot
Journal:  Front Vet Sci       Date:  2018-12-17

8.  Household air pollution in Nairobi's slums: A long-term policy evaluation using participatory system dynamics.

Authors:  K Dianati; N Zimmermann; J Milner; K Muindi; A Ezeh; M Chege; B Mberu; C Kyobutungi; H Fletcher; P Wilkinson; M Davies
Journal:  Sci Total Environ       Date:  2019-01-06       Impact factor: 7.963

9.  Environmental Remediation to Address Childhood Lead Poisoning Epidemic due to Artisanal Gold Mining in Zamfara, Nigeria.

Authors:  Simba Tirima; Casey Bartrem; Ian von Lindern; Margrit von Braun; Douglas Lind; Shehu Mohammed Anka; Aishat Abdullahi
Journal:  Environ Health Perspect       Date:  2016-01-08       Impact factor: 9.031

10.  System Approaches to Water, Sanitation, and Hygiene: A Systematic Literature Review.

Authors:  Nicholas Valcourt; Amy Javernick-Will; Jeffrey Walters; Karl Linden
Journal:  Int J Environ Res Public Health       Date:  2020-01-21       Impact factor: 3.390

View more
  1 in total

1.  One planet: one health. A call to support the initiative on a global science-policy body on chemicals and waste.

Authors:  Werner Brack; Damia Barcelo Culleres; Alistair B A Boxall; Hélène Budzinski; Sara Castiglioni; Adrian Covaci; Valeria Dulio; Beate I Escher; Peter Fantke; Faith Kandie; Despo Fatta-Kassinos; Félix J Hernández; Klara Hilscherová; Juliane Hollender; Henner Hollert; Annika Jahnke; Barbara Kasprzyk-Hordern; Stuart J Khan; Andreas Kortenkamp; Klaus Kümmerer; Brice Lalonde; Marja H Lamoree; Yves Levi; Pablo Antonio Lara Martín; Cassiana C Montagner; Christian Mougin; Titus Msagati; Jörg Oehlmann; Leo Posthuma; Malcolm Reid; Martin Reinhard; Susan D Richardson; Pawel Rostkowski; Emma Schymanski; Flurina Schneider; Jaroslav Slobodnik; Yasuyuki Shibata; Shane Allen Snyder; Fernando Fabriz Sodré; Ivana Teodorovic; Kevin V Thomas; Gisela A Umbuzeiro; Pham Hung Viet; Karina Gin Yew-Hoong; Xiaowei Zhang; Ettore Zuccato
Journal:  Environ Sci Eur       Date:  2022-03-08       Impact factor: 5.893

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.