Clinical trial research agenda on COVID-19 - the first two years in Germany and beyond.

BACKGROUND: We have followed the COVID-19 clinical trial research agenda from the beginning using the COVID-evidence.org platform. Now, two years after the COVID-19 pandemic started, our aim was to re-examine this research agenda with the latest data to provide a global perspective on the research landscape with a focus on Germany.
METHODS: We reviewed and updated previously published data on the COVID-19 clinical research agenda as of 28February 2022 focusing on randomized trials. We used the COVID-evidence.org platform including registry entries from ClinicalTrials.gov and the WHO International Clinical Trials Registry Platform as well as publications from the Living OVerview of Evidence platform for COVID-19 (L·OVE).
RESULTS: Two years on from the pandemic outbreak, there were 4,673 registered trials. The majority of these trials have remained small with a median of 120 planned participants (IQR 60-320). In the first hundred days of the pandemic most of them (50%) had been registered in China. More than two years later, the five countries with the most registered trials (alone or within a framework of international collaborations) were the USA (825 trials; 18%), Iran (619 trials; 13%), India (566 trials; 12%), China (353 trials; 8%), and Spain (309 trials; 7%). Only 119 trials were reported to have a study site in Germany (2.5% of the registered trials). Of the 4,673 trials registered, 15% (694 trials) had published their results by February 2022. The clinical research agenda has been marked by both successes, such as the large RECOVERY trial providing evidence on 10 treatments for COVID-19 including over 45,000 patients as of February 2022, and failures: worldwide only 57 randomized trials have been registered over two years that aimed to assess non-pharmaceutical interventions (e.g., face mask policies and lockdown measures) to prevent COVID-19, and only 11 of them had published results informing decisions that have an impact on the life of billions of people worldwide.
CONCLUSIONS: The COVID-19 clinical research agenda has highlighted the substantial effort of the research community but also the challenges of the clinical research ecosystem. Most importantly, it has shed light on the ability to circumvent traditional barriers and to make trials more useful even under extraordinary conditions. The time to learn our lessons and apply them is now, and the time to demonstrate how we have improved the system is before the next pandemic.

Introduction

Never before has biomedical research received so much attention as with the COVID 19 pandemic. COVID-19 has affected virtually all fields of science and widely dominated health sciences in the first two years of the pandemic [1]. Initially, basic research and preclinical studies played a key role, with great sucess: rapidly the understanding of the virus grew, diagnostic tests were established, and development of vaccines began [2]. The biomedical research focus then shifted to the evaluation of therapeutic interventions.

Randomized clinical trials aim to assess the benefits and harms of health interventions, making them essential for optimal decisions about the implementation of care and health interventions and underscoring their important role in clinical research and pandemic management. Yet, clinical research is often not decision-oriented and patient-centered, and therefore not as useful as it should be [3]. The COVID-19 clinical research agenda has seen some great success stories of highly pragmatic platform trials such as the RECOVERY trial which was the spearhead of providing decision-oriented and patient-centered evidence. Conversely, the global clinical research system utterly failed to inform decisions on non-pharmaceutical interventions to prevent COVID-19 (for example, testing and lockdown measures although they had such an unprecedented impact on human life [4].

We have followed the COVID-19 clinical trial research agenda from the beginning using the COVID-evidence.org platform [4], [5], [6], [7], [8], [9], [10], smiliarly to other projects [11], [12]. Now, more than two years into the COVID-19 pandemic, we looked again at this research agenda with the latest data to provide a global perspective on the research landscape, highlight the contribution of Germany to the research agenda, and focus on select areas of lights and shadow that have emerged over time.

Methods and data sources

We reviewed and updated previously published data on the COVID-19 clinical research agenda in the early days of the pandemic [5], during the first year globally [6] and with a focus on Germany [7] and on non-pharmaceutical interventions (NPIs) [4], focusing on randomized trials. To give a full picture of the entire COVID-19 research agenda of the past two years, we used the COVID-evidence.org platform (as of February 28, 2022) [9], [10], [13]. COVID-evidence is a living database that covers registry entries and publications of worldwide planned, ongoing, and completed randomized clinical trials (RCTs) on any intervention to treat or prevent SARS-CoV-2-infections (for methodological details see protocol [10]). Data sources are international trial registries (ClinicalTrials.gov; WHO International Clinical Trials Registry Platform) and the Living OVerview of Evidence platform for COVID-19 (L·OVE) which as been shown to be a reliable alternative to searching traditional literature databases [14].

The early days

It did not take long until the first RCTs for COVID-19 have been planned and registered. There were 11 RCTs registered (all Chinese) in the first 30 days after the World Health Organization (WHO) China Country Office was notified of cases of pneumonia of unknown cause on December 31, 2019. Five hundred and sixteen RCTs were planned or registered in the first 100 days, until April 9, 2020 [5]. They aimed to include over 350,000 participants worldwide. The early RCTs were predominantly small (median sample size 144; interquartile range [IQR] 70-334) and had a remarkable focus on some highly dominating treatments combined with a very wide spectrum of intervention types.

Almost all trials explored treatments (89%; 457 of 516), and most where pharmaceutical (91%; 468 of 516). The two most frequently investigated pharmacological classes were antivirals (e.g., lopinavir/ritonavir) and antimalarials (e.g., hydroxychloroquine).

Astonishingly, a single drug, hydroxychloroquine, was studied in almost 100 mostly small RCTs in the first 100 days. Even more remarkable was that most of these small trials have been registered although at that time a mega-trial planning with over 5,000 participants had already been registered. An efficient clinical research agenda would have required that research resources be allocated elsewhere once a mega-trial was registered. Of note, only 8% (40 of 516) of all RCTs were mega-trials with over 5,000 participants, among which were the now well-known REMAP-CAP [15] and RECOVERY [16] trials.

This great interest in a single substance was contrasted by little interest in investigating preventive measures, although widely employed in highly diverse ways and forms, impacting billions of persons across the world. Only 3 RCTs on non-pharmaceutical interventions (NPIs) for prevention were planned at that time, aiming to investigate facial masks (NCT04296643, ChiCTR2000030317, NCT04337541).

These 516 trials were conducted in 38 countries alone, or in the context of international collaborations, but more than 70% came from China (50%; n = 257), the United States (10%; n = 53), France (5%; n = 29) or Spain (4%; n = 21) – only 4% were international collaborations (n = 21). Of all 516 RCTs initiated worldwide in the first 100 days, only 12 mentioned a German site (2%), of which 6 were conducted only in Germany (1%) and 6 in the context of international collaborations (1%) [5].

After one year

Throughout the first year of the pandemic, the number of trials steadily increased [6]. After the initial dominance of trials conducted in Asia (mostly China), the number of trials registered in the rest of the world increased rapidly as the pandemic spread through March 2020. There were 2,814 registered randomized trials worldwide as of February 16, 2021. Most were still small with only 18% planning to recruit >500 participants and only 3% planning to recruit >5000 participants. A small proportion of 6% of trials linked to registry entries provided published results, allowing to inform decisions promptly. While this is indeed a small proportion – it does represent a remarkable absolute number of 171 trials with results published as of February 16, 2021 [6].

In Germany, 65 trials assessing interventions to treat or prevent COVID-19 were nationally and internationally registered during 2020 according to a recent analysis of all studies having planned to recruit participants in Germany [7]. This work showed that the majority of the trials were planned in collaboration with researchers from other countries (59%), were industry-funded (54%), assessed treatments (86%), and included hospitalized patients (68%). Overall, these 65 trials planned to recruit 187,179 participants worldwide, and 20,696 of them in Germany; and the trials were as small as the vast majority of studies worldwide, with an average number of planned participants per trial of 106 (IQR 40 to 345). As of May 21, 2021, 17 trials provided published results. A survey on the recruitment accrual in all 65 studies from Germany indicated that this was a clear challenge, as from the planned German participants, an estimated number of 13% were recruited (median 15 per trial [IQR 0 to 44]); and only 3 trials (nearly) reached the targeted sample size [7]. We closer looked at this part of the global research landscape, as this was surprising for many, given the long-standing tradition of biomedical research in Germany [29], the large pharmaceutical industry sector, country size and economic power.

After two years

One year later, then two years after the start of the pandemic, the clinical research trial output has increased more than 1.5-fold with 4,673 registered trials as of February 28, 2022. After a peak of registrations in April 2020 (with 582 RCTs registered in a month), the number of new registrations drastically decreased but reached a steady level with a median of 135 trials registered each month (IQR 98-148) from the beginning of 2021 (Figure 1 ). The majority of trials continued to be small with a median of 120 planned participants (IQR 60-320) and 17% included > 500 participants and only 2% (144 trials) > 5000 participants.

Figure 1

Number of COVID-19 trial registrations over time. Cumulative registration (dark blue) and number of registrations per month (orange). Of note, 22 RCTs were registereg before January 1st 2020, before the pandemic started but were then adapted to assess COVID-19 related interventions or to include COVID-19 patients.

An example of the COVID-19 research agenda’s inefficiency is the registration of additional 24 trials of hydroxychloroquine in 2021, planning to include over 8,000 participants (Table 1 ). These trials either described hydroxychloroquine as an experimental drug, or as standard of care in their registry entry, although there was published evidence from a meta-analysis of 28 RCTs available in early 2021 indicating that this controversial drug was associated with increased mortality [17].

Table 1

Overview of RCTs assessing therapies explored in RECOVERY (based on 4,673 RCTs registered as of February 28, 2022).

Intervention	RECOVERY results release date	N of trials (% of all trials)	N of all trials registered Before/After RECOVERY results released	N of trials with a German part Before/after RECOVERY	Planned sample size all trials§• total • per trial (median, IQR)	Planned sample size with a Geman part• total • per trial (median, IQR)
Hydroxychloroquine	5 Jun 2020	340(7.3%)	259/80*	6/0	• 483,019 • 131 [60; 450]	• 111, 808; • 220 [17; 11,557]
Dexamethasone	16 Jun 2020	86(1.8%)	20/66	none	• 25,631 • 120 [60; 302]	-
Lopinavir-Ritonavir	29 Jun 2020	105(2.2%)	81/24	1/0	• 227,303 • 108 [60; 435]	• 11,557 • 11,557
Azithromycin	14 Dec 2020	100(2.1%)	90/10	none	• 81,524 • 120 [60; 267]	-
Convalescent plasma	15 Jan 2021	100(2.1%)	92/8	6/0	• 83,006 • 110 [60; 305]	• 13,343; • 257 [134; 906]
Tocilizumab	11 Feb 2021	75(1.6%)	64/11	3/0	• 95,518 • 150 [61; 290]	• 12,209; • 452 [326; 6,004]
Colchicine	5 May 2021	62(1.3%)	44/18	none	• 95,317 • 124 [79; 309]	• -
Aspirin	8 Jun 2021	17(0.4%)	16/1	1/0	• 68,225 • 128 [61; 1,000]	• 11,557 • 11,557
Regeneron's monoclonal antibody combination	16 Jun 2021	11(0.2%)	5/6	none	• 29,725 • 1,359 [348; 3,600]	-
Baricitinib	3 Mar 2022	21(0.4%)	21/0	2/0	• 68,617 • 1,010 [165; 1,500]	• 3,425; • 1,712 [1,619; 1,809]

Abbreviations: CI: Confidence Intervals; IQR: Interquartile range.

27 RCTs had missing information on the intervention being assessed.

Missing registration date for 1 RCT for hydroxychloroquine.

Missing planned sample size for 60 RCTs for hydroxychloroquine; 5 for vaccine; 4 for lopinavir-ritonavir; 11 for azithromycin; 2 for tocilizumab; 1 for dexamethasone; 2 aspirin; 2 colchicine; 2 for convalescent plasma; and 4 for chloroquine.

-

The share of countries

The share of countries in global trial research has changed over time, with some countries increasingly initiating a large share of RCTs.

The 516 randomized studies registered in the early days were conducted (or at least planned to be conducted) in 38 countries or in the context of international collaborations, but more than 70% of the trials came from China , the United States, France or Spain. Over time, Asia continued to lead with 40% of the registered trials globally after two years (n = 1,857; considering only the national trials; Table 2 ), but China’s initial high share declined to 7% of all trials after two years (n = 343). New countries have emerged among the 5 with the highest number of registrations such as Iran (13%; n = 615) and India (11%; n = 506) (Figure 2 and Table 2). Two other countries have shown substantial increase in their clincial trial research contribution compared with the 100 days clinical research agenda: Brazil from 7 to 136 (3%) and Egypt from 1 to 88 (2%) national trials registered (Figure 3 ). Of note, although international trials with sites in multiple countries represented only 4% in the early days, this effort quickly increased to 13% of all registered trials (Figure 2 and Table 2).

Table 2

30 highest-ranked global clinical research contributions for COVID-19 trials (conducted in a single country nationally and conducted in multiple countries internationally; based on 4,673 RCTs registered as of February 28, 2022).

	National contribution only (n = 4,673)		National and international contribution (n = 4,673)
Rank	Countries	N (%)	Countries	N (%)
1	Iran	615 (13.2%)	USA	825 (17.7%)
2	International	611 (13.1%)	Iran	619 (13.2%)
3	USA	605 (12.9%)	India	566 (12.1%)
4	India	506 (10.8%)	China	353 (7.6%)
5	China	344 (7.4%)	Spain	309 (6.6%)
6	Spain	193 (4.1%)	Brazil	273 (5.8%)
7	France	139 (3%)	United Kingdom	211 (4.5%)
8	Brazil	136 (2.9%)	France	209 (4.5%)
9	Egypt	88 (1.9%)	Mexico	159 (3.4%)
10	Italy	82 (1.8%)	Italy	148 (3.2%)
11	Japan	77 (1.6%)	Canada	134 (2.9%)
12	Canada	73 (1.6%)	Germany	119 (2.5%)
13	Germany	61 (1.3%)	Japan	117 (2.5%)
14	Mexico	57 (1.2%)	Argentina	101 (2.2%)
15	Turkey	54 (1.2%)	Russia	98 (2.1%)
16	Australia	53 (1.1%)	Egypt	97 (2.1%)
17	Thailand	49 (1%)	Belgium	83 (1.8%)
18	Russia	47 (1%)	Australia	79 (1.7%)
19	Denmark	41 (0.9%)	Turkey	78 (1.7%)
20	Netherlands	41 (0.9%)	Colombia	73 (1.6%)
21	Pakistan	37 (0.8%)	Netherlands	71 (1.5%)
22	Belgium	34 (0.7%)	Denmark	68 (1.5%)
23	Argentina	29 (0.6%)	Thailand	66 (1.4%)
24	Cuba	28 (0.6%)	Peru	64 (1.4%)
25	Indonesia	28 (0.6%)	Poland	64 (1.4%)
26	Bangladesh	25 (0.5%)	South Korea	56 (1.2%)
27	Israel	24 (0.5%)	Ukraine	50 (1.1%)
28	Sweden	24 (0.5%)	Pakistan	49 (1%)
29	Colombia	22 (0.5%)	Israel	45 (1%)
30	Poland	18 (0.4%)	Indonesia	43 (0.9%)

Of note, 241 registered trials did not report the countries of conduct.

Figure 2

Evolution of the 5 highest ranked contributors in number of COVID-19 trial registrations during A) the early days (100 days), B) after one year, and C) after two years.

Figure 3

Evolution of COVID-19 trial registrations throughout the world during A) the early days (100 days), B) after one year, and C) after two years.

In the same period, in Germany a total of 61 trials were planned as national trials (Table 2) and 57 as international trials, so that there were overall 119 trials with a reported study site in Germany.

Dissemination of the evidence

The proportion of the 4,673 trials globally (including both, national and international projects) that provided published results which may provide evidence to inform decisions remaind small with 15%; however, the absolute number of 694 trials with results available either as publication, preprint or posted on the registry is still remarkable. Conversely, the proportion of the trials with published results is higher in Germany, with 26% (31 of 119). Here it is interesting to note that 42% (24 of 58) of the international trials that planned to include sites in Germany have been published, but only 11% (7 of 61) of the trials fully conducted in Germany delivered published results over 2 years. Overall, two years after the pandemic started, there are 31 clinical trials from Germany (alone or among other countries) with published results to treat or prevent COVID-19.

A story of success: The RECOVERY trial

The large, highly pragmatic (i.e. decision-oriented [18]) RECOVERY trial from the United Kingdom is clearly the very success story of clinical research during this pandemic since the results provided evidence directly informing clinical decisions on the treatment of millions of patients. RECOVERY received ethical approval within 9 days, recruited 10,000 patients within 6 weeks and provided the first treatment to reduce mortality within 3 months of its conceptualization [16], [19]. As of March 2022, over 47,000 patients had been recruited in nearly 200 sites across six countries providing results for ten randomized treatment evaluations and revealing four effective COVID-19 treatments (Table 1) [20]. Of note, beyond successfully finding treatments that work, RECOVERY has improved care of millions of patients by revealing that many promising treatments do not work or even do harm, thus protecting patients from unneccessary or harmful interventions. This may even be the most important contribution to the clinical research agenda, and a characteristic of excellent clinical research that has often been, and still is, undervalued (for example, by still using misleading labels for some excellent research as “negative trial”) [21].

This pandemic strikingly illustrated a phenomenon constantly observed in medical history, that many treatments were promising in theory, often widely used by experts with the best intentions, and sometimes supported by large-scale observational evidence, yet shown to be ineffective or even harmful in subsequent randomized trials [22].

RECOVERY has finally buried the traditional myth that randomized trials have to take a long time, need to have complex designs, and do not provide real-world evidence. Although high quality observational real-world data are of utmost importance to monitor the health of populations and development of the pandemic, the therapeutic breakthroughs for COVID-19 have not been generated by non-randomized, observational “real-world” evidence. While these approaches have been touted as critical cutting-edge technologies to guide treatment and support drug approval, and could even replace clinical trials, their track record in COVID-19 has been disappointing [6]. Neither hydroxychloroquine nor convalescent plasma – to only name two – have been able to demonstrate the benefits claimed by several very large observational studies [23], [24]. Without the well-conducted randomized clinical trials, millions of COVID-19 patients could have continued to be exposed to ineffective or even harmful treatments.

RECOVERY is a platform trial that compares multiple intervention arms using a factorial design where patients can receive more than one experimental treatment. The pragmatic features of the study design, with broad eligibility criteria reduced to the essentials (i.e. hospitalization, confirmed or suspected SARS-CoV-2 infection, and no specific contraindication to participation), have clearly fostered recruitment [18]. This is in contrast to the exclusion of patients of older age or with comorbidities, which would be hard to justify in trials that seek to inform real-world decisions in these populations for whom COVID-19 treatments are most needed.

An essential aspect of RECOVERY was its direct integration into patient care, with most centers being non-academic hospitals [25]. The primary endpoint, all-cause mortality at 28 days, was collected online and further information was gathered via national health registries using routinely collected data [26].

Overall, the potential of learning from COVID-19 to transform clinical research to make it more useful and patient-centered is high by establishing hundreds of platform trials for all relevant conditions as the very normal approach to evaluate treatment choices, by promoting rapid and most efficient data sharing processes, and by having a culture of clinical research as the standard of care. However, future research is needed to address the methodological challenges with this rather novel design [27].

A story of failure: non-parmaceutical interventions (NPIs)

For over two years now, in March 2022, the life of billions of people worldwide has been affected by drastic measures aiming to improve health by preventing infections with COVID-19. This included quarantine and isolation, the closing of schools, workplaces, shops, clubs, bars and restaurants, travel restrictions, the prohibition to leave their own home, meet friends and relatives even in the last days of their lives. Diagnostic interventions in numerous forms of testing regimens are part of daily life for many. Protective equipment such as surgical or N95 masks, thus far used only in healthcare settings or for specific professions, have been rolled-out to be used by everybody, in some places even by toddlers. Numerous strategies target various populations, some everybody, some only vulnerable persons. Even after almost two years, parts of the German population were forbidden to leave their homes at night if they had certain health characteristics (immune status), and some hospitals and nursing homes were closed for visitors and relatives of inpatients and residents.

This, of course, has massive ethical implications that require careful consideration of the benefits and harms of these measures. Whether or not someone is affected by such a measure usually seems to depend more on where they live and the regulations chosen by local decision-makers than on the individual’s risk profiles, population health determinants or clear, evidence-based criteria. For example, while in one part of a country like Germany, school children had to wear masks in class or were regularly tested, in other parts of the very same country this was at the same time not required and politicians heavily debate such regulations [28], [29]. This is a status of political equipoise, that may call for randomized assessments.

Many of these so-called non-pharmacological interventions (NPIs) are more or less supported by mechanistic assumptions, physical principles, preclinical and animal experiments. However, all novel pharmacological interventions that undergo clinical evaluation also are based on sound assumptions, theoretical principles and preclinical evaluation and animal experiments. And yet almost all of these candidate treatments, estimated 90%, fail to show sufficient benefit and safety to get approval [30]. Would it be reasonable to assume that NPIs are more frequently effective than the carefully developed pharmaceutical products seeking market accesss? As for drug treatments, the established method to show benefits and harms for non-pharmaceutical interventions is the randomized trial.

Continous monitoring of all NPI trials shows that as of February 28, 2022, 57 randomized trials were registered worldwide to assess how to effectively prevent COVID-19 with social or behavioural interventions, devices, or any other NPI [8], [13]. These trials were predominantly set up in adult community populations in North America and Europe assessing testing regimens or protective equipment (i.e., masks). Only some of them were planned to investigate strategies to mitigate the COVID-19 spread in nursing homes, schools, or universities. Randomized trials assessing the benefits and harms of masking children for many hours per day are lacking. The status of the NPI trials shows that only around one quarter of the trials (26%) is completed and half of them (47%) are still ongoing.

For the completed NPI trials, we are aware of only 11 trials with published results (Table 3 ). None of the trials came from Germany, highlighting that the German contribution to generate high-quality evidence supporting political decisions on the benefits and harms of NPIs is minimal. It cannot be ruled out that randomized trials from Germany have remained unregistered, but to our knowledge they have not appeared publicly in the scientific debate as it would be expected from important evidence.

Table 3

Overview of the 11 randomized assessments of non-pharmaceutical interventions to prevent from COVID-19 with published results (based on 4,675 RCTs registered as of February 28, 2022).

Registry ID	Intervention(s)	Comparator(s)	Setting, country	N individuals / clusters	Start to end date	Results
Trial acronym
Reference
NCT04620798 [38]NA	Immediate provision of COVID-19 antibody test results in addition to assessment of engagement with COVID-19 prevention behaviors following testing of university students	Delayed provision of COVID-19 antibody test results in addition to assessment of engagement with COVID-19 prevention behaviors following testing of university students	University, USA	1,076 / NA	2020-09 to 2020-11	No differences in numbers of serovonverted participants (from seronegative to seropositive) between the study groups (secondary outcome).
ChiCTR2000030317 [39]NA	Fully closed negative-pressure gastroscope isolation mask	No mask	Hospital, China	320 / NA	2020-02 to 2020-04	No COVID-19 cases were recorded during follow-up in both study groups (secondary outcome).
NCT04337541 [40]DANMASK-19	Surgical face mask recommendation	No recommendation	Community, Denmark	6,024 / NA	2020-04 to 2020-06	No differences in SARS-CoV-2 infections between the study groups (primary outcome).
NCT04406909 [41]TRAiN	Access to indoor fitness center applying physical distancing and enhanced hand and surface hygiene	No access	Community, Norway	3,764 / NA	2020-05 to 2020-06	No differences in SARS-CoV-2 infections between the study groups (primary outcome). No outpatient visits or hospital admissions due to COVID-19 in both study groups (secondary outcome).
CTRI/2020/07/026667 [42]NA	Morning and evening Pranayama yoga sessions	General fitness practices (e.g., walking, jogging, running)	Hospital, India	280 / NA	2020-09 to 2020-11	Lower number of SARS-CoV-2 infections in the yoga sessions group (primary outcome).
NCT04644328 [32]NA	Facebook ads containing a short video on the importance of staying safe during Thanksgiving and Christmas by considering not traveling, social distancing, and using a mask when appropriate	No Facebook ads	Community, USA	3,525,6399 / 1,587	2020-11 to 2021-01	Lower number of SARS-CoV-2 infections in the Facebook ads group (primary outcome).
NCT04668625 [43]NA	Access to an indoor music event with systematic same-day screening of attendees with antigen-detecting rapid diagnostic tests, use of face masks, and adequate air ventilation	No access	Community, Spain	1,047 / NA	2020-12 to 2020-12	Lower number of SARS-CoV-2 infections in the access to music event group (primary outcome).
ISRCTN18100261 [44]NA	Daily testing of contact cases of school staff and students	Isolating contact cases of school staff and students	School, United Kingdom	238,579 / 201	2021-04 to 2021-06	No differences in SARS-CoV-2 infections between the study groups (primary outcome).
NCT04630054 [45]NA	Community-level masks promotion strategies (multiple levels of randomization, including free surgical or cloth face masks with information on the importance of masking, role modeling by community leaders and imams, and in-person reminders)	No intervention	Community, Bangladesh	342,126 / 600	2020-11 to 2021-04	Lower numbers of SARS-CoV-2 infections in the mask use promotion group (primary outcome).
NCT04872075 [46]SPRING	Access to an indoor music event with systematic antigen-screening within 3 days, medical mask-wearing and optimized ventilation	No access	Community, France	6,678	2021-05 to 2021-06	No differences in SARS-CoV-2 infections between the study groups (primary outcome).
NCT04359264 [34]DISTANSE COVID	Income support of $1000 to community-living adults suffering from COVID-19-related financial disruptions and information about reducing the spread of COVID-19 over the phone and via email	Information about reducing the spread of COVID-19 over the phone and via email alone	Community, Canada	392	2020-04 to 2020-05	No differences in COVID-19 symptoms or SARS-CoV-2 infections between the study groups (primary outcome).

Abbreviations: N = Number; NA = Not applicable; NR = Not reported.

In sum, the foundation for potential evidence on the benefit and harms of NPIs is scarce; 57 trials, a tiny fraction of almost 5,000 trials initiated worldwide, assess NPIs to prevent COVID-19, with only a dozen having published results potentially informing evidence-based decisions [8], [10], [13], [31]. These data show that the worldwide research agenda failed to set up highly desired trials to inform political decision makers about the contribution of NPIs to prevent COVID-19.

Positive examples

However, there are some positive examples of randomized assessments of NPIs that are highlighted here to illustrate the range of creative possibilities and what could have been done.

One example is a pragmatic megatrial that was set-up in the US including more than 35 million people. Prior to Thanksgiving and Christmas holidays, Facebook users were randomly assigned to receive either ads containing a short video on the importance of “staying safe” by considering not traveling, social distancing, and using a mask when appropriate or no facebook ads. Confirmed SARS-CoV-2 infections were analysed on the zip-code level up to two weeks after the holidays. The results favor the Facebook ads indicating these measures to be an effective pubic health strategy to prevent individuals from SARS-CoV-2 infections [32].

Another example is the “GLasses Against transmission of SARS-CoV-2 in the community” (GLASSY) trial that was initiated in Norway; a pragmatic, randomized, and fully remote and virtual trial without any personal interaction between investigators and participants. It evaluates whether SARS-CoV-2 infections can be reduced when participants are asked to wear glasses (sunglasses or other glasses) when they are outside of their home and close to others (e.g., on public transport, in shopping centres) compared to participants that are asked to wear no glasses in public spaces [33].

A third example is the Canadian “Direct Income SupporT and Advice Negating Spread of Epidemic COVID-19” (DISTANSE COVID) trial; a randomized social assessment whether income support of $1000 to community-living adults suffering from COVID-19-related financial disruptions and information about reducing the spread of COVID-19 compared to information alone reduced symptoms related to COVID-19. The results indicate that COVID-19 symptoms were reduced in participants above the age of 50 [34].

Discussion

After two years of the pandemic, over 4,000 randomized trials have been registered to evaluate interventions to prevent or treat COVID-19. Unfortunately, most trials remained small and resulted in a limited number of publications. Very early in the pandemic, it became clear that there was a lack of timely coordination and structured efforts to knowledge generation – there was, with few exceptions, no integration of clinical trial research in the pandemic response. Remarkably, the development of new therapies was largely preceded by the assessment of repurposing drugs established for other diseases, such as the antimalarial hydroxychlorquine. The same question on hydroxychloroquine was investigated again and again, a rarely seen chaos-like redundancy without comprehensible justification [6]. It also became clear that the large and ambitious research effort would be accompanied by a huge waste of resources [35]. Germany played almost no role as a location for the clinical trials in the early response to the pandemic, being involved in only 2% of all over 500 clinical trials initiated in the first 100 days. Randomized assessments to find the most efficient non-pharmaceutical strategies to prevent COVID-19 was unfortunately not part of the early days response.

With steadily increasing number of trials over the first year, the number of trials with published results grew. Despite being only a small fraction of the over 2,800 trials initiated, there were still 171 trials sucessfully initiated, conducted and published within more or less one year – this is remarkable nevertheless.

In the second year, the deficits of the the COVID-19 clinical research agenda persisted with little evolution towards more coordination and efficiency. Trials remained small. Hydroxychloroquine was still included in newly registered trials. And Germany’s contribution remained limited contributing to 2.5% of registered trials nationally and internationally ranking on place 12. Germany has a long-standing tradition of excellent biomedical research in the field of basic research and preclinical studies [36]. However, with regard to practical health care decisions, a relatively small contribution of German trials was already described in 2013, with only 5% of the trials used for German Health Technology Assessments (HTA) coming from Germany [37] although such reports aim to inform benefit assessments with major relevance for health care in Germany. It seems little has improved during the COVID-19 pandemic [7].

Somewhat reassuring was the rise of internationally conducted trials which now represent 13% of the registered trials, ranging on place 2 worldwide, illustrating an improvement in collaborations and coordinations. The highest ranked position of Iran as individual country of origin with most registered trials worldwide is highly interesting and it needs a better understanding of the contributing factors.

The pandemic clinical research agenda will most certainly provide textbook examples of the missed opportunities but also the immense potential of the scientific community. On one hand, the scientific community’s inaction and continuing disinterest in conducting randomized assessments of non-pharmaceuticl interventions to prevent the spread of COVID-19 resulted in drastic preventive measures being taken without robust evidence to support these decisions. On the other hand, the incredible speed of the research agenda and the few illustrious examples, such as RECOVERY, of collaborations and coordinations, clearly illustrate the remarkable potential of the scientific community.

Our analysis here has several limitations, including that we may have missed duplicate entries across registries or of multiple national parts of an international trial, thus slightly overestimating the number of trials, or conversely, that we missed trials conducted in a country, for example because they were not registered or the registry data gave no indication of the country’s contribution. Some registry entries had missing data for sample size, interventions arms and/or country of conduct, thus, reported numbers and proportions may be imprecise. Finally, in this rapidly evolving setting, information available in a registry is not timely and sometimes never updated and we might not capture updates, adaptations and amendments to trial designs and/or interventions being assessed.

COVID-19 has highlighted the limitations of the current research system in Germany, but also challenged its status quo. It is simply not true that clinical trials need to be expensive and cumbersome [6]. Elegant and simple study designs with clinical research as standard of care can test treatments quickly and efficiently. It is obvious that priorities must be set to coordinate efforts that separate the useful from the useless and harmful.

Overall, successful clinical research does not require a revolution in methodology; we already have the tools. It is mainly the man-made problems in the research system along with the regulatory and institutional requirements that prevent us from making individual research success stories the normal state of medical progress.

Conclusions

The COVID-19 clinical research agenda was initiated at an incredible speed. The systematic assessment of the agenda highlights the challenges of the clinical research ecosystem on a world scale but also for individual countries. Most importantly, it has shed light on the ability to circumvent traditional hurdles and to make trials more useful even under extraordinary conditions. It is up to the system to adapt so that the enormous scientific potential of the clinical community can be unleashed.

The time to learn the lessons and apply them is now, and the time to demonstrate how we have improved the system is long before the next pandemic.

Funding

This work is part of the COVID-evidence project which is supported by the Swiss National Science Foundation, project ID 31CA30_196190.

Acknowledgement

The authors thank Pascal Düblin (University of Basel) for his support in managing the database and generation of Figure 3, Ulrich Dirnagl (Berlin Institute of Health at Charité BIH), and Atle Fretheim (Norwegian Institute of Public Health) for their critical feedback on a previous version of the manuscript.

Conflict of Interest

All authors declare that there is no conflict of interest.

CRediT author statement

The authors had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: All authors.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: All authors.

Critical revision of the manuscript for important intellectual content: All authors.

Supervision: All authors.