Literature DB >> 35493849

Development of novel spectroscopic and machine learning methods for the measurement of periodic changes in COVID-19 antibody level.

Zozan Guleken1, Yeşim Tuyji Tok2, Paweł Jakubczyk3, Wiesław Paja4, Krzysztof Pancerz5, Yaroslav Shpotyuk3, Jozef Cebulski3, Joanna Depciuch6.   

Abstract

In this research, blood samples of 47 patients infected by COVID were analyzed. The samples were taken on the 1st, 3rd and 6th month after the detection of COVID infection. Total antibody levels were measured against the SARS-CoV-2 N antigen and surrogate virus neutralization by serological methods. To differentiate COVID patients with different antibody levels, Fourier Transform InfraRed (FTIR) and Raman spectroscopy methods were used. The spectroscopy data were analyzed by multivariate analysis, machine learning and neural network methods. It was shown, that analysis of serum using the above-mentioned spectroscopy methods allows to differentiate antibody levels between 1 and 6 months via spectral biomarkers of amides II and I. Moreover, multivariate analysis showed, that using Raman spectroscopy in the range between 1317 cm-1 and 1432 cm-1, 2840 cm-1 and 2956 cm-1 it is possible to distinguish patients after 1, 3, and 6 months from COVID with a sensitivity close to 100%.
© 2022 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  Anti-SARS-CoV-2 antibody levels; FTIR; Machine learning; Raman spectroscopy

Year:  2022        PMID: 35493849      PMCID: PMC9040476          DOI: 10.1016/j.measurement.2022.111258

Source DB:  PubMed          Journal:  Measurement (Lond)        ISSN: 0263-2241            Impact factor:   5.131


Introduction

The coronavirus disease 2019 (COVID-19), which is caused by severe respiratory syndrome coronavirus 2 (SARS-CoV-2) was first reported in Wuhan, China in December 2019 and has spread among humans across the continents and eventually was recognized as a pandemic on March 11, 2020 [1], [2]. SARS-CoV-2 is a zoonotic, positive polarity RNA virus, which includes structural proteins, namely, spike (S), envelope (E), membrane (M), nucleocapsid (N), as well as 16 non-structural proteins, that are involved in viral infection and replication [3], [4]. SARS-CoV-2 infection initiates an immune response that targets these proteins and includes the production of neutralizing antibodies. The antibodies remain detectable in the plasma for months. These antibodies bind rapidly and strongly to viral antigens, blocking cellular infiltration and replication of the virus [5], [6], [7]. The plaque reduction neutralization test (PRNT) is the gold standard for demonstrating protective antibody titer in viral infections. However, the practical use of such a laborious method is limited due to the biosafety requirement (level–3 laboratory is mandatory). It is still unclear at what titer serum antibodies are protective from COVID-19, but studies have shown a high correlation between cell-based neutralization assays and serum antibody titers. In most patients, SARS-CoV-2 forms a self-limiting infection, and soon within 1–3 weeks on the average after antigens appear in the blood, the antibodies reach a level that can be serologically detected in the plasma [8], [9], [10], [11]. Dynamic measurement of total anti-SARS-CoV-2 antibody levels and periodic monitoring of dynamic titer bear great importance in epidemiological studies such as determining exposure and infection rates in the population, monitoring the development of herd immunity. Antibody level monitoring can also be used to determine disease severity and to design preventive measures against the risk of re-infection [12]. The level of antibody reflects the dependence on the amides and lipids metabolisms [13]. It was shown, that people with symptomatic COVID-19 have an almost 15-fold reduction in the serum of the sphingosine consistent with the presence of acid ceramidase protein, as compared to asymptomatic COVID-19 patients [14]. Previous studies in cohorts selected from the society have shown that antibodies disappear in an average period of four months [15], [16]. On the other hand, the community constantly encounters severe patients that require hospitalization, hence are faced with higher viral load. In recent years, spectroscopic methods combined with multivariate analyzes and machine learning methods have been used to differentiate tissues, cells and body fluids from sick and healthy people [17], [18]. The possibility of using these methods in medical diagnostics as well as in the diagnostics of viruses is investigated. Khan et al. showed that Raman spectroscopy analysis of blood serum can distinguish (with 97% of precision, 100% of sensitivity and 95% of specificity) between a healthy patient and a patient infected by hepatitis B virus [19]. Furthermore, in the other work, the authors showed, that using FTIR spectroscopy it is possible to distinguish between females suffering from symptomatic and asymptomatic COVID-19 [20]. In the other work, machine learning methods showed, that using FTIR data it is possible to detect COVID-19 infection with 87% of sensitivity [21]. In addition, Liu et al. showed high sensitivity of surface-enhanced Raman scattering (SERS) in the detection of the anti-SARS-CoV-2 IgM/IgG [22]. These authors proposed a sensor, which gives 800 times higher detection of antibodies than the standard IgM and IgG sensor. Consequently, FTIR and Raman spectroscopy can be used to detect COVID-19. However, in our work, besides the possibility to distinguish between the blood serum of people with COVID-19 and healthy people, the main attention was paid to the use of spectroscopies methods to predict the SARS-CoV-2 antibody timeline, estimate reinfection risk and the need for the vaccination by periodically assessing total antibody levels in people, who have recovered from COVID-19. For this purpose, FTIR and Raman spectroscopy methods in combination with multivariate analyses were used. To investigate the possibility of FTIR and Raman methods to distinguish patients with different antibody levels, the obtained spectroscopic data were further analyzed by machine learning and neural network methods [2]. In addition, the correlation between antibody and amides as well as lipids levels were analyzed in the respective vibration regions of Raman and FTIR.

Materials and methods

Patient selection

For this research, 47 patients aged 26–77 (healthcare employees) infected by COVID (confirmed by SARS-CoV-2 RT–PCR testing) were involved. Demographic data such as age, gender, history of additional disease/drug use, symptoms and treatments were recorded for each patient on the prepared form. Collected data is shown in Table 1 .
Table 1

Demographics, symptoms and comorbidities of the participants.

IDSexAgeSymptomsComorbidities
1Male26Fever, weakness, muscle pain, cough
2Male44Joint pain, coughPatient of hematology
3Male77Weakness, nauseaPatient of hematology
4Male42Asymtomatic
5Male52Fever, cough, shortness of breatHypertension
6Male32Fever, cough, myalgia
7Male24Fever, weakness
8Male45Fever, cough, weakness, Joint pain
9Male36Fever, shortness of breath, postnasal drip, cough, taste loss, diarrhea
10Male58Diarrhea, fever, cough, shortness of breathHypertension
11Male37Asymtomatic
12Male29Fever, myalgia, sore throat
13Male30Fever, myalgia, Joint pain
14Male41Fever, weakness, myalgia, headache, sore throat
15Male38Headache, weakness
16Male43Fever, weakness
17Male42Fever, weakness, taste loss, muscle pain
18Male47Fever, weakness, vomiting, muscle pain
19Male52Fever, myalgia, Joint pain
20Male44Myalgia
21Male61Fever, diarrhea
22Female29Fever, cough
23Female27Shortness of breath, coughAsthma
24Female38Cough, Joint pain, loss of taste and smell
25Female71Weakness, anorexia, cough, shortness of breath, diarrhea, fever, headacheHypertension Chronic obstructive pulmonary disease
26Female30Myalgia
27Female30Joint pain, fever, cough, diarrhea, nausea, weakness
28Female51Sore throat, fever, weakness, Joint pain, cough, nausea
29Female27Myalgia, fever, weakness, loss of taste and smell, nasal congestion
31Female42Weakness, chest pain, fever, arrhythmia
31Female54Muscle pain weakness, diarrhea
32Female35Muscle pain, nausea, headache, taste loss, cough, diarrhea
33Female39Muscle pain, weakness, diarrhea
34Female41Cough, Joint pain, loss of taste and smell
35Female62Shortness of breathColon ca, receiving chemotherapy
36Female36Fever, diarrhea, joint pain, weakness, cough, shortness of breath
37Female35Weakness, headache, sore throat, cough
38Female44Fever, shortness of breath, postnasal secretion, cough, taste loss, diarrhea
39Female55Fever, weakness, vomiting, muscle pain
40Female35Myalgia, loss of smell and tasteHypertension
41Female45Sore throat, loss of smell and taste, cough, muscle pain, weakness
42Female58Otalgia, cough, shortness of breath
43Female42Fever, diarrhea
44Female50Myalgia, loss of smell and taste
45Female32Asymptomatic
46Female56Fever, weakness, taste loss, muscle pain
47Female62Fever, weakness
Demographics, symptoms and comorbidities of the participants. The results of biochemical [erythrocyte sedimentation rate (ESH), leukocyte, hemoglobin, platelet counts, coagulation, liver enzymes, D-dimer, C-reactive protein] and radiological [lung radiography / computerized tomography (CT)] examinations were recorded by inquiring from the hospital information system. Positive RT-PCR test of COVID-19, age over 18, and belonging to the group of health care employees were used as selection criteria. All the selected patients agreed to give a sample for antibody measurement more than once, including the first blood sample after 1 month from the first diagnosis, the second one after 3 months and the last one – after 6 months. The severity of COVID-19 was determined according to the WHO (World Health Organization) criteria and the patients were evaluated separately as asymptomatic/symptomatic (mild-severe) [23].

Laboratory study

Peripheral blood samples were taken on the 1st, 3rd, and 6th month after the diagnosis of positive asymptomatic or symptomatic COVID-19. Total antibody level against SARS-CoV-2 N antigen was measured in ECLIA (Electrochemiluminescence immunoassay)-based, semi-quantitative Elecsys anti-N serological test (Roche Diagnostics Rotkreuz, Switzerland) in Cobas e601 device. The results were expressed as COI (cutt-off index) and values above one (>1 COI) were evaluated as the reactivity following the manufacturer's recommendations.

FTIR measurements

The Bruker Vertex 70v spectrometer equipped with an attenuated total reflection (ATR) diamond crystal plate was used to study the absorbance spectra of serum samples. The measurements were performed in 400–4000 cm−1 region with 32 scans for each sample, and spectral resolution of 4 cm−1. Collected blood samples were centrifuged (15 min, 3000 rpm) then serum was separated and stored (at −80 °C) till spectroscopic measurements. Before FTIR measurement, samples were thawed, spotted on a CaF2 slide and dried. The ATR diamond crystal was cleaned each time before the measurements [24]. All spectra were analyzed using OPUS 7.0 software. For each spectrum, the baseline correction, vector normalization and smoothing with Savitzky–Golay filter were performed [20].

FT-Raman measurements

Blood serum collected from patients after 1, 3 and 6 months after COVID-19 positive test (group I, II and III, respectively) was measured using FT-Raman spectrometer Nicolet NXR 9650. This spectrometer is equipped with a Nd: YAG laser operating at 1064 nm wavelength (power was set to 1 W). Before the measurement, the same sample preparation procedure (as for FTIR) was performed. Blood samples were centrifuged (15 min, 3000 rpm), then serum was separated and stored (at −80 °C). Before measurement, the samples were thawed. A volume of 4 µL of each serum sample dropped on a gold support was used for measurements. All spectra were recorded in the range from 150 to 3700 cm−1 with 8 cm−1 spectral resolution and 64 scans. Raman spectra were processed by the Omnic/Thermo Scientific software.

Multivariate analysis of obtained FTIR and FT-Raman spectra

To increase the distinguish efficiency between serum collected from patients after 1, 3 and 6 months after COVID-19 using FTIR and FT-Raman spectroscopies, as well as the similarity between samples in each analyzed group, Principal Component Analysis (PCA) and Hierarchical Component Analysis (HCA) were performed. Moreover, to identify the wavenumbers which could be used to differentiate serum from patients at different periods after COVID-19, the Partial Last Square (PLS) analysis was done. PCA and HCA analyses were performed using Past 3.0. software, while PLS was done using Origin 2019 software. PLS analyses were performed in the 800–4000 cm−1 region of FTIR and 500–3700 cm−1 region of Raman spectra, while PCA and HCA analyses were used for the range between 800 cm−1 and 1800 cm−1, as well as between regions, which were obtained from PLS analysis.

Analysis of FTIR absorbance dynamics

To mark the difference between the three analyzed groups and to confirm the conducted statistical analysis the absorbance dynamics method was applied. This method is based on the fact that in IR spectra, for a carefully selected range of wavenumbers two types of absorbance dynamics can be noticed. In the case of the first type , and in the case of the second type , where A denotes the FTIR spectrum and k is the wavenumber. This means that for the first type of dynamics the absorption is increasing with , while in the second is decreasing. The simple difference between such defined dynamics for wavenumber can be used as an indicator of the differences between the IR spectra under consideration and the appropriately calibrated value of the first derivative is a good measure of the differences. This is a very accurate method with the resolution of the order of a single wavenumber. In this research, the analyses were performed in the 1500–1800 cm−1 and 2700–3000 cm−1 regions of FTIR spectra, as according to PLS analysis, only in these regions the significant differences in the absorbance for the analyzed group can be noticed.

Data analysis using machine learning methods

To acquire the knowledge about the accuracy of FTIR spectroscopy in separating evaluated samples, six machine learning methods were used: Random forest (RF), [25]. C5.0 decision tree algorithm, [26]. Deep Neural Networks (DNN) [27]. k-nearest Neighbors (kNN) [28]. XGBoost trees [29]. Support Vector Machine (SVM) [30]. Appropriate datasets in a tabular form were created to classify the cases. The goal of building classification models was to check whether these models can distinguish between cases belonging to different categories (treated as decision classes): 1 month after COVID-19; 3 months after COVID-19; 6 months after COVID-19. The datasets consisted of rows (each row corresponds to one patient), columns representing features describing patients (wavenumbers of single peaks), and a decision column containing the categories mentioned earlier. Each dataset, before a feature selection process, contains 156 features (wavenumbers) and 1 decision attribute. The experiments were performed using the R environment in which the following packages were used: mltools, class, randomForest, C5.0, keras, xgboost and e1071. Additionally, the Boruta package [31] was used to perform the selection process for the most relevant features (wavenumbers) which have the greatest impact on the assignment of the category by evaluating the importance of each descriptive wavenumber. This approach reduced the original set of 156 features (wavenumbers) to approximately 61 to 106 features in case of the range of wavenumbers from 1500 to 1800 cm−1 and from 166 of original features (wavenumbers) to approximately 47 to 138 features in case of the range of wavenumbers from 2700 to 3000 cm−1 without degrading or improving the quality of cases classification (see Table 2 ). In this way, the analyses were performed using twelve datasets created.
Table 2

Datasets created to perform experiments devoted to distinguish cases between each pair of groups of patients using two ranges of wavenumbers (2-class classification problems).

DatasetWavenumbers# of cases# of featuresClasses
11500 to 1800 cm−184156Group I and II
28461
385156Group II and III
485106
581156Group I and III
68178
72700 to 3000 cm−184166Group I and II
88447
985166Group II and III
108579
1181166Group I and III
1281138
Datasets created to perform experiments devoted to distinguish cases between each pair of groups of patients using two ranges of wavenumbers (2-class classification problems).

Results

Biochemical results

In this study, biochemical tests, as well as physical methods such as FTIR and Raman spectroscopy in combination with multivariate and machine learning analyses were used to determine differences in the antibody level in patients infected by COVID-19. Investigations were performed after 1, 3, and 6 months (group I, II, and III, respectively) from the date of infection (as confirmed by RT-PCR test). The SARS-CoV-2 N antibody levels in the different periods after COVID-19 are shown in Table 3 . The highest level of antibodies, in general, was recorded after 1 month from infection by COVID-19. This level decreases periodically by the time after the disease. However, only a small loss (for 27 units) is observed in the mean value of antibody level after 1 and 6 months.
Table 3

SARS-CoV-2 N antibody level in patients after 1, 3, and 6 months from COVID-19.

Anti-N level
1st month (group 1)3rd month (group 2)6th month (group 3)
N404040
Mean89.479.562.4
Median89.569.053.0
Standard deviation61.660.659.0
Minimum410
Maximum196197200
SARS-CoV-2 N antibody level in patients after 1, 3, and 6 months from COVID-19. To show a correlation between the level of antibodies and the time since the COVID-19 disease, a correlation test was performed (Table 4 ).
Table 4

Correlation Matrix of SARS-CoV-2 N antibody (Anti-N) level between 1, 3 and 6 months later. Note: Ha is a positive correlation, * p < 0.05, ** p < 0.01, *** p < 0.001, one-tailed.

Anti-N level1thmonth3rdmonth6th month
1thmonthSpearman's rho
3rdmonthSpearman's rhoHa 0.378*
6th monthSpearman's rhoHa 0.329*Ha 0.844***
Correlation Matrix of SARS-CoV-2 N antibody (Anti-N) level between 1, 3 and 6 months later. Note: Ha is a positive correlation, * p < 0.05, ** p < 0.01, *** p < 0.001, one-tailed. The correlation test presented in Table 4 showed the correlation between antibody levels after 1 and 3 as well as 6 months from COVID-19 disease. Furthermore, a correlation between patients' antibody levels after 3 and 6 months from COVID-19 was observed. As can be seen from Fig. 1 , the total protein value decreases with the time since infection by COVID-19. However, it was noted, that only differences between patients after 1 and 6 as well as between patients after 3 and 6 months from COVID-19, were statistically significant. In the case of groups of patients after 1 and 3 months from COVID-19, the differences were not significant.
Fig. 1

Total protein values (mean ± SD) in 1th (7.30 ± 0.562), 3rd (7.12 ± 0.600) and in 6th (7.01 ± 0.427) months after COVID-19. Analyses were made by Wilcoxon rank, *noted as compared to the 1st month is p < 0.05. + noted as compared to the 3th month is p < 0.05.

Total protein values (mean ± SD) in 1th (7.30 ± 0.562), 3rd (7.12 ± 0.600) and in 6th (7.01 ± 0.427) months after COVID-19. Analyses were made by Wilcoxon rank, *noted as compared to the 1st month is p < 0.05. + noted as compared to the 3th month is p < 0.05. Albumin levels in COVID-19 patients were also changing with time (Fig. 2 ). The increase of albumin level was observed after 3rd month vs 1st month, while a decrease was observed after 6th month vs 3rd month. Statistically, a significant increase was in the 6th month after disease, compared to 1st and 3rd months. The increase in albumin level increased from 4.41 after 1 month to 4.47 after 6 months. Consequently, the difference was very small.
Fig. 2

Albumin levels (mean ± SD) in 1st (4.41 ± 0.282), 3rd (4.50 ± 0.289) and in 6th (4.47 ± 0.347) months after COVID-19. Analyses were made by Wilcoxon rank, *noted as compared to the 1st month + is noted as compared to 3rd month is p < 0.05. + noted as compared to the 3rd month is p < 0.05.

Albumin levels (mean ± SD) in 1st (4.41 ± 0.282), 3rd (4.50 ± 0.289) and in 6th (4.47 ± 0.347) months after COVID-19. Analyses were made by Wilcoxon rank, *noted as compared to the 1st month + is noted as compared to 3rd month is p < 0.05. + noted as compared to the 3rd month is p < 0.05.

FTIR and Raman results with multivariate analyses

The FTIR spectra of serum collected from patients in different periods after COVID-19 are presented in Fig. 3 a. The same peaks corresponding to functional groups building phospholipids, nucleic acids, carbohydrates, proteins and lipids vibrations were observed, and respective differences in the absorbance values were noticed. Peaks at 1082 cm−1 and 1165 cm−1 correspond to the vibration of PO2- and bending vibration of C—O—H groups from phospholipids, nucleic acids, and carbohydrates, respectively [32]. Amide vibrations which are structural units building proteins (amide III, amide II and amide I), were identified at 1238 cm−1, 1304 cm−1, 1531 cm−1 and 1635 cm−1 wavenumbers [32]. The vibration of CO (Amide I, CO stretching) was located at 1392 cm−1, while the peaks at 1454 cm−1 are originated from C—H stretching vibrations [33]. The peaks around 3278 cm−1 are originated from O—H stretching vibrations. The vibration modes of peaks at 2958 cm−1, 2931 cm−1 and 2872 cm−1 originate from the asymmetric vibration of C—H in CH3, asymmetric vibration of C—H in CH2 and symmetric vibration of C—H in CH3, respectively [34]. These functional groups in the structure of the lipids can be observed. Furthermore, the CO vibrations of lipids were also noticed at 1740 cm−1 [34].
Fig. 3

FTIR spectra of serum collected from patients 1, 3, and 6 months after COVID-19 (black, red, blue curves, respectively) (a); PLS analysis for IR range between 800 cm−1 and 4000 cm−1 (b); with diagnostic plots for groups I, II, III (c1, c2, c3, respectively).

FTIR spectra of serum collected from patients 1, 3, and 6 months after COVID-19 (black, red, blue curves, respectively) (a); PLS analysis for IR range between 800 cm−1 and 4000 cm−1 (b); with diagnostic plots for groups I, II, III (c1, c2, c3, respectively). By comparing all three analyzed groups, it could be noticed that the lowest absorbance of all described functional groups in the FTIR spectrum of serum was noticed 6 months after COVID-19 (group III). The highest absorbance of C—O—H groups from carbohydrates and CO, CH2, CH3 from lipids was noticed in patients 3 months after COVID-19 (group II) and slightly lower absorbance was observed in the spectrum for patients 1 month after COVID-19 (group I). However, the opposite situation is observed for amides vibrations (the highest for group I and slightly lower for group II). In the group I, the absorbance level of peaks at 1392 cm−1 and 1454 cm−1 was almost the same, which was visible in the value of ratio 1392 cm−1/1454 cm−1 (0.9963 ± 0.0002). While in the second group, the absorbance value of the peak at 1392 cm−1 was lower than in the case of the peak at 1454 cm−1 (ratio 1392 cm−1/1454 cm−1, 0.0909 ± 0.0033). In the group III, the absorbance of the peak at 1392 cm−1 was higher than the peak at 1454 cm−1 (ratio 1392 cm−1/1454 cm−1, 1.0157 ± 0.0004). Besides the absorbance intensity, differences in the shape of the spectrum were also detected. PLS analysis presented in Fig. 3b showed, that significant differences in the absorbance between three analyzed groups were placed at wavenumbers between 1500 cm−1 and 1800 cm−1 as well as between 2700 cm−1 and 3000 cm−1. These regions correspond to the vibrations of amides (amide II and amide I) and lipids functional groups (CO, CH2 and CH3). Furthermore, diagnostic plots obtained for groups showed, that experimental data fit well with the PLS model, Fig. 3c1, c2, c3. For groups II and III, fitting accuracy was around 75% in both cases, while in the case of group I, fitting accuracy was around 85%. Consequently, for these IR regions, PCA and HCA analyses were performed (Fig. 4, Fig. 5 ).
Fig. 4

PCA analysis of IR range between 1500 cm−1 and 1800 cm−1 (a1) and between 2700 cm−1 and 3000 cm−1 (b1) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19 with PC1 (a2, b2) and PC2 (a3, b3) loading.

Fig. 5

HCA analysis of IR range between 1500 cm−1 and 1800 cm−1 (a) and between 2700 cm−1 and 3000 cm−1 (b) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19.

PCA analysis of IR range between 1500 cm−1 and 1800 cm−1 (a1) and between 2700 cm−1 and 3000 cm−1 (b1) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19 with PC1 (a2, b2) and PC2 (a3, b3) loading. HCA analysis of IR range between 1500 cm−1 and 1800 cm−1 (a) and between 2700 cm−1 and 3000 cm−1 (b) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19. PCA analysis of IR range between 1500 cm−1 and 1800 cm−1 (Fig. 4a1) showed a possibility to differentiate the patients being 6 months after COVID-19 from patients 1 and 3 months after this disease. The principal components PC1 and PC2 were calculated and illustrated in Fig. 4. In group III the values of PC2 were negative. As was shown in Fig. 4a3, PC2 with a negative value is originated from the IR range between 1620 cm-1and 1685 cm−1. This range corresponded to amide I vibrations. Also using IR range between 2700 cm−1 and 3000 cm−1 (Fig. 2b1) it was noted, that only samples from group III can be differentiated for the next two analyzed groups of patients. For patients 6 months after COVID-19, both components, PC1 and PC2, had a negative value. Loading plots presented in Fig. 4b2 and 4b3, showed, that component 2 plays the main role in the differentiation, in which negative values for wavenumbers between 2775 cm−1 and 2830 cm−1, as well as between 2860 cm−1 and 2880 cm−1, were noticed. HCA analysis showed, that almost all patients after 1 month from COVID-19 created one similarity group, when vibrations of amide II and amide I are analysed (Fig. 5a). Furthermore, for these IR range, patients after 6 months from COVID-19 created two similarity groups, which were separated from each other. Moreover, these groups were also separated from the other two analyzed groups of patients (after 1 and 3 months). In the case of patients after 3 months from COVID-19, three similarity groups were noticed. However, what is important, these groups were more similar with patients from group I, than III. In the IR range between 2700 cm−1 and 3000 cm−1, HCA analysis didn’t show significant and well observable separation between three analyzed groups and similarity between samples collected from patients from I, II or III groups (Fig. 5b). In the Raman spectra of serum collected from patients after COVID-19 (Fig. 6 ), peaks attributed to proteins and amino acids vibrations were visible at 808 cm−1, 874 cm−1 and 1005 cm−1 [35]. Raman shifts at 1360 cm−1 and 1460 cm−1 are shown to correspond to CH3 and CH2 vibrations from proteins and lipids, respectively [35]. Amide I vibrations are located around 1650 cm−1 [35]. The highest values of Raman shifts were originated from the functional groups building lipid structures such as cholesterol and cholesterol ester: 1788 cm−1, 2929 cm−1 and 3053 cm−1 [36].
Fig. 6

FT-Raman spectra od serum collected from patients 1, 3 and 6 months after COVID-19 (black, red, blue curves, respectively) (a); PLS analysis for Raman range between 500 cm−1 and 3700 cm−1 (b) with diagnostic plots for group I, II, III (c1, c2, c3, respectively).

FT-Raman spectra od serum collected from patients 1, 3 and 6 months after COVID-19 (black, red, blue curves, respectively) (a); PLS analysis for Raman range between 500 cm−1 and 3700 cm−1 (b) with diagnostic plots for group I, II, III (c1, c2, c3, respectively). According to Raman spectra (Fig. 6a), the highest intensities of amino acids vibrations were noticed for patients 1 month after COVID, in comparison with next two analyzed groups, in which the intensities in these Raman range were almost the same. The highest intensity of peaks originated from CH3 and CH2 vibrations from proteins and lipids were visible in spectrum of patients 3 months after COVID-19, while the smallest in the spectrum of serum collected from people 6 months after COVID-19. In the case of vibrations of functional groups building cholesterol and esters, similar intensity was observed in spectrum of I and II groups, while in the III group, the intensity was lower. PLS analysis presented in Fig. 6b showed, that very wide range of Raman shifts can be helpful in the differentiation of serum collected from patients after different time from COVID-19. Square plot showed, that ranges between 1317 cm−1 and 1432 cm−1 and between 2840 cm−1 and 2956 cm−1, which correspond to proteins and lipids, could be helpful in distinguishing analyzed samples. Moreover, diagnostic plots showed, that fit with PLS model for groups I and II was around 80%, while for group III − 75% (Fig. 6c1-c3). PCA analysis of Raman spectra in the range between 1317 cm−1 and 1432 cm−1 showed, that it is possible to distinguish three analyzed groups to each other (Fig. 7 a1). For samples from group I the values of PC1 and PC2 components were positive, while for group II the value of PC1 was negative and PC2 – positive. In the case of group III the value of component 2 was negative while PC1 had positive as well as negative values. Loading plots showed, that the negative value of PC2 was in the range between 1365 cm−1 and 1424 cm−1 and this range can be helpful in differentiation between group III and groups II and I (Fig. 5a2, a3). Furthermore, in the Raman spectra range between 2840 cm−1 and 2956 cm−1, it is possible to distinguish three analyzed groups, because all samples for each group appeared in a different part of the coordinate system (Fig. 7b1). Almost all samples from group I had positive values of PC1 and PC2. In group II, values of PC1 and PC2 were negative, while in group III, PC1 was positive, while PC2 – negative.
Fig. 7

PCA analysis of Raman range between 1317 cm−1 and 1432 cm−1 (a1) and between 2840 cm−1 and 2956 cm−1 (b1) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19 with PC1 (a2, b2) and PC2 (a3, b3) loading.

PCA analysis of Raman range between 1317 cm−1 and 1432 cm−1 (a1) and between 2840 cm−1 and 2956 cm−1 (b1) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19 with PC1 (a2, b2) and PC2 (a3, b3) loading. HCA analysis of Raman spectra in the range between 1317 cm−1 and 1432 cm−1 showed, that all samples collected from patients after 3 months from COVID-19 (group I) created one similarity group (Fig. 8 a).
Fig. 8

HCA analysis of Raman range between 1317 cm−1 and 1432 cm−1 (a) and between 2840 cm−1 and 2956 cm−1 (b) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19.

HCA analysis of Raman range between 1317 cm−1 and 1432 cm−1 (a) and between 2840 cm−1 and 2956 cm−1 (b) of serum collected from patients after 1 (black dot), 3 (red dot) and 6 (blue dot) months from COVID-19. Moreover, almost all samples from the group created a similarity group, which was more similar to group III, than II. The same situation was observed for samples of group III, however in this case, part of the samples was more similar to group I and the next part to group II. Furthermore, HCA analysis in the spectral range corresponding to functional groups building cholesterol, lipids, and ester structures showed, that three separate similarity groups were created. It’s worth mentioning, that in each separate similarity group, samples from the same analyzed groups were placed. This means, that the Raman spectrum in this range was very similar for all patients after 1, 3 and 6 months from COVID-19, respectively (Fig. 8b). In Fig. 9 the results of calculation for dynamical spectra comparison between groups I and II and between I and III in the range between 1500 and 1800 cm−1 are presented.
Fig. 9

Differences in absorption dynamics between average FTIR spectra for patients 1 and 3 months (a) and 1 and 6 month (b) after COVID-19 in the range of wavenumbers from 1500 to 1800 cm−1. The value of absorption dynamics is normalized such that their values are between 0 and 100.

Differences in absorption dynamics between average FTIR spectra for patients 1 and 3 months (a) and 1 and 6 month (b) after COVID-19 in the range of wavenumbers from 1500 to 1800 cm−1. The value of absorption dynamics is normalized such that their values are between 0 and 100. As can be noticed, differences in the FTIR absorbance between groups I and II were placed at wavenumbers between 1589, 1637 cm−1 – 1643 cm−1, 1714 cm−1–1724 cm−1 and 1768 cm−1 –1770 cm−1, Fig. 9a. Similarly, the differences of spectra were calculated for groups I and III. The results of this comparison are presented in Fig. 9b. In this case a new shift in the range between 1541 cm−1–1547 cm−1 appear, which may be connected with patients healing. Results of calculations in the range of wavenumbers from 2700 to 3000 cm−1 are presented in Fig. 10 . In this particular case, the dynamics differences in spectra between the group I and II are for wavenumbers 2925 cm−1, 2951 cm−1 –2952 cm−1, 2995 cm−1, 3018 cm−1 and for the group I and III for 2925 cm−1, 2954 cm−1, 2956 cm−1, 2995 cm−1 (Fig. 10a). The lack of a peak at 3018 cm−1 for the comparison with group III suggests towards the process of healing (Fig. 10b).
Fig. 10

Differences in absorption dynamics between average FTIR spectra for patients 1 and 3 months (a) and 1 and 6 months (b) after COVID-19 in the range of wavenumbers from 2700 to 3000 cm−1.

Differences in absorption dynamics between average FTIR spectra for patients 1 and 3 months (a) and 1 and 6 months (b) after COVID-19 in the range of wavenumbers from 2700 to 3000 cm−1.

Machine learning

The accuracy of classification depends on the range of wavenumbers and the machine learning model used. It was in the range from 67.86% to 100.00% in case of the 1st range of wavenumbers and in the range from 58.33% to 100.00% in case of the 2nd range of wavenumbers. Most models achieved an accuracy of over 90%. Only for the DNN model the accuracy was sometimes lower, reaching 58 or 67%. It is worth noting, however, that in the case of analysis of the set of patients from groups I and III, the achieved classification accuracy for almost all models was at the level of 100%, i.e. the models unambiguously identified patients from these groups. Similarly, additional parameters describing the quality of classification reached the maximum value of 1. In Table 5, Table 6 additional values of parameters characterizing the quality of classification are presented. The parameters used are: precision, sensitivity and specificity and the results obtained for the 2-class sets are very good. The value of the sensitivity parameter shows that almost all patients from one group in comparison to another one are correctly identified as having proper features. The value of the specificity parameter shows that almost all patients from another group are identified as not having proper features.
Table 5

Classification results of group of patients 1, 3 and 6 months after COVID-19 (two-class dataset) with additional classification quality parameters in the range of wavenumbers from 1500 to 1800 cm−1 using six different machine learning models with original and selected relevant set of wavenumbers.

DatasetModelAccuracyPrecisionSensitivitySpecificity
Group I and II156 original featuresRF96.430.980.950.98
C5.091.670.950.880.95
kNN (k-3)96.4310.931
DNN67.860.620.850.52
XGBoost95.240.950.950.96
SVM70.240.640.880.55
Group I and II61 selected featuresRF95.240.980.930.98
C5.091.670.950.880.95
kNN (k-3)97.6210.951
DNN67.860.630.80.57
XGBoost95.240.950.950.96
SVM71.430.630.950.5
Group II and III156 original featuresRF98.820.9810.98
C5.096.470.960.980.95
kNN (k-3)98.820.9810.98
DNN97.6510.961
XGBoost97.6510.961
SVM97.6510.961
Group II and III106 selected featuresRF98.820.9810.98
C5.096.470.960.980.95
kNN (k-3)96.470.9310.93
DNN98.8210.981
XGBoost97.6510.961
SVM96.4710.931
Group I and III156 original featuresRF100111
C5.098.7710.981
kNN (k-3)100111
DNN100111
XGBoost100111
SVM100111
Group I and III78 selected featuresRF100111
C5.098.7710.981
kNN (k-3)100111
DNN100111
XGBoost100111
SVM98.7710.981
Table 6

Classification results of group of patients 1, 3 and 6 months after COVID-19 (two-class dataset) with additional classification quality parameters in the range of wavenumbers from 2700 to 3000 cm−1 using six different machine learning models with original and selected relevant set of wavenumbers.

DatasetModelAccuracyPrecisionSensitivitySpecificity
Group I and II166 original featuresRF96.430.950.970.96
C5.091.670.930.900.93
kNN (k-3)91.670.980.870.97
DNN75.000.730.750.75
XGBoost91.670.900.9250.91
SVM76.190.690.900.64
Group I and II47 selected featuresRF95.240.950.950.96
C5.092.860.930.930.93
kNN (k-3)95.2410.911
DNN58.330.590.40.75
XGBoost90.480.880.930.89
SVM77.380.710.880.68
Group II and III166 original featuresRF98.820.9810.98
C5.097.650.9610.95
kNN (k-3)97.650.9610.95
DNN98.8210.981
XGBoost97.6510.961
SVM97.6510.961
Group II and III79 selected featuresRF98.820.9810.98
C5.097.650.9610.95
kNN (k-3)98.820.9810.98
DNN97.6510.961
XGBoost97.6510.961
SVM98.8210.981
Group I and III166 original featuresRF100111
C5.098.7710.981
kNN (k-3)100111
DNN100111
XGBoost100111
SVM100111
Group I and III138 selected featuresRF100111
C5.098.7710.981
kNN (k-3)100111
DNN100111
XGBoost100111
SVM100111
Classification results of group of patients 1, 3 and 6 months after COVID-19 (two-class dataset) with additional classification quality parameters in the range of wavenumbers from 1500 to 1800 cm−1 using six different machine learning models with original and selected relevant set of wavenumbers. Classification results of group of patients 1, 3 and 6 months after COVID-19 (two-class dataset) with additional classification quality parameters in the range of wavenumbers from 2700 to 3000 cm−1 using six different machine learning models with original and selected relevant set of wavenumbers. In addition, a decision tree diagram was constructed using the C5.0 algorithm on the set of patients from groups I and III for both ranges of FTIR wavenumbers which are shown in Fig. 11 . From this simple diagram it can be seen that wavenumbers of 1700 and 2701 cm−1 perfectly distinguish between patients 1 and 6 months after COVID-19.
Fig. 11

Diagram of a decision tree built from a set of patients from groups I and III for range of wavenumbers 1500–1800 cm−1 (a) and 2700–3000 cm−1 (b).

Diagram of a decision tree built from a set of patients from groups I and III for range of wavenumbers 1500–1800 cm−1 (a) and 2700–3000 cm−1 (b). The results obtained from the supplied data, provide a basis for further extensive research on a large number of learning examples.

Discussion

After an illness, our body produces antibodies. The higher the level of these antibodies, the less likely you are to get sick once in a given disease [37]. Therefore, it’s extremely important to know the timelines with high antibody levels. Especially, nowadays, when COVID-19 pandemic spread in the world. Thanks to this knowledge, it may be possible to know, after what time since infected by COVID-19, the patients should e.g. have to be vaccinated to feel safe. Therefore, in this study, we did investigate the level of SARS-CoV-2 N antibody (Anti-N) in patients after 1, 3 and 6 months from COVID-19. Moreover, spectroscopy methods such as FTIR and Raman in combination with multivariate and machine learning methods were employed to distinguish the patients with different antibody levels. Löfström et al. showed, that the level of n-antibodies significantly increased in patients from 1 to 3 months and significantly decreased from patients 3 to 6 months [38]. In this study, the highest decrease of antibody level after 6 months from COVID-19 is also noticed (see Table 3). Memory B cells have to generate high avidity IgG antibodies to establish long-lasting immunity [39], [40]. Unfortunately, in case of COVID-19 infection, a decline in antibody concentration after 3 months could be response for the risk of reinfection already after 9–12 months [41]. Furthermore, as showed in this work, the total protein and albumin levels also decrease with the extension of time after COVID-19 as presented in Fig. 1, Fig. 2, respectively. Several papers showed, that low serum levels of total protein, albumin, prealbumin is visible in patients after COVID disease [42], [43]. Furthermore, FTIR and Raman spectra demonstrated the most visible differences in the intensity of peaks corresponding to amides vibrations, as seen in Fig. 3a and Fig. 6a, respectively. Amides are the most prevalent structures of living things, which build an important organic molecules and various biomolecules such as peptides, proteins and nucleic acids [44]. Consequently, PLS analyses of obtained IR and Raman spectra (Fig. 3b and Fig. 6b, respectively) showed, that vibrational regions of amides can be used in differentiation serum collected from patients after 1, 3 and 6 months from COVID-19. PCA and HCA analyses showed, that it is possible to distinguish three groups of patients using Raman spectroscopy in the range between 1317 cm−1 and 1432 cm−1 (Fig. 7a1, Fig. 8a1), while in the case of FTIR spectra, using the range between 1500 cm−1 and 1800 cm−1 (Fig. 4a1), only patients after 6 months from COVID-19 can be differentiated from the patients after 1 and 3 months. Interestingly, the Raman range, which was noticed in this work, coincides with the position of the peak that was used to test the anti-SARS-CoV-2 IgM/IgG level using the SERS technique (1328 cm−1) [22]. Moreover, Payne et al., showed, that the strongest peaks corresponding to spike proteins from COVID-19 were located in the Raman range, which was used to differentiate samples in this work [45]. Also, Carlomagno et al., showed, that peak in the Raman spectrum located at 1317 cm−1, which is originated from structural proteins of COVID-19 can be used to differentiate samples collected from people with positive and negative results of COVID-19 test [46]. This suggests, that in the Raman spectra, vibrations of protein functional groups play a very important role in the detection of COVID-19 or antibodies. However, the analysis of dynamic of FTIR spectra (Fig. 9) showed that the exact distinction between patients after 1 and 3 months from COVID-19 can be obtained by investigating the regions between 1637 cm−1 and 1643 cm−1, 1714 cm−1 and 1724 cm−1, 1768 cm−1 and 1770 cm−1 with accuracy close to 100% (Table 5). Furthermore, FTIR and Raman spectra, as well as analysis of FTIR spectra dynamics, showed, that differences in antibody levels in patients at different periods after COVID-19 could be also differentiated in the lipids region of spectra (Fig. 3b, Fig. 4b1, Fig. 6b, Fig. 7b1, Fig. 8b1, Fig. 10 and Table 6). Janneh et al. showed that reduced sphingosine levels are highly associated with the development of symptomatic and asymptomatic COVID-19 SARS-CoV-2-infected [14]. Moreover, the dependence of memory T cells on fatty acid oxidation is known [13]. In addition to mitochondrial biogenesis, the mitochondria’s quality also influences T cells and their ability to control viral, e.g. COVID-19 infections [47]. Increased effector T cell function exhibits superior anti-viral activity to control SARS-CoV-2/COVID-19 is mainly associated with increased glutaminolysis and increased dependence on mitochondrial metabolism, e.g. lipids metabolism [48]. Consequently, lipids vibrations visible in FTIR and Raman spectra can be used in the identification of the level of SARS-CoV-2 N antibody (Anti-N). Summarizing, it was shown in this work, that FTIR and Raman spectroscopy methods and analyses of these data by multivariate and machine learning methods can be helpful in the determination of the SARS-CoV-2 N antibody (Anti-N) levels.

Conclusions

In this study, the possibility of using FTIR and Raman spectroscopy to identify differences in the antibody levels in patients after 1, 3 and 6 months from COVID-19, were investigated. Obtained FTIR and Raman spectra showed that in patients after 6 months from COVID-19, the level of amides II and amide I were lower than in patients after 1 month from COVID-19. Moreover, multivariate analysis showed, that using Raman spectroscopy in the range between 1317 cm−1 and 1432 cm−1 and between 2840 cm−1 and 2956 cm−1 allows distinguishing patients after 1, 3 and 6 months from COVID-19. The absorbance dynamics method shows the existence of continuous change in the dynamics of FTIR spectra as a function of time after recovery from COVID-19. It was possible to indicate the ranges of wavenumbers in which such changes occur suggesting their possible use as markers that can examine the rate of recovery from the disease. Furthermore, the results obtained using 6 different machine learning techniques showed the possibility to almost perfectly differentiate the different stages of recovery. It was also possible to use selected wavenumbers as certain thresholds to distinguish patients between different levels of SARS-CoV-2 antibody. Obtained results and performed analysis illustrate a high potential of FTIR and Raman spectroscopy as new diagnostic methods in distinguishing SARS-CoV-2 antibody levels at patients in different periods after COVID-19 infection.

CRediT authorship contribution statement

Zozan Guleken: Conceptualization, Methodology, Data curation, Writing – original draft, Supervision, Visualization. Yeşim Tuyji Tok: Methodology. Paweł Jakubczyk: Software, Validation. Wiesław Paja: Software, Validation. Krzysztof Pancerz: Software, Validation. Yaroslav Shpotyuk: Writing – review & editing. Jozef Cebulski: Writing – review & editing. Joanna Depciuch: Conceptualization, Methodology, Data curation, Writing – original draft, Supervision, Visualization.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
  36 in total

Review 1.  Generation of memory B cells and their reactivation.

Authors:  Takeshi Inoue; Imogen Moran; Ryo Shinnakasu; Tri Giang Phan; Tomohiro Kurosaki
Journal:  Immunol Rev       Date:  2018-05       Impact factor: 12.988

2.  Human neutralizing antibodies elicited by SARS-CoV-2 infection.

Authors:  Bin Ju; Qi Zhang; Jiwan Ge; Ruoke Wang; Jing Sun; Xiangyang Ge; Jiazhen Yu; Sisi Shan; Bing Zhou; Shuo Song; Xian Tang; Jinfang Yu; Jun Lan; Jing Yuan; Haiyan Wang; Juanjuan Zhao; Shuye Zhang; Youchun Wang; Xuanling Shi; Lei Liu; Jincun Zhao; Xinquan Wang; Zheng Zhang; Linqi Zhang
Journal:  Nature       Date:  2020-05-26       Impact factor: 49.962

3.  Antibody Detection and Dynamic Characteristics in Patients With Coronavirus Disease 2019.

Authors:  Fei Xiang; Xiaorong Wang; Xinliang He; Zhenghong Peng; Bohan Yang; Jianchu Zhang; Qiong Zhou; Hong Ye; Yanling Ma; Hui Li; Xiaoshan Wei; Pengcheng Cai; Wan-Li Ma
Journal:  Clin Infect Dis       Date:  2020-11-05       Impact factor: 9.079

4.  Mitochondrial Dynamics Controls T Cell Fate through Metabolic Programming.

Authors:  Michael D Buck; David O'Sullivan; Ramon I Klein Geltink; Jonathan D Curtis; Chih-Hao Chang; David E Sanin; Jing Qiu; Oliver Kretz; Daniel Braas; Gerritje J W van der Windt; Qiongyu Chen; Stanley Ching-Cheng Huang; Christina M O'Neill; Brian T Edelson; Edward J Pearce; Hiromi Sesaki; Tobias B Huber; Angelika S Rambold; Erika L Pearce
Journal:  Cell       Date:  2016-06-09       Impact factor: 41.582

5.  Longitudinal Monitoring of SARS-CoV-2 IgM and IgG Seropositivity to Detect COVID-19.

Authors:  Raymond T Suhandynata; Melissa A Hoffman; Michael J Kelner; Ronald W McLawhon; Sharon L Reed; Robert L Fitzgerald
Journal:  J Appl Lab Med       Date:  2020-09-01

6.  Diagnostic performance of initial blood urea nitrogen combined with D-dimer levels for predicting in-hospital mortality in COVID-19 patients.

Authors:  Anying Cheng; Liu Hu; Yiru Wang; Luyan Huang; Lingxi Zhao; Congcong Zhang; Xiyue Liu; Ranran Xu; Feng Liu; Jinping Li; Dawei Ye; Tao Wang; Yongman Lv; Qingquan Liu
Journal:  Int J Antimicrob Agents       Date:  2020-07-23       Impact factor: 5.283

7.  Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study.

Authors:  Kelvin Kai-Wang To; Owen Tak-Yin Tsang; Wai-Shing Leung; Anthony Raymond Tam; Tak-Chiu Wu; David Christopher Lung; Cyril Chik-Yan Yip; Jian-Piao Cai; Jacky Man-Chun Chan; Thomas Shiu-Hong Chik; Daphne Pui-Ling Lau; Chris Yau-Chung Choi; Lin-Lei Chen; Wan-Mui Chan; Kwok-Hung Chan; Jonathan Daniel Ip; Anthony Chin-Ki Ng; Rosana Wing-Shan Poon; Cui-Ting Luo; Vincent Chi-Chung Cheng; Jasper Fuk-Woo Chan; Ivan Fan-Ngai Hung; Zhiwei Chen; Honglin Chen; Kwok-Yung Yuen
Journal:  Lancet Infect Dis       Date:  2020-03-23       Impact factor: 25.071

8.  Decreased serum albumin level indicates poor prognosis of COVID-19 patients: hepatic injury analysis from 2,623 hospitalized cases.

Authors:  Wei Huang; Chenze Li; Zhiquan Wang; Hong Wang; Ning Zhou; Jiangang Jiang; Li Ni; Xin A Zhang; Dao-Wen Wang
Journal:  Sci China Life Sci       Date:  2020-06-18       Impact factor: 10.372

9.  Microwave-Assisted Rapid Preparation of Nano-ZnO/Ag Composite Functionalized Polyester Nonwoven Membrane for Improving Its UV Shielding and Antibacterial Properties.

Authors:  Dongfeng Shao; Qufu Wei
Journal:  Materials (Basel)       Date:  2018-08-11       Impact factor: 3.623

10.  Humoral Immune Response to SARS-CoV-2 in Iceland.

Authors:  Daniel F Gudbjartsson; Gudmundur L Norddahl; Pall Melsted; Kristbjorg Gunnarsdottir; Hilma Holm; Elias Eythorsson; Asgeir O Arnthorsson; Dadi Helgason; Kristbjorg Bjarnadottir; Ragnar F Ingvarsson; Brynja Thorsteinsdottir; Steinunn Kristjansdottir; Kolbrun Birgisdottir; Anna M Kristinsdottir; Martin I Sigurdsson; Gudny A Arnadottir; Erna V Ivarsdottir; Margret Andresdottir; Frosti Jonsson; Arna B Agustsdottir; Jonas Berglund; Berglind Eiriksdottir; Run Fridriksdottir; Elisabet E Gardarsdottir; Magnus Gottfredsson; Olafia S Gretarsdottir; Steinunn Gudmundsdottir; Kjartan R Gudmundsson; Thora R Gunnarsdottir; Arnaldur Gylfason; Agnar Helgason; Brynjar O Jensson; Aslaug Jonasdottir; Hakon Jonsson; Thordur Kristjansson; Karl G Kristinsson; Droplaug N Magnusdottir; Olafur T Magnusson; Lovisa B Olafsdottir; Solvi Rognvaldsson; Louise le Roux; Gudrun Sigmundsdottir; Asgeir Sigurdsson; Gardar Sveinbjornsson; Kristin E Sveinsdottir; Maney Sveinsdottir; Emil A Thorarensen; Bjarni Thorbjornsson; Marianna Thordardottir; Jona Saemundsdottir; S Hjortur Kristjansson; Kamilla S Josefsdottir; Gisli Masson; Gudmundur Georgsson; Mar Kristjansson; Alma Moller; Runolfur Palsson; Thorolfur Gudnason; Unnur Thorsteinsdottir; Ingileif Jonsdottir; Patrick Sulem; Kari Stefansson
Journal:  N Engl J Med       Date:  2020-09-01       Impact factor: 91.245

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.