Literature DB >> 26392783

The sensitivity, specificity, predictive values, and likelihood ratios of fecal occult blood test for the detection of colorectal cancer in hospital settings.

Salah H Elsafi1, Norah I Alqahtani1, Nawaf Y Zakary2, Eidan M Al Zahrani3.   

Abstract

OBJECTIVES: To study the performance of a single test using two fecal occult blood tests with colonoscopy for the detection of colorectal cancer (CRC) for the first time in Saudi Arabia to determine possible implications for the anticipated colorectal screening program.
MATERIALS AND METHODS: We compared the performance of guaiac and immunochemical fecal occult blood tests for the detection of CRC among patients of 50-74 years old attending two hospitals in the Eastern Region of Saudi Arabia. Samples of feces were collected from 257 asymptomatic patients and 20 cases of confirmed CRC, and they were tested simultaneously by the guaiac-based occult blood test and monoclonal antibody-based immunoassay kit. Colonoscopy was performed on all participants and the results were statistically analyzed with both positive and negative occult blood tests of both methods.
RESULTS: Of the 277 subjects, 79 tested positive for occult blood with at least one method. Overall, the number of those with an occult blood-positive result by both tests was 39 (14.1%), while for 198 (71.5%), both tests were negative (P<0.0001); 40 (14.4%) samples showed a discrepant result. Colonoscopy data were obtained for all 277 patients. A total of three invasive cancers were detected among the screening group. Of the three, the guaiac test detected two cases, while the immunochemical test detected three of them. Of the 20 control cases, the guaiac test detected 13 CRC cases (P=0.03), while the immunochemical test detected 16 of them (P<0.0001). The sensitivity of guaiac and immunochemical tests for the detection of CRC in the screening group was 50.00% (95% confidence interval [CI] =6.76-93.24) and 75.00% (95% CI =19.41-99.37), respectively. For comparison, the sensitivity of the guaiac fecal occult blood test for detecting CRC among the control group was 65.00% (95% CI =40.78-84.61) while that of FIT was 80.00% (95% CI =56.34-94.27). The specificity of the guaiac and immunoassay tests was 77.87% (95% CI =72.24-82.83) and 90.12% (95% CI =85.76-93.50), respectively. The positive likelihood ratio of guaiac and immunochemical tests for the detection of CRC was 2.26 (95% CI =0.83-6.18) and 7.59 (95% CI =3.86-14.94), whereas the negative likelihood ratio was 0.64 (95% CI =0.24-1.71) and 0.28 (95% CI =0.05-1.52), respectively. The positive predictive values of guaiac and immunochemical tests were 3.45% (95% CI =0.426-11.91) and 10.71% (95% CI =2.27-28.23), respectively. There was no marked difference in the negative predictive values for both methods. The sensitivity of the fecal occult blood test by FIT was significantly higher for stages III and IV colorectal cancer than for stages I and II (P=0.01) and it was insignificant for the guaiac fecal occult blood test (P=0.07).
CONCLUSION: In areas where other advance screening methods of CRC are not feasible, the use of FIT can be considered.

Entities:  

Keywords:  colorectal cancer; endoscopy; fecal occult blood test; guaiac; immunochemical

Year:  2015        PMID: 26392783      PMCID: PMC4573202          DOI: 10.2147/CEG.S86419

Source DB:  PubMed          Journal:  Clin Exp Gastroenterol        ISSN: 1178-7023


Introduction

Colorectal cancer (CRC) is an important health concern and a leading cause of death among adults worldwide. In Saudi Arabia, a total of 4,201 cases of CRC were registered in the national Saudi Cancer Registry, with a noticeable increase in incidence rates between 2001 and 2006.1 This cancer ranked first among the male population and third among the female population with an overall age-standardized incidence rate of 6.6 per 1,000,000.2 Between 1994 and 2003, age-standardized rates for CRC in Saudi Arabia had increased almost twofold.3 Early detection of CRC is one of the best approaches to reduce related deaths. A broad spectrum of choices is available for CRC screening, including fecal occult blood (FOB) testing (FOBT), flexible sigmoidoscopy, and colonoscopy.4,5 FOBT detects blood in the stool that is not visible on gross inspection, usually less than 50 mg of hemoglobin per gram of stool.6 The test is intended for the determination of gastrointestinal bleeding found in a number of gastrointestinal disorders including diverticulitis, colitis, polyps, and CRC. Three randomized controlled clinical trials showed that FOBT reduced the risk for death from CRC.7–9 Two types of FOBTs of different analytical principles are available: the traditional guaiac (G)-FOBT; and the antibody-based fecal immunochemical testT(FIT). The G-FOBT is based on the oxidation of phenolic compounds present in the guaiac (ie, guaiaconic acids), impregnated on the card that detects the pseudoperoxidase activity of the hematin portion of any hemoglobin, resulting in the production of a blue color.10,11 G-FOBTs are not specific for human hemoglobin and they detect any peroxidase found in feces (eg, plant peroxidases, heme in red meat), and they are affected by certain chemicals (eg, vitamin C).12 It may also detect bleeding from any site in the gastrointestinal tract, including the stomach.13 Recently, an immunoassay for the FOBT has been introduced utilizing two monoclonal antibodies that specifically detect the presence of human globin in feces and is thus more specific for bleeding from the distal gut. In the early 1970s, G-FOBTs were first proposed for the screening of CRC,14 and evidence has shown that they reduce both the incidence and mortality of CRC,7–9,15,16 although positive and negative predictive values were suboptimal.17 CRC screening by G-FOBTs had also been complicated by a high incidence of false-positive results, especially when patients do not follow a restricted diet before testing.11 More recently, FIT has been widely used as an alternative to G-FOBT for CRC screening programs. Several methods of FIT exist including automated quantitative analysis. Comparisons of different techniques to detect occult blood in the stool have been widely performed. Recent studies that compared G-FOBT and FIT in screening populations indicated superiority of the latter for the detection of both cancers and advanced adenomas.17–19 In the past few years, CRC screening has become more popular and colonoscopy has been postulated as the gold standard.20 Although extensive literature concerning FOBT and CRC screening is available, these are mostly community based with only a few being hospital based. While community-based screening studies provide critical information on program sensitivity and the acceptability of a test in a large population, often only small numbers of CRCs are detected.21 In referral hospital-based studies, a higher prevalence of CRC will allow for better understanding of the performance of FOBTs for the detection of CRC as compared to colonoscopy. Most other study designs have included colonoscopy for positive FOBTs only.17–19,22 In order to directly measure the specificity of the FOBTs, the colonoscopy results of individuals with negative results should also be available. To allow for the better evaluation of the methods of FOBTs, a comparative study design that includes the performance of both tests in parallel on the same stool samples is needed.23 The objective of this study is to compare the sensitivity, specificity, positive predictive value, and negative predictive value of G-FOBT and FIT in the same stool samples among patients attending hospitals who all underwent colonoscopy. To the best of our knowledge, no previous work has been done in Saudi Arabia for the detection of CRC by FOBT.

Materials and methods

Study design

The Research and Ethics Committee at the King Fahd Military Medical Complex (Dhahran, Saudi Arabia) approved this prospective cohort study protocol, including patients who reported to two tertiary hospitals in the eastern region of Saudi Arabia – King Fahd Military Medical Complex (Dhahran, Saudi Arabia); and King Faisal Specialist Hospital (Dammam, Saudi Arabia) from June 2012 through May 2013. All asymptomatic participants that reported to hospital in this study were 50–74 years of age; they were tested once for FOB by two simultaneous methods, and they were scheduled for colonoscopy. Patients who reported symptoms of disease of the lower gastrointestinal tract were excluded. The medical record number of each of the participants was recorded. The results of the participants who were offered colonoscopy were taken from the medical record during the final 6 months of the study period (ie, June 2013 through December 2013). Twenty confirmed CRC cases were recruited as a control.

Fecal occult blood test

During the study period, 277 samples of feces were collected and tested simultaneously using the guaiac-based Colo-Screen® by Helena Laboratories (Cat no: 5073; Beaumont, TX, USA) and the monoclonal antibody-based immunoassay (RAPEPKT313) kit by DIAsource© (DIAsource ImmunoAs-says SA, Nivelles, Belgium) using the 1-day method. ColoScreen® was performed according to the manufacturer’s instructions. In brief, using the applicator, very thin smears of stool from different sites were applied in boxes A and B, and they were allowed to air dry before the cover was closed. The perforated window on the back of the slide was then opened and two drops of ColoScreen developer was applied to the back of boxes A and B before reading the results after 30 seconds and within 2 minutes. Any trace of blue color, within or on the outer rim of the specimen, was reported as positive for occult blood. RAPEPKT313 was performed according to the manufacturer’s instructions. In brief, a stool specimen is collected into the sampling tube containing extraction solution. After mixing the stool sample, a test strip is screwed into the sampling tube by breaking the bottom seal of the sampling tube while maintaining a vertical position, and it was allowed to settle for approximately 1 minute. The extracted fecal solution flows into the bottom space of the test strip and triggers the start of the FOB immunoassay. If human hemoglobin is present at a level higher than 50 ng/mL in a fecal sample extract, a red colored band appears in the test region, which is located in the lower half of the test membrane. A similar colored band must appear in the control region located in the upper-half of the test membrane, indicating that the test strip is functioning properly and the result is valid.

Colonoscopy

All participants underwent complete colonoscopy in one of the two hospitals. Colonoscopies were performed in a standard fashion by experienced gastroenterologists. The location and size of all polypoid lesions were recorded and the tumor specimens were pathologically classified as previously described.24

Statistics analysis

Statistical analysis was performed using SAS software version 9.1. Sensitivities, specificities, and predictive values of G-FOBT and FIT for CRC were calculated as previously described.6,25 We used the chi-squared and t-test, and P-values >0.05 were considered statistically significant.

Results

Overall, 277 individuals between 50 and 74 years of age (mean: 63.8 years; standard deviation =7.9 years) (189 males and 88 females) were tested by the two methods, G-FOBT and FIT. Table 1 shows that the FOBT positivity rates of the guaiac and immunoassay tests for the screening and control groups were 22.6%, 12.1%, 65%, and 80%, respectively. For the occult blood tests, 39 (14.1%) patients were positive for both tests, while 198 (71.5%) were negative by both tests. Overall, 40 (14.4%) samples showed a discrepant result.
Table 1

Performance characteristics of FIT compared with G-FOBT among the screening and control groups

G-FOBTFIT
Total
Screening group
Control group
PositiveNegativePositiveNegative
Positive263213071
Negative519434206
Total31226164277

Note: Chi-squared =108.93; P<0.0001.

Abbreviations: FIT, fecal immunochemical test; G-FOBT, guaiac fecal occult blood test.

Colonoscopy was successfully performed on all 257 patients in the screening group and three invasive cancers were detected. Of the patients endoscoped, 37 were occult blood-positive by both or at least one test, and the other 194 were negative by both methods. Among the 20 cancer cases in the control group, 13 and 16 tested positive by G-FOBT and FIT, respectively. Tables 2 and 3 indicated the performance characteristics of G-FOBT and FIT for the detection of CRC, respectively.
Table 2

Performance characteristics of G-FOBT for detecting colorectal cancer

G-FOBTScreening group
TotalControl group
Colorectal cancer
Colorectal cancer
PositiveNegative
Positive2565813
Negative21971997
Total425325720

Note: Chi-squared =1.75; P=0.19.

Abbreviation: G-FOBT, guaiac fecal occult blood test.

Table 3

Performance characteristics of FIT for detecting colorectal cancer

FITScreening group
TotalControl group
Colorectal cancer
Colorectal cancer
PositiveNegative
Positive3252816
Negative12282294
Total425325720

Note: Chi-squared =17.20; P=0.00.

Abbreviation: FIT, fecal immunochemical test.

The sensitivity of G-FOBT and FIT for the detection of CRC among the screening group was 50.00% (95% confidence interval [CI] =6.76–93.24) and 75.00% (95% CI =19.41–99.37), respectively. The specificity of G-FOBT and FIT was 77.87% (95% CI =72.24–82.83) and 90.12% (95% CI =85.76–93.50), respectively (Table 4). The positive likelihood ratio of guaiac and immunochemical tests for the detection of CRC was 2.26 (95% CI =0.83–6.18) and 7.59 (95% CI =3.86–14.94), whereas the negative likelihood ratio was 0.64 (95% CI =0.24–1.71) and 0.28 (95% CI =0.05–1.52), respectively.
Table 4

Sensitivity, specificity, and predictive values and 95% CI (between parenthesis) of G-FOBT and FIT for colorectal cancer (n=277)

G-FOBTFIT
Sensitivity50.00% (6.76–93.24)75.00% (19.41–99.37)
Specificity77.87% (72.24–82.83)90.12% (85.76–93.50)
Positive likelihood ratio2.26 (0.83–6.18)7.59 (3.86–14.94)
Negative likelihood ratio0.64 (0.24–1.71)0.28 (0.05–1.52)
Positive predictive value3.45% (0.42–11.91)10.71% (2.27–28.23)
Negative predictive value98.99% (96.42–99.88)99.56% (97.59–99.99)

Abbreviations: CI, confidence interval; G-FOBT, guaiac fecal occult blood test; FIT, fecal immunochemical test; n, number.

The positive predictive values of G-FOBT and FIT were 3.45% (95% CI =0.426–11.91) and 10.71% (95% CI =2.27–28.23), respectively. There was no marked difference in negative predictive values for both methods, being 98.99% (95% CI =96.42–99.88) and 99.56% (95% CI =97.59–99.99), respectively. Table 5 shows the sensitivity of FOB by FIT, which was significantly higher for stages III and IV CRC than for stages I and II (P=0.01) and insignificant for G-FOBT (P=0.07).
Table 5

The sensitivities and 95% CI (between parentheses) of a single G-FOBT and FIT by different anatomic stages of colorectal cancer

nG-FOBT positive casesG-FOBT sensitivity % (95% CI)FIT positive casesFIT sensitivity % (95% CI)
Stage I2150.0 (1.26–98.74)150.0 (1.26–98.74)
Stage II15853.33 (26.59–78.73)960.0 (32.29–83.66)
Stage III3266.67 (9.43–99.16)266.67 (9.43–99.16)
Stage IV3266.67 (9.43–99.16)3100.00 (29.24–100.00)
P-valuet=3.68; P=0.066t=2.83; P=0.005

Abbreviations: CI, confidence interval; G-FOBT, guaiac fecal occult blood test; FIT, fecal immunochemical test; n, number.

Discussion

We compared the sensitivity and specificity of a guaiac test and a monoclonal antibody-based immunoassay performed on 277 older patients reporting to the King Fahd Military Medical Complex and King Faisal Specialist Hospital for the detection of occult blood and the prediction of CRC in a hospital setting. In this study, the occult blood positivity rates of the same samples were 22.6% and 12.1% by guaiac and immunoassay tests, respectively. The high incidence of false-positive test results by guaiac-based testing is largely due to the lack of proper dietary restrictions for several days prior to testing. In another study, even with properly prepared patients, the incidence of false-positive results with G-FOBT was found to be as high as 10%.26 Red meat, fruits, and vegetables high in peroxidase, high doses of ascorbic acid (vitamin C, 250 mg/day or more), oral medications such as aspirin or other nonsteroidal anti-inflammatory drugs, heavy alcohol consumption, and some others may interfere with the test.27 The number of observed agreements between the two test methods is 240 (86.6%), whereas 37 (13.4%) samples showed a discrepant result between the two methods. Because there is no “gold standard” reference method for FOBT, we could not resolve which method gave the “correct” results among the discrepant cases. On the other hand, FIT methods are specific for human hemoglobin and require no dietary preparation, although medications that may cause minor gastrointestinal bleeding will potentially produce positive results. In normal subjects, a small amount of blood is lost in the intestine each day. It has been stated before that a blood loss of 2–3 mL (approximately 0.3 mg hemoglobin/g of stool) is the lower limit of blood loss that may be associated with gastrointestinal pathology.28 It has been indicated before that performing two FOBT tests does not improve diagnostic accuracy; rather, it increases costs.29 Unlike many previous studies,17,19,22 the colonoscopy results were also available for all those that were tested for occult blood, including those with negative results, which allowed for the improved detection of specificities. The sensitivity of G-FOBT and FIT for the detection of CRC was 50.00% (95% CI =6.76–93.24) and 75.00% (95% CI =19.41–99.37), respectively. The specificity of G-FOBT and FIT was 77.87% (95% CI =72.24–82.83) and 90.12% (95% CI =85.76–93.50), respectively. A number of studies have reported clinical evaluations of various FOBT methods, and guidelines have been published for CRC screening with varying levels of sensitivities and specificities for detecting CRC, depending on the study design. Generally, the sensitivity of FOBT for CRC is relatively low, between 30% and 80%, in most population-based studies,30–33 while specificity has been reported to be between 87% and 98%.32 In agreement with our findings, a systematic review of the literature on repeated annual or biennial ColoScreen or G-FOBT revealed that the reported sensitivity for CRC varied from 51% to 100%, and specificity varied from 90% to 97%.26 Furthermore, the positive predictive value (the percentage of positive tests that are true-positive results) ranged from 2.4% to 17.0%.33 Low sensitivity for detecting CRC using guaiac-based tests was also reported in a population-based study.17,34 Immunochemical tests for FOBT have been studied as an alternative to guaiac-based tests.35 Many studies have shown that FIT has better performance characteristics when compared to most G-FOBTs, and it also detects advanced adenomas, with a sensitivity for advanced adenomas ranging from 20% to 40%.17–19,36 FIT testing has been shown to facilitate compliance and it improves specificity for CRC screening, but at an increased cost compared to guaiac-based FOBT.37 FITs are moderately sensitive, highly specific, and they have high overall diagnostic accuracy for detecting CRC.38 However, different brands of quantitative FITs, even those using the same cutoff hemoglobin concentration, perform differently in mass screening.39 Comparisons of different techniques to detect occult blood in stool have been widely performed. This study, which is in agreement with some others,40–42 indicated the higher sensitivity, specificity, and predictive values of FIT for the screening of CRC when compared to community-based studies.43 We detected only a few cases of CRCs among the screening group that resulted in a wide range of 95% CIs for sensitivity. However, specificity was well detected with a high degree of confidence. Moreover, the positive likelihood ratio of FIT for the detection of CRC was 7.59 (95% CI =3.86–14.94), indicating good performance of the test. When classifying the tumors according to the different stages, the sensitivity of FOB by FIT was significantly higher for stages III and IV CRC than for stages I and II, which is in agreement to what was reported before.44

Conclusion

We believe that FIT may offer advantages over G-FOBT in hospital settings because its higher sensitivity, combined with its low incidence of false-positive test results, could improve screening programs for CRC. It is worth mentioning that our sample size was only modest, we had a limited follow-up period, and the FOBT was administered once.
  39 in total

1.  The effect of fecal occult-blood screening on the incidence of colorectal cancer.

Authors:  J S Mandel; T R Church; J H Bond; F Ederer; M S Geisser; S J Mongin; D C Snover; L M Schuman
Journal:  N Engl J Med       Date:  2000-11-30       Impact factor: 91.245

Review 2.  Population-based screening for colorectal cancer with faecal occult blood test--do we really have enough evidence?

Authors:  Göran Ekelund; Jonas Manjer; Sophia Zackrisson
Journal:  Int J Colorectal Dis       Date:  2010-07-30       Impact factor: 2.571

3.  Performance of the immunochemical fecal occult blood test in predicting lesions in the lower gastrointestinal tract.

Authors:  Tsung-Hsien Chiang; Yi-Chia Lee; Chia-Hung Tu; Han-Mo Chiu; Ming-Shiang Wu
Journal:  CMAJ       Date:  2011-08-02       Impact factor: 8.262

Review 4.  Cochrane systematic review of colorectal cancer screening using the fecal occult blood test (hemoccult): an update.

Authors:  Paul Hewitson; Paul Glasziou; Eila Watson; Bernie Towler; Les Irwig
Journal:  Am J Gastroenterol       Date:  2008-05-13       Impact factor: 10.864

Review 5.  Colorectal cancer screening.

Authors:  Ramona-M McLoughlin; Colm-A O'Morain
Journal:  World J Gastroenterol       Date:  2006-11-14       Impact factor: 5.742

6.  A quantitative immunochemical fecal occult blood test for colorectal neoplasia.

Authors:  Zohar Levi; Paul Rozen; Rachel Hazazi; Alex Vilkin; Amal Waked; Eran Maoz; Shlomo Birkenfeld; Moshe Leshno; Yaron Niv
Journal:  Ann Intern Med       Date:  2007-02-20       Impact factor: 25.391

7.  Randomised controlled trial of faecal-occult-blood screening for colorectal cancer.

Authors:  J D Hardcastle; J O Chamberlain; M H Robinson; S M Moss; S S Amar; T W Balfour; P D James; C M Mangham
Journal:  Lancet       Date:  1996-11-30       Impact factor: 79.321

8.  Colorectal cancer in the Kingdom of Saudi Arabia: need for screening.

Authors:  Mahmoud H Mosli; Mahmoud S Al-Ahwal
Journal:  Asian Pac J Cancer Prev       Date:  2012

9.  Colorectal cancer screening programme by faecal occult blood test in Tuscany: first round results.

Authors:  G Grazzini; G Castiglione; C Ciabattoni; F Franceschini; D Giorgi; S Gozzi; P Mantellini; P Lopane; M Perco; T Rubeca; P Salvadori; C B Visioli; M Zappa
Journal:  Eur J Cancer Prev       Date:  2004-02       Impact factor: 2.497

Review 10.  Review article: faecal occult blood testing for colorectal cancer.

Authors:  J E Allison
Journal:  Aliment Pharmacol Ther       Date:  1998-01       Impact factor: 8.171

View more
  17 in total

1.  A Comprehensive Metabolomics Analysis of Fecal Samples from Advanced Adenoma and Colorectal Cancer Patients.

Authors:  Oiana Telleria; Oihane E Alboniga; Marc Clos-Garcia; Beatriz Nafría-Jimenez; Joaquin Cubiella; Luis Bujanda; Juan Manuel Falcón-Pérez
Journal:  Metabolites       Date:  2022-06-15

2.  Faecal biomarker patterns in patients with symptoms of irritable bowel syndrome.

Authors:  Anton Emmanuel; Darryl Landis; Mark Peucker; A Pali S Hungin
Journal:  Frontline Gastroenterol       Date:  2016-03-07

Review 3.  Methods and novel technology for microRNA quantification in colorectal cancer screening.

Authors:  Laura Moody; Hongshan He; Yuan-Xiang Pan; Hong Chen
Journal:  Clin Epigenetics       Date:  2017-10-24       Impact factor: 6.551

Review 4.  Diagnostic Accuracy of FOBT and Colorectal Cancer Genetic Testing: A Systematic Review & Meta-Analysis.

Authors:  Abdul Rahman Ramdzan; Muhammad Aklil Abd Rahim; Aznida Mohamad Zaki; Zuraidah Zaidun; Azmawati Mohammed Nawi
Journal:  Ann Glob Health       Date:  2019-05-15       Impact factor: 2.462

5.  Stage-Specific Sensitivity of Fecal Immunochemical Tests for Detecting Colorectal Cancer: Systematic Review and Meta-Analysis.

Authors:  Tobias Niedermaier; Yesilda Balavarca; Hermann Brenner
Journal:  Am J Gastroenterol       Date:  2020-01       Impact factor: 12.045

6.  A blood screening test for Alzheimer's disease.

Authors:  Sid E O'Bryant; Melissa Edwards; Leigh Johnson; James Hall; Alcibiades E Villarreal; Gabrielle B Britton; Mary Quiceno; C Munro Cullum; Neill R Graff-Radford
Journal:  Alzheimers Dement (Amst)       Date:  2016-06-25

Review 7.  Current Tissue Molecular Markers in Colorectal Cancer: A Literature Review.

Authors:  Gaia Peluso; Paola Incollingo; Armando Calogero; Vincenzo Tammaro; Niccolò Rupealta; Gaetano Chiacchio; Maria Laura Sandoval Sotelo; Gianluca Minieri; Antonio Pisani; Eleonora Riccio; Massimo Sabbatini; Umberto Marcello Bracale; Concetta Anna Dodaro; Nicola Carlomagno
Journal:  Biomed Res Int       Date:  2017-10-29       Impact factor: 3.411

8.  Initial guidelines for colorectal cancer screening in Saudi Arabia: a beginning.

Authors:  Majid A Almadi; Alan N Barkun
Journal:  Ann Saudi Med       Date:  2015 Sep-Oct       Impact factor: 1.526

Review 9.  Developments in Point-of-Care Diagnostic Technology for Cancer Detection.

Authors:  Bryony Hayes; Caroline Murphy; Aoife Crawley; Richard O'Kennedy
Journal:  Diagnostics (Basel)       Date:  2018-06-02

10.  Evaluation of the guaiac fecal occult blood test for detection of gastrointestinal bleeding in the rhesus macaque (Macaca mulatta).

Authors:  Rachel Elizabeth Cooper; Eric Kenneth Hutchinson; Jessica Marie Izzi
Journal:  J Med Primatol       Date:  2019-11-01       Impact factor: 0.667

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.