Literature DB >> 28859648

Engaging patients and families to create a feasible clinical trial integrating palliative and heart failure care: results of the ENABLE CHF-PC pilot clinical trial.

Marie Bakitas1,2, J Nicholas Dionne-Odom3, Salpy V Pamboukian4, Jose Tallaj4, Elizabeth Kvale5, Keith M Swetz5, Jennifer Frost6, Rachel Wells7, Andres Azuero3, Konda Keebler3, Imatullah Akyar3,8, Deborah Ejem3, Karen Steinhauser9, Tasha Smith3, Raegan Durant10, Alan T Kono6.   

Abstract

BACKGROUND: Early palliative care (EPC) is recommended but rarely integrated with advanced heart failure (HF) care. We engaged patients and family caregivers to study the feasibility and site differences in a two-site EPC trial, ENABLE CHF-PC (Educate, Nurture, Advise, Before Life Ends Comprehensive Heartcare for Patients and Caregivers).
METHODS: We conducted an EPC feasibility study (4/1/14-8/31/15) for patients with NYHA Class III/IV HF and their caregivers in academic medical centers in the northeast and southeast U.S. The EPC intervention comprised: 1) an in-person outpatient palliative care consultation; and 2) telephonic nurse coach sessions and monthly calls. We collected patient- and caregiver-reported outcomes of quality of life (QOL), symptom, health, anxiety, and depression at baseline, 12- and 24-weeks. We used linear mixed-models to assess baseline to week 24 longitudinal changes.
RESULTS: We enrolled 61 patients and 48 caregivers; between-site demographic differences included age, race, religion, marital, and work status. Most patients (69%) and caregivers (79%) completed all intervention sessions; however, we noted large between-site differences in measurement completion (38% southeast vs. 72% northeast). Patients experienced moderate effect size improvements in QOL, symptoms, physical, and mental health; caregivers experienced moderate effect size improvements in QOL, depression, mental health, and burden. Small-to-moderate effect size improvements were noted in patients' hospital and ICU days and emergency visits.
CONCLUSIONS: Between-site demographic, attrition, and participant-reported outcomes highlight the importance of intervention pilot-testing in culturally diverse populations. Observations from this pilot feasibility trial allowed us to refine the methodology of an in-progress, full-scale randomized clinical efficacy trial. TRIAL REGISTRATION: Clinicaltrials.gov NCT03177447 (retrospectively registered, June 2017).

Entities:  

Keywords:  Caregiver; Heart failure; Intervention development; Palliative care; Rural; Telehealth

Mesh:

Year:  2017        PMID: 28859648      PMCID: PMC5580310          DOI: 10.1186/s12904-017-0226-8

Source DB:  PubMed          Journal:  BMC Palliat Care        ISSN: 1472-684X            Impact factor:   3.234


Background

Of the 6 million U.S. individuals with heart failure (HF), approximately 300,000 will die each year. By 2030, HF prevalence is expected to swell by 46% to over 8 million [1]. Evidence-based advances in medication management (e.g. ACEIs, beta-blockers), coronary revascularization, mechanical circulatory support devices, and cardiac resynchronization have lengthened HF survival [2, 3]. However, these added years of life are often accompanied by significant morbidity and prognostic uncertainty requiring difficult discussions and decisions about treatments and quality of life (QOL) [2, 4, 5]. These burdens often extend beyond the individual with HF to family members who must take on new roles to assist patients with disease management [6]. These caregivers can develop needs [7] that, when unmet, lead to psychological stress and poorer health [8, 9]. Recent professional guidelines recommend involvement of palliative care for New York Heart Association (NYHA) Class III/IV and American Heart Association (AHA) Stage C/D HF patients undergoing advanced therapies, facing difficult medical decisions, having complex or refractory symptoms, and having overstrained caregivers [10-15]. Yet only 1-out-of-3 HF patients receive palliative care and usually not until the final weeks to days before death [16]. Therefore, integrating palliative care earlier in the HF trajectory, when patients are relatively healthy and functional, may help patients and their families cope and live better with advanced disease [17-20]. High quality trials in cancer have demonstrated positive patient and family caregiver outcomes from early palliative care (EPC) [21, 22]. However, given the difficulties in prognostication, the prevalence of sudden cardiac death, [23] and an erratic illness trajectory, [24] it is not clear when or how to integrate palliative care in HF [25]. Furthermore, trials of EPC have rarely included persons with low income and education, of a minority race, and who reside in rural, medically-underserved areas [25-29]. Thus, it is imperative to develop models of EPC that are responsive to the HF trajectory, and also are tailored to be culturally appropriate for minority and underserved populations for whom HF can have particularly pernicious effects. To address these challenges, we actively engaged patients and family members with diverse socioeconomic and racial backgrounds to aid in further refining and culturally-tailoring ENABLE CHF-PC (Educate, Nurture, Advise, Before Life Ends Comprehensive Heartcare for Patients and Caregivers), a telephonic EPC intervention for rural-dwelling, underserved HF patients and their family caregivers. In a proof-of-concept, formative evaluation study [30], we translated materials and protocols from our successful EPC ENABLE oncology model [31-33] to a HF population. This study demonstrated acceptability, feasibility, and a signal of potential efficacy in an educationally, socioeconomically, and racially homogeneous sample of 11 patient-caregiver dyads [30] Thus, the current ENABLE CHF-PC feasibility trial was expanded to include an additional site in the southeastern U.S. that had greater racial and cultural diversity in order to identify intervention acceptability and feasibility and thus greater generalizability to a broader U.S. population. The purpose of this study was to: 1) determine the feasibility of recruiting and retaining a rural, racially-diverse sample of patient-caregiver dyads for 24 weeks and 2) explore longitudinal patient and caregiver outcomes including QOL, global health, anxiety, and depression to inform intervention measures and the need for additional protocol modifications for a larger clinical efficacy trial.

Methods

Study design

In this feasibility study, conducted April 1, 2014 to December 31, 2015 individuals with AHA Stage C/D and/or NYHA Class III/IV HF and their family caregivers received the ENABLE CHF-PC intervention and were followed for 24 weeks. The study protocol was approved by the institutional review boards of Dartmouth College (Lebanon, New Hampshire) and the University of Alabama at Birmingham (Birmingham, Alabama) and all participants provided written informed consent.

Setting and sample

Study participants were recruited from cardiology clinics at 1) Dartmouth-Hitchcock Medical Center (DHMC), Lebanon, NH, which serves a largely rural, white population in a state ranked lowest in religiosity, and 2) the University of Alabama at Birmingham (UAB), Birmingham, AL, which serves a diverse rural-urban population that includes a large proportion of Blacks/African-Americans in a state ranked highest in religiosity [34]. Study coordinators at both sites reviewed outpatient cardiology clinic schedules to identify eligible patients. Following physician approval, a study coordinator approached patients and their caregivers during a clinic appointment to explain the study and obtain consent. Patient inclusion criteria were: 1) diagnosis of NYHA Class III/IV and/or AHA Stage C/D HF; 2) English speaking; 3) ≥50 years of age; and 4) completion of baseline questionnaires. Exclusion criteria were: 1) dementia or impaired cognition (Callahan score ≤ 4) [35], 2) active Axis I psychiatric or substance use disorder; and 3) non-correctable hearing impairment. Patients were asked to nominate a caregiver for participation, defined as “someone who knows you well and is involved in and has knowledge of your medical care.” Caregivers were only excluded for non-correctable hearing loss.

The ENABLE CHF-PC intervention

A comprehensive description of the evolution and development of ENABLE CHF-PC has been described in detail elsewhere [30]. Briefly, the ENABLE CHF-PC intervention (Fig. 1) tested in this study included: 1) an in-person outpatient palliative care consultation (caregiver invited to attend) following National Consensus Guidelines [36], 2) weekly, semi-structured palliative care nurse coach (patients: 6 sessions; caregivers: 4 sessions) telephone and monthly follow-up sessions using Charting Your Course, an educational guidebook. Sessions, conducted weekly, covered the following topics problem solving, self-care, symptom management, decision-making and advance care planning, and life review (patients only) that were tailored to individual participant needs. The life review sessions were based on Steinhauser and colleagues’ Outlook intervention [37]. The goal of the sessions was to encourage participants to feel empowered and to develop skills that would assist them to make value-driven decisions about their medical and life-sustaining treatment choices as their disease worsened: Patients and caregivers were assigned separate nurse coaches to increase their sense of confidentiality.
Fig. 1

Study Schema

Study Schema Five nurse coaches each received 20 h of training including self-study of intervention protocols and scripts and interactive role-play of 10 digitally-recorded practice sessions. The nurse coaches were debriefed on their training sessions by the principal investigator (PI) (MB) and co-investigator (co-I) (JND-O) and were provided with constructive feedback. Intervention fidelity was maintained through standardized training, the use of structured interventionist scripts, use of standardized session documentation templates, and weekly PI and co-I supervisory team meetings [38].

Data collection and measures

Study coordinators completed measures with patients and caregivers by phone at baseline, 12- and 24-weeks. Participants received a $10 check for each completed measurement occasion. Baseline demographics included age, gender, race/ethnicity, religion, marital and work status, educational level, and medical insurance. Clinical characteristics abstracted from electronic health records included NYHA class, ejection fraction, presence of an implanted heart device, medications, and laboratory data. These data were entered into the Seattle Heart Failure Model (SHFM) web-based calculator to compute 1, 2 and 5-year survival estimates (https://depts.washington.edu/shfm/). Nurse coaches also informed patients and caregivers that the purpose of this pilot trial was to determine intervention and study procedure acceptability in a new patient population (those with heart failure from diverse socioeconomic cultures). Hence the nurse coach would be actively seeking their critique and feedback throughout the intervention in order to make improvements for future patients. Nurses recorded sessions, and actively tracked patient and caregiver feedback on intervention components that were found to be helpful or in need of improvement in a Research Electronic Data Capture (REDCap) database [39]. Additional file 1: Table S1 shows patient- and caregiver-reported outcome measures.

Statistical analysis

The feasibility primary aim was determined by monitoring participants’ study status (enrolled, deceased, lost to follow-up) and calculating intervention and measurement completion rates (e.g. actual # completed/possible # per protocol). Patient and caregiver demographic characteristics were tabulated and compared between sites with bivariate tests of association and effect sizes (Cohen’s d [40] or d-equivalent [41] or nominal variables). We assessed associations between baseline characteristics and participant attrition using simple logistic regressions. We used estimated odds ratios to determine associations between patient characteristics and attrition. We used longitudinal, fitted, linear mixed methods, adjusted for covariates associated with attrition, to estimate participant-reported outcomes’ changes from baseline to follow-up (12 and 24 week means combined) [42]. Change estimates were transformed to effect sizes (Cohen’s d) using baseline estimates of pooled standard deviations. Change was estimated overall and by site. All analyses were conducted using SAS v9.4. Due to the exploratory nature of the study, we relied on effect size estimation using Cohen’s guidelines for magnitude of effect size d (i.e. small: 0.2, moderate: 0.5, and large: 0.8) rather than hypothesis testing to interpret results; however we also report p-values for completeness.

Results

Sample characteristics

We assessed 431 patients for eligibility (Fig. 2); approached 120 eligible patients for participation; and enrolled 61 patients (50% response rate) and 48 family caregivers. Eligible patients declined participation due to “not interested” (n = 22) or “not needed” (n = 8).
Fig. 2

CONSORT diagram: Patient Recruitment, Treatment, and Analysis

CONSORT diagram: Patient Recruitment, Treatment, and Analysis Overall, patients (n = 61) were a mean age of 71 years, male (51%; n = 31), white (80%, n = 49), Protestant (65.6%, n = 40), married or living with a partner (62%, n = 38), retired (56%, n = 34), were high school or General Education Diploma (GED) graduates (43%, n = 26) had Medicare/private insurance (64%, n = 39) and were rural (72.1%, n = 44) (Table 1). Patients and caregivers lived a median of 46 miles (range 1–177 miles) from UAB and 54 miles (range 6–128 miles) from DHMC. Compared to DHMC, UAB patients had higher proportions of black, Protestant, never married, and patients on disability. Clinically, most patients were NYHA Class IIIa/b or IV, with a mean ejection fraction of 38; 46% had no implanted cardiac device; 80% were on beta-blockers; and 59% were on statins. SHFM survival probabilities averaged 84% for 1-year, 72% for 2-years, and 49% for 5-years.
Table 1

Patient Demographics

All patients (N = 61)Dartmouth (n = 32)UAB (n = 29) p * d
n (%) n (%) n (%)
Age, Mean (SD)70.59 (10.7)73.41 (10.8)67.48 (9.8)0.030.55
 Male31 (50.8)18 (56.2)13 (44.8)0.370.23
Race
 White49 (80.3)31 (96.9)18 (62.1)
 Black11 (18.0)0 (0)11 (37.9)<.00010.95
 Other1 (1.6)1 (3.1)11 (37.9)
Religion
 Protestant40 (65.6)13 (40.6)27 (93.1)
 Catholic10 (16.4)8 (25.0)2 (6.9)<.00011.04
 Other4 (6.6)4 (12.5)0 (0)
 None7 (11.5)7 (21.9)0 (0)
Marital Status
 Never married6 (9.8)0 (0)6 (20.7)
 Married or living with partner38 (62.3)21 (65.6)17 (58.6)0.040.55
 Divorced or separated4 (6.6)3 (9.4)1 (3.5)
 Widowed13 (21.3)8 (25.0)5 (17.2)
Work status
 Employed6 (9.8)3 (9.4)3 (10.3)
 Retired/Homemaker34 (55.7)23 (71.9)11 (37.9)0.020.60
 Not employed3 (4.9)0 (0)3 (10.3)
 Disability18 (29.5)6 (18.8)12 (41.4)
Education
  < High school graduate4 (6.6)1 (3.1)3 (10.3)
 High school graduate or GED26 (42.6)12 (37.5)14 (48.3)
 Some college or technical school15 (24.6)9 (28.1)6 (20.7)0.420.21
 College graduate9 (14.8)4 (12.5)5 (17.2)
 Graduate degree5 (8.2)4 (12.5)1 (3.5)
 No response2 (3.3)2 (6.3)0 (0)
Medical insurance
 Private/commercial8 (13.1)4 (12.5)4 (13.8)
 Medicare/Medicaid14 (23.0)7 (21.9)7 (24.1)0.950.01
 Medicare and Private39 (63.9)21 (65.6)18 (62.0)
NYHA class
 Class I1 (1.6)0 (0)1 (3.5)0.010.74
 Class II3 (4.9)2 (6.3)1 (3.5)
 Class IIIa25 (41.0)7 (21.9)18 (62.0)
 Class IIIb18 (29.5)14 (43.8)4 (13.8)
 Class IV12 (19.7)9 (28.1)3 (10.3)
 Missing/Not recorded2 (3.3)0 (0)2 (6.9)
Ejection Fraction, Mean (SD)37.86 (16.3)36.81 (16.9)39.05 (15.8)0.600.14
Implanted Cardiac Devices
 None28 (45.9)10 (31.3)18 (62.0)0.160.36
 BiV Pacemaker7 (11.5)5 (15.6)2 (6.9)
 ICD13 (21.3)9 (28.1)4 (13.8)
 BiV ICD11 (18.0)7 (21.9)4 (13.8)
 Missing/Not recorded2 (3.3)1 (3.1)1 (3.5)
Heart Medications
 ACE-I20 (32.8)11 (34.4)9 (31.0)0.780.07
 Beta-blocker49 (80.3)29 (90.6)20 (69.0)0.050.51
 ARB18 (29.5)13 (40.6)5 (17.2)0.050.50
 Statin36 (59.0)17 (53.1)19 (65.5)0.440.20
 Allopurinol8 (13.1)5 (15.6)3 (10.3)0.710.10
 Aldosterone blocker27 (44.3)17 (53.1)10 (34.5)0.200.33
 None3 (4.9)1 (3.1)2 (6.9)0.600.14
Diuretic Intake (mg)
 Furosemide29.02 (42.9)32.19 (47.1)25.52 (38.1)0.550.16
 Bumetanide0.03 (0.3)0 (0)0.07 (0.4)--
 Torsemide25.57 (44.0)36.88 (48.9)24.14 (38.6)0.810.06
 Metolazone0.38 (1.2)0 (0)0.72 (1.7)--
 Hydrochlorothiazide1.02 (4.7)0.78 (4.4)1.28 (5.1)0.690.11
Lab data, median
 Hemoglobin (g/dL)12.3 [9–16.4]12.45 [9–16.4]12.3 [10.1–16.2]0.700.10
 Lymphocyte %WBC16.95 [3–48]22.4 [3–48]10 [4–42]0.020.58
 Uric acid (mg/dL)6.65 [0–11]7.25 [0–11]2.05 [0–7.3]0.011.15
 Total cholesterol (mg/dL)146 [0–253]139 [0–253]151 [0–259]0.260.34
 Sodium (mmol/L)139 [123–145]139.5 [123–145]139 [127–145]0.780.07
Seattle Heart Failure Model
1-year survival probability, SD0.84 (0.1)0.82 (0.2)0.87 (0.1)0.130.38
2-year survival probability, SD0.72 (0.2)0.69 (0.2)0.76 (0.1)0.140.39
5-year survival probability, SD0.49 (0.2)0.45 (0.2)0.53 (0.2)0.180.36
Charlson Comorbidity Index6.66 (92.5)6.84 (1.8)6.45 (3.0)0.550.16
Rural Location44 (72.1)31 (96.9)13 (44.8)--

Abbreviations: SD standard deviation, GED General Education Development, NYHA New York Heart Association, BiV biventricular, ICD implantable cardioverter-defibrillator, ACE-I angiotensin-converting-enzyme inhibitor; ARB = angiotensin receptor blocker

* p-values from t-test, Chi-squared, or Fisher’s exact tests, as appropriate

†Effect size: Cohen’s d or d-equivalent: small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

Patient Demographics Abbreviations: SD standard deviation, GED General Education Development, NYHA New York Heart Association, BiV biventricular, ICD implantable cardioverter-defibrillator, ACE-I angiotensin-converting-enzyme inhibitor; ARB = angiotensin receptor blocker * p-values from t-test, Chi-squared, or Fisher’s exact tests, as appropriate †Effect size: Cohen’s d or d-equivalent: small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8 Family caregivers (n = 48) were a mean age of 65 years, female (81%, n = 39), white (83%, n = 40), Protestant (52%, n = 25), married or living with a partner (81%, n = 39), retired (50%, n = 24), had a graduate degree (27%; n = 13) and were the patients’ spouse or partner (65%, n = 31) (Table 2). Compared to DHMC, UAB caregivers were more often black and Protestant.
Table 2

Caregiver Demographics

All caregivers (N = 48)Dartmouth (n = 29)UAB (n = 19)
n (%) n (%) n (%) p * d
Age, Mean (SD)64.94 (9.3)65.18 (10.3)64.58 (7.7)0.0820.06
Gender
 Female39 (81.3)23 (79.3)16 (84.2)0.990
Race
 White40 (83.3)29 (100.0)11 (57.9)0.00021.19
 Black8 (16.7)0 (0)8 (42.1)
Religion
 Protestant25 (52.1)7 (24.1)18 (94.7)
 Catholic7 (14.6)7 (24.1)0 (0)
 Jewish1 (2.1)1 (3.5)0 (0)<.00011.26
 Other6 (12.5)6 (20.7)0 (0)
 None9 (18.8)8 (27.6)1 (5.3)
Marital Status
 Never married2 (4.2)0 (0)2 (10.5)0.090.51
 Married or living with partner39 (81.3)26 (89.7)13 (68.4)
 Divorced or separated3 (6.3)2 (6.9)1 (5.3)
 Widowed4 (8.3)1 (3.5)3 (15.8)
Work status
 Employed17 (35.4)9 (31.0)8 (42.1)
 Retired/Homemaker24 (50.0)15 (51.7)9 (47.4)
 Not employed3 (6.3)1 (3.5)2 (10.5)0.490.20
 Disability3 (6.3)3 (10.3)0 (0)
 No response1 (2.1)1 (3.5)0 (0)
Education
 <High school graduate3 (6.3)2 (6.9)1 (5.3)
 High school graduate or GED12 (25.0)7 (24.1)5 (26.3)
 Some college or technical school11 (22.9)5 (17.2)6 (31.6)0.230.36
 College graduate9 (18.8)4 (13.8)5 (26.3)
 Graduate degree13 (27.1)11 (37.9)2 (10.5)
Relationship to patient
 Spouse/partner31 (64.6)20 (69.0)11 (57.9)
 Parent8 (16.7)4 (13.8)4 (21.1)
 Son or daughter4 (8..3)2 (6.9)2 (10.5)0.630.14
 Other relative3 (6.3)1 (3.5)2 (10.5)
 Friend2 (4.2)2 (6.9)0 (0)

Abbreviations: SD standard deviation, GED General Education Development

* p-values from t-test or Fisher’s exact tests, as appropriate

†Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

Caregiver Demographics Abbreviations: SD standard deviation, GED General Education Development * p-values from t-test or Fisher’s exact tests, as appropriate †Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

Feasibility/acceptability: Intervention and measure completion

Overall study attrition was due to withdrawal (18%; n = 11) and death (5%; n = 3). In-person comprehensive palliative care assessments were completed by 64% (n = 39) (UAB = 41%; n = 12 vs. DHMC 84.4%; n = 27). Non-completion (n = 22) was due to “declined” (61%; n = 14), “no-show” (26%; n = 6) or died before appointment (13%; n = 2). Most patients (69%; n = 42; UAB = 41%; n = 12 vs DHMC = 94%; n = 30) and caregivers (79%; n = 38; UAB = 63%; n = 12 vs DHMC = 90%; n = 26) completed the nurse coaching sessions. Average weekly session duration was 46- (caregivers)–50-(patients) minutes and monthly check-in calls were 13 min. At the completion of the weekly sessions, nurse coaches assessed patient and caregiver satisfaction with the intervention, which was high and no participants reported adverse events. We observed between-site differences in measurement completion for patients (UAB = 38%; n = 11 vs DHMC =72%; n = 23; p = 0.008, d-equivalent = 0.7), but not for caregivers (UAB = 58%; n = 11 vs DHMC = 69%; n = 20; p = 0.54, d-equivalent = 0.18). Exploratory analyses of study attrition, and participant baseline demographics and outcomes (Additional file 1: Tables S2 and S3) revealed that the strongest predictors of patient attrition were site (UAB vs. DHMC: OR = 4.7, 95% C.I. = [1.6, 14.4], p = 0.006) and baseline Patient Assessment of Chronic Illness Care (PACIC)-patient activation subscale score (OR = 0.57 per SD increase, 95% C.I. = [0.3, 0.9], p = 0.026). The strongest predictor of caregiver attrition was decreased caregiver QOL (measured by the Bakas Caregiving Outcomes Scale (BCOS) score) (OR = 0.49 per SD increase, 95% C.I. = [0.2, 1.1], p = 0.073). Patient and caregiver feedback relative to the intervention included the density, high literacy level of the patient/caregiver Charting Your Course guides, and difficulty attending (due to travel distance/transportation) and misunderstanding the purpose of the in-person outpatient palliative care consultation. They also provided critical feedback about the study measures: they reported an inability to complete the literacy measure, and a high burden of completing the symptom measure.

Patient reported outcome measures

Key effect size differences were evident between the UAB and DHMC patient-reported baseline (Additional file 1: Table S4) and change from baseline to week 24 outcomes (Table 3). At baseline, relative to DHMC, UAB had >0.20 effect size differences that were lower in KCCQ symptom subscale, PROMIS mental health, PACIC (activation scale) and humor coping and higher KCCQ-QOL subscale, perceived social support (e.g. MSPSS) and use of denial and religious coping strategies. UAB patients experienced moderate improvements post-intervention (baseline to 24-week) in all KCCQ subscales (d = 0.37–0.79), MSAS-HF symptom burden index, HADS (d = 0.31–0.34), and Physical and Mental Global Health subscales (d = 0.46–0.53) and a small magnitude of improvement in the decision-support subscale. DHMC patients had a moderate post-intervention improvement in the MSAS-HF symptom burden index (d = .50) and small-moderate improvements (but to a lesser extent than UAB) in the KCCQ (d = 0.21–0.39), HADS (d = 0.20–0.23) and Global Mental Health (d = 0.23) subscales.
Table 3

Patient-reported Outcome Measures - Change from Baseline (Adjusted)

All patientsDartmouthUAB
Mean (SE) p * Effect size Mean (SE) p * Effect size Mean (SE) p * Effect size
KCCQ
 Physical limitation13.30 (4.4)0.0030.509.90 (6.1)0.110.3717.90 (6.2)0.010.67
 Symptoms10.80 (4.3)0.010.445.30 (5.5)0.340.2117.00 (6.6)0.010.69
 Social limitation8.40 (5.1)0.100.286.20 (6.7)0.360.2111.10 (7.8)0.160.37
 Quality of life10.70 (4.0)0.0090.410.40 (5.4)0.060.3911.30 (6.2)0.070.42
 KCCQ functional status11.60 (4.0)0.0050.496.90 (5.3)0.200.2917.50 (5.8)0.0040.74
 KCCQ clinical summary10.30 (3.9)0.0090.447.80 (5.2)0.140.3313.70 (5.7)0.020.58
MSAS-HF Symptom Burden Index−25.80 (7.1)0.0004−0.54−24.20 (8.0)0.003−0.50−25.7 (12.8)0.05−0.54
HADS
 Anxiety−1.00 (0.5)0.08−0.29−0.70 (0.6)0.28−0.20−1.20 (0.9)0.20−0.34
 Depression−1.10 (0.6)0.07−0.28−0.90 (0.7)0.17−0.23−1.20 (1.1)0.28−0.31
PROMIS
 Global Physical Health T score2.70 (1.5)0.080.321.50 (2.0)0.470.183.80 (2.0)0.070.46
 Global Mental Health T score3.00 (1.4)0.040.361.90 (1.8)0.300.234.40 (2.2)0.050.53
PACIC
 Patient activation0.20 (0.2)0.260.170.20 (0.2)0.350.170 (0.3)0.950
 Decision support0.30 (0.2)0.100.300.20 (0.2)0.450.20.30 (0.3)0.230.30
 Goal setting0.30 (0.2)0.090.290.30 (0.2)0.250.290.20 (0.2)0.480.20
 Problem solving0.30 (0.2)0.140.270.20 (0.2)0.290.180.20 (0.3)0.590.18
 Care Coordination0 (0.2)0.920−0.10 (0.2)0.61−0.090.10 (0.3)0.800.09
 PACIC Summary Score0.20 (0.1)0.140.230.10 (0.2)0.420.110.10 (0.2)0.500.11

Abbreviations: SE standard error, KCCQ Kansas City Cardiomyopathy Questionnaire, MSAS-HF Memorial Symptom Assessment Scale-Heart Failure, HADS Hospital Anxiety and Depression Scale, PROMIS Patient Reported Outcomes Measurement Information System, PACIC Patient Assessment of Chronic Illness Care. All change from baseline estimates were adjusted for measures associated with attrition (e.g. religious preference, baseline PACIC-Patient Activation subscale and SHFM 1-year survival probability)

* p-values from t-test or Fisher’s exact tests, as appropriate

†Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

Patient-reported Outcome Measures - Change from Baseline (Adjusted) Abbreviations: SE standard error, KCCQ Kansas City Cardiomyopathy Questionnaire, MSAS-HF Memorial Symptom Assessment Scale-Heart Failure, HADS Hospital Anxiety and Depression Scale, PROMIS Patient Reported Outcomes Measurement Information System, PACIC Patient Assessment of Chronic Illness Care. All change from baseline estimates were adjusted for measures associated with attrition (e.g. religious preference, baseline PACIC-Patient Activation subscale and SHFM 1-year survival probability) * p-values from t-test or Fisher’s exact tests, as appropriate †Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

Caregiver reported outcome measures

No between-site differences were noted in caregiver-reported baseline outcomes (Additional file 1: Table S5). However post-intervention estimates of change from baseline to 24 weeks demonstrated that UAB caregivers had moderate effect size improvements in BCOS, HADS-Depression, Global Mental Health, and MBCB scores and small magnitude improvements in HADS-Anxiety and Global Physical Health (Table 4). At DHMC the moderate post-intervention improvement was noted for MBCB-Stress Burden and MBCB total scores and small improvements in BCOS, HADSdepression and PAC-outlook on life subscales.
Table 4

Caregiver-reported Outcomes - Change from Baseline to 24 weeks (Adjusted for BCOS)

All caregiversDartmouthUAB
Mean (SE) p * Effect size Mean (SE) p * Effect size Mean (SE) p * Effect size
BCOS score3.70 (2.0)0.070.402.30 (2.2)0.300.256.70 (3.8)0.090.73
HADS
 Anxiety−0.20 (0.5)0.69−0.070.10 (0.7)0.860.03−0.70 (0.9)0.42−0.23
 Depression−1.30 (0.7)0.08−0.32−1.10 (0.9)0.26−0.27−1.90 (1.1)0.11−0.47
PROMIS
 Global Physical Health1.70 (1.4)0.210.221.60 (1.8)0.380.21.60 (2.2)0.450.20
 Global Mental Health1.80 (1.3)0.180.241.00 (1.8)0.570.133.20 (1.8)0.080.43
MBCB
 Objective burden−1.10 (0.5)0.02−0.33−0.50 (0.6)0.39−0.15−2.10 (0.8)0.01−0.63
 Demand burden−0.60 (0.4)0.09−0.28−0.04 (0.3)0.22−0.19−1.20 (0.8)0.16−0.56
 Stress burden−1.30 (0.4)0.001−0.58−1.40 (0.5)0.003−0.62−1.40 (0.7)0.07−0.62
 Total Score−3.10 (1.0)0.002−0.53−2.40 (1.0)0.03−0.41−4.60 (2.0)0.03−0.78
PAC
 Self-affirmation0.40 (0.8)0.580.110.30 (0.9)0.700.080.60 (1.4)0.680.16
 Outlook on life0.40 (0.4)0.410.160.50 (0.6)0.410.200.40 (0.7)0.610.16
 PAC Total0.90 (1.2)0.430.150.90 (1.4)0.520.151.10 (2.0)0.570.19

Abbreviations: SE standard error, BCOS Bakas Caregiving Outcomes Scale, HADS Hospital Anxiety and Depression Scale, PROMIS Patient Reported Outcomes Measurement Information System, MBCB Montgomery Borgatta Caregiver Burden Scale, PAC Positive Aspects of Caregiving

* p-values from t-test or Fisher’s exact tests, as appropriate

†Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8

All change estimates were adjusted for the baseline measures most strongly associated with caregiver attrition: caregiver education, baseline BCOS score and baseline MBCB - objective burden subscale

Caregiver-reported Outcomes - Change from Baseline to 24 weeks (Adjusted for BCOS) Abbreviations: SE standard error, BCOS Bakas Caregiving Outcomes Scale, HADS Hospital Anxiety and Depression Scale, PROMIS Patient Reported Outcomes Measurement Information System, MBCB Montgomery Borgatta Caregiver Burden Scale, PAC Positive Aspects of Caregiving * p-values from t-test or Fisher’s exact tests, as appropriate †Effect size: Cohen’s d or d-equivalent; small: d ~ 0.2, medium d ~ 0.5, large d ~ 0.8 All change estimates were adjusted for the baseline measures most strongly associated with caregiver attrition: caregiver education, baseline BCOS score and baseline MBCB - objective burden subscale

Resource use

At baseline there were no between-group differences in hospital days, intensive care unit (ICU) days or emergency department (ED) visits (Table 5). However, from baseline to 24 weeks, a small-moderate effect size decrease was noted in hospital and ICU days per month; a small effect size decrease in ED visits per month was only noted at UAB. At baseline 87% (n = 28) of DHMC and 28% (n = 8) of UAB patients had an advance directive (p < 0.001); by study end, one additional patient per site completed an advance directive. Related to hospice care, at baseline each site had one patient enrolled in hospice and by study end, four additional patients were enrolled in hospice (UAB = 1; DHMC = 3) (p = 0.07; d = 0.48).
Table 5

Resource Use At Baseline

At Baseline (prior 3 months)All patients (N = 60)Dartmouth (n = 31)UAB (n = 29)
Mean (SD)Mean (SD)Mean (SD) p Effect size
Hospital days/month1.44 (3.0)1.7 (3.6)1.17 (2.2)0.720.18
ICU days/month0.26 (1.0)0.34 (1.3)0.16 (0.6)0.320.18
ED visits/month0.23 (0.4)0.26 (0.4)0.21 (0.4)0.540.13
Resource Use- Difference from Baseline
All patients (N = 34)Dartmouth (n = 23)UAB (n = 11)
Mean (SE) p * Effect size Mean (SE) p * Effect size Mean (SE) p * Effect size
Hospital days/month−0.89 (0.3)0.0020.39−1.18 (0.4)0.0060.57−0.61 (0.4)0.130.24
Days/month in ICU, Mean−0.16 (0.1)0.060.29−0.12 (0.1)0.230.26−0.21 (0.2)0.160.31
ED visits/month, Mean−0.05 (0.1)0.330.170 (0.1)0.940.05−0.09 (0.1)0.260.26

Abbreviations: SD standard deviation, SE standard error, Estimates from longitudinal models fitted with negative binomial distributions (log link), adjusted for baseline, PACIC Patient Activation, and religious preference

* p-values from t-test or Fisher’s exact tests, as appropriate

†Effect size: Cohen’s d (Cohen, 1988), or d-equivalent (Rosenthal & Rubin, 2003) small: d ~ 0.2, moderate d ~ 0.5, large d ~ 0.8

Resource Use At Baseline Abbreviations: SD standard deviation, SE standard error, Estimates from longitudinal models fitted with negative binomial distributions (log link), adjusted for baseline, PACIC Patient Activation, and religious preference * p-values from t-test or Fisher’s exact tests, as appropriate †Effect size: Cohen’s d (Cohen, 1988), or d-equivalent (Rosenthal & Rubin, 2003) small: d ~ 0.2, moderate d ~ 0.5, large d ~ 0.8

Discussion

The purpose of this 2-site, single-arm pilot study was to determine feasibility and potential efficacy of implementing the ENABLE CHF-PC EPC tele-health intervention in a racially-diverse, southeastern US HF population. Previously, ENABLE had demonstrated effectiveness in two large cancer RCTs [33, 43] and in a small, mostly white northeastern HF sample [30]. We were able to achieve our primary study feasibility/acceptability aim in a racially and culturally diverse sample by engaging patients and family caregivers and soliciting their feedback to make improvements in the study design, measures, and intervention. The key lessons learned from this pilot could be of considerable value to other researchers and clinicians attempting to integrate supportive and palliative care into racially-diverse HF populations. First, health literacy issues were marked in our trial and resulted in changes to future study outcome measures, intervention materials, and recruitment and retention procedures. Per our study coordinator reports, participants expressed frustration and dissatisfaction in completing our original health literacy measure, The Newest Vital Sign [44]. We recommend that others be sensitive to health literacy when working with this population and consider pretesting all measures and materials prior to initiating them in large scale trials. Second, we encountered significant recruitment challenges in the southeastern site. We needed to screen more UAB individuals for eligibility (n = 344) compared to DHMC (n = 87) and proportionally fewer eligible UAB patients agreed to participate. Several factors may explain this discrepancy. The southeast has a high proportion of individuals of black race; this population experiences the highest burden of illness from HF in the US and at a much younger age than whites [45]. Blacks have also been noted to have high rates of healthcare system mistrust and a much lower uptake of palliative and hospice services than whites [46-51]. In response to these factors, we reduced our age eligibility criterion from 65 to 50 years and contracted with a recruitment service who was highly-experienced in community-based research in racially underserved populations and maintained weekly communications with the recruitment service and UAB cardiologists at HF clinical meetings. Second, this was our first effort to identify and recruit eligible, racially-diverse HF patients for an early palliative care study. Our cardiologist co-investigators were extremely supportive and cooperative, and assisted us to find the most efficient and effective way to identify eligible patients and refine our screening, recruitment and operational procedures without disrupting clinical patient care. Early on, we also realized the need to adjust processes to improve UAB participants’ uptake of the outpatient palliative care consultation component of the intervention. The UAB Supportive Care and Survivorship Clinic faculty and staff helped us to refine outpatient palliative care consultation scheduling procedures so that, when-ever possible, these visits would coincide with other ap-pointments in an effort to overcome transportation issues of patients who lived long distances from the medical center. Many UAB patients lacked familiarity or had misperceptions about EPC, in some cases confusing it with hospice care. We provided our recruiters with ex-tensive training about the goals of EPC as providing “an extra layer of support” so that they were better able to introduce the study in a non-threatening way. We lever-aged the trusting relationship that most HF patients had with their cardiologists and the UAB health system and carefully ‘branded’ our materials to be consistent with all other UAB programs. We have also expanded our in-progress RCT recruitment sites to include the local Veteran’s Affairs Medical Center, a nurse-led clinic for under-insured HF patients, and we are developing partnerships with community agencies, payers, and churches. Fostering clinical [52] and community [48, 52–54] relationships are critical components of successful community-based recruitment. Third, participant retention was equally challenging. As is common in palliative care trials, [55, 56] both sites experienced considerable intervention, measurement and overall attrition. Fewer UAB patients participated in the outpatient palliative care consultation (32% vs 68%) and intervention sessions (41% vs 94%), and fewer UAB caregivers completed all intervention sessions (63% vs 90%). In exploratory analyses, in addition to site, we found links between patient attrition and lower activation scores and between caregiver attrition and lower QOL scores. We offer two explanations for our differential attrition. First, during joint weekly supervisory meetings, UAB more so than DHMC nurse coaches, reported that participants found the Charting Your Course guides to be lengthy and text-heavy. This combined with lower ‘activation’ levels may have caused some UAB participants to find the intervention burdensome. We revised our materials to be more colorful and pictorial to address what may have been a health literacy issue. The link between caregiver attrition and quality of life and burden is not surprising given that caregivers have been shown to neglect their own needs in favor of caring for the patient. Hence caregivers may not make time for participation in a support intervention [57]. Of interest, distance to the centers and patients’ disability status were not predictors of attrition, reinforcing the ability of telephonic services to increase palliative care access. Though not powered for hypothesis testing, we identified small-to-moderate longitudinal improvements in QOL, symptom, and psychological patient and caregiver-reported outcomes. Of interest is that there was a more robust improvement noted in UAB vs. DHMC patients and caregivers. The higher attrition at UAB may account for this difference. We were also intrigued by the significant between-site differences in the patient activation measure; UAB patients had much lower activation scores than DHMC patients and the scores remained stable over the course of the study. In our prior cancer study we also did not see a signal in this measure [33]. Though others have found improvement in PACIC empowerment subscales from early initiation of supportive care (via nurse navigators) [58] it may be that ‘activation’ is not the EPC mechanism or that the PACIC is not sufficiently sensitive to detect changes in activation. Alternatively, the relatively high activation scores observed in the DHMC cancer and HF samples, may be an indication that the instrument has a ceiling effect. Several limitations of these findings are important to note. First, as a single-arm feasibility pilot study, the trial did not have a control group and was not powered to evaluate efficacy. However, as our primary goal was feasibility in a culturally-diverse clinical setting and population, we learned valuable lessons that informed our subsequent RCT, thereby reinforcing the necessary step of pilot testing interventions prior to embarking on large-scale intervention trials [59]. Second, the patient and caregiver identified post-intervention improvements are inconclusive, preliminary, and not to be generalized as eligibility criteria and intervention changes were made during the course of the pilot. Differential attrition between the two sites may account entirely for the outcome differences. We are currently conducting a large, NIH/NINR-funded clinical trial of ENABLE CHF-PC to evaluate efficacy and address most of these limitations.

Conclusion

In conclusion, a model of concurrent HF palliative care was feasibly pilot-tested in a heterogeneous sample of individuals with NYHA Class III/IV HF and their family caregivers. Between-site demographic, attrition, and participant-reported outcomes highlight the importance of intervention pilot-testing in culturally-diverse populations.
  54 in total

1.  Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium.

Authors:  Albert J Bellg; Belinda Borrelli; Barbara Resnick; Jacki Hecht; Daryl Sharp Minicucci; Marcia Ory; Gbenga Ogedegbe; Denise Orwig; Denise Ernst; Susan Czajkowski
Journal:  Health Psychol       Date:  2004-09       Impact factor: 4.267

2.  Participation in research studies: factors associated with failing to meet minority recruitment goals.

Authors:  Raegan W Durant; Roger B Davis; Diane Marie M St George; Ishan Canty Williams; Connie Blumenthal; Giselle M Corbie-Smith
Journal:  Ann Epidemiol       Date:  2007-05-25       Impact factor: 3.797

3.  2009 focused update: ACCF/AHA Guidelines for the Diagnosis and Management of Heart Failure in Adults: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines: developed in collaboration with the International Society for Heart and Lung Transplantation.

Authors:  Mariell Jessup; William T Abraham; Donald E Casey; Arthur M Feldman; Gary S Francis; Theodore G Ganiats; Marvin A Konstam; Donna M Mancini; Peter S Rahko; Marc A Silver; Lynne Warner Stevenson; Clyde W Yancy
Journal:  Circulation       Date:  2009-03-26       Impact factor: 29.690

4.  Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support.

Authors:  Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde
Journal:  J Biomed Inform       Date:  2008-09-30       Impact factor: 6.317

Review 5.  Identifying, recruiting, and retaining seriously-ill patients and their caregivers in longitudinal research.

Authors:  Karen E Steinhauser; Elizabeth C Clipp; Judith C Hays; Maren Olsen; Robert Arnold; Nicholas A Christakis; Jennifer Hoff Lindquist; James A Tulsky
Journal:  Palliat Med       Date:  2006-12       Impact factor: 4.762

6.  Advanced (stage D) heart failure: a statement from the Heart Failure Society of America Guidelines Committee.

Authors:  James C Fang; Gregory A Ewald; Larry A Allen; Javed Butler; Cheryl A Westlake Canary; Monica Colvin-Adams; Michael G Dickinson; Phillip Levy; Wendy Gattis Stough; Nancy K Sweitzer; John R Teerlink; David J Whellan; Nancy M Albert; Rajan Krishnamani; Michael W Rich; Mary N Walsh; Mark R Bonnell; Peter E Carson; Michael C Chan; Daniel L Dries; Adrian F Hernandez; Ray E Hershberger; Stuart D Katz; Stephanie Moore; Jo E Rodgers; Joseph G Rogers; Amanda R Vest; Michael M Givertz
Journal:  J Card Fail       Date:  2015-05-04       Impact factor: 5.712

Review 7.  Palliative Care in Heart Failure.

Authors:  Roxana Ghashghaei; Rayan Yousefzai; Eric Adler
Journal:  Prog Cardiovasc Dis       Date:  2016-01-07       Impact factor: 8.194

Review 8.  A review of the trials which examine early integration of outpatient and home palliative care for patients with serious illnesses.

Authors:  Mellar P Davis; Jennifer S Temel; Tracy Balboni; Paul Glare
Journal:  Ann Palliat Med       Date:  2015-07

9.  Translating and testing the ENABLE: CHF-PC concurrent palliative care model for older adults with heart failure and their family caregivers.

Authors:  J Nicholas Dionne-Odom; Alan Kono; Jennifer Frost; Lisa Jackson; Daphne Ellis; Ali Ahmed; Andres Azuero; Marie Bakitas
Journal:  J Palliat Med       Date:  2014-07-29       Impact factor: 2.947

Review 10.  Caregivers' contributions to heart failure self-care: a systematic review.

Authors:  Harleah G Buck; Karen Harkness; Rachel Wion; Sandra L Carroll; Tammy Cosman; Sharon Kaasalainen; Jennifer Kryworuchko; Michael McGillion; Sheila O'Keefe-McCarthy; Diana Sherifali; Patricia H Strachan; Heather M Arthur
Journal:  Eur J Cardiovasc Nurs       Date:  2014-01-06       Impact factor: 3.908

View more
  15 in total

1.  Looking Back, Moving Forward: A Retrospective Review of Care Trends in an Academic Palliative and Supportive Care Program from 2004 to 2016.

Authors:  Gulcan Bagcivan; Marie Bakitas; Jackie Palmore; Elizabeth Kvale; Ashley C Nichols; Stephen L Howell; J Nicholas Dionne-Odom; Gisella A Mancarella; Oladele Osisami; Jennifer Hicks; Chao-Hui Sylvia Huang; Rodney Tucker
Journal:  J Palliat Med       Date:  2019-03-11       Impact factor: 2.947

2.  Survival time to complications of congestive heart failure patients at Felege Hiwot comprehensive specialized referral hospital, Bahir Dar, Ethiopia.

Authors:  Nuru Mohammed Hussen; Demeke Lakew Workie; Hailegebrael Birhan Biresaw
Journal:  PLoS One       Date:  2022-10-20       Impact factor: 3.752

3.  Effect of an Early Palliative Care Telehealth Intervention vs Usual Care on Patients With Heart Failure: The ENABLE CHF-PC Randomized Clinical Trial.

Authors:  Marie A Bakitas; J Nicholas Dionne-Odom; Deborah B Ejem; Rachel Wells; Andres Azuero; Macy L Stockdill; Konda Keebler; Elizabeth Sockwell; Sheri Tims; Sally Engler; Karen Steinhauser; Elizabeth Kvale; Raegan W Durant; Rodney O Tucker; Kathryn L Burgio; Jose Tallaj; Keith M Swetz; Salpy V Pamboukian
Journal:  JAMA Intern Med       Date:  2020-09-01       Impact factor: 21.873

Review 4.  Compendium of Health and Wellness Coaching: 2019 Addendum.

Authors:  Gary A Sforzo; Miranda P Kaye; Sebastian Harenberg; Kyle Costello; Laura Cobus-Kuo; Erica Rauff; Joel S Edman; Elizabeth Frates; Margaret Moore
Journal:  Am J Lifestyle Med       Date:  2019-05-26

5.  Referral Practices of Cardiologists to Specialist Palliative Care in Canada.

Authors:  Michael J Bonares; Ken Mah; Jane MacIver; Lindsay Hurlburt; Ebru Kaya; Gary Rodin; Heather Ross; Camilla Zimmermann; Kirsten Wentlandt
Journal:  CJC Open       Date:  2020-12-09

6.  Telephone interventions, delivered by healthcare professionals, for providing education and psychosocial support for informal caregivers of adults with diagnosed illnesses.

Authors:  Margarita Corry; Kathleen Neenan; Sally Brabyn; Greg Sheaf; Valerie Smith
Journal:  Cochrane Database Syst Rev       Date:  2019-05-14

7.  Examining Adherence and Dose Effect of an Early Palliative Care Intervention for Advanced Heart Failure Patients.

Authors:  Rachel Wells; James Nicholas Dionne-Odom; Andres Azuero; Harleah Buck; Deborah Ejem; Kathryn L Burgio; Macy L Stockdill; Rodney Tucker; Salpy V Pamboukian; Jose Tallaj; Sally Engler; Konda Keebler; Sheri Tims; Raegan Durant; Keith M Swetz; Marie Bakitas
Journal:  J Pain Symptom Manage       Date:  2021-02-05       Impact factor: 5.576

8.  African American Recruitment in Early Heart Failure Palliative Care Trials: Outcomes and Comparison With the ENABLE CHF-PC Randomized Trial.

Authors:  Macy L Stockdill; J Nicholas Dionne-Odom; Rachel Wells; Deborah Ejem; Andres Azuero; Konda Keebler; Elizabeth Sockwell; Sheri Tims; Kathryn L Burgio; Sally Engler; Raegan Durant; Salpy V Pamboukian; Jose Tallaj; Keith M Swetz; Elizabeth Kvale; Rodney Tucker; Marie Bakitas
Journal:  J Palliat Care       Date:  2020-12-01       Impact factor: 1.980

9.  The effectiveness and cost-effectiveness of hospital-based specialist palliative care for adults with advanced illness and their caregivers.

Authors:  Sabrina Bajwah; Adejoke O Oluyase; Deokhee Yi; Wei Gao; Catherine J Evans; Gunn Grande; Chris Todd; Massimo Costantini; Fliss E Murtagh; Irene J Higginson
Journal:  Cochrane Database Syst Rev       Date:  2020-09-30

Review 10.  Translating a US Early Palliative Care Model for Turkey and Singapore.

Authors:  Imatullah Akyar; James N Dionne-Odom; Grace Meijuan Yang; Marie A Bakitas
Journal:  Asia Pac J Oncol Nurs       Date:  2018 Jan-Mar
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.