Agreement between physicians' and nurses' clinical decisions for the management of the fracture liaison service (4iFLS): the Lucky Bone™ program.

UNLABELLED: We determined if nurses can manage osteoporotic fractures in a fracture liaison service by asking a rheumatologist and an internist to assess their clinical decisions. Experts agreed on more than 94 % of all nurses' actions for 525 fragility fracture patients, showing that their management is efficient and safe.
INTRODUCTION: A major care gap exists in the investigation of bone fragility and initiation of treatment for individuals who have sustained a fragility fracture. The implementation of a fracture liaison service (FLS) managed by nurses could be the key in resolving this problem. The aim of this project was to obtain agreement between physicians' and nurses' clinical decisions and evaluate if the algorithm of care is efficient and reliable for the management of a FLS.
METHODS: Clinical decisions of nurses for 525 subjects in a fracture liaison service between 2010 and 2013 were assessed by two independent physicians with expertise in osteoporosis treatment.
RESULTS: Nurses succeeded in identifying all patients at risk and needed to refer 27 % of patients to an MD. Thereby, they managed autonomously 73 % of fragility fracture patients. No needless referrals were made according to assessing physicians. Agreement between each evaluator and nurses was of >97 %. Physicians' decisions were the same in >96 %, and Gwet AC11 coefficient was of >0.960 (almost perfect level of agreement). All major comorbidities were adequately managed.
CONCLUSIONS: High agreement between nurses' and physicians' clinical decisions indicate that the independent management by nurses of a fracture liaison service is safe and should strongly be recommended in the care of patients with a fragility fracture. This kind of intervention could help resolve the existing care gap in bone fragility care as well as the societal economic burden associated with prevention and treatment of fragility fractures.

Introduction

Osteoporosis is a chronic disease with fractures as its main outcome. It has been widely documented that this condition is treatable and the fractures preventable [1, 2]. Nevertheless, approximately 30 % of women will be diagnosed with osteoporosis and about half of this proportion will receive treatment following a fragility fracture [3, 4]. Moreover, costs associated with the treatment of fragility fractures are high worldwide, ranging from $2.3 billion in Canada (2008), $15 to 20 billion in the USA, and $37 billion in the European Union (2010) annually [5-7]. Ageing of the population can only exacerbate the problem [8].

A lot of effort has been put into the development of management models for the prevention of subsequent fractures [9, 10]. A high intensity of intervention model of care, such as a fracture liaison service (FLS), has proven to be one of the best approaches in reducing the care gap in osteoporosis [11]. A FLS is characterized by three main interventions (3i): identification of patients at risk for fracture, investigation for bone fragility, and initiation of treatment for subsequent fracture prevention [12, 13]. Our FLS consists in a 4i management, the fourth “i” being integration of follow-up. Indeed, after the initiation of treatment, a thorough follow-up of patients was undertaken to ensure persistence, compliance, safety, and prevention of subsequent fractures. A nurse case manager (NCM) is the dedicated health care professional usually designated to manage a FLS in collaboration with orthopedic surgeons or other specialists [14, 15]. Still, the need to assess the management of a FLS by nurses remains.

The main goal of the present project was to develop and implement an algorithm based on the clinical guidelines of Osteoporosis Canada that could be applied independently by nurses through an order set. Therefore, the objective of this study was to determine if nurses can carry out the role of a NCM in a FLS while ensuring safety of the clinical decisions regarding identification of patients at risk, investigation for bone fragility, initiation of treatment, referral to a specialist when needed, and follow-up.

Methodology

Study design

We conducted a cross-sectional study as part of a larger prospective cohort study that aimed to determine the incidence of subsequent fractures following initiation of a FLS. Between 2010 and 2013, men and women were identified by NCMs at the outpatient orthopedic clinic of Hôpital du Sacré-Coeur de Montréal and Hôpital Jean-Talon. NCMs looked through medical files to identify patients (1) aged 40 years and older and (2) with a fracture sustained following a low-energy trauma such as a fall from standing height, from a chair, a bed, and even from a severe cough or a sneeze [16]. Only patients from the outpatient orthopedic clinic were identified and recruited. Exclusion criteria include (1) patients less than 40 years old, (2) with an open fracture, (3) a fracture from a high energy trauma, (4) a fracture of the skull/face/little bones under the wrist or ankle, (5) a pathological fracture, (6) severe kidney failure, (7) pregnant or breastfeeding, (8) with dementia, or (9) unable to fill a questionnaire in English or French.

Informed consent was obtained from all participants included in the study. This study was approved by the Hôpital Sacré-Coeur de Montréal and Centre Hospitalier de l’Université de Montréal ethic research committees.

Data collection

Patients enrolled in the FLS are followed over a 10-year period with systematic follow-ups (3, 6, 12, 18, 24 months, and each year). During the baseline evaluation, the NCM collected the following information: age, sex, body mass index (BMI), fracture site, number of previous fractures, medications, medical history, and family history. Patients were provided with a requisition for serum (total blood count, creatinine, thyroid-stimulating hormone, parathyroid hormone, calcium, protein electrophoresis, C-reactive protein, alkaline phosphatase, 25-hydroxy vitamin D, osteocalcin, and C-telopeptide) and bone mineral density (BMD) testing. Patients were referred to a bone specialist at baseline for the following reasons: (1) patients that experienced treatment failure, defined as a fragility fracture sustained while taking an anti-resorptive agent for at least a year, (2) aged between 40 and 49 years, or (3) presenting a contraindication to treatment. The management algorithm of care followed by NCMs was based on Osteoporosis Canada guidelines for the prevention of fragility fractures. This algorithm is summarized in Fig. 1.

Fig. 1

Management algorithm of nurses in the Lucky Bone TM program. BMD bone mineral density, FLS fracture liaison service, y.o. years old

Fracture liaison service personnel

This program was managed by a clinical nurse specialist (CNS) with the help of two clinical nurses. A CNS with a graduate level of studies and extensive clinical experience was responsible for the clinical nurses’ training, guidance, and case discussion with physicians. The training of clinical nurses for the FLS included a 6-h theoretical presentation mainly on osteoporosis physiopathology, the management of fragility fractures, and pharmacological/non-pharmacological treatment for bone fragility. This was followed by a 2-month training period with the CNS.

Intervention

Two physicians, a rheumatologist and an internist, with expertise in osteoporosis management and clinical research (JPR and SNM) evaluated if nurses’ actions in terms of referral decision and treatment initiation were consistent with the algorithm of care for the 543 subjects (Fig. 2).

Fig. 2

Evaluation process of nurses’ clinical decisions of referral and initiation of treatment of enrolled fragility fracture patients

Data collected included age, sex, site of fracture, number of previous fractures, medical history, medication list, blood biochemistry test results, BMD T-scores, BMI, decision of referral, reason of referral, and initiation of treatment at baseline. Blood tests included serum bone turnover biomarkers (CTX-1 and osteocalcin), protein electrophoresis, creatinine, creatinine clearance, calcium, 25-hydroxy vitamin D, and parathyroid hormone (PTH). All cases were attributed with a number as their only mean of identification.

Statistical analysis

To ensure a precise and reliable raw agreement between the nurses and the evaluators, a sample size of subjects to be reviewed was calculated based on the purpose of the probability to obtain a statistically significant kappa coefficient. Because we assumed no bias between the two raters, the calculations based on the Donner and Eliasziw goodness-of-fit formula was used with a type I probability of error of 0.05, 90 % of power, an expected proportion of positive ratings of 0.9, a kappa to detect of 0.8, and a null value of 0.6 [17]. For a two-tailed test, we needed a sample size of 449 needed «observations» to agree on or not. Therefore, the whole study population (n = 543) yielded sufficient statistical power.

The primary outcome, the raw agreement between the nurses and each evaluator, was calculated as the proportion of nurses’ decisions agreed upon by the evaluators. The same was done for raw agreement between both evaluators (agreement and disagreement for the same cases). Pearson’s chi-squared test was used to determine if there was a significant association between the experts’ answers. A one-proportion z test with a 95 % confidence interval was used to observe the difference, if one present, between the obtained total agreement and the hypothesized one, which was of 90 %. No measure of reliability was calculated for the total agreement because it included two types of decisions per subject, leaving a contingency table as not feasible. We considered a p value of ≤0.05 as statistically significant.

Inter-rater reliability was calculated with Cohen’s kappa coefficient (κ) with 95 % confidence intervals. This statistic allows to measure raw agreement by adjusting for chance agreement [18]. The obtained coefficient varies between 1 and −1, where 1 is a perfect agreement, 0 indicates no agreement, and −1 means a perfect disagreement [19]. It was possible to use this reliability measure with the production of contingency tables since our variables are dichotomous nominal ones. However, it was necessary to use an alternative to this measure because of Feinstein and Cicchetti’s «paradox of kappa» (1990) [20]. It is a possible bias generated by the agreement distribution in the population, presenting as a low value of kappa when the agreement is high or the opposite. To address this problem, a «paradox resistant» option exists, Gwet’s AC1 coefficient [21]. Here are the formulas of both coefficients:where p is the global proportion of agreement and e(K) and e(γ) represent the agreement probability attributed to chance [22, 23]. The AC1 coefficient also determines inter-rater reliability by adjusting agreement for chance but differs in agreement probability of chance calculation. Instead of estimating the probability that an answer is attributed to chance, the AC1 coefficient estimates the probability of an observer to agree even if the answer is random. Interpretation of kappa and AC1 coefficients is based on the Landis and Koch scale (1977) [19].

Results

Population characteristics

A total of 525 subjects’ data was reviewed by the two physicians. Studied population characteristics according to sex are shown in Table 1. A significant number of patients had a diagnosis of osteoporosis, digestive disorders, hypercholesterolemia, and hypertension. Main fracture sites included the wrist, ankle, and humerus. Thirty-two percent of patients had sustained a fragility fracture prior to the index fracture. Overall, nurses referred almost 27 % of patients to a specialist mainly for treatment failure and for age 49 years or less, as pre-specified.

Table 1

Study population characteristics according to sex

	Women	Men
N (%)	452 (86.1)	73 (13.9)
Mean age (years) (±SD)	63.4 (±11.7)	63.2 (±10.5)
Minimum (years) n	39	46
Maximum (years) n	89	89
Fracture sites n(%)
Wrist	184 (40.7)	20 (27.4)
Ankle	71 (15.7)	17 (23.3)
Humerus	62 (13.7)	7 (9.6)
Vertebrae	32 (7.1)	8 (11.0)
Femur	15 (3.3)	8 (11.0)
Hip	13 (2.9)	3 (4.2)
Other	75 (16.6)	10 (13.7)
Patients with previous FF n(%)	150 (33.2)	18 (24.6)
Medical history n(%)
Hypertension	146 (32.3)	39 (53.4)
Osteoporosis	143 (31.6)	5 (6.8)
Gastric disorder	127 (28.1)	9 (12.3)
Dyslipidemia	113 (25.0)	36 (49.3)
Cancer	38 (8.4)	4 (5.5)
Diabetes	32 (7.1)	15 (20.5)
Rheumatoid arthritis	32 (7.1)	0 (0.0)
Osteoarthritis	31 (6.9)	2 (2.7)
Kidney disease	21 (4.6)	7 (9.6)
Myocardial infarction	18 (4.0)	7 (9.6)
Angina	18 (4.0)	3 (4.1)
Stroke	14 (3.1)	7 (9.6)
Inflammatory bowel disease	9 (2.0)	2 (2.7)
Liver disease	8 (1.8)	2 (2.7)
Bowel problems	6 (1.3)	2 (2.7)
Neuromuscular disease	4 (0.9)	1 (1.4)
Patients under BP n(%)	88 (19.5)	3 (4.2)
Patients under calcium and vitamin D n(%)	138 (30.5)	7 (9.6)
Patients with T-score n(%)a	368 (81.4)	66 (90.4)
Vertebral T-score
[2.5 to −1.0]	94 (25.6)	13 (19.7)
[−1.0 to −2.5]	161 (43.7)	26 (39.4)
[−2.5 and less]	113 (30.7)	27 (40.9)
Femoral T-score
[2.5 to −1.0]	86 (23.4)	15 (22.7)
[−1.0 to −2.5]	229 (62.2)	39 (59.1)
[−2.5 and less]	53 (14.4)	12 (18.2)
Patients with BMI	403 (89.2)	70 (95.9)
Mean (kg/m2) (±SD)	25.6 (±5.2)	27.5 (±5.6)
Minimum (kg/m2) n	13.9	14.8
Maximum (kg/m2) n	49.3	40.9
Patients with CTX-1	306 (67.7)	52 (71.2)
Mean (ng/ml) (±SD)	0.367 (±0.203)	0.357 (±0.168)
CTX-1 < 300 ng/ml n	128 (41.8)	22 (42.3)
CTX-1 > 300 ng/ml n	178 (58.2)	30 (57.7)
Referred patients n(%)	130 (28.8)	11 (15.1)
Reasons of referral n(%)
Fracture under BP	66 (50.8)	2 (18.2)
Patient aged <50 years old	40 (30.8)	5 (45.4)
Contraindications/intolerances	14 (10.8)	0 (0.0)
Abnormal screening	2 (1.5)	1 (9.1)
CTX-1/osteocalcin	1 (0.7)	1 (9.1)
Other	7 (5.4)	2 (18.2)

BMD bone mineral density, BP bisphosphonates, CTX-1 C-terminal telopeptide with type I collagen, FF fragility fracture, SD standard deviation

aT-score refers to BMD testing

Agreement

Table 2 shows raw agreement between nurses and physicians as well as the raw agreement between both physicians. Inter-rater reliability is also presented in this table. More than 97 % of referral and initiation of treatment decisions by the nurses were agreed on by either evaluator. Overall, near 95 % of all nurses’ decisions were agreed on by both evaluators («yes-yes» answers) (95 % CI [0.925 à 0.964]). There was a significant positive association between answers of the two physicians for the types of decision (p < 0.05). Both evaluators disagreed on the nurses’ clinical decisions in 5/525 cases (<1 %). Twenty two out of 525 clinical decisions were disagreed on by one of the two evaluators, mainly for non-referral of some patients (under 65 years of age with a major fracture, on hormonal therapy, low BMD in young patients) or that were recruited for a stress fracture of the foot.

Table 2

Agreement between nurses and physicians according to the type of clinical decision and inter-rater reliability regarding type of clinical decision

Agreement between	Type of decision	N	%	p Value	95 % CI
Evaluator no. 1 and nurses	Referral or not	521	99.2
	Initiation of treatment	515	98.1
Evaluator no. 2 and nurses	Referral or not	513	97.7
	Initiation of treatment	514	97.9
Evaluator no. 1 and no. 2	Referral or not	515	98.1*	<0.001
	Initiation of treatment	508	96.8*	<0.001
	Total agreement	498	94.8**	<0.001	[0.925, 0.964]**
		κ	AC1		95 % CI AC1
	Referral or not	0.368	0.980		[0.968, 0.992]
	Initiation of treatment	0.174	0.966		[0.950, 0.982]

CI confidence interval

*p ≤ 0.05, statistically significant

**p ≤ 0.05, one-proportion z test with a 95 % confidence interval, statistically significant

Our kappa values for inter-rater variability were very low (<0.370). The paradox of kappa was corrected by calculating Gwet’s AC1 coefficient where values are higher (>0.960). These results are consistent with an almost perfect level of agreement on the scale of Landis and Koch.

Management of major comorbidities and contraindications/intolerances

When looking at referred patients, three of them were referred for abnormal screening (high PTH level or a T-score lower than −5.0). Two patients were referred for very low levels of bone turnover biomarkers. Fourteen subjects were referred for contraindication to treatment or intolerance to medication. Other reasons of referral were major comorbidities.

Regarding non-referred patients, some of them had a medical diagnosis that required particular attention even if a referral was not necessary (see Fig. 3). Patients with these medical conditions were not referred to a bone specialist for one of the following reasons: (1) They were followed by a specialist before joining the FLS, (2) were prescribed an alternate anti-resorptive agent when they were contraindicated (chronic renal failure or gastric problems), or (3) dropped out before a meeting with our specialist.

Fig. 3

Distribution of non-referred patients to a specialist regarding their comorbidities

Discussion

The main objective of this study was to obtain agreement between physicians and nurses’ clinical decisions in a FLS. It was important to determine if nurses can identify a fragility fracture from a trauma fracture and inform patients about available care (first i), propose appropriate investigation in order to rule out causes of secondary osteoporosis (second i), initiate pharmacological treatment when appropriate (third i), and follow the patient (fourth i). If so, we also needed to determine whether a nurse can identify specific health conditions other than the bone fragility, which could require the intervention of a physician. It was the secondary objective of this study to assess the algorithm of care used in this program.

Our results show that the overall agreement between the nurses and both physicians was high (95 %) and significantly higher than hypothesized (90 %). Individually, the two types of clinical decisions (referral to specialist and initiation of treatment) were agreed on by each evaluator up to 97 % and more. The inter-rater reliability was also a lot higher than projected, reaching an almost perfect level of agreement according to the Landis and Koch scale [19]. Thus, the experts had a very similar management path and clinical decision process for patients with fragility fractures. When acknowledging that the physicians practice different specialities (rheumatology and internal medicine), the results confirm that the management of bone fragility is approximately the same between health professionals. These results suggest that nurses can efficiently manage a FLS. All patients with major comorbidities were adequately managed with a referral to a physician or by insuring that the patient is already followed by the appropriate health professional. Patients aged between 40 and 49 years were automatically referred to a physician because they met all the bone fragility criteria except for the cutoff age of intervention recommended by Osteoporosis Canada, which is 50 years or more. Patients with treatment failure had to be referred to a physician since alternative treatments are exceptional medications for which nurses would not have the authorization to prescribe in an order set.

Since less than 1 % of decisions were not agreed upon by both evaluators, the management algorithm was found to be usable in an FLS managed by nurses. These guidelines include not only the 3i of an FLS (identification, investigation, initiation of treatment) but also the fourth i: integration.

A high-intensity intervention model is required for the prevention of fragility fractures according to study results throughout scientific literature [11, 15]. A high-intensity model of care matches the definition of a fracture liaison service but omits the monitoring of results and follow-up of patients (fourth i) [12, 13, 24]. Many studies have demonstrated the effectiveness of such a service with a NCM as its main contributor [14, 15]. All studies with the aim to determine efficacy of a FLS listed the interventions done and measured clinical outcomes as results. All assumed that the NCM was a professional with the appropriate skills and qualifications to handle the management of fragility fracture patients. None assessed the safety and efficacy nor described the necessary training for such a professional. Furthermore, several studies used a registered nurse as the NCM [25-28], while the other half used a specialized nurse [14, 15, 29]. Thus, there was a need to define which professional should be attributed the NCM role for a proper and secure intervention.

The difference between registered and specialized nurses resides in the level of scholar graduation and the number of years of clinical experience. Depending on the country’s policies and states/provinces’ regulations, several nursing diplomas or roles exist [30]. In general, a registered nurse has a college degree and a specialized nurse has an advanced studies degree with a lot of expertise. The best-known roles of specialized nurses are the nurse practitioner (NP) and the CNS. They ensure that there is improvement in the management of patients, that nurses’ work is optimized, and to the development of functional, reliable, and effective systems [31, 32]. Moreover, an expert panel determined in 2011 the most efficient preventive approach in the management of osteoporosis. They indicated that a NCM should be the designated professional for the management of a fragility fracture system [33]. A literature review and meta-analysis gathering the results of physician substitution studies showed that a high level of skills leads to a better management [34].

In the FLS studied, a CNS works in collaboration with two clinical nurses, which ensure the first-line intervention with patients. A pattern of hierarchy was observed; the CNS stood out with her leadership and management of other nurses’ abilities. As clinical nurses would ensure the recruitment of patients, data collection, the scheduling of appointments, the requests for laboratory and radiology tests, referrals to a physician, and follow-ups with patients, the CNS would guide the nurses with their clinical decisions and help in recognizing major comorbidities to be taken care of.

This study’s main strength lies in the high number of cases or “observations” reviewed by our experts. Also, we were able to have the participation from two physicians with different specialities, which was an advantage in demonstrating the homogeneity of interventions to treat fragility fractures within health professionals. A possibility of bias exists because of the physician evaluator no. 1 who was the referral specialist consulted by six patients included in the study. However, all patients included for the evaluation by experts were attributed a number for identification in order to preserve confidentiality. This reduces the possibility of the evaluator no. 1 recognizing one of the six patients. It would also have been an option to exclude these patients of the study, this without affecting its power. Moreover, this evaluator has reviewed the guidelines used by nurses in this FLS. However, he was not part of the group of experts who created the algorithm of care. This study could not help determine if subsequent fractures could be prevented by the early intervention of nurses in a 4iFLS. Losses to follow-up and compliance to treatment are issues that could not be assessed in the present project. Longitudinal analyses are yet to come.

This study shows that nurses can efficiently and safely manage patients with fragility fractures. The implementation of FLSs (4i), such as the Lucky Bone™ program, with nurses as case managers with the help of a specialized nurse for management is feasible and could have a major impact on health care accessibility. This approach could greatly contribute on closing the care gap of the underlying osteoporosis in patients that sustained a fragility fracture.