Methodological considerations of investigating adherence to using offloading devices among people with diabetes.

Foot ulcers are a diabetic complication associated with significant morbidity, mortality, and amputation risk. Offloading devices prevent and heal foot ulcers, but adherence to using these devices is low. The reasons for nonadherence are unclear, and study results are difficult to compare due to methodological heterogeneity. This paper explores aspects of investigating adherence to using offloading devices among people with diabetes and provides recommendations for future studies, focusing on study designs, definitions of adherence, measurement methods, and conceptual frameworks. Most studies use a cross-sectional observational study design, limiting the potential to establish the temporal sequence between predictors and adherence, rule out confounding factors, and establish causality. Studies defining adherence as the length of time the device is worn have often used self-report to measure adherence, which may be unreliable. Studies using activity monitors to measure adherence have defined adherence as the number of steps taken with the device, which excludes weight-bearing activities where no steps are taken. Conceptual frameworks are not made explicit in the current quantitative research. It is concluded that future studies should use a longitudinal design with observational studies to identify patient groups prone to nonadherence and factors that influence adherence and experimental studies to evaluate interventions to improve adherence, focusing on these patient groups and factors. Furthermore, adherence should be defined in terms of relative adherence to using offloading devices during all weight-bearing activities, and objective measurement of adherence (using accelerometers and temperature monitors) should be used whenever possible. Clearly defined conceptual frameworks should guide the choice of factors to include in the study and the analysis of their interactions. By implementing these recommendations, research could provide a stronger evidence base in the future, supporting interventions to increase adherence and thereby improve outcomes for people with diabetic foot complications.

Introduction

Diabetic foot ulcers are a common and devastating complication of diabetes. The lifetime incidence of diabetic foot ulcers has been estimated to be between 19% and 34%.1 Numerous studies have shown that diabetic foot ulcers are associated with increased mortality,2 lower quality of life,3 high costs,4 and increased risk of lower limb amputation.5 Offloading devices are a central intervention to prevent and heal diabetic foot ulcers, especially plantar ulcers, which account for almost 50% of the foot ulcers seen in specialized clinics.6 Obviously, the devices can have no effect if the person does not use them, and it is well known that adherence often is low when it comes to using devices such as therapeutic footwear,7–15 cast walkers,16,17 and shoes offloading the forefoot or heel.18 Therefore, guidelines recommend the use of nonremovable devices to offload foot ulcers during the treatment period.19,20 However, it is not feasible to use nonremovable devices once the ulcer is healed, and ~40% of ulcers recur within 1 year.1 Thus, a better understanding of factors affecting adherence is urgently needed in order to better prevent ulcerations, claimed to be one of the most significant unsolved issues in the care of people affected by diabetic foot complications.21

Clinicians often ask patients about adherence when it is believed to be low. Naturally, the focus is on finding reasons for the patient being nonadherent and ways to convince the patient about the benefits of adherence. However, this is a problematic approach for understanding adherence in general. First, clinicians usually ask for reasons that work against adherence but not for reasons working for adherence, resulting in too few factors being identified as influencing adherence. Second, clinicians seldom ask adherent patients about factors affecting their adherence, that is, they overlook a potential control group with which to contrast the nonadherent patients’ answers. Thus, complaints such as the appearance of the shoes may seem to be important for nonadherence although adherent patients may be equally concerned about this.22,23 Third, patients can only give reasons that they are consciously aware of, such as the appearance and weight of the therapeutic shoes, and may not give reasons that they are less aware of, such as sensory neuropathy eliminating pain when walking on ulcerated feet without the shoes. In summary, the clinical approach to investigating adherence involves the risk of giving a simplistic understanding of adherence, in which too few factors are identified and their role in adherence is misunderstood.

Some studies24,25 have used a qualitative approach, which is useful for understanding the subjective experiences, but it suffers from weaknesses similar to the clinical approach. Some quantitative studies26–28 have investigated factors affecting adherence, but they have included several diagnoses in the same study. This makes the results more difficult to interpret because patients with different diagnoses, such as rheumatoid arthritis and diabetes, may have different views and priorities regarding footwear.29 A review from 201630 found only six quantitative studies investigating factors affecting adherence to using therapeutic shoes among people with diabetes. The authors found some evidence against using sex, diabetes duration, or ulcer history to predict adherence. The evidence for or against other factors was weak or conflicting.30 Only a few studies have been published since then. Crews et al16 found that larger and more severe ulcers, more severe neuropathy, and foot pain predicted better adherence and postural instability predicted worse adherence. Kossioris et al31 found that patients with active foot ulcers were less adherent to wearing appropriate footwear than patients without ulcers. Keukenkamp et al32 found that a motivational interviewing intervention improved adherence in the short term, but the improvement was not statistically significant and returned to baseline levels in the longer term. In general, results from studies are difficult to compare because the studies have used different study designs, defined and measured adherence in different ways, and studied different factors that could influence adherence.30 Thus, there is a need for a methodological discussion on these topics. The aims of this methodological commentary were to discuss methodological aspects of investigating adherence to using offloading devices among people with diabetes and provide recommendations for future studies. The focus was on choice of study design, definitions of adherence, methods to measure adherence, and conceptual frameworks.

Choice of study design

Two basic criteria, temporality and statistical association, are fundamental when drawing inferences about causal relationships between exposures and outcome, for example, between certain factors and adherence to using offloading devices.

Temporality means that the exposure precedes the outcome in time. If we want to test whether the belief in the efficacy of the offloading devices affects adherence to using them, we need to establish that this belief precedes adherence and not the other way around. For example, a person who does not wear his or her therapeutic shoes for esthetic reasons may rationalize his or her choice afterward by stating that the shoes were not healing the ulcer. This gives researchers the false impression that lack of belief in the shoes’ efficacy is the reason for nonadherence, when the real reason is that he or she finds the shoes unattractive. Therefore, longitudinal studies in which the time sequence of exposure and outcome can be established are preferable to cross-sectional studies. Unfortunately, most studies that assess attitudes to the offloading device and adherence are more or less cross-sectional,8,14,22,23 making it difficult to separate attitudes as reasons for nonadherence from attitudes as after-the-fact rationalizations. Causality can be especially challenging to investigate when negative patient beliefs and low adherence self-reinforce through a feedback loop, resulting in a “vicious diabetic foot cycle”.33 In these cases, repeated measurements may be needed to follow how beliefs and adherence-related behaviors develop and interact over time.

Statistical association means that there should be a dependency between measures of exposures and measures of outcome. If motivation influences adherence, we expect higher motivation to be associated with higher adherence and lower motivation to be associated with lower adherence. However, spurious correlations can sometimes be found between two variables in an analysis when both variables are correlated with a third variable, a confounder. This may explain some surprising results in the literature. For example, Breuer22 found that a higher proportion of adherent patients than nonadherent patients expected to develop ulcers whatever they do, when the opposite would make more sense. It is possible that this association was due to a confounding variable: adherent patients also reported their diabetic foot complications to be more severe, which could have been the true reason for their higher adherence.

Both observational and experimental studies can be longitudinal and thereby establish temporality, but their approaches to investigating statistical associations and ruling out confounding differ. Several observational studies have been published, where researchers measured factors believed to influence adherence and adherence level and investigated statistical associations between the factors and the level of adherence.8,13,14,16,22,23,31,34 Univariate analysis has often been used8,13,22,31,34 but is not recommended because of the risk of confounding. To counteract this risk, stratified or multivariate analyses can be used,35 and the latter has been used in some studies.14,22,30 A limitation of stratified and multivariate analyses is that all potential confounders need to be identified in advance in order to measure and include them in the analysis. In addition, observational studies are most appropriate for identifying patient groups that demonstrate low adherence and factors that influence adherence. To establish which interventions improve adherence, experimental studies are needed. In these studies, participants are randomized to two or more interventions believed to influence adherence. To the author’s knowledge, only one small experimental study has investigated the effects of an intervention (motivational interviewing) on adherence to using offloading devices.32 With randomization, both known and unknown confounders tend to be equally distributed in the intervention groups if the study population is sufficiently large, and the risk of confounding the results will be reduced.35 However, randomization is no guarantee for equal distribution of potential confounders, and thus, they are often also measured and included in a stratified or multivariate analysis to take their effects into account.

Generally speaking, observational studies should be followed by experimental studies to evaluate interventions to improve adherence, focusing on the patient groups and factors identified in the observational studies. Experimental studies can also be conducted without any preceding observational study. For example, if we know that motivational interviewing improves motivation to use therapeutic shoes, we can conduct an experiment and compare adherence levels between the intervention and control groups, as in the study by Keukenkamp et al.32 However, if the effect of motivational interviewing on motivation is uncertain, this approach can be problematic; we do not know whether a lack of effect on adherence indicates that motivational interviewing did not improve motivation, improved motivation did not improve adherence, or a combination of the two. For this reason, it is desirable that the factor believed to mediate the effect (in this case, motivation level) between the intervention (motivational interviewing) and the outcome (adherence) is measured to facilitate interpretation if the results of the experiment are negative.

Defining adherence and nonadherence

The purpose of offloading devices is to mitigate pressure on the feet when standing or walking, to prevent or heal foot ulcers. Therefore, the abstract definition of adherence in this context would be something akin to “use of the device when putting pressure on the feet”. The abstract definition is seldom made explicit in the literature, but two concrete definitions, operationalizations, prevail: device wearing time7–10,13,15,23,31,34,36,37 and number of steps taken with the device.12,14,17,32,38,39 In general, wearing time has been used to operationalize adherence when using self-report, and step count has been used to operationalize adherence when using activity monitors. Operationalizing adherence in terms of wearing time is less clinically relevant, as the goal is not that patients wear the device many days and hours per se but that they use the device when there is pressure on the feet. Operationalizing adherence in terms of step count is thus more clinically relevant but misses the fact that feet are also subject to pressure when the person is standing still. Thus, the operationalization of adherence should take all weight-bearing activities into account.

Furthermore, wearing time and number of steps can be operationalized as absolute or relative adherence. Absolute adherence refers to the wearing time or number of steps with the device, while relative adherence refers to the proportion of adherent behavior. Two people may have equal absolute adherence, for example, both using the device for 6 hours or 3,000 steps/day, but for one person, this reflects a relative adherence of 100% and for the other, this reflects a relative adherence of 75% as a result of also taking 1,000 steps or walking 2 hours/day without using the device. Thus, relative adherence is more clinically relevant to measure than absolute adherence, and to calculate it, we also need to define and measure nonadherence. In studies using activity monitor data to calculate relative adherence, the number of steps taken with the device has been divided by the total number of steps taken (with and without the device).14,16,32 In studies using self-report, researchers have either asked participants to estimate the percentage of daytime they wear their devices8,36,37 or asked them to estimate the number of days and hours they wear their devices and then calculated the relative adherence on the assumption that total daytime is 16 hours.23,31 However, the definition of nonadherence (weight-bearing activity without using the offloading device) deserves more attention; researchers may want to consider whether all nonuse of the offloading device is equally bad and should be lumped together as nonadherence. For example, using no shoes and using conventional shoes can both be classified as nonadherence, but plantar pressures are usually higher when walking barefoot.38–40 Thus, there may be a need to define and measure different forms of nonadherence, which has not been done in studies so far. In addition, some studies8,10,14 have found that adherence at home is much lower than adherence away from home, pointing toward a need to separate these two forms of adherence in studies and investigate whether different factors affect them.

Methods to measure adherence

Studies have assessed adherence using structured interviews,10,11,13,31,36,37 self-report questionnaires,7,8,15,18,23, 34,41 entries in patients’ clinical records,42 observations of what shoe type patients wear when attending the clinic,22,31 a temperature monitor in the device,9,43 a temperature monitor in the device combined with an activity monitor worn around the ankle,12,14,32,44,45 or an activity monitor on the device combined with another activity monitor worn around the waist or at the hip.16,17 Ideally, the measurement method should be valid, reliable, sensitive to change, and feasible; it should also discriminate different forms of nonadherence. Objective methods such as temperature and activity monitors generally have stronger measurement properties than subjective self-report methods such as interviews and questionnaires. When using self-report, patients may find it difficult to accurately remember their adherence level, and studies on orthotic devices for other medical conditions have shown that self-report overestimates adherence.46,47 However, using objective methods, such as temperature and activity monitors, is not without challenges.

When using a temperature monitor in the device to assess adherence, temperature recordings can sometimes be difficult to interpret. Studies in hot and cold climates, such as Italy48 and Sweden,43 pose specific challenges: high temperatures might be recorded even when the device is not worn and low temperatures might be recorded even when the device is worn, depending on the indoor and outdoor temperatures. One way to overcome this is to validate a cutoff temperature to separate use from nonuse.9 Another approach is to use two temperature monitors in the device, one close to the skin and the other further from the skin.44 Similar temperature levels would indicate that the device is not being worn, and two differ ent levels would indicate that it is being worn, regardless of whether the recorded temperatures are high or low. Both approaches, using a validated cutoff temperature and using dual temperature monitors, seem valid for use in future studies. However, temperature monitors can only assess whether the device is being worn or not; to assess to what extent the device is worn during weight-bearing physical activities, activity monitors are needed.

A drawback of the traditional activity monitor, the pedometer, is that it only counts steps. Pedometers cannot separate standing (where the feet support the full body weight) from sitting (where the feet support only a fraction of the body weight). Standing time might be important to consider because people with diabetic peripheral neuropathy can spend twice as much time standing as walking.49 However, the clinical significance of standing for ulcer prevention and healing is not yet established. On the one hand, plantar pressure when standing often exceeds 3 N/cm2 (30 kPa), needed to arrest nutritional blood flow in the skin,50 especially when barefooted.51–53 It may be speculated that because people with sensory neuropathy do not feel discomfort if blood flow is arrested, they would not shift their weight when standing to improve circulation. On the contrary, postural sway, which is believed to counteract the arrest of blood flow caused by plantar pressure,51 is increased in people with diabetic sensory neuropathy.54,55 One study56 found a negative association between standing time and ulcer healing, which lends some support to the significance of measuring standing time, which pedometers cannot do. Activity monitors in the form of accelerometers can be unreliable when it comes to separating standing from sitting,57 but some studies have successfully done this using an accelerometer incorporated in a shirt49,56,58 or attached to the thigh.57,59,60 Thus, accelerometers that can separate standing from sitting are preferable to pedometers and should preferably be used when investigating adherence and the significance of standing for ulcer prevention and healing. Two monitors to measure adherence should ideally be used: one accelerometer worn on the body to assess total weight-bearing activities and a second monitor (temperature monitor or accelerometer) attached to the offloading device, to allow assessment of the proportion of weight-bearing activities when wearing the device.

A general problem with temperature and activity monitors is that people who know that their adherence is being monitored may increase their actual adherence or use deceptive strategies to create the impression of high adherence.61 Thus, the measures may be biased and not reflect everyday adherence. To overcome this, study designs involving a deceptive element have been suggested.62 There are different degrees of deception involved: stealth monitoring, where participants neither know about nor consent to being monitored; withholding, where participants are informed retroactively that they have been monitored and are given an opportunity to withhold consent; authorized deception, where participants are informed that the study will include a deceptive element, which will be revealed after the data collection; and full disclosure, where participants are informed and give consent to being monitored before data collection.62 Some authors have used concealed monitors16 or not informed study participants about the true purpose of the monitors, for example, saying that the monitors measure temperature but not that the purpose is to assess adherence.14 However, collecting data without the participants’ knowledge, or without revealing its true purpose, could be ethically questionable, and it is not clear whether participants were debriefed afterward and given an opportunity to withdraw consent retroactively, which is recommended.61 The withholding approach is less questionable than stealth monitoring, but people may still feel that their integrity has been compromised and lose trust in researchers in the future. The authorized deception approach is less questionable, but it has not been used in studies on offloading devices. Naturally, the full disclosure approach is the least ethically questionable and could be valid if the monitors are used for a long time period during which they are not seen or felt, hopefully leading the participants to fall back into their everyday adherence pattern over time. Some temperature monitors can measure temperatures and store data for 100 days without any need to replace batteries or download data, which would have reminded the person about the monitoring.9 Unfortunately, many accelerometers do not yet have this capacity, and studies using accelerometers have typically collected data only for 7 days,12,14,17,45 although one study collected data for 35 days.16 Hopefully, future technological developments will expand the battery capacity and data storage of accelerometers, making it possible to collect data for longer time periods without interruptions. Thereby, both the methodological demands of unbiased data and the ethical requirements of informed consent could be fulfilled. In the meantime, the authorized deception approach seems to be a fruitful strategy for studies on adherence.

Conceptual frameworks

The conceptual framework chosen for the study is important for at least two reasons: first, it guides our choice of factors to study, that is, the factors that might affect adherence and second, it suggests causal mechanisms, that is, in what way the factors interact, which determines how to analyze the data. Quantitative studies on adherence to using offloading devices have so far not specified any conceptual framework, which may explain why different studies have investigated different factors that could affect adherence,30 and the rationale for choosing them is unclear. A review30 used the framework of the World Health Organization,63 categorizing factors into five dimensions: patient factors, therapy factors, condition factors, health system factors, and social and economic factors. The review concluded that most studies focus on patient, therapy, and condition factors, while factors related to the health system or patients’ social and economic circumstances are often overlooked.30 This framework could be useful for future studies, but it specifies neither how the factors interact nor how time affects adherence; theoretical and qualitative studies suggest that adherence is a dynamic process in which beliefs, values, and behaviors interact and change over time.24,33,64

Frameworks used in related fields could serve as a starting point and inspiration in future studies. For example, different models and concepts have been used to study which factors influence diabetic foot self-care practices and use of assistive technologies. The health belief model includes perceived seriousness of the health condition and perceived susceptibility to developing it, perceived benefits and barriers to engaging in healthy behavior, cues to action, and self-efficacy.65 Three out of four studies using this model found that at least one of the model’s components was associated with adherence to diabetic foot self-care.66–69 The model could thus be useful for studying adherence to using offloading devices, and one study suggests that perceived benefits of therapeutic shoes are associated with a higher adherence.23 In the common-sense model of illness behavior, patients give meaning to their diagnosis and symptoms by constructing a mental model based on their lay knowledge, experiences, and significant others, guiding them in what actions to take.70 Three studies found that components of the model are associated with adherence to diabetic foot self-care.71–73 One instrument, the Patient Interpretation of Neuropathy questionnaire, was developed to address patients’ common-sense understanding of diabetic neuropathy and foot ulcers,74 and one study using this questionnaire75 found an association between patients’ misperceptions of their condition and potentially damaging self-care behaviors. The locus of control concept denotes to what extent people believe that outcomes of events are the results of their own actions or forces beyond their control.76 This concept has been associated with diabetic foot self-care,77 and it has been speculated that it can affect adherence to using offloading devices.33 A number of models have been developed to understand what factors influence the use of assistive technology. For example, one qualitative study78 used a model by Lenker and Paquet79 to understand what factors influence the use of orthopedic shoes. However, some caution is warranted when applying models developed for assistive technology. Most assistive technologies aim to facilitate activities and participation in social life, which provides a positive incentive to use them. In contrast, offloading devices aim to prevent or treat diabetic foot complications but may at the same time hamper activities and participation (due to negative effects on gait and unaesthetic devices causing social stigma),24,64,80,81 providing a negative incentive to use them. Thus, the factors at play may differ between offloading devices and other assistive technologies.

Discussion

The aims of this methodological commentary were to discuss aspects of investigating adherence to using offloading devices among people with diabetes and provide recommendations for future studies. To date, studies have mainly used a cross-sectional, observational study design; defined adherence as device wearing time or number of steps taken with the device; measured adherence with questionnaires or monitors; and not used any explicit conceptual framework. In future, more longitudinal studies are recommended; there should be observational studies to identify patient groups prone to nonadherence and factors that influence adherence, and experimental studies should be used to evaluate interventions to improve adherence, focusing on these patient groups and factors. It is further recommended that adherence should be defined in terms of relative adherence to using offloading devices during all weight-bearing activities. Researchers should use objective methods (accelerometers and temperature monitors) to measure adherence whenever possible. Furthermore, a clearly defined conceptual framework should be adopted before the study is initiated, providing a rationale for what factors to study and how to analyze their interactions with each other and with adherence (Table 1).

Table 1

Summary of dominating approaches in current research and recommendations for future studies

Aspect	Dominating approaches in current research	Recommendations for future studies
Study designs	Cross-sectional, observational	Use longitudinal study designs with observational studies to identify nonadherent patient groups and factors affecting adherence and experimental studies to evaluate interventions to improve adherence
Definitions of adherence	Wearing time7–10,13,15,23,31,34,36,37 or number of steps taken with the device12,14,17,32,44,45	Define adherence as device use during all weight-bearing activities
Methods to measure adherence	Interviews,10,11,13,31,36,37 questionnaires,7,8,15,18,23,34,41 temperature monitors,9,12,14,43–45 pedometers,12,14,17,32,44,45 and accelerometers16	Use objective methods (accelerometers and temperature monitors) whenever possible. Validated questionnaires can be used for surveys
Conceptual frameworks	Frameworks not defined and focus on a narrow range of factors (eg, patient-, therapy-, and condition-related factors)	Use clearly defined frameworks (eg, the health belief model or the common-sense model of illness behavior) and include a wider range of factors (eg, social and economic circumstances, health system-related factors, locus of control, self-efficacy, and a time/process perspective)

In reality, these recommendations can sometimes conflict or not be practically feasible. For instance, although it would be ideal to use monitors to measure both adherence and non-adherence, it may not be feasible to put a monitor in every pair of shoes (therapeutic and conventional) that a person owns. Thus, a tradeoff may be needed, such that adherence is measured with a monitor in the offloading device, but self-report is used to distinguish different forms of nonadherence, for example, to separate wearing conventional shoes from standing and walking without shoes. Furthermore, to increase the generalizability of the results, researchers may want to include large groups of participants and then rely on questionnaires to assess adherence, although objective measurement methods are usually preferable. Thus, self-report is sometimes the most feasible alternative to measure adherence. Studies are needed to validate questionnaires that assess adherence to using offloading devices. When it comes to study design, experimental studies are more effective to counteract confounding than observational studies. However, several factors of interest, such as foot deformity and ulcer history, cannot be allocated to participants experimentally. Thus, observational studies are the only option for investigating such factors.

In future work with exploring and improving adherence to using offloading devices, researchers could benefit from methods and findings from other research fields facing similar challenges. For example, many parallels can be drawn between using offloading devices to prevent and heal diabetic foot ulcers and orthotic treatment of adolescent idiopathic scoliosis, as both interventions demand high- and long-term adherence; in both cases, the medical benefits of using the devices are uncertain and distant in time, in contrast with the disadvantages in terms of a negative impact on esthetics, clothing, function, activities, and social life, which are immediate.8,24,64,80,82–84 Furthermore, in both fields, electronic adherence monitoring has been suggested not only as a method to study adherence but as an intervention to improve adherence, although ethical concerns have been raised about this approach.48,85,86

Hopefully, this methodological commentary will contribute to discussions, reflections, and studies of high quality investigating factors that affect adherence to using offloading devices. In this way, patients in need of special support can be identified and effective interventions can be developed to increase adherence and thereby improve the outcomes for people with diabetic foot complications. Although this article focuses on adherence to using offloading devices among people with diabetes, the principles discussed may have a wider applicability. Thus, they can provide input to other research fields investigating adherence to using other forms of medical devices.

Conclusion

It is recommended that future studies use a longitudinal design with observational studies to identify patient groups prone to nonadherence and factors that influence adherence and experimental studies to evaluate interventions to improve adherence, addressing these patient groups and factors. Adherence should be defined in terms of relative adherence to using offloading devices during all weight-bearing activities, and objective measurement of adherence (using accelerometers and temperature monitors) should be used whenever possible. Clearly defined conceptual frameworks should guide the choice of factors to include in the study and the analysis of their interactions. Finally, a wider range of factors should be included in future studies.