Voicing Individual Concerns for Engagement in Hemodialysis (VOICE-HD): A Mixed Method, Randomized Pilot Trial of Digital Health in Dialysis Care Delivery.

BACKGROUND: People receiving in-center hemodialysis (HD) have prioritized the need for more individualized health information and better communication with nephrologists. The most common setting for patient-nephrologist interactions is during the HD treatment, which is a time pressured setting that lacks privacy.
OBJECTIVE: To facilitate effective communication in the hemodialysis (HD) unit, we evaluated the usability of a web application (web app) from both the patient and physician perspective. The main aim of the web app was to support patients in prioritizing their dialysis concerns outside of the clinical HD encounter.
DESIGN: Mixed method, parallel arm, multi-site, pilot randomized controlled trial.
SETTING: Two outpatient Canadian HD centers. PARTICIPANTS: Adult patients receiving in-center HD and their attending nephrologists.
METHODS: Patients were randomized to either a web application or an active control (paper form) for logging concerns to be addressed at weekly encounters with the nephrologist over 8 weeks. Topics included: HD treatment, symptoms, modality, and medications. The primary outcome was usability, defined as effectiveness (engagement with the tool, frequency of submitted concerns, whether the concern was satisfactorily addressed) and satisfaction with the tool using a priori thresholds and explored in interviews with patients and nephrologists.
RESULTS: 77 patients (30 women, median age 61, interquartile range [53,67], median 2 years [1,4] on dialysis) and 19 nephrologists (4 women, median age 46 [36,65]) were enrolled. Patient use of a digital device at baseline was low (20%). Engagement with the tool was 70% (web app) and 100% (paper) with a lower proportion of patients in the web app group submitting at least one concern over 8 weeks compared to the paper form group: 56.7% vs 87.9%. Weekly concerns were satisfactorily addressed in both groups and ≥70% of patients would continue to use the tools. For patients, both tools promoted preparation and participation in the encounter; however, only the web app facilitated greater privacy in relaying concerns. For most nephrologists, the tools were disruptive to their workflow and were perceived as unnecessary given existing processes and familiarity with patients. For future versions of the app, patients suggested more features to facilitate self-management and nephrologists suggested integration with health databases and multidisciplinary teams. LIMITATIONS: Tertiary setting may limit generalizability.
CONCLUSIONS: Both tools promoted fundamental components of self-management; however, patients in the paper form group submitted concerns more often and this tool was easier to remember to use. Although modifications would likely enhance web app usability, successful future adoption is limited by physician acceptance.Trial registration ClinicalTrials.gov NCT03605875.

What was known before

Digital health can be used to facilitate communication between patients and physicians; however, the usability and acceptability of digital health in the context of HD care has not been explored.

What this adds

From the patient perspective, both tools supported aspects of self-management and were valued, though the paper form was used more often to prepare for the encounter. For the web app, patients desired additional features to support self-management and for the physician to acknowledge their concern, either through the web app or in the clinical encounter. For physicians, adoption of the web app was influenced as much by the perceived negative influence on efficiency and workflow as it was by a culture that does not prioritize patient centered care.

Introduction

There is growing interest in improving the delivery of patient-centered care, defined as care that is respectful and responsive to individual patient preferences. Effective communication is a cornerstone of patient-centered care as it provides the opportunity for people to express their perspectives, participate in self-management and decision-making, and to develop a physician–patient partnership. Effective communication between physicians and patients has also been associated with higher patient satisfaction with care and improved health outcomes.

People receiving in-center hemodialysis (HD) desire better communication with their physicians. Areas of particular concern include the amount of information nephrologists share with patients and how this information is delivered.[4,5] In Canada and the United States, it is common for interactions between the patient and his or her nephrologist to occur during HD treatment. This prevailing model of HD care delivery (“walk rounds”) is a potential barrier to quality patient-physician interactions for several reasons. First, interactions are often time-pressured, limiting the discussion to immediate concerns. Second, patients may minimize their concerns if symptoms occur outside of HD or forget to raise them when the physicians arrive and presents their agenda. Finally, lack of privacy is a potential barrier to present the discussion of sensitive issues.

Digital health broadly refers to the use of electronic communication tools, services, and processes to deliver health care and has the potential to improve aspects of healthcare care delivery, such as facilitating preparation for health encounters. However, the usability and acceptability of digital health in the context of HD care has not been explored. To address this knowledge gap, the aim of this pilot study was to develop and test the usability of a web application (web app) to support patients in prioritizing their dialysis concerns outside of the clinical HD encounter. The rationale for this study was directly informed by patient research priorities from the Can-SOLVE CKD Network-supported Triple I project, a multi-center initiative aimed at re-shaping HD care. Specifically, evaluating innovative methods to improve the delivery of individualized health information was a key research priority theme.

Methods

This was a mixed method, multi-center, parallel randomized controlled pilot trial (NCT03605875). Due to the nature of the intervention, participants and study staff were not blinded. The study was conducted in outpatient HD units at tertiary care centers in Edmonton, Alberta and Winnipeg, Manitoba, Canada. In Edmonton, HD care was delivered in a shared model (nephrologists rotate through the HD unit and “share” the care of all patients) and a longitudinal model (the nephrologist cares for specific HD patients over time) and as a shared model in Winnipeg. The process for collecting patient concerns for the rounding nephrologist was similar at all sites with the charge nurse documenting concerns at the start of the shift on the doctor’s board. Physicians typically reviewed concerns at the start of the shift and rounded independently.

Nephrologists were eligible if they were willing to use either tools on rounds, conducted the encounter during HD, and rounded at least once a week for a minimum of 4 weeks. Patients were recruited from participating nephrologists’ shifts and were eligible if they were ≥18 years old, receiving in center HD at least thrice weekly, had no planned shift or modality change within the next year, and were medically stable. If a patient was unable to use either tool, caregivers of patients could participate on their behalf. All participants provided informed consent. Participants were randomized 1:1 to the intervention (web-app) or control (paper form) using permuted blocks of 4 and 6. The randomization sequence was computer generated using Stata/MP 15.1 (www.stata.com); allocation was concealed by web-based central randomization using The Research Electronic Data Capture System (REDCap 8.8.2 ©2018 Vanderbilt University). Dialysis unit staff and participants were counseled that for urgent concerns, communication should occur directly with the health care team, as per usual care. The study was approved by research ethics boards at the Universities of Alberta and Manitoba (Pro00076483; HS21472 [H2018:033]).

Intervention

The aim was to design a tool that would promote discussion on common hemodialysis-related concerns in a user-friendly format. Design elements for the older user were included, such as minimizing typing, scrolling and using larger font. Design of the web app content is shown in Figure 1 and examples of the Web App interface are shown in Supplemental Appendix 1. Web app participants and nephrologists received an orientation session and written instructions on how to navigate the web app. The web app was used weekly over the 8-week study period on a designated rounding day and patients were limited to submitting 2 concerns per week. Patients could use the web app at any time but were encouraged to log concerns outside of dialysis time and to bring their device to HD on the designated day. The day prior to the encounter, patients were emailed a system-generated reminder to log their concern. For patients without access, a tablet was provided in the waiting room prior to initiation of HD. To evaluate willingness to engage with the tool independent of having specific concerns, patients were instructed to select “no concerns” if they had none. Once a concern was submitted, the nephrologist could view it in the web app immediately or on the designated rounding day.

Figure 1.

Web application content development.

Active Control

To determine whether the web-based format had utility beyond that of paper, we used a structured paper form as the comparator. The paper form group recorded their weekly concerns on a 6-page form that was distributed on a weekly basis and contained the same categories as the web app. Similar to the web app, patients were asked to log no more than 2 concerns per week, encouraged to use the tool outside of dialysis time, to indicate if they had “no concerns” that week if they had none, and to bring the form to the weekly round on the rounding day. Patients were asked to sign the form to indicate that they had reviewed it prior to the encounter. Patients shared the concerns with nephrologists when they rounded but the form was not viewed by the nephrologist prior to the encounter.

Outcome Measures

Usability

Usability was defined a priori as effectiveness (engagement with the tool, frequency of submitted concerns, the outcome of the concern, that is, whether the concern was satisfactorily addressed; Table 1) and satisfaction with the tool. Engagement with the tool reflected participants’ interest in reviewing the content of the tool in the absence of a weekly concern and was tabulated as the proportion of patients who logged in without a concern (web app) or who returned a signed paper form without a concern (active control). Satisfaction was ranked on a 5-point Likert scale and defined as ≥70% of patients agreeing or strongly agreeing with the survey statement. We explored differences in satisfaction between groups and tabulated the proportion of concerns labeled as private and the login frequency of nephrologists.

Table 1.

Outcomes and Usability Metrics for Effectiveness.

Usability metric	Usability outcome	Web app(N = 30) a	Paper(N = 35) a
Engagement with the tool	≥70% of patients engaging with the tool at least once over 8 weeks	21 (70.0)	33 (100.0)
Number of submitted concerns	≥70% of patients submitting at least one concern over 8 weeks	17 (56.7)	29 (87.9)
Patient-weeks with an evaluated encounter		44/237	89/255
Number of patient- weeks with at least one concern		16	49
Outcome of the interaction	≥70% of patient weeks with concerns satisfactorily addressed
	Satisfactorily addressed	14 (87.5)	47 (95.9)
	My concern was addressed by the nephrologist	13 (81.3)	41 (83.7)
	Plan to address the concern with a different health provider	2 (12.5)	1 (2.0)
	Plan made with the nephrologist to help address the issue	0 (0)	8 (16.3)
	Unsatisfactorily addressed	2 (12.5)	2 (4.1)
	I did not speak with the nephrologist today	2 (12.5)	0 (0)
	My concern(s) was not addressed by the nephrologist	0 (0)	2 (4.1)
	Other usability outcomes
	Number of concerns submitted overall	63	298
	Number of concerns labeled as private	6 (9.5)	13 (4.4)

Data collected after baseline.

Quality of the Communication

As a secondary aim, we explored patients’ satisfaction with the quality of communication with the nephrologist within and between groups using the Communication Assessment Tool (CAT-14). The CAT uses 14 items scored on a 5-point response scale, ranging from 1 = poor to 5 = excellent to score physicians’ interpersonal and communication skills. Results were categorized as the proportion reporting the interaction as very good/excellent (4-5) vs good/fair (<4).

Qualitative Data Collection

To better understand the factors that influenced usability, all participants were invited to participate in a semi-structured interview at study completion (Supplemental Appendix 2). Our methodological approach was Interpretive Description. Interpretive description was developed for answering questions in health care, where common patterns from a range of individual experiences are explained in the relevant social context and used to inform recommendations for clinical practice. All interviews were conducted by the 2 site study coordinators and occurred either face to face or by telephone. All interviews were audio recorded and transcribed verbatim. S.T. verified the transcripts with the audio recordings.

Statistical Analyses

Quantitative analyses were completed in Stata/MP 15.1 (www.stata.com). The primary analysis followed an intention-to-treat approach. Per protocol results were also generated. Descriptive statistics were reported as counts and percentages, or medians and interquartile ranges (IQR) or ranges, as appropriate. Differences in communication between groups was assessed using unadjusted logistic regression. Paired differences in communication between time points within groups was assessed using McNemar’s test. P <.05 was statistically significant. Differences in usability parameters between groups were assessed using the χ2 test. No sample size calculation was performed due to the pilot nature of this trial, nor were any interim analyses planned due to the short duration of the study.

Qualitative Analysis

S.T. independently coded the interviews using a broad–based coding scheme (open coding).

The codes were revised and reviewed for each individual interview and grouped into common themes (S.T., K.S.M.), which were compared across interviews, first among patient participants then among nephrologists and revised further with the study team, which included nephrologists and a patient partner. We used established strategies for ensuring rigor in qualitative research including confirmability of the results through an audit trail with and credibility through reflexivity, which included discussion among members of the research team in relation to their roles as nephrologists and patients.

Results

This trial is reported according to the Consolidated Standards of Reporting Trials (CONSORT) guidelines. All participants (nephrologists and patients) were recruited from February 2018 to September 2018.

Participant Flow

All nephrologists (n = 19) approached agreed to participate; 16 (84.2%) participated in interviews. Of the 356 patients screened for eligibility, 98 were ineligible and 181 (51%) declined participation (Figure 2). A total of 77 patients were randomized and 59 finished the 8-week study (web app N = 28; paper N = 31). There were 11 withdrawals in the web app group vs 7 in the paper control. Forty-one patients (69.5%) participated in interviews.

Figure 2.

Participant flow diagram.

Participant Characteristics

Nephrologists were predominantly male (78%) and 50% were White. Median years in practice was 15 (interquartile range [IQR]: 5, 3-32). Baseline characteristics of patients are shown in Table 2. The median age of patient participants was 61 ([IQR]: 53, 67). Median time on HD was 2 years (IQR: 1,4). Overall, 19.7% of patients did not use a digital device (computer, smartphone or tablet) with lower use among those in the paper group; 89% of patients had internet access.

Table 2.

Baseline Characteristics of Patients.

Characteristic	All	Web-App	Paper
N	77	39 (50.7)	38 (49.4)
Age, years [interquartile range]	61 [53,67]	57 [48,66]	64 [54,68]
Female	30 (41.1)	13 (37.1)	17 (44.7)
White	45 (58.4)	22 (56.4)	23 (60.5)
Post-secondary education	47 (65.3)	26 (76.5)	21 (55.3)
Employed	13 (17.8)	10 (28.6)	3 (7.9)
Cause of end-stage renal disease
Diabetes	29 (37.7)	15 (38.5)	14 (36.8)
Hypertension	18 (23.4)	12 (30.8)	6 (15.8)
Glomerulonephritis	12 (15.6)	4 (10.3)	8 (21.1)
Polycystic kidney disease	3 (3.9)	1 (2.6)	2 (5.3)
Other	13 (16.9)	5 (12.8)	8 (21.1)
Time on hemodialysis, y	2 [1,4]	2 [1,6]	2 [1,4]
Comorbidities
Obesity	27 (36.5)	12 (32.4)	15 (40.5)
Cardiovascular disease	72 (96.0)	35 (94.6)	37 (97.4)
Diabetes	41 (54.7)	20 (54.1)	21 (55.3)
Chronic lung disease	16 (20.8)	5 (12.8)	11 (28.9)
Psychiatric illness	21 (28.4)	14 (38.9)	7 (18.4)
Smoking	30 (40.5)	14 (38.9)	16 (42.1)
Substance misuse	8 (10.8)	6 (16.7)	2 (5.3)
Social media use	44 (62.0)	22 (64.7)	22 (59.5)
Digital devices
Computer	46 (60.5)	26 (68.4)	20 (52.6)
Smartphone	39 (51.3)	22 (57.9)	17 (44.7)
Tablet	31 (40.8)	18 (47.4)	13 (34.2)
None of above	15 (19.7)	5 (13.2)	10 (26.3)
Internet access	63 (88.7)	30 (88.2)	33 (89.2)
Internet use frequency
Daily	44 (57.1)	22 (56.4)	22 (57.9)
Several times a week	9 (11.7)	5 (12.8)	4 (10.5)
Once a week	1 (1.3)	1 (2.6)	0 (0.0)
Several times a month	6 (7.8)	3 (7.7)	3 (7.9)
Never	12 (15.6)	4 (10.3)	8 (21.1)

Note. N (%) or Median (interquartile range).

Outcomes usability

Effectiveness metrics are shown in Table 1. Twenty-one of 30 patients (70%) in the web app group and 100% of patients in the paper group engaged with the tool at least once. A lower proportion of patients in the web app group submitted at least one concern compared to the paper form group: 56.7% vs 87.9% over the study period. Of the patient weeks with an evaluation of the encounter, the concern was satisfactorily addressed in 87.5% and 95.9% of encounters for the web app and paper, respectively. The number of concerns labeled as “private” was comparable between groups. The median login frequency per nephrologists over 8 weeks was 5.25 (IQR: 2-7.5).

The types of concerns by group is shown in Figure 3. The most common concerns in both groups were related to symptoms, followed by those related to HD treatment. A higher proportion of concerns were classified as “Other” in the web app group; most of which were related to one of the pre-defined categories (transplant status, symptoms, medication; Supplementary Appendix 3).

Figure 3.

Types of concerns by group.

Tool satisfaction

Both groups were highly satisfied with the tools in all domains with the exception of finding it easy to remember to bring either tool to the weekly round (web app 55%, paper 68%; Figure 4). Participants in the paper group tended to find it easier to remember to use the tool weekly (web app 50%, paper 76%; P = .051). The majority of participants were interested in continuing to use either tool.

Figure 4.

Satisfaction with tool usability.

Quality of the communication (CAT-15)

Within each group, there was no change over the study in satisfaction with the quality of the nephrologists’ communication (Table 3). Between groups, web app use was associated with a lower frequency of being able to talk without interruptions from the nephrologist (73% vs 97%; P = .04). There was also a trend toward higher satisfaction with the information provided by the nephrologist in the paper group (77% vs 97%; P = .06).

Table 3.

Proportion Ranking Excellent or Very Good vs Good, Fair, or Poor on the Communication Assessment Tool-14 (CAT-14) Within and Between Groups.

Characteristic	Timepoint	Web-AppN (%)	PaperN (%)	Logistic P-value a
Doctor greeted me in a way that made me feel comfortable	Baseline	25 (92.6)	29 (90.6)
	Week 8	19 (86.4)	28 (96.6)	.21
McNemar b	P	1.00	1.00
Doctor treated me with respect	Baseline	25 (92.6)	30 (90.9)
	Week 8	19 (86.4)	29 (100.0)	-
McNemar	P	1.00	.50
Doctor showed interest in my ideas about my health	Baseline	24 (88.9)	28 (87.5)
	Week 8	18 (81.8)	25 (89.3)	.46
McNemar	P	1.00	1.00
Doctor understood my main health concerns	Baseline	24 (88.9)	29 (90.6)
	Week 8	18 (81.8)	28 (96.6)	.11
McNemar	P	1.00	1.00
Doctor paid attention to me	Baseline	25 (92.6)	29 (90.6)
	Week 8	17 (77.3)	26 (89.7)	.24
McNemar	P	.25	1.00
Doctor let me talk without interruptions	Baseline	25 (92.6)	29 (90.6)
	Week 8	16 (72.7)	28 (96.6)	.04
McNemar	P	.13	1.00
Dctor gave me as much information as I wanted	Baseline	24 (88.9)	29 (87.9)
	Week 8	17 (77.3)	28 (96.6)	.06
McNemar	P	.50	1.00
Doctor talked in terms I could understand	Baseline	27 (100.0)	30 (90.9)
	Week 8	20 (90.9)	28 (96.6)	.41
McNemar	P	.50	1.00
Doctor checked to be sure I understood everything	Baseline	24 (88.9)	28 (84.8)
	Week 8	18 (81.8)	27 (93.1)	.23
McNemar	P	1.00	.50
Doctor encouraged me to ask questions	Baseline	24 (88.9)	28 (84.8)
	Week 8	17 (77.3)	25 (89.3)	.26
McNemar	P	.63	1.00
Doctor involved me in decisions as much as I wanted	Baseline	23 (85.2)	30 (90.9)
	Week 8	17 (77.3)	26 (92.9)	.13
McNemar	P	1.00	1.00
Doctor discussed next steps, including any follow-up plans	Baseline	24 (88.9)	27 (81.8)
	Week 8	17 (77.3)	25 (89.3)	.26
McNemar	P	.63	.63
Doctor showed care and concern	Baseline	24 (88.9)	29 (90.6)
	Week 8	17 (77.3)	27 (93.1)	.12
McNemar	P	.63	1.00
Doctor spent the right amount of time with me	Baseline	22 (81.5)	27 (81.8)
	Week 8	17 (77.3)	25 (89.3)	.26
McNemar	P	1.00	1.00

Note. Odds ratio not calculated for values of zero.

Between group differences.

Within group differences.

Qualitative Results-Themes and Subthemes

Three main themes explained usability: influence on the encounter, contextual factors influencing uptake, and the user experience. Corresponding subthemes and exemplar quotes are shown in Table 4.

Table 4.

Exemplar Quotes From Patients and Nephrologists.

Theme	Subtheme and quote
Influence on the encounter	Preparation Patients-web app • “[I liked] the opportunity to explain symptoms or issues . . . they’re in a fairly big hurry trying to get through . . . ” • “There’s some people who cannot just simply express themselves well when they are in front of the doctor. Sometimes they have a tendency to just prioritize what is the most important information they said because a doctor, they don’t normally hang out with you that long. In those cases, online communication is pretty good because you can express yourself well..” • “Well, like when it came to the fact that I was uh if I’m at home and I notice something that I forgot to ask the doctor while he was in, then I was able to send it to him and then he would get a chance to read it. So, I found it very beneficial for me, because I have memory issues.” • “What’s nice is it’s easy – it was easy to use. The only – and the good thing was, it does register what your concerns are and you have a copy of it. Type of thing. So from that standpoint, it’s good. Your concerns, I don’t think, they can’t get lost type of thing.” • “Yeah, sure. Yeah. Because I do have a concern actually whether I’m on the transplant list or not now, so uh I didn’t even realize that this doctor would know that..As it is now, I don’t even know what to ask the doctor, because I’m not sure exactly where his work begins when another Nephrologist starts. Because there’s so many different people . . . ”
	Patients-paper • “Yes. I think it is easier. Yeah. I think it’s a way easier and sometimes I think when we talk, like doctor might not really know what I want to ask, so I think it’s better write down first.” • “[caregiver]The questions were there. It guided you the right way plus the fact we had the paper allowed us to if we had a question and it wasn’t a dialysis day, we could write it down so we wouldn’t forget it.” [Patient] I like that idea because I am such a slow person, okay? And I enjoy that.” • “Yes, every week. I didn’t necessarily have something for the doctor every week. But at least you reviewed all of the – all the pages dealt with the different series of questions, so it was thorough that way and you could go over all the pages to make sure that you covered everything, in advance.” • “Mmmm. No, I think it’s [paper forms] a good idea. It increases communication and allows you to consider what your situation more frequently, so I think it’s a good thing.” • “And again, it also kind of reminds you to ask certain questions because when you don’t have anything in front of you, it’s kind of trying to regurgitate all this stuff you’re trying to remember and sometimes you forget stuff and sometimes you don’t even know that you can even discuss certain things with the doctor, so there are things on there like, kidney treatment or treatment in general, and other stuff you can talk to the doctor about that I wasn’t aware of you could even do so, it’s [the form] kind of an eye opener as well. From the patient’s standpoint.” • “Yeah, because that [using the forms] let me know more or less how I could talk to him. Like – because there’s a lot of stuff I sort of ignore but reading those, then I know I can ask him or whatever.” • “I found [using the paper forms] very helpful, actually. And I got more information than usual.”
	Nephrologists • “But it also, I guess, changed my interaction with how – when I saw – when there was a patient who had a problem, that kind of became a focus of “I’m here to answer this question” or to address it. And you might do so and you – it allowed me to think about things before actually talking to the patient and some were a miscommunication issue. Which might – I mean, it might have gone the same way, but I just found it useful to know the question ahead of time. And sometimes you could address the – so sometimes if you went to the patient and asked them what their problem was and it would take them a while to come up with the answer. And then you’d get the question but then you’d need to do further background work to figure out what the answer would be or what the next step should be. This way, you had it ahead of time and you could check something on the computer or do whatever and then you could resolve it right then and there. So yeah.” • “Useless. Useless as you can get. It [the web app] makes uh takes a lot of time and patients don’t get it at all. They just don’t know how to use it . . . They did – they don’t do it. Period . . . One of the patient’s phone fell through. The other was extremely frustrated because each time she had problems to log in . . . and the other one was fine but he never voiced a concern on the web app and when I was rounding, there was tons of concerns.” • “So, the ones that were on the web app, they are not web app people. They are not computer people. If I had maybe younger patients who have higher education level and more money to use these devices, maybe that would be easier. Right? But the population that I have, they are people – they are simple people and I don’t think they have enough knowledge or resources to be proficient in the web app. At least – I can give you an example. One of them had a phone and the phone was broken the majority of times so he couldn’t even log in, right?” • “I don’t know. I didn’t really see the value in the paper form for sure. The web app? Sure, that would be handy, but I just – I don’t know. Patients didn’t seem to find any value in it, so . . . ” • “The thought behind it was that the patients would enter this data before they came. Some of them did it literally a few minutes before they were hooked on or something like that. I thought, because their concerns were – an hour ago I was not feeling well, or something like that. Or “I was not feeling well this morning” or “I don’t want to do dialysis today” so . . . It’s – I don’t understand if that is what the aim of the web app is. Because the aim of the web app was to facilitate concerns which are ongoing to not be addressed. These are too – these are too small or too current . . . For the web app to change anything.”
	Efficiency Patients (web app only) • “Umm, I think it just speeds up the uh, like speeds up the interaction, umm, you know, knowing when the doctor comes to see you he already knows your concern.” • “He was – it’s quicker for him to respond to my questions because he already knows what they are. So he’s given time to read over and either diagnose or switch medications. Whatever is necessary. And it probably takes a lot of stress off of the doctor, as well. You know, like when it comes to questions and stuff like that, he doesn’t have to remember so much because if he reads it, then he troubleshoots it then and then when he comes in here, we talk about it, then we troubleshoot it further, if needed. So, I found that it was very useful in those ways.” • “Definitely. In a huge way. As soon as um as soon as the doctor came in, he knew immediately why he was stopping in to see me, which I really, really liked, and we dealt with it and it was a done deal. Life was great. I loved it. I thought it was fantastic. Yes.” • “As I said to you before, I wish this was set in stone right across the board for all medical staff. I thought it was wonderful. I would love nothing more than to see this with the – my G.P., with my cardiologist, with every other doctor. I find it saves a lot of time . . . ” • “It was easy to use. It was fine. It was redundant because the charge nurse still asks if I have anything for the doctor and I never really knew if the doctor read my concerns and actually many times, I saw the doctor pull up the app and read my concerns standing next to me. So I think it’s redundant and didn’t really make communicating any easier. I liked the idea of it, that they would already know what the issue was coming in that day, and being prepared for it in some way.”
	Nephrologists • “It’s [the web app] time consuming; you have to log in, the devices are not working, it takes time to load stuff. During that time, I could have learned the patient’s issue immediately. Right? While rounding on the patient and asking the patient directly, what do you need? Right? I don’t want to spend 10 minutes to log in and stuff because I can directly help people during these 10 minutes.” • “ . . . Now, the downside to that [directing concerns to the physician] is, there are lots of issues that are triaged by nurses that are appropriately triaged by nurses that as a Nephrologist you don’t ever have to hear about. But the nurses tell people, you know, “Look. You really need to go see your family doctor about that.” Or, “Your toothache? I’m sorry, that’s not something your Nephrologist can help you with.” Or, you know, this x, y, or z. You know. I don’t know. This falls under the category of unintended consequences then, too. There is a value to having an experienced charge nurse appropriately triage issues that are or are not relevant. And an experienced charge nurse can do that very well.” • “Actually, I think um I think the paper form was a real hindrance because sometimes the patients would feel that they write it on the paper and then so they don’t have to tell the charge nurse that they want to talk to me. And that actually makes things twice as hard. I think the paper is not very useful and in terms of to help change the way I interact with the patient no, because usually, either way, I know ahead of time, either from the charge nurse or from the app what the patient wanted. The paper actually made it more work because then I had to go and seek it out.” • “I just had to go more often to the patient, just because they were in the study . . . And every time you go to a patient, they would bring up concerns which were not recorded.” • “ . . . Currently, it’s [communication] all fragmented. That’s why having an extra system is sort of helpful but not really kind of thing. I think if it’s all linked together and if the patients have a concern, it’s actually recorded there..”
	Personalizing the encounter Patients-Web app • “And it was more like, it was personal for you, when they showed you how to type it out and you know, even the doctor would know what my issue was and then talk to me about it, instead of having him come to me and tell me my issue . . . ” • “Ahh yeah. I liked the fact that I was involved in it, that was very good, and I think if I had more issues, it would become even more helpful.” • “I found it useful. I got to – I got results from the questions I asked and all-in-all, I think it’s something that should be out there all the time, to be honest.” • “ . . . I like the privacy that I’m getting because I don’t have to discuss it with multiple people. I want this in effect immediately.”
	Patients-Paper • “Um I liked the fact that you got to explain something if he would have the chance to look at it. The nurse condenses it, I’m sure, make it fit in her little space on her sheet, whereas this way you got to expand on what you needed to say.” • “I just found that he spent quite a bit of time with me rather than going on to the next patient. So, I liked that . . . He also noticed when I had a good idea and he would um agree with it.”
	Nephrologists • “I found them [web app and paper] pretty clear and easy to use. I guess my question would be – is how do patients feel? Like because really, it’s a mechanism for them to address their concerns to me. I found that straight forward from a receiving end. What I would know less about if it was a reasonable form for the patients if they got things across clearly? Yes, there was a fair amount on that paper form for them to look at, so I’m not sure how they feel about that. I mean, I found it you can kind of just really quickly skim through it as the rounding physician. I don’t know what they thought of it, but . . . • “ . . . sometimes it’s helpful and hear from the patient’s perspective rather than the charge nurse telling me what the problem is. Yeah, that would be sort of the only thing that would be a real good part of this.” • “No, I was expecting maybe there might be some super-confidential questions they ask me. They didn’t. But that doesn’t mean anything because maybe at that time, that month, they didn’t have that issue. So, I can’t say. I can’t rule out the fact that in this way, maybe we get more confidential or personal questions. I don’t know. But there wasn’t any.” • “Right. So, there are trade-offs to – to having the nursing staff be involved in screening the concerns. Right? And it happens all the time that patients say, “You know, look. I have something personal” you know, and where the nurse says, “Yeah, Mr. x or y wants to talk to you. They wouldn’t tell me what it was. They said it was, you know, they just needed to talk to you.” And then it’s usually something that, you know, like they just want to keep private and then that’s fine. That happens all the time. I mean, people make that happen. Patients make that happen. I suppose, you know, we’d be missing a small proportion of people who don’t feel comfortable empowering themselves to tell the nurse, “I need to talk to the doctor and no, I’m not going to tell you what it is.” Then that would be – and then the app would make that more anonymous if that’s the case. Do I think that’s a big population? No. Do I really think that’s a big problem? No.”
Contextual factors influencing adoption	I already had the doctor coming around Patients (web app only) • “It [the web app] was just one more thing to remember to do. But again, it’s unrealistic, depending on where you’re planning to use it. In a setting like this where the doctors make rounds, my goodness, you know, it’s just one more thing that they have to do that you wouldn’t have to do normally. Does that make sense?” • “Not really. Because I don’t have any issues . . . I prefer to – to talk to him directly, right? It’s more easier that way because uh when you send a message, people can interpret it so many ways, you know what I’m saying? So, I’d much rather talk to him directly. That’s my own preference, though.” • “Yeah. That would be great. Do it quickly. [laughs] It’s [the web app] is needed. It’s really needed. Especially for the night time people that don’t get to see a doctor that often . . . ” • “Sometimes people didn’t see the time urgency as much as I did. So there was kind of – they call that – I don’t know, somebody would make a decision that it [my concern] wasn’t like important.”
	Nephrologists • “..I think that because patients are in the in-centre unit, they are rounded on, again, once or twice a week by a physician, they’re constantly seen by bedside nurse, clinical resource nurse every treatment, so they already have very good access to practitioners so an incremental thing, just is another step they’re not really incrementally gaining much benefit . . . ” • “But you know, to be quite honest with you, because their communication here is so good um I don’t think anything was gained from this form of communication at all.”
	Reciprocal action Patients (web app only) • “I wasn’t sure if my [web app] comments were just going off into the ether for the first while. But at the last couple weeks the physician who was doing rounds, clearly had read the comments I’d made. So, if they do their bit and we do our bit, I think it’s good.” • “Yes [I’m interested in continuing to use the web app], as long as the doctor came and said, “I read your comments” so I know that he’s actually looking at the program and reading the comments from patients. That’s a positive.” • “If I saw that the doctors were paying attention to it before my dialysis run would be great. And if it somehow got rid of the redundant overlap between the app and the charge nurse asking me if I needed anything that day.” • “I would have loved it if the doctor would have actually brought the tablet with him. Right? Like that was never – I wish they had just brought the tablet with them. Like when he’s doing it then you would know, right? Because he would say, what was your concern? I’m like, I don’t know. I can’t remember. Well, you couldn’t remember sometimes, eh? I’m like I can’t remember what I wanted to ask you because I wrote it down for you. I don’t know, go get the tablet!” • “..and some of them [physicians] had difficulty with um I don’t know if it was logging in or getting the generating their list of patients, because I would hear them complain about well, I can’t get into the app and you know, who’s supposed to actually be on it this week, and stuff like that.” • “It was uh you know, I’ve watched the doctors using it and I think they probably have more concerns getting used to it [laughs] . . . it’s [unclear] what I think. [laughs]
	We know these patients so well Nephrologists • “So the key thing for us, absolutely not. I think it [the web app] made absolutely no difference at all . . . The fact that we round and interact with our patients every shift, I think they are very comfortable in telling us what they need to tell us.” • “They – you know, we know these patients so well that when they see me, they right away know what they want to say. Even if there are issues that they wouldn’t mention on the web app. It’s just – I don’t know. They are more communicative when they see me directly. And I know them well, so I know which questions to ask them, right? • “Ahh, you know, we’re – I see it as a barrier to communication more than anything. Well, so people write these things, present them, put them on a computerized interface. I mean, that in itself is one step that puts you away from your patient, and it also takes time. . . . Like this is – you know, I mean, you just need to walk through the dialysis unit to know that sometimes our patients don’t communicate very well at all and we actually have to use our intuition to figure out what’s going on. This is high level reporting.”
The user experience	Patients (web app only) • “..what I didn’t like about the web app and that would be the limited opportunities I had to voice questions to write in questions. Twice a week, I thought was not sufficient enough due to the fact that we have um as dialysis patients, different issues pop up. And I could have maybe none for one week and not really need to use it. Or I could end up having say, 10 different issues at 10 different opportunities and only have two opportunities to use it. So I didn’t appreciate that . . . ” • “Yeah, and I never knew if the doctor had read it in advance it would be nice for some indication. A checkmark or something showing that a doctor had read my concern.” • “I think it [the web app] needs to evolve a little bit more. It’d be nice to have more of our info on there for us to look at, you know, like our blood pressures and stuff. Yes, I think our blood pressures would be nice to have on there. Our weights. For us to see. Because we don’t always remember, right? Coming in or going out. Because you do not always feel that good afterwards, so . . . ” • “Yeah. So that was something, something would have an app that you would be able to enter the bloodwork or see your, some information on tests or transplant information, or even just some educational nutrition stuff.” • “You know, like your bloodwork and things. Instead of getting that hard copy it would be nice if it would just kind of went to the – as part of the Web App, then you could look it up. Especially if other people such as the dietitian starts getting involved, or – or the exercise lady, here. Different things like that. Depending on how much you – you know, make it available . . . ” • “I don’t know what else. If I could put in specific concerns about my last run or about runs in general or how things are being managed. In like a private sort of way.” • “Well, to be able to talk to other patients [through the app] because it’s so . . . Well, I think that’s really important because you know, we get a little bit from the doctors. The nurses vary in their opinions and you always seem to have a different one. Yeah. I think for a lot of us, it would be really helpful to be able to talk to each other. Yeah. That support’s really needed.” • “Um. Maybe um scheduling. Like if I could change my schedule through it. Or if maybe there was an early machine one day, the app could alert me that I could come in early for that machine. Like the nurses sometimes do.”
	Nephrologists • “And the other thing is, you know, having a web app where you had to log in every time is kind of not that convenient. I mean, I can understand the privacy issues . . . I mean, these technologies are out there, so I guess, that’s the case. I look at it on my face and it opens up, so that would make things much, much easier.” • “The user interface has to be easy to use that is stream alerts to either email or text message so I don’t have to check a separate application for specific information. The web app on the patient’s side has to respect interprofessional care so it can’t be just notifying a nephrologist about everything. It has to be notifying a member of the care team. So what we’re trying to encourage in dialysis in our unit is that patients are part of a team, not just a nephrologist. So if there are specific nephrologist issues it should be directed to the nephrologist, but a lot of times, many of the issues identified in the app would stream to the nephrologist and they should be going to other members of the team.” • “ . . . to make this really useful, uh I think that this has to be better integrated into EMRs and uh it has to be uh team based and involve more team members than just the physician and the patient.”

Theme 1: Influence on the Encounter

Preparation for the encounter. Patients in both groups commonly expressed that the tool helped prepare them for encounters with the nephrologist. Being prepared was important because the doctors had limited time but also because it facilitated a process for remembering, organizing, and reporting concerns. This preparation also provided guidance regarding what type of concerns they should discuss with the nephrologist. Several patients commented that they obtained more information from the nephrologist using the paper tool than with usual care. One nephrologist expressed that seeing the patient’s questions on the web app ahead of the encounter helped prepare them. However, nephrologists mainly viewed the patients’ web app concerns during the encounter. Several nephrologists indicated that the web app was not useful because it did not work reliably for patients, patients did not know how to use the app, or because their patients had low technology proficiency and access. Another physician indicated that patients were using the web app at the last minute to enter minor concerns, with limited impact on the encounter.

Efficiency of the encounter. Several patients expressed that the tool “sped up” the interaction. Implicit to the perception of greater efficiency was the condition that the nephrologist viewed the concern(s) prior to the encounter. Conversely, if not viewed in advance, the web app “did not make communicating any easier.” Although the majority of nephrologists described both tools as inefficient or “an extra step” that had questionable value, paper was more often described as inconvenient. For one nephrologist, paper was more work as it necessitated further patient contact. Both tools disrupted the usual work-process of having the charge nurse “screen” irrelevant concerns. For some, the web app contributed to an existing problem of fragmented communication.

Personalizing the encounter. Several patients in both groups commented that the tools helped them express what was important to them in their own words instead of having the doctor “tell me my issue” or the nurse “condense it.” Greater participation in the encounter was also mentioned by several patients. Specific to the web app, privacy (explained as not having to discuss an issue with multiple people) was mentioned as an additional benefit. Several nephrologists expressed the importance of hearing concerns in the patients’ own words. However, the majority did not expound on the patients’ perspective of the tools. One nephrologist expected that patients would have used the app to relay sensitive information more often while others did not think a tool was needed for this.

Theme 2: Contextual Factors Influencing Uptake

I already had the doctor coming around. Several patients did not use the web app to log their concerns because they saw the nephrologist regularly or because they preferred direct communication. Conversely, several patients expressed a need for the web app because they “don’t get to see a doctor that often” or there were barriers in the existing system to having a concern addressed. Several nephrologists commented that because they and members of the healthcare team saw their patients so often or because the communication was so good already, the added value of the tools was limited.

Reciprocal action. Patients commonly expressed satisfaction with the web app (and the encounter) if the nephrologist demonstrated knowledge of their submitted concerns (and likewise, dissatisfaction if concerns were not viewed). Several participants also commented that they were aware of the nephrologists’ dissatisfaction with the tool or struggles with the app. One patient jokingly remarked that the physicians appeared to have the greatest difficulty getting used to it.

“We know these patients so well . . . ” Several nephrologists expressed that they already knew the patient’s concerns and what was important to discuss. One physician indicated that the web app interfered with the patient-doctor interaction, took up more of their time, and was a barrier to communication that could not provide the level of “intuition” required to understand the patient’s problem.

Theme 3: The User Experience

The web app group found the tool was “straightforward” and easy to use. Several patients did not want a limit on the number of weekly concerns. Additional suggested features included: notification that their concern had been viewed by the nephrologist, and access to their blood work, blood pressure, weight, and transplant status. One participant indicated they wanted to manage this additional information privately. Two novel suggestions were using an app to talk to other patients for additional support and to make changes to their dialysis schedule.

In contrast, nephrologists generally did not like the web app. One physician stated, within their care group, it was “universally not liked.” Frequently mentioned limitations were the inconvenience of logging in and lack of integration with the multidisciplinary team and the electronic medical record.

Discussion

Our findings provide important insight into the use of digital health in HD care, as well as a greater understanding of HD patients’ preferences and expectations of the patient-doctor encounter. Although the web app met most criteria for usability, patients in the paper group submitted concerns more often and this tool was easier to remember to use. Both tools promoted fundamental components of self-management, such as organization, recall, and presentation of concerns. For some patients, the tools promoted greater participation in the encounter. Unique to the web app group was the theme of enhanced privacy, meaning not having to tell multiple people about any concern (even if not identified as especially sensitive), which differed from the nephrologists’ conception of relaying information on a sensitive topic. For most nephrologists, the web app was perceived as not useful either because of the limitations of the tool itself or due to the perception that patients were unable to use it or access it. Both tools were viewed as a disruption to their workflow that created additional work. For some nephrologists, the tools were superfluous given that they considered the existing communication to be good and believed that they already knew the issues to address with patients.

Given that internet and digital device use was low among patients, remembering to use the tool was likely a barrier. However, other factors contributed to lower usability. First, there was high drop-out in the web-app group after randomization, prior to engaging with the tool, demonstrating that readiness to engage with technology in this context was variable. Second, web app participants were more likely to value the tool if the rounding nephrologist viewed their concerns prior to the encounter, indicating that variable uptake by physicians influenced patient use and/or perceptions of the web app’s utility. Third, web app use was associated with a lower frequency of being able to talk without interruptions, which may have negatively influenced its use. Finally, patients may have simply preferred direct communication. In another study in kidney transplant recipients, preference for direct communication was one reason people did not use technology to communicate with providers. Although this preference is reasonable, low self-efficacy, perceived low proficiency, and lower socioeconomic status are also associated with lower health technology use.[14,15] It is therefore important for health providers to identify patients’ reasons for not engaging with technology so that barriers to accessibility do not exacerbate existing health disparities.

Many patients viewed the tools as a useful, educative guide on “how” to talk to the nephrologist as well as “what” type of concerns they could discuss. This knowledge gap is surprising given the median time on dialysis was 2 years but is potentially an unintended consequence of having other health team members screen and triage concerns. The main barrier to the patient and nephrologist jointly defining the agenda and expectations for the encounter was the perception of limited time. The tension between delivering care that is patient-centered vs care that is convenient for the system and providers has been described elsewhere in the literature.[16,17] Although mechanisms to prioritize patients concerns is one proposed solution, our interpretation of the qualitative data suggests that the success of such mechanisms depends on perceived influence on physicians’ efficiency and workflow.

Data describing how technology influences the patient-doctor interaction in HD are limited. Studies from other settings report the use of health technology tools as both barriers and facilitators to provider’s “relational practice” which in part was influenced by provider culture.[18,19] As clinician participation or endorsement is a known driver of patients’ health technology use, we posit that physician culture negatively influenced higher adoption of the web app in our study. For example, for some nephrologists, knowing the patient was conflated with knowing the patients’ concerns or “what is important.” This paternalistic approach to communication is consistent with previous studies across variable HD settings. In one study of elderly HD patients, the health-care team was perceived as owners of the knowledge, deciding what the patients needed to know. In another study of in-center HD patients, although patients viewed their relationships with the care team as good, they did not feel involved in decisions regarding their care or consider it to be individualized.

Our study has strengths and limitations. This study was directly informed by the priorities of patients and to our knowledge, is the first trial to examine the role of technology in HD care delivery. We used a priori criteria and applied a comprehensive approach to understanding usability. To understand the advantages of a health technology tool over less resource-intensive methods and to equalize co-interventions, we used paper as a comparator. As nephrologists delivered care to participants in both groups, there is potential for contamination, which could have resulted in more frequent elicitation of concerns in the control group and could have potentially been mitigated with cluster randomization at the level of the provider. We recognize that the intervention was mainly directed at the patient, thus focusing on 1 side of a 2-sided relationship. However, similar interventions that included the training of physicians were no more effective than those that only involved patients. We did not include multidisciplinary team members in this pilot as the aim was to facilitate communication with the provider that patients commonly consider as their main source of information. As the frequency of internet-based technology use was relatively low, 8 weeks may have been too short to adequately evaluate use. Finally, patients and physicians were primarily male and White and the setting was tertiary care, which may limit generalizability of our findings.

Conclusions

We found that overall, patient participants appreciated tools (web app or paper) to help prepare them for and set the agenda for the encounter with the nephrologist. In contrast, most nephrologists viewed the tools as either cumbersome to use, unnecessary given their knowledge of the patient, or disruptive to the process of having staff screen concerns. However, many patients described limitations to the existing system of relaying concerns through unit staff, suggesting that to deliver care that is respectful and responsive to individual patient preferences, additional mechanisms whereby patients can clearly identify and communicate their concerns to providers should be evaluated. Consistent with the recommendations from nephrologists and patients’ desire for more opportunities to manage their own dialysis, the ability for the patient to direct their concern to the appropriate dialysis team member would be an important feature to include in these tools. In terms of future iterations of digital tools, bi-directional communication with providers and social interaction were other desired features that may increase adoption. For tools designed to include the nephrologist, efficiency of workflow was highly valued and therefore the integration of these tools into existing processes (ie, the electronic medical record) may increase uptake. Furthermore, given the complexity of the HD setting, piloting the tool in the unit during the development phase could enhance usability. Given the higher usability of paper, one conclusion from our study may be that development of digital tools is not patient-centric. However, the need for technology to facilitate HD care delivery is borne not only out of demand for greater individualization of care, but also and as demonstrated the recent coronavirus pandemic, out of the need to support digital literacy as more resources are being provided virtually. Future studies and initiatives should consider how to integrate the patient voice and preference into the design of these tools. Ultimately, however, the use of technology to facilitate patient participation depends as much on the adoption of values that are consistent with patient-centered care by healthcare providers as it does on the attributes of the tool.

Click here for additional data file.

Supplemental material, sj-jpg-1-cjk-10.1177_20543581211032857 for Voicing Individual Concerns for Engagement in Hemodialysis (VOICE-HD): A Mixed Method, Randomized Pilot Trial of Digital Health in Dialysis Care Delivery by Stephanie Thompson, Kara Schick-Makaroff, Aminu Bello, Marcello Tonelli, Natasha Wiebe, Robert Buzinski, Mark Courtney, Susan Szigety, Nikhil Shah and Clara Bohm in Canadian Journal of Kidney Health and Disease

Click here for additional data file.

Supplemental material, sj-pdf-2-cjk-10.1177_20543581211032857 for Voicing Individual Concerns for Engagement in Hemodialysis (VOICE-HD): A Mixed Method, Randomized Pilot Trial of Digital Health in Dialysis Care Delivery by Stephanie Thompson, Kara Schick-Makaroff, Aminu Bello, Marcello Tonelli, Natasha Wiebe, Robert Buzinski, Mark Courtney, Susan Szigety, Nikhil Shah and Clara Bohm in Canadian Journal of Kidney Health and Disease

Click here for additional data file.

Supplemental material, sj-pdf-3-cjk-10.1177_20543581211032857 for Voicing Individual Concerns for Engagement in Hemodialysis (VOICE-HD): A Mixed Method, Randomized Pilot Trial of Digital Health in Dialysis Care Delivery by Stephanie Thompson, Kara Schick-Makaroff, Aminu Bello, Marcello Tonelli, Natasha Wiebe, Robert Buzinski, Mark Courtney, Susan Szigety, Nikhil Shah and Clara Bohm in Canadian Journal of Kidney Health and Disease