Literature DB >> 31391944

Content and Quality of Websites for Patients With Chronic Kidney Disease: An Environmental Scan.

Michelle Smekal1, Sarah Gil1, Maoliosa Donald1,2, Heather Beanlands3, Sharon Straus4,5, Gwen Herrington6, Dwight Sparkes6, Lori Harwood7, Allison Tong8, Allan Grill9, Karen Tu9, Blair Waldvogel6, Chantel Large6, Claire Large6, Marta Novak10, Matthew James1,2, Meghan Elliott1, Maria Delgado6, Scott Brimble11, Susan Samuel2,12, Brenda R Hemmelgarn1,2.   

Abstract

BACKGROUND: Although numerous websites for patients with chronic kidney disease (CKD) are available, little is known about their content and quality.
OBJECTIVE: To evaluate the quality of CKD websites, and the degree to which they align with information needs identified by patients with CKD.
METHODS: We identified websites by entering "chronic kidney disease" in 3 search engines: Google.com (with regional variants for Australia, Canada, the United Kingdom, and the United States), Bing.com, and Yahoo.com. We included the first 50 unique English-language sites from each search. We evaluated website content using a 30-point scale comprising 8 priority content domains identified by patients with CKD (understanding CKD, diet, symptoms, medications, mental/physical health, finances, travel, and work/school). We used standardized tools to evaluate usability, reliability, and readability (DISCERN, HONcode, LIDA, Reading Ease, and Reading Grade Level). Two reviewers independently conducted the search, screen, and evaluation.
RESULTS: Of the 2093 websites identified, 115 were included. Overall, sites covered a mean (SD) of 29% (17.8) of the CKD content areas. The proportion of sites covering content related to understanding CKD, symptoms, and diet was highest (97%, 80%, and 72%, respectively). The proportion of sites covering travel, finances, and work/school content was lowest (22%, 12%, and 12%, respectively). The mean (SD) scores for DISCERN, LIDA and HONcode were 68% (14.6), 71% (14.4), and 75% (17.2), respectively, considered above average for usability and reliability. The mean (SD) Reading Grade Level was 10.6 (2.8) and Reading Ease was 49.8 (14.4), suggesting poor readability.
CONCLUSIONS: Although many CKD web sites were of reasonable quality, their readability was poor. Furthermore, most sites covered less than 30% of the content patients identified as important for CKD self-management. These results will inform content gaps in internet-accessible information on CKD self-management that should be addressed by future eHealth web-based tools.

Entities:  

Keywords:  chronic kidney disease; internet; online; self-management; websites

Year:  2019        PMID: 31391944      PMCID: PMC6668187          DOI: 10.1177/2054358119863091

Source DB:  PubMed          Journal:  Can J Kidney Health Dis        ISSN: 2054-3581


What was known before

Patients often visit websites to access health information; however, little is known about the content and quality of online information available for patients with chronic kidney disease (CKD). Previous work has highlighted gaps in quality and reported poor readability; these studies have primarily focused on appraising some quality measures, including readability, in a limited number of websites. A comprehensive evaluation of both content and quality of information on websites is needed.

What this adds

Our study provides an assessment of local and international CKD website quality and summarizes the availability of information content areas identified as important by patients with CKD. This study highlights content and quality gaps in internet-accessible information on CKD that should be addressed by future web-based tools.

Introduction

Chronic kidney disease (CKD) affects approximately 10% of adults in Canada and contributes to significant morbidity, mortality, and health care expenditures.[1] The trajectory of CKD progression may be improved by lifestyle modifications, such as diet and blood pressure management, and as a result, there is considerable interest in encouraging patients to self-manage aspects of their lifestyle, medical treatments, and symptom monitoring and management, with the goal of slowing disease progression.[2-4] Numerous websites have been developed to support patient education for CKD; however, little is known about the content and quality of these websites, or the extent to which they address information needs identified by patients. Previous work evaluating CKD websites was limited to first page search results, is out-of-date, or was limited in scope (focusing on a small number of unique websites or limited to a specific geographic region or interest area such as living donor transplantation).[5-10] The main objectives of this environmental scan were to (1) identify and evaluate CKD website quality (usability, reliability, and readability), and (2) summarize CKD content relative to self-management needs identified by CKD patients in our prior work.[11]

Methods

Search Strategy

Given the diversity in websites and data, an environmental scan was determined to be the optimal method to synthesize knowledge regarding the content and quality of websites for patients with CKD. We consulted with a medical library specialist at the University of Calgary to finalize our search strategy and search terms. We systematically searched the 3 most popular English-language search engines: GoogleTM, BingTM, and YahooTM.[12] To account for potential geographic variation in search results, we included regional variants for the leading search engine, Google, which accounted for 71% of desktop and 89% of mobile traffic worldwide in the year preceding data collection.[12] We searched “chronic kidney disease” in each of the search engines: Google.com (four separate searches with preferences set to Australia, Canada, the United Kingdom, and the United States), Bing.com, and Yahoo.com. “Chronic kidney disease” is a term commonly used by patients in website searches.[5] In search engines, each search term is treated as a distinct keyword; therefore, while the search would prioritize sites with all 3 terms (and particularly those sites that repeat the key word[s]), it would also include sites with an individual term. Thus, “kidney disease” would capture the majority of sites, and inclusion of “chronic” would provide additional specificity. Web traffic data, including Alexa Rank, was collected alongside the search and screen using a free chrome plug-in, SEOquake, which reports search engine optimization metrics for each website listed in the search results in the 3 search engines used in this study.[13] Alexa rank is a metric of global website popularity relative to all other websites available and is calculated based on daily website traffic and page views over a 3-month period.[14]

Inclusion and Exclusion Criteria

We included only English-language websites. Websites that had nonfunctional links, required subscription to access content, or were discussion forums, blogs, scholarly journals or news articles were excluded. Eligible websites were recorded in a spreadsheet for further evaluation.

Website Screening

Two reviewers (M.D.S. and S.G.) independently searched and screened websites in September 2018 for inclusion. We followed the Canadian Agency for Drugs and Technologies in Health guidelines[15] for systematically searching the internet. Websites were reviewed in descending order until 50 unique, eligible websites were identified from each search engine (ie, we did not include subsites of URLs already cataloged), or until at least 200 sites were screened for eligibility in each search. Websites were included if both reviewers agreed on their inclusion; conflicts and uncertainty were resolved by discussion and involvement of a third reviewer (B.R.H.).

Website Review and Data Extraction

The review occurred in 2 phases: (1) quality (usability, reliability, and readability) and (2) assessment of CKD content. Phase 1 was completed independently by 2 reviewers (M.D.S. and S.G.) for all sites. For Phase 2, each website was reviewed by 1 reviewer (divided equally between reviewers).

Phase 1: Quality assessment (usability, reliability, and readability)

We assessed eligible sites for quality using the validated DISCERN,[16,17] Health on the Net (HON) Code of Conduct,[18] and MinervaLIDAtion (LIDA)[19] instruments. These tools are freely available online and have been used extensively to evaluate health website quality.[20-28] The DISCERN tool includes 16 questions that evaluate reliability and quality of written health information. Similar to Lutz et al,[5] we used the DISCERN tool without the 7-item subscale related to treatment choices, as treatment choices for CKD (dialysis, transplant) were not the focus of our review. Each question was rated on a 5-point Likert scale; the minimum overall score (excluding the treatment subscale) was 9 and the maximum was 45. Higher scores indicate greater quality and reliability. The DISCERN tool was originally developed for a “consumer,” rather than academic audience, although it has been used primarily by academic researchers to appraise written health information.[29] The HONcode includes 14 questions that evaluate 8 overarching principles relating to justifiability, transparency, and financial disclosure, among other items. Each question is rated as present (1)/absent (0), with higher scores indicating greater compliance with HONcode standards. The HON Foundation has provided official certification for qualified websites since 1995 and the code is broadly known as an ethical standard for health websites.[30] The LIDA instrument is a tool both to guide the development of and to evaluate health websites. The LIDA instrument includes 41 questions that assess accessibility, usability, and reliability. We used the LIDA instrument without the accessibility subscale, as the online accessibility checker tool is no longer available and some of the questions are not applicable to more recent website development advancements. For the usability and reliability sections, each question is rated on a 3-point scale; the minimum overall score for these sections is 0 and the maximum is 81. Higher scores indicate greater usability and reliability. Readability was assessed using the Flesch Reading Ease (FRE) scale and Flesch-Kincaid Reading Grade Level (FKRGL).[31-33] Similar to other studies[5,9,10] we imported 200 to 400 words from each site into Microsoft Word and assessed the text using the readability statistics function, which reports both the FRE and FKRGL scales (MS Word 10, Microsoft Inc., Redmond, Washington). Both scales are calculated using word length, number of syllables per word, and number of words per sentence. FKRGL is reported as a numerical grade level and FRE is scored on a scale of 0 to 100, with lower scores suggesting poor readability. In general, a grade 6 reading level is recommended for patient education materials.[34]

Phase 2: Assessment of CKD content

We assessed all sites for specific content areas relating to information needs identified by CKD patients and their caregivers from a National CKD self-management study.[11] Content areas included overarching categories of understanding CKD, diet, symptoms, medications, finances, mental/physical health, travel, and work/school. Several subcategories were identified under each broad category, resulting in 30 content areas in total. We also categorized websites according to the audience(s) the site appeared to be tailored to (patient-focused, clinician-focused, or both) and by site type as follows: (1) academic/professional (universities, hospitals, and research centers); (2) nonprofit organizations, foundations, and charities; (3) commercial and pharmaceutical companies; and (4) other.

Rater Calibration

The 2 reviewers independently screened a convenience sample of 20 consecutive websites using the inclusion and exclusion criteria. After 2 rounds (40 websites), good agreement was achieved (κ = 0.92). Following the website screening activity, the 2 reviewers piloted the evaluation process by independently applying the assessment instruments to 5 randomly selected CKD sites. This process familiarized the reviewers to the instruments and identified interpretive differences for further discussion. Scoring differences were resolved by discussion. The reviewers conducted 3 sequential pilots (15 websites total). Following the first round, the percent agreement for the CKD content checklist was >90% and by the third round was ≥90% across all instruments (LIDA = 93.1%, κ = 0.52; HONcode = 97.7%, κ = 0.81; DISCERN = 90%, κ = 0.68).

Data Synthesis/Analysis

We used descriptive statistics (mean [percentage], SD, frequencies) to summarize quality and content scores. Scores demonstrating greater than 20% difference between raters were reviewed a second time and a final score was assigned by consensus. We reported the mean of the 2 raters’ results for scores with differences of less than 20%.

Results

Search Results and Website Characteristics

A total of 2093 sites were identified by the 2 reviewers (Figure 1). After ineligible sites and duplicates were removed from individual searches, 115 websites were eligible and included in the evaluation. The most common reasons for exclusion were duplicate websites, academic journals, and news articles. The number of websites identified in each search engine and the number of search engines each site appeared in are summarized in Figure 2. There was overlap in website identification across each of the searches, with some websites appearing in more than 1 search engine; however, only approximately 35% of websites were repeatedly identified in more than 3 search engines and 41% of websites appeared in a single search engine only. Websites were primarily targeted to a patient (56%) or patient and clinician audience (39%) and the majority of sites were developed by academic/professional centers (universities, hospitals, and research centers) (39%), followed by commercial and pharmaceutical companies (30%), nonprofit organizations, foundations and charities (29%), and other/unknown (1%).
Figure 1.

CKD website review PRISMA flow diagram.

Note. CKD = chronic kidney disease.

aOther includes pdf documents, videos, clinic directories, veterinary clinics, practice guidelines, books, project descriptions.

Figure 2.

Search engine results.

Note. CKD = chronic kidney disease.

CKD website review PRISMA flow diagram. Note. CKD = chronic kidney disease. aOther includes pdf documents, videos, clinic directories, veterinary clinics, practice guidelines, books, project descriptions. Search engine results. Note. CKD = chronic kidney disease.

CKD Content

Overall, sites covered a mean (SD) of 29% (17.8) of the 30 identified CKD content areas (Tables 1 and 2). The proportion of sites covering at least 1 content topic related to understanding CKD, symptoms, and diet was the highest (97%, 80%, and 72% respectively), and approximately half included content on mental/physical health (53%) and medications (52%). The proportion of sites covering travel, finances, and work/school content was low (22%, 12%, and 12%, respectively). There were a number of patient-identified information needs found in less than 10% of websites. This included those related to diet (options for eating out, practical tools for diet tracking), mental and physical support (screening tools for depression, how to communicate with others about mental health), finances (cost considerations for medications, food etc), travel (accessing health care abroad, what to bring), and work and school (supports and considerations for returning to work/retraining, how to discuss potential limitations with employer or school, and what should be disclosed and to whom). When stratified by website category (academic/professional, commercial/pharmaceutical, nonprofit/charity) or website audience (patient, clinician, both), there was minimal difference in the proportion of content topics covered by websites (Supplemental Table 1).
Table 1.

Proportion of Websites Addressing Specific CKD Content (n = 115).

Patient-identified information needsn (%)
Understanding CKD
 Basic information about CKD, what causes it, how to assess risk, understanding eGFR107 (93.0)
 Basic information about kidneys/kidney function93 (80.9)
 How to slow progression of CKD88 (76.5)
 What to expect as CKD progresses and overall implications on lifestyle61 (53.0)
Websites with at least 1 topic covered111 (96.5)
Symptoms
 What are the symptoms of CKD, what causes them89 (77.4)
 What to expect as CKD progresses61 (53.0)
 Considerations for comorbidities and impact of treatments for other conditions27 (23.5)
 How to manage symptoms, and when to seek help24 (20.9)
Websites with at least 1 topic covered92 (80.0)
Diet
 Information about diet/nutritional requirements, what types of changes need to be made81 (70.4)
 How to identify renal friendly/unfriendly foods41 (35.7)
 How to make modifications to prepared or ethnic foods11 (9.6)
 Practical tools for diet tracking10 (8.7)
 Options for eating out, including considerations for those with diabetes6 (5.2)
Websites with at least 1 topic covered83 (72.2)
Mental & Physical Support
 Physical wellness—exercise/activities to slow progression, potential restrictions49 (42.6)
 Mental wellness, specifically related to isolation, depression34 (29.6)
 Emotional/social support resources and peer support (eg, online peer support, face-to-face, etc)27 (23.5)
 How to communicate with others about mental health12 (10.4)
 Screening tools for depression7 (6.1)
Websites with at least 1 topic covered61 (53.0)
Medications
 Common medications for CKD, their indications, side effects to watch for, and long-term effects59 (51.3)
 How to manage side effects, interactions between medications (traditional and alternative) for other illnesses/conditions14 (12.2)
Websites with at least 1 topic covered60 (52.2)
Travel
 Things to consider regarding travel and CKD, potential limitations22 (19.1)
 Insurance13 (11.3)
 Accessing health care abroad10 (8.7)
 What to bring7 (6.1)
Websites with at least 1 topic covered25 (21.7)
Finances
 Resources and potential short- and long-term expenses, considerations relating to reduced workforce participation, medication/insurance coverage14 (12.2)
 Cost considerations (medications, equipment, food etc)4 (3.5)
Websites with at least 1 topic covered14 (12.2)
Work and School
 Accommodating the work/school environment13 (11.3)
 How to discuss potential limitations with employer/school9 (7.8)
 Supports and considerations for returning to work/retraining6 (5.2)
 What should be disclosed and to whom (HR, teacher etc)4 (3.5)
Websites with at least 1 topic covered14 (12.2)

Note. CKD = chronic kidney disease.

Table 2.

Website details including audience, rank, content and quality (n=115).

• = Reported• = Not reportedUnderstanding CKDDietSymptomsMedicationsMental & physical supportFinancesTravelWork & schoolProportion of content areas covered (%)DISCERN (%)LIDAHONcode (%)FRE (n/100)FKRGL
Website name:Website URLAudienceWebsite categoryWebsite rank based on web traffic (Alexa Rank)Basic information about kidneys/kidney functionBasic information about CKD, causes, how to assess risk, understanding eGFRHow to slow CKD progressionWhat to expect as CKD progresses and overall implications on lifestyleInformation about diet/ nutritional requirements and what types of changes need to be madeHow to identify renal friendly/unfriendly foodsHow to make modifications to prepared or ethnic foods.Options for eating out, considerations for those with diabetes,Practical tools for diet/lab tracking.What are the symptoms of CKD, what causes themWhat to expect as CKD progressesHow to manage symptoms, and when to seek help.Considerations for comorbidities and impact of treatments for other conditionsCommon medications for CKD, their indications, side effects to watch for/long term effects of medicationsHow to manage side effects, interactions between medications (traditional and alternative) for other illnesses/ conditions.Mental wellness, isolation, depressionScreening tools for depressionHow to communicate with others about mental healthEmotional/social support, resources and peer supportPhysical wellness, exercise, activities to slow progression, potential restrictionsResources for potential short- and long-term expenses relating to CKD (reduced work)Cost considerations (medications, insurance, equipment, food etc)Things to consider regarding travel and CKD, potential limitationsInsuranceAccessing health care abroadWhat to bringAccommodating the work/school environmentSupports and considerations for returning to work/retrainingHow to discuss potential limitations with employer/schoolWhat should be disclosed and to whom (HR, teacher)Usability (%)Reliability (%)Total (%)
Aboriginal Health Info Net https://healthinfonet.ecu.edu.au/key-resources/resources/?kw=kidney&searchIn_title=Yes&joiner=OR&pagenum=Yes&sorter=Yes PatientAcademic/professional (universities, hospitals, and research centers)27 (24.1K)10.077.876.975.976.578.639.112.7
American Association of Kidney Patients https://aakp.org/ckdpredialysis-education/ PatientNonprofit organizations, foundations, and charities93 (2.21M)33.363.360.250.056.850.041.214.2
American Heart Association http://www.heart.org/en/health-topics/diabetes/why-diabetes-matters/kidney-disease–diabetes BothNonprofit organizations, foundations, and charities24 (10.5K)13.377.876.975.976.592.953.311.0
American Kidney Fund http://www.kidneyfund.org/ PatientNonprofit organizations, foundations, and charities54 (141K)46.772.291.774.185.885.779.75.5
Australian Government Department of Health http://health.gov.au/internet/main/publishing.nsf/Content/chronic-kidney BothAcademic/professional (universities, hospitals, and research centers)39 (46.8K)13.375.668.575.971.082.133.215.6
BC Government https://www2.gov.bc.ca/gov/content/health/practitioner-professional-resources/bc-guidelines/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)17 (7.76K)30.078.968.561.166.075.013.117.1
BC Renal Agency http://www.bcrenalagency.ca/health-professionals/clinical-resources/chronic-kidney-disease-(ckd) BothAcademic/professional (universities, hospitals, and research centers)94 (2.26M)50.078.986.174.182.185.753.09.3
Better Health Victoria State Government https://www.betterhealth.vic.gov.au/health/conditionsandtreatments/kidney-failure PatientAcademic/professional (universities, hospitals, and research centers)33 (35.7K)13.376.770.474.171.685.753.69.6
Bupa UK https://www.bupa.co.uk/health-information/urinary-bladder-problems/chronic-renal-failure PatientCommercial and pharmaceutical companies45 (77.3K)26.780.080.670.477.289.358.78.8
CDC https://www.cdc.gov/kidneydisease/basics.html BothAcademic/professional (universities, hospitals, and research centers)8 (2.20K)16.777.881.585.282.789.357.59.2
CESPHN https://www.cesphn.org.au/general-practice/help-my-patients-with/chronic-disease-management/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)90 (2.02M)6.761.174.159.369.153.628.615.0
Choosing Wisely https://choosingwiselycanada.org/chronic-kidney-disease/ BothAcademic/professional (universities, hospitals, and research centers)70 (669K)13.367.868.563.066.753.667.77.2
CKD pathway http://www.ckdpathway.ca/ ProviderAcademic/professional (universities, hospitals, and research centers)108 (6.34M)16.781.180.675.979.067.937.614.2
Cleveland clinic https://my.clevelandclinic.org/health/diseases/15096-kidney-disease-chronic-kidney-disease PatientAcademic/professional (universities, hospitals, and research centers)20 (9.24K)10.070.081.577.880.2100.058.08.2
CorHealth Ontario https://www.corhealthontario.ca/resources-for-healthcare-planners-&-providers/quality-improvement-toolkits/chronic-kidney-disease-screening/Chronic-Kidney-Disease-Improving-screening-&-identification-of-CKD-for-adult-patients-in-Ontario ProviderAcademic/professional (universities, hospitals, and research centers)107 (5.36M)3.375.685.277.882.764.38.318.9
Davita http://www.davita.com/kidney-disease/overview/stages-of-kidney-disease PatientCommercial and pharmaceutical companies41 (49.9K)93.374.492.675.987.078.657.89.6
Diabetes UK https://www.diabetes.org.uk/Guide-to-diabetes/Complications/Kidneys_Nephropathy BothNonprofit organizations, foundations, and charities52 (104K)13.363.381.575.979.678.664.08.0
DPC Education Center http://www.dpcedcenter.org/chronic-kidney-disease PatientNonprofit organizations, foundations, and charities97 (2.63M)53.365.675.974.175.382.158.09.9
Drugs.com https://www.drugs.com/mcd/chronic-kidney-disease PatientCommercial and pharmaceutical companies14 (3.16K)30.070.072.274.172.8100.044.611.6
eMedicine Health https://www.emedicinehealth.com/chronic_kidney_disease/article_em.htm PatientCommercial and pharmaceutical companies22 (10.1K)36.763.377.879.678.4100.046.211.4
Fairview https://www.fairview.org/patient-education/86310 BothNonprofit organizations, foundations, and charities37 (45.8K)13.351.172.268.571.071.463.27.3
Family Doctor https://familydoctor.org/condition/chronic-kidney-disease-ckd/ BothNonprofit organizations, foundations, and charities40 (49.4K)23.375.688.075.984.0100.074.15.2
Fresenius Kidney Care https://www.freseniuskidneycare.com/about-chronic-kidney-disease/stages/chronic-kidney-disease-ckd-stages PatientCommercial and pharmaceutical companies62 (411K)66.766.787.075.983.371.455.710.2
Fresenius Australia https://www.fmc-au.com/community/articles/250-world-kidney-day-raising-awareness-for-chronic-kidney-disease BothCommercial and pharmaceutical companies101 (2.96M)13.355.674.166.771.660.736.212.3
Fresenius Medical Care https://www.freseniusmedicalcare.com/en/patients-families/family-caregivers/ BothCommercial and pharmaceutical companies71 (769K)20.062.288.975.984.675.052.99.9
Good To Go Insurance https://www.goodtogoinsurance.com/medical-travel-insurance/chronic-kidney-disease PatientCommercial and pharmaceutical companies69 (656K)16.743.356.546.353.142.958.39.5
Guy’s & St. Thomas Kidney Patients’ Association http://www.gsttkpa.org/ PatientsNonprofit organizations, foundations, and charities58 (208K)10.062.276.970.474.757.157.68.7
HCA Healthcare https://hcahealthcare.com/hl/?/Yes03Yes58/Lifestyle-Changes-to-Manage-Chronic-Kidney-Disease BothCommercial and pharmaceutical companies56 (158K)16.752.264.866.765.485.776.45.5
Health Care Siemens—Australia https://www.healthcare.siemens.com.au/laboratory-diag0stics/assays-by-diseases-conditions/kidney-disease BothCommercial and pharmaceutical companies72 (812K)10.070.081.577.880.271.429.718.1
Health Direct Australia https://www.healthdirect.gov.au/chronic-kidney-disease PatientAcademic/professional (universities, hospitals, and research centers)35 (44.1K)13.381.176.988.980.992.952.410.2
Health Insight Nevada https://healthinsight.org/nv-patients-family/498-chronic-kidney-disease BothNonprofit organizations, foundations, and charities87 (1.66M)0.065.671.366.778.478.620.315.6
Health Line—CKD https://www.healthline.com/health/chronic-kidney-disease PatientNonprofit organizations, foundations, and charities4 (529)20.067.874.174.174.196.450.18.8
HealthLink BC https://www.healthlinkbc.ca/healthy-eating/early-chronic-kidney-disease PatientAcademic/professional (universities, hospitals, and research centers)48 (91.1K)36.778.977.885.280.285.763.87.6
Health Services Executive https://www.hse.ie/eng/health/az/c/chronic-kidney-disease/ BothAcademic/professional (universities, hospitals, and research centers)36 (45K)30.067.875.983.378.478.658.39.4
Health& https://healthand.com/au/topic/general-report/chronic-kidney-disease PatientCommercial and pharmaceutical companies88 (1.93M)10.061.186.174.182.185.742.311.8
Healthwise—Sask Health online https://www.healthwise.net/saskhealthlineonline/Content/StdDocument.aspx?DOCHWID=aa65427 PatientAcademic/professional (universities, hospitals, and research centers)53 (113K)30.080.074.194.480.978.669.46.5
Info KID https://www.infokid.org.uk/chronic-kidney-disease-ckd PatientAcademic/professional (universities, hospitals, and research centers)85 (1.58M)20.065.681.563.075.364.369.87.2
Jama https://jamanetwork.com/journals/jama/fullarticle/2524193 BothAcademic/professional (universities, hospitals, and research centers)21 (9.32K)16.771.178.783.380.292.943.511.4
Kidney ABC (Tongshantang Hospital) http://www.kidneyabc.com/ckd/ * PatientCommercial and pharmaceutical companies64 (492K)20.041.171.344.462.332.159.87.7
Kidney Care UK https://www.kidneycareuk.org/about-kidney-health/conditions/ckd/ PatientNonprofit organizations, foundations, and charities91 (2.02M)60.083.394.477.888.971.448.512.2
Kidney Cares Community (Tongshantang Hospital) http://www.kidney-cares.org/ckd-treatment/ * PatientCommercial and pharmaceutical companies82 (1.23M)20.035.667.646.360.542.943.412.1
Kidney Disease (Tongshantang Hospital) http://www.renaldiseases.org/ckd/ * PatientCommercial and pharmaceutical companies104 (3.64M)20.040.074.151.966.742.941.813.1
Kidney Disease Symptoms (Tongshantang Hospital) http://www.kidney-symptom.com/chronic-kidney-disease/ * PatientCommercial and pharmaceutical companies81 (1.21M)20.040.068.550.062.342.953.19.1
Kidney Disease Treatment Center (Tongshantang Hospital) http://www.kidney-support.org/ckd/ * PatientCommercial and pharmaceutical companies99 (2.77M)20.040.068.550.062.342.941.812.7
Kidney Failure (Tongshantang Hospital) http://www.kidneyfailureweb.com/ckd/ * PatientCommercial and pharmaceutical companies76 (962K)26.740.070.453.764.839.337.712.7
Kidney Foundation of Canada https://www.kidney.ca/kidney-disease Patient/caregiverNonprofit organizations, foundations, and charities73 (846K)63.370.088.951.976.564.347.111.4
Kidney Health Australia https://kidney.org.au/your-kidneys/detect/kidney-disease/stages-of-chronic-kidney-disease-787 BothNonprofit organizations, foundations, and charities68 (617K)53.373.390.781.587.778.639.112.2
Kidney Patient Guide http://www.kidneypatientguide.org.uk/financial.php PatientNonprofit organizations, foundations, and charities95 (2.39M)50.079.486.172.281.592.956.49.2
Kidney Research UK https://www.kidneyresearchuk.org/health-information/chronic-kidney-disease PatientNonprofit organizations, foundations, and charities74 (869K)20.066.779.663.074.178.650.711.0
Kidney School https://www.kidneyschool.org/ BothNonprofit organizations, foundations, and charities98 (2.71M)36.770.084.359.375.964.371.47.1
Kidney Services China (Tongshantang Hospital) http://www.kidneyservicechina.com/stage-3-ckd/ * PatientCommercial and pharmaceutical companies96 (2.41M)23.340.064.825.951.939.347.311.2
Kidney Support Network http://ksn.org.au/ PatientNonprofit organizations, foundations, and charities114 (14.4M)13.348.977.851.969.150.051.19.2
Kidney Treatment (Tongshantang Hospital) http://www.kidney-treatment.org/ckd/ * PatientCommercial and pharmaceutical companies84 (1.49M)13.340.063.031.552.532.135.416.2
Kidney Wales https://www.kidneywales.cymru/about-kidney-disease/what-is-kidney-disease/stages-chronic-kidney-disease/ PatientNonprofit organizations, foundations, and charities113 (13.9M)16.764.475.057.469.157.158.69.0
Kids Health https://kidshealth.org/en/parents/chronic-kidney-disease.html BothNonprofit organizations, foundations, and charities25 (10.7K)23.375.689.881.587.085.750.210.7
Lab Tests Online https://labtestsonline.org/conditions/kidney-disease BothCommercial and pharmaceutical companies32 (31.1K)20.081.174.174.174.1100.048.910.9
Life Line Screening https://www.lifelinescreening.com/screening-services/chronic-kidney-disease-screening PatientCommercial and pharmaceutical companies59 (293K)6.765.682.466.777.264.336.310.8
Life Options https://lifeoptions.org/learn-about-kidney-disease/ patientsNonprofit organizations, foundations, and charities60 (404K)56.770.081.559.374.167.984.24.5
London Health Sciences http://www.lhsc.on.ca/Patients_Families_Visitors/Renal/AdjustingtoKidneyDisease/Travel/index.htm BothAcademic/professional (universities, hospitals, and research centers)51 (103K)50.075.685.274.181.571.442.911.7
Long Island kidney and hypertension http://www.kidneyandhypertensioncare.com/chronic-kidney-disease.php PatientAcademic/professional (universities, hospitals, and research centers)112 (13.4M)10.053.352.857.454.353.647.511.4
Manitoba Renal Program http://www.kidneyhealth.ca/wp/kidney-disease/ BothAcademic/professional (universities, hospitals, and research centers)105 (4.62M)60.073.363.055.660.564.355.19.7
Mayo clinic https://www.mayoclinic.org/diseases-conditions/chronic-kidney-disease/symptoms-causes/syc-2035452Yes BothNonprofit organizations, foundations, and charities7 (1.24K)46.777.876.977.877.2100.048.910.5
Med Broadcast https://medbroadcast.com/condition/getcondition/chronic-renal-failure PatientCommercial and pharmaceutical companies44 (67.5K)40.061.163.948.158.675.037.011.4
Medical Dictionary https://medical-dictionary.thefreedictionary.com/kidney+disease UnknownCommercial and pharmaceutical companies6 (636)40.065.652.844.450.067.935.013.1
Medical News Today https://www.medicalnewstoday.com/articles/172179.php BothCommercial and pharmaceutical companies10 (2.61K)33.383.368.572.269.8100.048.410.3
Medicine Net https://www.medicinenet.com/script/main/art.asp?articlekey=30944 PatientCommercial and pharmaceutical companies11 (2.86K)50.077.871.377.873.5100.045.212.0
Medline Plus https://medlineplus.gov/chronickidneydisease.html PatientAcademic/professional (universities, hospitals, and research centers)13 (3.12K)20.074.462.072.265.492.972.55.9
MedScape https://emedicine.medscape.com/article/238798-overview ClinicianAcademic/professional (universities, hospitals, and research centers)9 (2.47K)16.777.872.277.874.196.429.813.8
Merck Manuals—professional (MSD) https://www.merckmanuals.com/professional/genitourinary-disorders/chronic-kidney-disease/chronic-kidney-disease ClinicianCommercial and pharmaceutical companies31 (27.8K)33.382.273.175.974.182.114.016.2
Merck Manuals-consumer (also MSD) https://www.merckmanuals.com/en-ca/home/kidney-and-urinary-tract-disorders/kidney-failure/chronic-kidney-disease-ckd PatientCommercial and pharmaceutical companies30 (27.7K)30.071.169.470.469.882.133.912.9
Mount Sinai https://www.mountsinai.org/health-library/diseases-conditions/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)29 (24.9K)40.076.763.964.864.275.073.46.2
My Doctor http://www.mydr.com.au/health-images/chronic-kidney-disease PatientCommercial and pharmaceutical companies46 (83.7K)50.082.275.970.474.1100.058.49.6
My Kidney https://www.mykidney.org/home.aspx PatientAcademic/professional (universities, hospitals, and research centers)100 (2.81M)36.765.663.940.756.253.665.08.0
My VMC https://www.myvmc.com/diseases/kidney-disease-chronic-renal-failure/ BothAcademic/professional (universities, hospitals, and research centers)50 (93.9K)30.075.677.885.280.296.447.611.5
MyHealth Alberta https://myhealth.alberta.ca/Health/pages/conditions.aspx?hwid=aa65427 PatientAcademic/professional (universities, hospitals, and research centers)26 (11.5K)43.383.377.881.579.085.767.76.8
NIDDK https://www.niddk.nih.gov/health-information/kidney-disease/chronic-kidney-disease-ckd BothAcademic/professional (universities, hospitals, and research centers)2 (153)60.080.073.179.666.082.169.16.7
National Kidney Center http://www.nationalkidneycenter.org/chronic-kidney-disease/ PatientNonprofit organizations, foundations, and charities83 (1.25M)36.772.265.763.064.871.458.98.7
National Kidney Federation UK https://www.kidney.org.uk/help-and-info/medical-information-from-the-nkf-/medical-info-ckd-info/ PatientNonprofit organizations, foundations, and charities77 (981K)40.068.977.870.475.378.660.69.3
National Kidney Foundation https://www.kidney.org/atoz/content/about-chronic-kidney-disease BothNonprofit organizations, foundations, and charities42 (50.4K)76.777.866.753.762.392.955.29.1
National Kidney Foundation of Illinois http://www.nkfi.org/education/chronic-kidney-disease BothNonprofit organizations, foundations, and charities89 (2.01M)26.762.275.964.872.267.953.29.5
Nephcure https://nephcure.org/livingwithkidneydisease/what-is-kidney-disease/ BothNonprofit organizations, foundations, and charities78 (1.0M)50.074.451.937.046.975.049.610.7
Net Wellness http://www.netwellness.org/healthtopics/kidney/kidneytreatment.cfm UnknownNonprofit organizations, foundations, and charities75 (912K)26.773.383.381.582.775.036.213.6
NHS https://www.nhs.uk/conditions/kidney-disease/symptoms/ PatientAcademic/professional (universities, hospitals, and research centers)15 (3.36K)50.074.477.879.678.492.962.48.7
NHS Inform https://www.nhsinform.scot/illnesses-and-conditions/kidneys-bladder-and-prostate/chronic-kidney-disease PatientAcademic/professional (universities, hospitals, and research centers)47 (85.0K)56.776.766.763.065.489.359.19.1
NI Direct Government Services https://www.nidirect.gov.uk/conditions/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)34 (42.5K)20.068.977.888.981.571.461.08.4
NICE Pathways UK https://pathways.nice.org.uk/pathways/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)28 (24.6K)30.087.880.679.680.282.133.913.2
NRS Healthcare https://www.nrshealthcare.co.uk/articles/condition/chronic-kidney-disease PatientCommercial and pharmaceutical companies63 (481K)36.761.161.150.057.464.350.711.6
Ontario Renal Network http://www.renalnetwork.on.ca/info_for_patients/kidney_disease/ BothAcademic/professional (universities, hospitals, and research centers)109 (7.2M)23.370.074.164.871.078.651.89.7
Patient https://patient.info/doctor/chronic-kidney-disease-pro BothNonprofit organizations, foundations, and charities19 (9.02K)40.084.475.979.677.2100.051.59.9
PHN Central and Eastern Australia https://www.cesphn.org.au/general-practice/help-my-patients-with/chronic-disease-management/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)92 (2.02M)3.358.964.859.361.753.626.617.4
Renal Support Network http://www.rsnhope.org/kidney-disease-health-library/ BothNonprofit organizations, foundations, and charities86 (1.62M)60.058.966.753.762.360.754.09.6
Rexall https://www.rexall.ca/articles/view/253/Chronic-Renal-Failure PatientCommercial and pharmaceutical companies55 (146K)30.061.167.655.663.660.746.312.1
Rogosin Institute http://www.rogosin.org/patient-care/kidney-disease/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)106 (4.65M)6.758.974.144.464.257.141.211.9
Saskatoon Health Region http://www.saskatoonhealthregion.ca/locations_services/Services/Kidney-Health/Pages/Chronic-Kidney-Disease-Clinic.aspx PatientAcademic/professional (universities, hospitals, and research centers)66 (537K)23.373.367.668.567.985.751.210.3
Scottish Kidney Federation[a] http://scotskidneyfederation.org/ckd-information.html PatientNonprofit organizations, foundations, and charitiesNAn/a57.869.457.465.460.739.712.0
Shire Canada https://www.shirecanada.com/patients/therapeutic-areas/chronic-kidney-disease PatientCommercial and pharmaceutical companies103 (3.59M)10.057.869.457.465.460.739.712.0
St Agnes Surgery http://www.stagnessurgery.com.au/chronic-kidney-disease.html PatientAcademic/professional (universities, hospitals, and research centers)110 (8.09M)23.355.668.546.361.167.932.315.2
Standford Healthcare https://stanfordhealthcare.org/medical-conditions/liver-kidneys-and-urinary-system/kidney-failure.html BothAcademic/professional (universities, hospitals, and research centers)38 (46.2K)10.066.773.157.467.967.946.49.8
Sunnybrook hospital https://sunnybrook.ca/content/?page=intro-chronic-kidney-disease-treatment PatientAcademic/professional (universities, hospitals, and research centers)49 (93.8K)13.375.679.664.874.775.038.09.4
The Renal Association https://renal.org/information-resources/the-uk-eckd-guide/ckd-stages/ ClinicianAcademic/professional (universities, hospitals, and research centers)65 (520K)60.082.275.072.274.182.139.913.5
The Royal Melbourne Hospital https://www.thermh.org.au/health-professionals/clinical-services/nephrology/chronic-kidney-disease BothAcademic/professional (universities, hospitals, and research centers)61 (405K)6.767.871.368.570.478.635.712.9
Think Kidneys https://www.thinkkidneys.nhs.uk/ckd/information-for-the-public/ PatientNonprofit organizations, foundations, and charities102 (3.22M)23.371.179.666.775.367.960.99.4
UC San Diego Health https://health.ucsd.edu/specialties/nephrology/Pages/chronic-kidney-disease.aspx PatientAcademic/professional (universities, hospitals, and research centers)12 (2.95K)43.378.975.970.474.175.045.711.1
UCSF Department of surgery https://surgery.ucsf.edu/conditions–procedures/chronic-kidney-disease.aspx BothAcademic/professional (universities, hospitals, and research centers)18 (8.53K)33.372.272.268.571.085.772.86.4
UNC Kidney Center https://unckidneycenter.org/kidneyhealthlibrary/chronic-kidney-disease-1/ BothAcademic/professional (universities, hospitals, and research centers)79 (1.07M)40.066.770.459.366.771.456.89.3
UptoDate https://www.uptodate.com/contents/chronic-kidney-disease-beyond-the-basics BothCommercial and pharmaceutical companies16 (5.23K)23.383.359.392.670.482.142.311.3
UW Health https://www.uwhealth.org/health/topic/major/kidney-disease-chronic/aa65427.html PatientAcademic/professional (universities, hospitals, and research centers)43 (59.8K)40.066.763.959.362.360.767.76.8
Very Well Health https://www.verywellhealth.com/chronic-kidney-disease-overview-1132509 PatientNonprofit organizations, foundations, and charities23 (10.4K)43.386.784.385.284.6100.042.313.1
Web MD https://www.webmd.com/a-to-z-guides/understanding-kidney-disease-basic-information BothCommercial and pharmaceutical companies5 (599)33.371.184.385.284.6100.068.07.2
Welling Homeopathy https://www.wellinghomeopathy.com/treatment-of-chronic-kidney-disease-ckd/ PatientCommercial and pharmaceutical companies67 (569K)16.735.666.750.061.142.939.013.6
Western Nephrology http://westneph.com/chronic-kidney-disease/ BothAcademic/professional (universities, hospitals, and research centers)111 (11.8M)10.052.274.140.763.064.338.212.8
Wiki How https://www.wikihow.com/Create-a-Kidney-Diet-to-Reverse-Chronic-Kidney-Disease PatientCommercial and pharmaceutical companies3 (179)6.768.974.185.277.878.658.38.9
Wikipedia https://en.wikipedia.org/wiki/Chronic_kidney_disease BothNonprofit organizations, foundations, and charities1 (5)26.772.271.379.674.192.918.514.5
World Kidney Day https://www.worldkidneyday.org/faqs/chronic-kidney-disease/ PatientNonprofit organizations, foundations, and charities80 (1.13M)26.764.481.564.875.960.750.910.0
Your MD https://www.your.md/condition/kidney-disease-chronic/ PatientCommercial and pharmaceutical companies57 (196K)46.773.382.479.681.575.060.78.1

Note. CKD = chronic kidney disease; FRE = Flesch Reading Ease; FKRGL = Flesch-Kincaid Reading Grade Level; eGFR = estimated glomerular filtration rate; CDC = Centers for Disease Control and Prevention; CESPHN = Central and Eastern Sydney Primary Health Network; DPC = Dialysis Patient Citizens; VMC = Virtual Medical Center; NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases; NHS = National Health Service.

Website became unavailable during evaluation.

Website link no longer accessible on 9 July 2019.

Proportion of Websites Addressing Specific CKD Content (n = 115). Note. CKD = chronic kidney disease. Website details including audience, rank, content and quality (n=115). Note. CKD = chronic kidney disease; FRE = Flesch Reading Ease; FKRGL = Flesch-Kincaid Reading Grade Level; eGFR = estimated glomerular filtration rate; CDC = Centers for Disease Control and Prevention; CESPHN = Central and Eastern Sydney Primary Health Network; DPC = Dialysis Patient Citizens; VMC = Virtual Medical Center; NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases; NHS = National Health Service. Website became unavailable during evaluation. Website link no longer accessible on 9 July 2019. The top 10 websites covering the greatest proportion of CKD content areas were Davita (93.3%), National Kidney Foundation (76.7%), Fresenius Kidney Care (66.7%), Kidney Foundation of Canada (63.3%), Kidney Care UK (60%), Manitoba Renal Program (60%), National Institute of Diabetes and Digestive and Kidney Diseases (60%), Renal Support Network (60%), The Renal Association (60%), Life Options (56.7%), and NHS Inform (56.7%).

Website Quality (Reliability, Usability, and Readability)

Most websites demonstrated moderate to high reliability and usability (Table 3); however, there was considerable variability across all websites, with scores as low as 35% in some cases. There was little variability when comparing mean scores of each instrument. The mean (SD) DISCERN score was 68.1% (14.6), LIDA was 71.0% (14.4), and HONcode was 74.6% (17.2). Although there was only slight variation in most scores, 2 usability measures were comparatively low across all sites: engagability (57%) and currency of presented information (51%). There was considerable variation in readability across all websites; the mean (SD) FKRGL was grade 10.6 (2.8) and FRE was 49.8 (14.4), suggesting poor readability. When stratified by website category (academic/professional, commercial/pharmaceutical, nonprofit/charity) or website audience (patient, clinician, both), there was minimal difference in quality scores across most quality metrics (Supplemental Table 1). The DISCERN, HONcode, and LIDA Reliability scores were slightly higher for websites geared toward a clinician audience; however, there were only 3 clinician-specific websites included in our evaluation. Readability did not differ based on website category or audience.
Table 3.

Mean Quality and Readability Assessment Scores for Reviewed Sites (n = 115).

MeasurementMean score% (±SD)
DISCERN
 Are the aims clear?79.0 (7.9)
 Does it achieve its aims?73.0 (10.6)
 Is it relevant?70.0 (11.4)
 Is it clear what sources of information were used to compile the publication (other than the author or producer)?62.4 (19.3)
 Is it clear when the information used or reported in the publication was produced?63.5 (20.4)
 Is it balanced and unbiased?66.1 (14.4)
 Does it provide details of additional sources of support and information?68.3 (19.6)
 Does it refer to areas of uncertainty?62.5 (13.6)
 Overall rating of the publication67.9 (14.6)
DISCERN total score68.1 (14.6)
LIDA
Usability measures
  Clarity77.3 (10.9)
  Consistency82.4 (10.9)
  Functionality79.2 (7.6)
  Engagability57.1 (14.7)
  Currency50.9 (14.8)
Reliability measures
  Conflicts of interest86.4 (14.2)
  Content production63.9 (20.4)
LIDA total score71.0 (14.4)
HON code74.6 (17.2)
FREMean FRE (±SD)49.8 (14.4)
FKRGLMean Grade (±SD)10.6 (2.8)

Note. FRE = Flesch Reading Ease; FKRGL = Flesch-Kincaid Reading Grade Level.

Mean Quality and Readability Assessment Scores for Reviewed Sites (n = 115). Note. FRE = Flesch Reading Ease; FKRGL = Flesch-Kincaid Reading Grade Level. The top 10 websites for each quality metric are included in Table 4. There was some variability in the websites achieving the highest quality scores across each quality metric; however, several sites scored in the top 10 across multiple quality metric categories (including American Kidney Fund, Kidney Care UK, Medical news Today, My Doctor, Family Doctor, MyHealth Alberta, UpToDate, and Very Well Health).
Table 4.

Top 10 Websites According to Quality Criteria[a].

Overall rankDISCERN (%)LIDA
Readability
Usability (%)Reliability (%)Flesch reading easeFlesch-Kincaid reading grade level
1NICE Pathways UK (87.78)Kidney Care UK (94.4)Health Wise Saskatchewan (94.4)Life Options (84.2)Life Options (4.5)
2Very Well Health (86.67)Davita (92.6)UpToDate (92.6)American Kidney Fund (79.7)Family Doctor (5.2)
3Patient (84.44)American Kidney Fund (91.7)NI Direct Government Services (88.9)HCA Healthcare (76.4)American Kidney Fund (5.5)
4Medical News Today (83.33)Kidney Health Australia (90.7)Health Direct Australia (88.9)Family Doctor (74.1)HCA Healthcare (5.5)
5UpToDate (83.33)Kids Health (89.8)Very Well Health (85.2)Mount Sinai (73.4)Medline Plus (5.9)
6MyHealth Alberta (83.33)Kidney Foundation of Canada (88.9)Web MD (85.2)UCSF Department of Surgery (72.8)UCSF Department of Surgery (6.4)
7Kidney Care UK (83.33)Fresenius Medical Care (87)CDC (85.2)Medline Plus (72.5)Health Wise Saskatchewan (6.5)
8Merck Manuals—Professional (82.22)Kidney Patient Guide (86.1)HealthLink BC (85.2)Kidney School (71.4)NIDDK (6.7)
9My Doctor (82.22)BC Renal Agency (86.1)My Virtual Medical Center (85.2)Info KID (69.8)MyHealth Alberta (6.8)
10The Renal Association (82.22)Health& (86.1)Wiki How (85.2)Health Wise Saskatchewan (69.4)UW Health (6.8)

Note. CDC = Centers for Disease Control and Prevention; NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases.

HON Code—12 websites scored 100.0%: Cleveland Clinic; Drugs.com; eMedicine Health; Family Doctor; Lab Tests Online; Mayo Clinic; Medical News Today; Medicine Net; My Doctor; Patient; Very Well Health; WebMD.

Top 10 Websites According to Quality Criteria[a]. Note. CDC = Centers for Disease Control and Prevention; NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases. HON Code—12 websites scored 100.0%: Cleveland Clinic; Drugs.com; eMedicine Health; Family Doctor; Lab Tests Online; Mayo Clinic; Medical News Today; Medicine Net; My Doctor; Patient; Very Well Health; WebMD.

Website Traffic

There was considerable variability in website traffic measured using Alexa Rank. The Alexa Rank ranged from 5 (Wikipedia) to 14.4M (Kidney Support Network). Websites with the highest traffic (Table 5) tended to be general health websites offering information on multiple medical conditions. One exception was the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), which ranked second overall for website traffic in our results (Alexa Rank 153). Most websites with the highest web traffic covered less than 40% of content topics (ranging from 6.7% [Wiki How] to 60% [NIDDK]), had quality scores above 70% in most cases (ranging from 44.4 [Medical Dictionary] to 100 [WebMD, Mayo Clinic, Medical News Today]), and readability ranged from grade 6.7 (NIDDK) to grade 14.5 (Wikipedia).
Table 5.

Top 10 Websites According to Website Traffic (Alexa Rank).

Website nameWebsite rank based on web traffic (Alexa Rank)Proportion of content areas covered (%)DISCERN (%)LIDA
HON code (%)Readability
Usability (%)Reliability (%)Flesch reading easeFlesch–Kincaid reading grade level
Wikipedia1 (5)26.772.2271.379.692.918.514.5
NIDDK2 (153)60.08073.179.682.169.16.7
Wiki How3 (179)6.768.8974.185.278.658.38.9
Health Line–CKD4 (529)20.067.7874.174.196.450.18.8
Web MD5 (599)33.371.1184.385.2100.068.07.2
Medical Dictionary6 (636)40.065.5652.844.467.935.013.1
Mayo clinic7 (1240)46.777.7876.977.8100.048.910.5
CDC8 (2200)16.777.7881.585.289.357.59.2
MedScape9 (2470)16.777.7872.277.896.429.813.8
Medical News Today10 (2610)33.383.3368.572.2100.048.410.3

Note. NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases; CKD = chronic kidney disease; CDC = Centers for Disease Control and Prevention.

Top 10 Websites According to Website Traffic (Alexa Rank). Note. NIDDK = National Institute of Diabetes and Digestive and Kidney Diseases; CKD = chronic kidney disease; CDC = Centers for Disease Control and Prevention.

Discussion

We completed a comprehensive review of CKD websites to evaluate their quality as well as content relative to 8 overarching information needs identified by CKD patients in our prior work.[11] Of the 115 websites included, we found that they were of reasonably high quality, as assessed using validated instruments. However, their mean reading grade level was grade 11, much higher than recommended for a general patient audience, and information related to travel, finances, and work/school in particular was very limited. We found considerable variation in content covered across all websites, with the majority of websites including information on less than 30% of the information needs expressed by patients as important for self-management.[11] Information related to understanding CKD, symptoms, and diet were included across most of the websites; however, content related to travel, finances, and work/school considerations was particularly lacking and, where available, was not tailored to a Canadian audience. Our review also highlighted deficiencies in content related to mental health, including screening tools for depression and strategies to communicate with others about mental health, and content related to dietary and self-management needs, such as practical tools for tracking diet and laboratory data and guidance on eating in restaurants. In addition, the website content was often difficult to navigate and required considerable time searching for the topics listed in our content checklist. We also found considerable variability in website traffic measured using Alexa Rank, with the highest ranking (correlating to the greatest traffic) being general health websites and not specific to CKD. In fact, the websites with the highest traffic covered less than 40% of the content areas and information needs identified by patients with CKD. Furthermore, both quality and readability were similar irrespective of the website category or audience. While previous CKD website reviews focused on quality and readability assessment,[5,10] a recent evaluation[35] of CKD mobile applications available in the Apple Store, Google Play, and 360 Mobile Assistant included a review of content topics identified as important to CKD self-management.[36] Similar to our review, Lee et al found that most of the mobile applications contained less than 60% of the information topics assessed and found considerable content gaps relating to managing medications (11.8% of apps), engaging and sustaining social support (6.4% of apps), and maintaining social and occupational roles (0% of apps).[35] These findings reveal a consistent need to improve the comprehensiveness of content relating to patient-identified self-management information needs across all eHealth platforms. When compared with earlier studies,[5,10] our evaluation revealed some improvement in website quality, particularly with regard to referencing the source of content and discussing areas of uncertainty, although this finding could be due to the larger number of websites evaluated in our review. Readability, however, continues to be a significant issue with the majority of sites written for a grade 10, or higher, audience. Weiss[34] recommends that written health information be targeted to a grade 6 audience to ensure that patients with a range of health literacy are able to understand presented information. Similar to other studies appraising CKD websites,[5,10] we found that most CKD websites had a reading grade level greater than the 10th grade, or rated “difficult” to “very difficult.” As patient-focused health resources are increasingly developed for and accessed from an online environment,[37] this finding highlights the ongoing need to reduce the complexity of online health information and improve the accessibility of the language used. Strengths of our study include a broad search methodology and inclusion of 1 popular search engines encompassing results from Australia, Canada, the United Kingdom, and the United States. We used 3 different measures of usability and reliability, with 2 reviewers completing the evaluation independently. The 2 reviewers also independently measured readability using 2 different methods for all sites. Our study does, however, have limitations. We limited our review to English-language websites, and although we screened >2000 websites and included 115 in our evaluation, our search terms were limited to “chronic kidney disease” so it is possible we inadvertently missed CKD websites that did not include these terms, although these are the terms most commonly used by patients with CKD.[5] In addition, websites may change rapidly over time and the content and quality may change as websites are updated and new content and features are added; therefore, the results are reflective of the website content and quality at the time of our review. Our study provides a comprehensive review of CKD websites and includes regional variants within the search strategy, allowing broad identification and evaluation of international sites. Our results highlight the lack of tailored, comprehensive online information for CKD, and identify specific information and quality gaps in need of attention. These results will inform content gaps in internet-accessible information on CKD self-management that should be addressed by future eHealth web-based tools. Click here for additional data file. Supplemental material, SuppTable_1._Mean_score_based_on_website_category_and_audience_17May2019 for Content and Quality of Websites for Patients With Chronic Kidney Disease: An Environmental Scan by Michelle Smekal, Sarah Gil, Maoliosa Donald, Heather Beanlands, Sharon Straus, Gwen Herrington, Dwight Sparkes, Lori Harwood, Allison Tong, Allan Grill, Karen Tu, Blair Waldvogel, Chantel Large, Claire Large, Marta Novak, Matthew James, Meghan Elliott, Maria Delgado, Scott Brimble, Susan Samuel and Brenda R. Hemmelgarn in Canadian Journal of Kidney Health and Disease
  28 in total

Review 1.  Whatever happened to qualitative description?

Authors:  M Sandelowski
Journal:  Res Nurs Health       Date:  2000-08       Impact factor: 2.228

2.  HON label and DISCERN as content quality indicators of health-related websites.

Authors:  Yasser Khazaal; Anne Chatton; Daniele Zullino; Riaz Khan
Journal:  Psychiatr Q       Date:  2012-03

3.  DISCERN: an instrument for judging the quality of written consumer health information on treatment choices.

Authors:  D Charnock; S Shepperd; G Needham; R Gann
Journal:  J Epidemiol Community Health       Date:  1999-02       Impact factor: 3.710

4.  The impact of self-management support on the progression of chronic kidney disease--a prospective randomized controlled trial.

Authors:  Sue-Hsien Chen; Yun-Fang Tsai; Chiao-Yin Sun; I-Wen Wu; Chin-Chan Lee; Mai-Szu Wu
Journal:  Nephrol Dial Transplant       Date:  2011-03-17       Impact factor: 5.992

5.  Assessment of osteoporosis-website quality.

Authors:  E M Lewiecki; L A Rudolph; G M Kiebzak; J R Chavez; B M Thorpe
Journal:  Osteoporos Int       Date:  2006-01-31       Impact factor: 4.507

6.  Improving on-line information for potential living kidney donors.

Authors:  E M Moody; K K Clemens; L Storsley; A Waterman; C R Parikh; A X Garg
Journal:  Kidney Int       Date:  2007-03-14       Impact factor: 10.612

7.  Evaluation of eHealth web sites for patients with chronic kidney disease.

Authors:  Jonathan B Jaffery; Bryan N Becker
Journal:  Am J Kidney Dis       Date:  2004-07       Impact factor: 8.860

Review 8.  The doctor, the patient and the world-wide web: how the internet is changing healthcare.

Authors:  J A Powell; M Darvell; J A M Gray
Journal:  J R Soc Med       Date:  2003-02       Impact factor: 18.000

9.  Debate about evaluation and monitoring of sites carrying the HON-Logo.

Authors:  T Nater; C Boyer
Journal:  J Med Internet Res       Date:  2000 Apr-Jun       Impact factor: 5.428

10.  Website quality indicators for consumers.

Authors:  Kathleen M Griffiths; Helen Christensen
Journal:  J Med Internet Res       Date:  2005-11-15       Impact factor: 5.428

View more
  6 in total

1.  Quality assessment of consumer-facing websites on sodium reduction.

Authors:  Tasfia Hussain; Taha Ahmedna; Matti Marklund; Lawrence J Appel; Megan E Henry
Journal:  J Clin Hypertens (Greenwich)       Date:  2022-09-29       Impact factor: 2.885

2.  An evaluation of the quality of online perinatal depression information.

Authors:  Madison P Hardman; Kristin A Reynolds; Sarah K Petty; Teaghan A M Pryor; Shayna K Pierce; Matthew T Bernstein; Patricia Furer
Journal:  BMC Pregnancy Childbirth       Date:  2022-03-15       Impact factor: 3.007

3.  A Research Protocol for Implementation and Evaluation of a Patient-Focused eHealth Intervention for Chronic Kidney Disease.

Authors:  Maoliosa Donald; Heather Beanlands; Sharon Straus; Lori Harwood; Gwen Herrington; Blair Waldvogel; Maria Delgado; Dwight Sparkes; Paul Watson; Meghan Elliott; Kerry McBrien; Aminu Bello; Brenda Hemmelgarn
Journal:  Glob Implement Res Appl       Date:  2022-01-30

4.  An eHealth self-management intervention for adults with chronic kidney disease, My Kidneys My Health: a mixed-methods study.

Authors:  Maoliosa Donald; Heather Beanlands; Sharon Straus; Michelle Smekal; Sarah Gil; Meghan J Elliott; Lori Harwood; Blair Waldvogel; Maria Delgado; Dwight Sparkes; Allison Tong; Allan Grill; Marta Novak; Matthew T James; K Scott Brimble; Karen Tu; Brenda R Hemmelgarn
Journal:  CMAJ Open       Date:  2022-08-16

5.  An evaluation of the quality of COVID-19 websites in terms of HON principles and using DISCERN tool.

Authors:  Reza Safdari; Marsa Gholamzadeh; Soheila Saeedi; Mozhgan Tanhapour; Sorayya Rezayi
Journal:  Health Info Libr J       Date:  2022-08-10

6.  Features of patient-education websites for patients with chronic kidney disease: an analysis of recommended websites.

Authors:  Rohanit Singh; Bernard G Jaar; Gibran Kazi; Lawrence J Appel
Journal:  BMC Nephrol       Date:  2020-11-03       Impact factor: 2.388

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.