This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.

Background

Health information technology has become common in the care of patients with chronic diseases; however, there are few such applications employed in kidney disease.

Objective

The aim of the study was to evaluate the use of a website providing disease-specific safety information by patients with predialysis chronic kidney disease.

Methods

As part of the Safe Kidney Care (SKC) study, an educational website was designed to provide information on safety concerns in chronic kidney disease. Phase I study participants were provided a medical alert accessory with a unique ID number, the Safe Kidney Care website, and an in-person tutorial on the use of the Internet and accessing the SKC website at baseline. Participants were asked to visit the website and enter their unique ID as frequently as they desired over the next 365 days or until their annual follow-up visit, whichever occurred first. Participants’ visits and dwell times on specific safety modules were tracked using embedded webpage PHP scripts linked to a MySQL database, enabling the collection of website usage statistics.

Results

Of 108 Phase I participants, 28.7% (31/108) visited the website from 1-6 times during the observation period (median follow-up 365 days). Median access time was 7 minutes per visit (range <1-46) and 13 minutes per person (range <1-123). The three most frequently visited pages were “Renal function calculator”, “Pills to avoid”, and “Foods to avoid”. High school education and frequent Internet use were significantly associated with website entry (P=.02 and P=.03, respectively).

Conclusions

Preliminary results show general interest in a Web-based platform designed to improve patient safety in chronic kidney disease.

Health information technology is expected to play a growing role in medical care delivery over the coming years [1]. The Internet has become a major source of educational health materials for both patients and providers and mobile health applications are being developed for a wide variety of diseases and health conditions [2-7]. For health IT applications to have a beneficial impact on disease outcomes, they must be designed to match the predominant technologic proficiency (e-literacy) of the target population. While the use of computers, the Internet, and mobile devices continues to rise in the United States [8,9], many chronic disease populations are not the target of commercial IT developers. The population with chronic kidney disease is one such population, as it includes a high preponderance of individuals who are older, of lower socioeconomic status, and with lower health literacy [10,11]. Therefore, it is unknown whether health IT tools intended for chronic kidney disease can be effective.

The Safe Kidney Care (SKC) study was a prospective cohort designed to gauge adverse safety events in chronic kidney disease. In Phase I of this study, we set out to evaluate the acceptance and initial use of a health IT system including a device designed to increase recognition of chronic kidney disease (medical alert accessory) and linked to a website. The medical alert bracelet was devised for the purpose of alerting patients and providers of a patient’s diagnosis of chronic kidney disease and directing these individuals to a website informing patients, family members, and providers about the unique patient safety concerns associated with chronic kidney disease management. We tracked the incidence of study participants’ initial entry into the website over a one-year period and their prioritization of chronic kidney disease patient safety concerns.

MethodsStudy Population

The SKC cohort study (Clinicaltrials.gov NCT 01407367) was approved by the University of Maryland School of Medicine Institutional Review Board and Veterans Affairs Maryland Health Care System Baltimore Research and Development committee. The primary objective of the SKC cohort study was to examine the relationship between chronic kidney disease recognition and patient safety. The objective of Phase I of the SKC cohort was to evaluate a medical alert accessory (American Medical ID, Houston, TX) noting the participant’s diagnosis of chronic kidney disease and directing patients and providers to the Safe Kidney Care website offering information on common patient safety concerns pertinent to chronic kidney disease. To be eligible for the SKC cohort, participants needed two measures of renal function with an estimated glomerular filtration rate (eGFR) of less than 60 ml/min/1.73 m2 at least 90 days apart and no more than 18 months prior to enrollment. Participants were excluded for Phase I if they were expected to reach end-stage renal disease or die within one year from enrollment or if they had skin sensitivity to silver or stainless steel. Primary sources for recruitment and enrollment were the University of Maryland Medical System and Baltimore Veterans Affairs Medical Center Early Renal Insufficiency disease management clinics.

Safe Kidney Care (SKC) Cohort Study Procedures

Upon enrollment into the SKC cohort, participants were seen at baseline and then annually in-center with a 6-month interim telephone follow-up visit. At the baseline visit, Phase I participants were provided with a fitted medical alert accessory of their choosing (bracelet or necklace) engraved with the message: “Decreased kidney function”. For safe care, please visit the Safe Kidney Care website and a unique study number. This unique ID number did not contain any personally identifiable information. After baseline data collection and provision of the medical alert accessory, the study coordinator provided participants with a demonstration and short tutorial on accessing the Internet and SKC website, where to enter their unique ID number, and a tour of the website and its features. At completion of the tutorial, participants were encouraged to use the website, along with family members and providers. They were instructed to enter their unique ID number when accessing the website’s patient portal so that their usage could be tracked, although this was not required for entrance into the website (Figure 1).

Safe Kidney Care Website Development

Prior to the commencement of enrollment into the SKC cohort, an extensive literature review was conducted to identify chronic kidney disease-pertinent patient safety concerns. Approximately 800 academic and community nephrologists were then invited to participate in a survey to prioritize identified candidate patient safety concerns and to suggest additional potential patient safety events not previously considered. The feedback by participating respondents (n=142) was then used as the basis for development of the SKC website, which covers the most commonly identified chronic kidney disease-specific patient safety concerns along with other general nephrology educational topics. The resulting modules were reviewed by an expert panel convened for the SKC project with additional modifications made based on their input. The website contains both a patient and family member portal, which provides module descriptions in lay terms, and a health care provider portal, which uses common medical terminology.

The resultant SKC website was designed using guidelines for color and content layout incorporated from the 508 Compliance and Disabilities Act and heuristic design [12,13]. Emphasis was placed on ease of readability, with text written to target a 6th grade reading level in the patient portal. The primary placement of the “Safety Concerns” was in a circular distribution to avoid the implication of prioritization of topics. Images were designed to be static because of the anticipated limited access to Adobe Flash (or other multimedia platform). The website was designed to limit the need to scroll; however, on pages with a requirement for scrolling, the most important content was placed above the fold so as to ensure primary focus on the safety content. The capability to increase text size on every page was installed and displayed and meaningful, relatable icons were chosen for easy recognition of content topics (eg, picture of a stethoscope to represent “What to Tell My Doctor”). A quick-launch side panel, entitled “Learn More”, included links to pages on the SKC website which provide users with basic information about the function of the kidneys, what is meant by kidney disease, definition of the glomerular filtration rate (GFR), and a glossary of commonly used medication terms (eg, “blood pressure”, “dialysis”, and “nephrologist”). The website markup and content were constructed using HTML with embedded functions programmed using PHP programming language (Version 5.3.5). The design was conceived with the goal of optimal use on all Internet portals. Usability testing was conducted on a small representative sample and previously reported [14]. Modifications to the website were instituted based on feedback from usability participants.

To evaluate the receipt of information designed for the targeted audience, we tracked activities on the SKC website of each bracelet ID assigned to study group participants, including page viewing frequency, browsing time for each page, and feedback. Due to flexibility and security concerns, our implemented computer routine was believed to surpass other available online tracking and analysis services (eg, Google Analytics), as our own implementation and hosting permitted precise tracking defined for the study purposes with data stored securely on our local server.

The website was programmed to track both registered and anonymous users through PHP scripts embedded in each webpage. The PHP scripts were linked with a database built on the MySQL server, to collect and store predefined website usage statistics. For each distinct participant log-in or anonymous guest visit, a unique session number was assigned to label all actions during the visit until the session expired or the visitor started a new session. Medical alert accessory unique ID, session number, log-in time, and IP address were recorded into a table for each independent visit. During a session, each click of an internal or external link was captured and a unique record was generated, including session number, page/link entry time, and page/link ID. With this information, it was possible to recreate the visiting pathway for each visit, to count total pages read in each session, and to calculate other pertinent statistics such as frequency of each page visited in each session, or number of visits from a registered user. It is generally difficult to determine the time when a visitor leaves a page because the visitor may leave the computer for an interruption and return after some time; hence, it was not possible to ascertain precisely how long a visitor focused on the content of the webpages. Nevertheless, the dwelling time for each page was estimated, under the assumption that a visitor would not spend an extended time on a single page but would continue to browse different pages. At the same time, a minimum length of time must also be spent on each page to conduct effective reading. Therefore, an effective dwelling length on a page was counted if the time difference between two distinct webpage entry times (within the same session) was longer than 5 seconds and less than 10 minutes.

Outcomes

The primary outcome in this analysis was the first entry into the SKC website with input of a unique ID number by SKC study participants at any time following completion of their baseline SKC visit until their first annual follow-up visit or 365 days of observation, whichever occurred first. Access of the health care provider portal was not analyzed for the purpose of this study. The number of days from baseline SKC visit was recorded, as was the length of dwell time on the website and on selected modules. Modules were ranked by frequency of selection if selected at least once during the participant’s initial visit on the website.

Covariates

Additional factors measured at baseline SKC visit and included in the analysis were demographic characteristics, socioeconomic status, education, health literacy and numeracy [15], and ease and frequency of use of the Internet. Baseline serum creatinine was measured and used to estimate the GFR with the abbreviated Modified Diet in Renal Disease equation [16].

Statistical Methods

For descriptive analyses, continuous variables were presented with mean and standard error (SE) and Student’s t test for comparison across groups. Binomial and categorical variables were expressed as N (%) with comparisons made with the chi-square test. Stepwise logistic regression was used to examine factors that predict incident registration into the SKC website. All factors were used in a forward stepwise inclusion procedure with retention of only those factors with significance of P<.05.

Results

Enrollment commenced for Phase I of the SKC cohort on April 15, 2011 and the last of 108 participants completed the baseline visit on January 23, 2012. A medical alert bracelet was selected by 55 (50.9%, 55/108) of participants with 53 (49.1%, 53/108) choosing the medical alert necklace. The median observation time was 365 days (range 305-365). Table 1 shows the demographic and baseline characteristics of all participants. Mean age of SKC participants was 64 years (SD 11) with a mean estimated GFR of 42 ml/min/1.73m2 (SD 14). Of note, 10 enrolled participants were estimated to have eGFRs >60 ml/min/1.732 at their baseline visit, despite two screening eGFRs that fit enrollment criteria of eGFR <60 ml/min/1.73m2. The majority of participants were black, unmarried, with a household income of ≤ US$50,000 annually (72.2%, 78/108; 55.6%, 60/108; and 68.5%, 74/108, respectively). While 86.1% of participants (93/108) reported availability of computer access, 45.4% (49/108) estimated their Internet usage to be less frequent than weekly or daily.

Figure 2 shows the results of the SKC website usage at the end of observation for all participants. To date, 28.7% (31/108) of participants visited the website since study enrollment a median of 1 time (range 1-6). Median SKC website access time per visit was 7 minutes (range <1-46). Median cumulative SKC website access time per person was 13 minutes (range <1-123) with a cumulative access time by all 31 participants of 669 minutes. The three most frequently visited pages were “Renal function calculator”, “Pills to avoid”, and “Foods to avoid” (Table 2).

The adjusted proportion of individuals with SKC website log-in by baseline characteristic is shown in Table 3. After stepwise logistic analysis, pertinent and significant factors predictive of incident use of the SKC website were high school diploma (OR 3.22, 95% CI 1.18-8.81) and frequent use of the Internet (OR 3.31, 95% CI 1.13-9.72), P=.02 and P=.02, respectively.

cSeven participants were unable to complete the abbreviated Test of Functional Health Literacy Assessment (TOFHLA) due to conditions such as blindness.

DiscussionPrincipal Findings

In this study, we have described the longitudinal access and usage of a Web-based reference on the unique concerns of patient safety in chronic kidney disease based on the provision of a medical alert accessory with a unique identifier and prompt for website use. The study evaluates the alignment of a commonly used medical alert device, designed to enhance awareness of chronic kidney disease, with a health IT portal offering disease-pertinent information to the target population. The results offer an assessment on the likelihood that individuals with chronic kidney disease and their family members will utilize this alert system intended to increase disease awareness and improve patient safety. The findings suggest a substantial proportion of the SKC Phase I sample, designed to be representative of the chronic kidney disease population, were capable and motivated to access the website to view the developed patient safety modules. The results reveal the population’s prioritization of safety concerns specific to chronic kidney disease. Moreover, the report on dwell time provides indication of the importance users placed on the content.

Several reports show that patients with chronic disease who are empowered with IT tools for monitoring, training, and self-management have improved outcomes [2-7], yet few prior investigations evaluate the usage of these applications in general or those specifically designed for the chronic kidney disease population. While online educational materials designed to promote patient education and community awareness of kidney disease are available via high-quality programs such as the National Kidney Disease Education Program [17] and the National Kidney Foundation [18], the use of these materials by the target population remains unknown. Our study is unique in its demonstration of the feasibility of acceptance and utilization of a hybrid system combining a longstanding physical device (a variant of which has been most commonly utilized in kidney disease to preserve potential vascular access sites) [19] with its value enhanced by a usability-tested health IT portal [14] providing extensive information relevant to the chronic kidney disease population.

Introduction of online tools does not guarantee their usage by the target population and the results from this study support prior examinations that estimate use of online tools to be highly variable. Our findings align with studies in other chronic diseases, which reveal inconsistency in website use, but self-reported or measured use has been noted to range from approximately 10-40% of those queried [20-22]. Adults in the United States living with chronic disease are significantly less likely than healthy adults to have access to the Internet (62% vs 81%), but once online, those with chronic disease are more likely to use social media and online tools to share information and obtain support from their peers [23]. Individuals with chronic disease still report an overwhelming preference to receive health-related education and advice from a professional source such as a health care provider [24], which emphasizes the role of the Internet as an accessory to, rather than a replacement for, quality provider-patient interactions. The results presented here suggest information needs in the areas most frequently visited on the website, even for face-to-face encounters.

Limitations

The study presented has limitations related to the descriptive nature of the results, which may limit generalizability. While approximately 30% of participants visited the SKC website, 70% did not, which is an important finding. These individuals who did not access the website were not specifically asked to comment on reasons for their lack of participation (eg, lack of interest rather than access), which may not be captured in the demographic evaluation of computer and Internet access, but likely is highly relevant to future work using health IT applications in chronic kidney disease. The use of nephrologists only in identifying specific areas of safety concerns in chronic kidney disease was limited in that it did not include advanced practitioners or primary care providers, who play important roles in caring for individuals with chronic kidney disease and undoubtedly would have added value to the content. Further, we did not incorporate patients in the initial design of the website; however, usability testing was performed with such a population using an iterative process used to finalize the SKC website [14]. Finally, the relatively short follow-up of participants does not allow us to yet comment on the impact of the conjoined alert accessory and website resource on patient safety outcomes in chronic kidney disease.

Conclusions

Patient safety is a significant problem in kidney disease and online education tools such as the SKC website may serve as platform to educate individuals with chronic kidney disease about potential hazards related to their condition. Further examination is needed to assess individuals’ long-term utilization and dissemination of such materials and the impact of such resources in preventing safety events in chronic kidney disease.

AbbreviationseGFR

estimated glomerular filtration rate

SKC

Safe Kidney Care

TOFHLA

Test of Functional Health Literacy Assessment

Dr Fink is funded for this work by a grant from the National Institute of Diabetes and Digestive and Kidney Diseases (R01 DK084017) (PI: Jeff Fink). Medical alert bracelets were provided gratis by American Medical ID in Houston, TX, for use in this study [25].