Research into the relationship between digital health literacy and healthy lifestyle behaviors: an intergenerational comparison

The diversity of the population worldwide suggests a great need for cross-culturally validated research instruments or scales. Researchers and clinicians must have access to reliable and valid measures of concepts of interest in their own cultures and languages to conduct cross-cultural research and/or provide quality patient care. Although there are well-established methodological approaches for translating, adapting and validating instruments or scales for use in cross-cultural health care research, a great variation in the use of these approaches continues to prevail in the health care literature. Therefore, the objectives of this scholarly paper were to review published recommendations of cross-cultural validation of instruments and scales, and to propose and present a clear and user-friendly guideline for the translation, adaptation and validation of instruments or scales for cross-cultural health care research. A review of highly recommended methodological approaches to translation, adaptation and cross-cultural validation of research instruments or scales was performed. Recommendations were summarized and incorporated into a seven-step guideline. Each one of the steps was described and key points were highlighted. Example of a project using the proposed steps of the guideline was fully described. Translation, adaptation and validation of instruments or scales for cross-cultural research is very time-consuming and requires careful planning and the adoption of rigorous methodological approaches to derive a reliable and valid measure of the concept of interest in the target population. © 2010 Blackwell Publishing Ltd.

Background Electronic health resources are helpful only when people are able to use them, yet there remain few tools available to assess consumers’ capacity for engaging in eHealth. Over 40% of US and Canadian adults have low basic literacy levels, suggesting that eHealth resources are likely to be inaccessible to large segments of the population. Using information technology for health requires eHealth literacy—the ability to read, use computers, search for information, understand health information, and put it into context. The eHealth Literacy Scale (eHEALS) was designed (1) to assess consumers’ perceived skills at using information technology for health and (2) to aid in determining the fit between eHealth programs and consumers. Objectives The eHEALS is an 8-item measure of eHealth literacy developed to measure consumers’ combined knowledge, comfort, and perceived skills at finding, evaluating, and applying electronic health information to health problems. The objective of the study was to psychometrically evaluate the properties of the eHEALS within a population context. A youth population was chosen as the focus for the initial development primarily because they have high levels of eHealth use and familiarity with information technology tools. Methods Data were collected at baseline, post-intervention, and 3- and 6-month follow-up using control group data as part of a single session, randomized intervention trial evaluating Web-based eHealth programs. Scale reliability was tested using item analysis for internal consistency (coefficient alpha) and test-retest reliability estimates. Principal components factor analysis was used to determine the theoretical fit of the measures with the data. Results A total of 664 participants (370 boys; 294 girls) aged 13 to 21 (mean = 14.95; SD = 1.24) completed the eHEALS at four time points over 6 months. Item analysis was performed on the 8-item scale at baseline, producing a tight fitting scale with α = .88. Item-scale correlations ranged from r = .51 to .76. Test-retest reliability showed modest stability over time from baseline to 6-month follow-up (r = .68 to .40). Principal components analysis produced a single factor solution (56% of variance). Factor loadings ranged from .60 to .84 among the 8 items. Conclusions The eHEALS reliably and consistently captures the eHealth literacy concept in repeated administrations, showing promise as tool for assessing consumer comfort and skill in using information technology for health. Within a clinical environment, the eHEALS has the potential to serve as a means of identifying those who may or may not benefit from referrals to an eHealth intervention or resource. Further research needs to examine the applicability of the eHEALS to other populations and settings while exploring the relationship between eHealth literacy and health care outcomes.

Background With the digitization of health care and the wide availability of Web-based applications, a broad set of skills is essential to properly use such facilities; these skills are called digital health literacy or eHealth literacy. Current instruments to measure digital health literacy focus only on information gathering (Health 1.0 skills) and do not pay attention to interactivity on the Web (Health 2.0). To measure the complete spectrum of Health 1.0 and Health 2.0 skills, including actual competencies, we developed a new instrument. The Digital Health Literacy Instrument (DHLI) measures operational skills, navigation skills, information searching, evaluating reliability, determining relevance, adding self-generated content, and protecting privacy. Objective Our objective was to study the distributional properties, reliability, content validity, and construct validity of the DHLI’s self-report scale (21 items) and to explore the feasibility of an additional set of performance-based items (7 items). Methods We used a paper-and-pencil survey among a sample of the general Dutch population, stratified by age, sex, and educational level (T1; N=200). The survey consisted of the DHLI, sociodemographics, Internet use, health status, health literacy and the eHealth Literacy Scale (eHEALS). After 2 weeks, we asked participants to complete the DHLI again (T2; n=67). Cronbach alpha and intraclass correlation analysis between T1 and T2 were used to investigate reliability. Principal component analysis was performed to determine content validity. Correlation analyses were used to determine the construct validity. Results Respondents (107 female and 93 male) ranged in age from 18 to 84 years (mean 46.4, SD 19.0); 23.0% (46/200) had a lower educational level. Internal consistencies of the total scale (alpha=.87) and the subscales (alpha range .70-.89) were satisfactory, except for protecting privacy (alpha=.57). Distributional properties showed an approximately normal distribution. Test-retest analysis was satisfactory overall (total scale intraclass correlation coefficient=.77; subscale intraclass correlation coefficient range .49-.81). The performance-based items did not together form a single construct (alpha=.47) and should be interpreted individually. Results showed that more complex skills were reflected in a lower number of correct responses. Principal component analysis confirmed the theoretical structure of the self-report scale (76% explained variance). Correlations were as expected, showing significant relations with age (ρ=–.41, P<.001), education (ρ=.14, P=.047), Internet use (ρ=.39, P<.001), health-related Internet use (ρ=.27, P<.001), health status (ρ range .17-.27, P<.001), health literacy (ρ=.31, P<.001), and the eHEALS (ρ=.51, P<.001). Conclusions This instrument can be accepted as a new self-report measure to assess digital health literacy, using multiple subscales. Its performance-based items provide an indication of actual skills but should be studied and adapted further. Future research should examine the acceptability of this instrument in other languages and among different populations.