Ariana-Anamaria CORDOȘ [a,b] , Sebastian-Aurelian ȘTEFĂNIGĂ [c,1] ,
Călin MUNTEAN [d], Corina Violeta VERNIC [d] and Sorana D. BOLBOACĂ [b]
[a] Babeș-Bolyai University, Cluj-Napoca, Romania
[b] Iuliu Hațieganu University of Medicine and Pharmacy Cluj-Napoca, Romania
[c] West University Timișoara, Romania
[d] Victor Babeș University of Medicine and Pharmacy, Timișoara, Romania
ORCiD ID: Ariana-Anamaria CORDOȘ https://orcid.org/0000-0003-2853-4058
Sebastian-Aurelian ȘTEFĂNIGĂ https://orcid.org/0000-0002-6211-9205
Călin MUNTEAN https://orcid.org/0000-0002-0497-0405
Corina Violeta VERNIC https://orcid.org/0000-0002-6099_871X
Sorana D. BOLBOACĂ https://orcid.org/0000-0002-2342-4311
Abstract
Access to the internet and online resources changes the concept of health and increases people’s autonomy. In this context, Health Literacy (HL) is a critical determinant of health-related choices. At World Health Organization (WHO) level, M-POHL (Action Network on Measuring Population and Organizational Health Literacy of WHO-Europe) created and validated on European population four questionnaires: digital HL (HLS19-DIGI), communication HL (with doctors from health care services – HLS19-COM-P-Q11 long version and HLS19-COM-P-Q6 short version), online navigation HL (HLS19-NAV), and vaccination HL (HLS19-VAC). Based on the expertise of the team, the present study aimed to report the study protocol for Romanian translation, culturally adapting and psychometric testing the following three M-POHL health literacy tools: HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6. We will conduct a qualitative descriptive study design in seven steps to translate and adapt the HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6 to the Romanian speakers. The study will begin with the translation of English (En)-Romanian (Ro) (2 researchers involved) (step 1), followed by the evaluation of the translation by a bilingual researcher independent of the two researchers who did the En-Ro translation (step 2), the translation of Ro-En (2 researchers but not those in step 1; step 3), the evaluation of the translation by a bilingual researcher independent of the two researchers who did the Ro-En translation (step 4), evaluation of the translation of the tool in an expert group (step 5), pilot testing on a sample of the target population (step 6) and full psychometric testing of the version resulting from step 6 (step 7).
Keywords
Health literacy (HL), Survey, Translation, Validation.
Introduction
Access to the internet and to the resources available online changes the concept of health and increases people’s autonomy. In this context, Health Literacy (HL) is a critical determinant of health-related choices. Low levels of health literacy are associated with poorer health [1,2], unhealthy behavior and more visits to healthcare services [3,4]. A high proportion of people have low HL, with a clear social gradient for HL [4]. At the World Health Organization (WHO) level, M-POHL (Action Network on Measuring Population and Organizational Health Literacy of WHO-Europe) has activities to assess literacy in the context of health. Among the objectives, M-POHL includes conducting regular, high-quality, internationally comparative surveys on health literacy, health literacy systems and organizations, collecting and analyzing data on organizational health literacy (structures, processes, and capacities conducive to health literacy). Data from the European Health Literacy Knowledge Survey show that almost half of the Europeans surveyed (Romania did not participate in this study) have inadequate or problematic health knowledge. Poor health literacy skills are associated with riskier behavior, poorer health, less self-management, and more hospitalization and costs [5]. Under the umbrella of M-POHL, specific tools have been developed, validated, and applied to measure four relevant specific aspects of HL (https://m-pohl.net/tools): (1) Digital HL (HLS19-DIGI) [6], (2) HL of communication (with doctors of health care services – HLS19-COM-P-Q11 Long version and HLS19-COM-P-Q6 Short version) [7], (3) HL internet browsing (HLS19-NAV) [8-10], and (4) Vaccination HL (HLS19-VAC). There is evidence on different aspects of health literacy in European countries [4]. The present study aimed to present the study protocol for Romanian translation, cultural adaptation, and psychometric testing of three health literacy M-POHL tools from the area of expertise of the research team, namely HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, and HLS19-COM-P-Q6.
Materials and Methods
The translation and cultural adaptation of the questionnaires will be done applying the methodology described by HSRI (Human Services Research Institute, USA) [11] and following the methodology recommended by Sousa and Rojjanasrirat [12]. Table 1 summarizes the steps that apply to each instrument. The procedures that will be followed are presented in Table 2.
Table 1. ALSATION study: steps and description.
Step 1: Translating the tool from En to Ro (2 experienced researchers from academia with different backgrounds). The first translator must have knowledge of medical terminology and tool construction, and the second translator must be familiar with colloquial phrases, slang, and jargon regarding digital literacy, idiomatic expressions, and emotional terms. The approach will generate two translated versions containing words and sentences that cover both medical language and ordinary spoken language with its cultural nuances.
Step 2: Evaluation of the translation by a bilingual researcher independent of the two researchers who made the initial translation. At this stage, ambiguities and discrepancies of words, sentences, and meanings are evaluated. The identified discrepancies are discussed and resolved by a group consisting of the two researchers who made the initial translation, the third researcher, and at least two other members of the research team. This group must reach a consensus and will report the preliminary Ro versions.
Step 3: Translate the preliminary version of the tool from Ro to En. Use different two researchers/translators with the characteristics described in step 1.
Step 4: Apply the approach presented in step 2 for comparing the translated versions from Ro to En relative to the original version of the tool. At this stage, the similarity of the instructions, elements, and response format is assessed in terms of wording, item structure, meaning, and relevance. Repeat steps 1 to 4 as many times as necessary to solve all ambiguities and discrepancies. Alternatively, only elements that do not retain their original meaning are retranslated and translated back.
Step 5: Evaluate the translation of the tool in an expert group (targeted number is 10). We will evaluate the clarity of instructions, items, and response possibilities. The experts will be invited to assess each element of the instrument in terms of content relevance (1 = not relevant; 2 = somewhat relevant; 3 = relevant but requires minor changes; 4 = very relevant. Items classified as 1 or 2 will be revised [13]); sharpness (1 = blurry; 2 = item needs review; and 3 = very clear); and necessity (1 = non-essential; 2 = useful but not essential; and 3 = essential). The content validity index will be calculated at the element level (I-CVI, CVI=content validity) and at the S-CVA/Ave scale level (mean calculation method) [14]. The items with 0.70 ≤ I-CVI (relevance of items) ≤ 0.79 will be reviewed [15], and those with I-CVI < 0.70 will be removed [16]; S-CVA/Ave ≥ 0.90 shows excellent content validity [15]. The process will continue until acceptable indices of validity are obtained or eliminated. The final version will be analyzed in terms of content (internal validity) by calculating the kappa coefficient [17], the minimum acceptable coefficient to be considered a good tool being 0.60, excellent above 0.74.
Step 6: Pilot testing on a sample of the target population (targeted sample size: 10-40 participants). At this stage, each participant evaluates the instructions and elements of the instrument using a dichotomous scale (clear or unclear). For evaluations in the “blurry” category, participants are asked to provide suggestions on how to rewrite to make the language clearer. We will reassess items and elements of the instrument that at least 20% of the sample consider unclear [18].
Step 7: Full psychometric testing of the version resulting from step 6 (targeted sample size: minimum 10 subjects per instrument scale item). What do we evaluate? At least one of the following: (1) reliability of internal consistency; (2) stability reliability (test-retest reliability); (3) the validity of the construction (convergent and/or divergent, discriminatory validity).
Table 2. ALSATION study: main procedures.
Step 1: Criteria for identifying potential participants for translation: Language skills En (minimum level C1) and Ro (mother tongue); Experience in the field (medicine, sociology, public health, applied informatics in medicine or related fields); Previous experience in questionnaire translation or questionnaire-based research: if possible, previous translation experience (questionnaires or other research materials) in the previously listed areas. Participants must give their consent. Benefits (fees or other benefits – e.g., inclusion in the research team) and delivery times are established.
Step 2: Two researchers (other than those in step 1) will be invited to take part in the activities of this step. Eligibility criteria: Language skills En (minimum level C1) and Ro (mother tongue), and Experience in questionnaire research.
Step 3: The criteria for translators are those described in Step 1. The people involved in Step 1 cannot be involved in this step.
Step 4: Identical as the procedure described in Step 2.
Step 5: Eligibility criteria for the Expert Group participants: Experience in the field (medicine, sociology, public health, applied informatics in medicine or related fields); Previous experience in questionnaire-based research; Availability of active participation.
Step 6: Eligibility criteria: It is part of the target group, represented by the general population; The mother tongue is Romanian; Has the ability to understand what reads in Romanian; Preferably, has the necessary skills to use online tools. To capture all demographic and socio-cultural groups, at least two trained researchers will help the potential participants in this process. How to identify participants: Individual invitations of research team members – convenient snowball – those who participate are asked to invite 1-2 more acquaintances/colleagues/family members/neighbors; Groups – social media platforms (e.g., Facebook, etc.); Invitations – Professional social media platforms/patient groups/patients, etc.
Step 7: Eligibility criteria: It is part of the target group, represented by the general population; The mother tongue is Romanian; She/He can understand what he reads in Romanian; She/He has the necessary skills to use online tools. How to identify participants: Students: regardless of field of study, form of schooling, sex, or other criteria (reliability of stability); Participants in activities intended for the general population: leisure, health (cross-country, health education), screening, etc.; Support groups and patient associations; General population.
The ethical approval has been received from the Ethics Committee of the Iuliu Hațieganu University of Medicine and Pharmacy Cluj-Napoca (approval number AVZ152/29 July 2024) and the signed informed consent was waived.
Results, Discussion and Conclusion
The Brief Health Literacy Screen [18] and Single-Item Literacy Screener (SILS) [19] are available surveys to measure health literacy, but none have a validated Romanian version. The HLS-EU-Q16 is the only HL survey translated and validated in Romania that reflects the Romanian reality in 2019 [20]. The HLS-EU-Q16 assesses literacy according to the definition that existed at the time of development, a definition that is no longer valid. M-POHL captures better the current definition of HL and offers instruments capable of evaluating several dimensions of HL. The M-POHL results showed that almost half of the Europeans surveyed have inadequate or problematic health literacy knowledge and skills [21]. Poor health literacy skills are associated with riskier behavior, poorer health, less self-management, and more hospitalizations and costs [22].
Romanian versions of the targeted M-POHL surveys on HL can enhance the assessment of health literacy achievements within the Romanian population, who did not take part in the validation of M-POHL surveys. Romanian versions of targeted M-POHL surveys will provide valid tools tailored to the cultural and linguistic requirements of the Romanian population. The translated and validated versions will be instruments capable of evaluating specific aspects of digital health literacy, potentially leading to increased participation and accurate responses. This is crucial, as language and cultural nuances can affect how individuals comprehend and respond to survey questions [23]. Enhancing health literacy assessment through a translated survey can provide valuable insights into the health literacy levels of the Romanian population, information that is essential for developing targeted interventions and policies to improve health outcomes and reduce health disparities [24] in the context of digital health and care [25].
Translating the health literacy survey into Romanian is a necessity that will offer a tailored approach to assessing health literacy achievements within the Romanian population. This initiative aligns with the broader goal of promoting health literacy as a fundamental aspect of improving health knowledge, skills, and behaviors, ultimately leading to better health outcomes for the Romanian population.
References
- Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: An updated systematic review. Ann Intern Med. 2011;155:97. doi:10.7326/0003-4819-155-2-201107190-00005.
- Levin-Zamir D, Baron-Epel OB, Cohen V, Elhayany A. The association of health literacy with health behavior, socioeconomic indicators, and self-assessed health from a national adult survey in Israel. J Health Commun. 2016;21:61–68. doi:10.1080/10810730.2016.1207115.
- Vandenbosch J, Van den Broucke S, Vancorenland S, Avalosse H, Verniest R, Callens M. Health literacy and the use of healthcare services in Belgium. J Epidemiol Community Health. 2016;70(10):1032-8. doi:10.1136/jech-2015-206910.
- Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al; HLS-EU Consortium. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25(6):1053-8. doi:10.1093/eurpub/ckv043.
- Kickbusch I, Pelikan JM, Apfel F, Tsouros AD. Health literacy: the solid facts. World Health Organization, Regional Office for Europe; 2013 [cited 2024 Jun 10]. Available from: https://iris.who.int/handle/10665/326432.
- Pelikan JM, Link T, Straßmayr C, Waldherr K, Alfers T, Bøggild H, et al.; HLS19 Consortium of the WHO Action Network M-POHL. Measuring Comprehensive, General Health Literacy in the General Adult Population: The Development and Validation of the HLS19-Q12 Instrument in Seventeen Countries. Int J Environ Res Public Health. 2022;19(21):14129. doi:10.3390/ijerph192114129.
- Finbråten HS, Nowak P, Griebler R, Bíró É, Vrdelja M, Charafeddine R, et al. The HLS19-COM-P, a New Instrument for Measuring Communicative Health Literacy in Interaction with Physicians: Development and Validation in Nine European Countries. Int J Environ Res Public Health. 2022;19(18):11592. doi:10.3390/ijerph191811592.
- Gille S, Griese L, Schaeffer D. Preferences and Experiences of People with Chronic Illness in Using Different Sources of Health Information: Results of a Mixed-Methods Study. Int J Environ Res Public Health. 2021;18(24):13185. doi:10.3390/ijerph182413185.
- Griese L, Berens EM, Nowak P, Pelikan JM, Schaeffer D. Challenges in Navigating the Health Care System: Development of an Instrument Measuring Navigation Health Literacy. Int J Environ Res Public Health. 2020;17(16):5731. doi:10.3390/ijerph17165731.
- Griese L, Finbråten HS, Francisco R, De Gani SM, Griebler R, Guttersrud Ø, et al.; HLS19 Consortium. HLS19-NAV-Validation of a New Instrument Measuring Navigational Health Literacy in Eight European Countries. Int J Environ Res Public Health. 2022;19(21):13863. doi:10.3390/ijerph192113863.
- Chávez LM, Canino G. Toolkit on Translating and Adapting Instruments. Human Services Research Institute; 2005 [cited 2024 Mar 27]. Available from: https://www.hsri.org/files/uploads/publications/PN54_Translating_and_Adapting.pdf.
- Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268-74. doi:10.1111/j.1365-2753.2010.01434.x.
- Lynn MR. Determination and quantification of content validity. Nursing Research. 1986;35(6):382–385.
- Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Research in Nursing and Health. 2006;29(5):489-97.
- Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-H. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4(5):165-78.
- Wynd CA, Schmidt B, Schaefer MA. Two quantitative approaches for estimating content validity. West J Nurs Res. 2003;25(5):508-18. doi:10.1177/0193945903252998.
- Topf M. Three estimates of interrater reliability for nominal data. Nursing Research. 1986;35(4):253-5.
- Rudd RE, Comings JP. Learner Developed Materials: An Empowering Product. Health Educ Behav. 1994;21(3):313-27.
- Morris NS, MacLean CD, Chew LD, Littenberg B. The single item literacy screener: Evaluation of a brief instrument to identify limited reading ability. BMC Fam Pract. 2006;7:21. doi:10.1186/1471-2296-7-21.
- Coman MA, Forray AI, Van den Broucke S, Chereches RM. Measuring Health Literacy in Romania: Validation of the HLS-EU-Q16 Survey Questionnaire. Int J Public Health. 2022;67:1604272. doi:10.3389/ijph.2022.1604272.
- Nurss J, Parker R, Williams M, Baker D. TOFHLA: Test of Functional Health Literacy in Adults. Show Camp: Peppercorn Books and Press; 2001.
- Kickbusch I, Pelikan JM, Apfel F, Tsouros AD. Health literacy: the solid facts. World Health Organization, Regional Office for Europe; 2013 [cited 2024 Jun 25]. Available from: https://iris.who.int/handle/10665/326432.
- Chen X, Acosta S. Translation in health literacy research. In: Ji M, Laviosa S, editors. The Oxford Handbook of Translation and Social Practices. Oxford Academic; 2020 [cited 2024 Jun 25]. doi:10.1093/oxfordhb/9780190067205.013.31.
- Sørensen K. From Project-Based Health Literacy Data and Measurement to an Integrated System of Analytics and Insights: Enhancing Data-Driven Value Creation in Health-Literate Organizations. Int J Environ Res Public Health. 2022;19(20):13210. doi:10.3390/ijerph192013210.
- European Commission. eHealth – Digital health and care [Internet]. [cited 2024 Aug 26]. Available from: https://health.ec.europa.eu/ehealth-digital-health-and-care_en.