MedPharmRes
University of Medicine and Pharmacy at Ho Chi Minh City
Original article

Translation and cross-cultural adaptation of the Vietnamese version of the Diabetes Distress Scale

Ong Phuc Thinha, Huynh Ngoc Van Anha, Do Thanh Tungb, To Gia Kiena,*
aFaculty of Public Health, University of Medicine and Pharmacy, Ho Chi Minh City, Vietnam
bEastern International University, Binh Duong, Vietnam
*Address correspondence to To Gia Kien, Faculty of Public Health, University of Medicine and Pharmacy, Ho Chi Minh City, Vietnam Email: togiakien@ump.edu.vn

© Copyright 2018 MedPharmRes. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: May 28, 2018; Revised: Jul 25, 2018; Accepted: Aug 24, 2018

Published Online: Sep 30, 2018

Abstract

Background:

The Diabetes Distress Scale (DDS) is a valid instrument to measure diabetes distress included in American Diabetes Association and Canadian Diabetes Association guidelines but not available in Vietnamese. This study translated and culturally adapted the DDS to assess diabetes distress of Vietnamese type 2 diabetics and evaluated its internal consistency, face and content validity.

Methods:

The translation process followed standard guidelines for adaptation of an instrument: forward translation, back translation, synthesis, evaluation by an expert panel and pretest. The expert panel included three English specialists as linguistic experts and six content experts in multidisciplinary areas relevant to the study. The pretest was conducted on a sample of 31 type 2 diabetics in the Endocrinology outpatient clinic at Trung Vuong hospital. Content validity was determined based on experts’ concurrence using content validity index for items (I-CVI). Face validity is assessed by participants in pretest. Internal consistency was measured using Cronbach’s alpha.

Results:

Final version was equivalent with the original English version and easy to understand. I-CVI of 17 items were 1.00 in linguistic experts and greater than 0.83 in content experts. All 31 participants involved in the pretest commented that the items were very clear and acceptable regarding their socioeconomic background. Cronbach’s alpha coefficient was 0.76 – 0.93 for each subscale and 0.94 for the overall.

Conclusion:

Vietnamese version of the DDS was reliable, face and content-valid to assess diabetes distress in type 2 diabetics among Vietnamese.

Keywords: diabetes; diabetes distress scale; cross-cultural adaptation; reliability; content validity

1. INTRODUCTION

Diabetes is the main cause of mortality, morbidity, disability and healthcare expenditure worldwide [1]. Since 1980, the burden of diabetes in developing countries has increased significantly faster than in developed countries [2]. The prevalence of diabetes and pre-diabetes in Vietnam between 2010 and 2015 has doubled over 5 years, from 2.6% to 4.1% and 1.5% to 3.5%, respectively [3]. In 2016, a study using HbAlc to diagnose diabetes found the prevalence of diabetes and pre-diabetes in individuals with age over 30 years in Ho Chi Minh city were 12.3% and 40.1%, respectively [4]. Diabetes has become a public health burden in Vietnam as a result of several socioeconomic changes and culturaltransitions [5].

Living with diabetes could be exhausting, tough and overwhelming struggle, which emphasized the need of a comprehensive diabetes care program not only focus on clinical outcomes but also explore the potential behavioral and psychological issues [6]. Focusing on diabetes distress is considered as a global approach to psychological problems associated with diabetes [7]. According to the Canadian Diabetes Association, diabetes distress is defined as “the despondency and emotional turmoil related specifically to having the condition, the need for continual monitoring and treatment, persistent concerns about complications and the potential erosion of personal and professional relationships” [8].

The prevalence of severe diabetes distress varies from 10 – 30% across settings and countries [9]. A recent study showed that the prevalence reached 39% in Canadian type 2 diabetics [10]. Diabetes distress is significantly associated with self-care behavior and poor glycemic control, possibly due to stress hormones leading to hyperglycemia [9, 10]. Therefore, diabetes distress has been recommended for routine screening by the American Diabetes Association and Canadian Diabetes Association [8,12]. There are two instruments accepted as measurements of diabetes distress: The Problem Areas in Diabetes scale (PAID) and the Diabetes Distress Scale (DDS) [13].

Diabetes Distress Scale was developed by Polonsky et al. in 2005 to measure four central domains of diabetes distress: emotional burden, physician care, disease management and interpersonal support [14]. The instrument surmounted limitations of several previous instruments such as the ATT39, the Questionnaire on Stress in Patients with Diabetes-Revised (QSD-R) and also the Problem Areas in Diabetes Scale (PAID) [14]. Instruction to apply DDS in clinical practice was officially introduced by the Canadian Diabetes Association in 2016 [15]. An overall average score of less than 2.0 is considered as “little or no distress”, 2.0 – 2.9 is interpreted as “moderate distress”, from 3.0 and above indicates “high distress” [16], DDS has been translated and culturally adapted to different languages worldwide [17-24] but not available in Vietnamese.

There was no reliable and valid instrument to assess distress levels in diabetics that could lead to unknown prevalence of distress in diabetes and consequently underestimate the effect of psychological issues on diabetes self-management and glycemic control in Vietnam. This study was to translate and culturally adapt the Diabetes Distress Scale into Vietnamese and evaluate its internal consistency, face and content validity.

2. METHOD

2.1. Translation procedure

The translation process was based on standard guidelines from Guillemin et al. [24] for cross-cultural adaptation of health-related quality of life measures. The procedure included five steps: forward translation, back translation, synthesis, expert committee review and pretesting.

2.1.1. Forward translation, back translation and synthesis

After permission to use and translate the DDS was obtained, forward translation of the DDS was performed by two independent translators: the former was a member of the study group who was aware of the concepts and objectives of the instrument and the latter was a qualified English translator who was not informed about these details.

Each forward translation was back-translated from Vietnamese to English independently. This stage was carried out by two translators who were bilingual overseas Vietnamese in the United States and Australia without prior knowledge of the original instrument. Discussion between four translators was held to combine all translated version into a synthesis. Any issue was resolved by repeated online discussion until a consensus was reached.

2.1.2. Expert committee review

The instrument was first evaluated by a committee of linguistic experts consisting of three qualified English language specialists to access the semantic and idiomatic equivalence between the source and the target version. Then, a panel of six content experts specializing in multidisciplinary areas relevant to the study evaluated the experiential and conceptual equivalence. The expert panel consisted of two family doctors, two endocrinologists, a psychologist and a specialist in instrument development. The number of experts in each committee followed guidelines by Lynn et al [25]. Linguistic and content experts were asked to rate 17 items for their relevance and clarity compared with the original instrument using a four-point Likert content validity scale. A cover letter with instructions was included to guide experts for scoring method.

Experts were also invited to suggest modifications to improve the quality of the instrument. Any suggestion was reported and applied based on majority rule, then synthesized into a prefinal version by another member of the study group. This version was translated back to English by another bilingual overseas Vietnamese in the United States who was not aware of the concept explored and then was reviewed by the first developer of the original DDS to ensure equivalence with the original instrument.

mpr-2-3-5-g1
Figure 1. The translation process
Download Original Figure
Table 1. Instructions for rating items
Relevance (semantic and idiomatic equivalence) Clarity (experiential and conceptual equivalence)
1 – Cannot be used, not relevant 1 – Cannot be used, not clear
2 – Cannot be used, item needs some revisions 2 – Cannot be used, item needs some revisions
3 – Relevant, may be used with minor revisions 3 – Clear, may be used with minor revisions
4 – Very relevant 4 – Very clear
Download Excel Table
2.1.3. Pretesting

The pretest was conducted on a sample of 31 type 2 diabetics in the Endocrinology outpatient clinic at Trung Vuong Hospital. Inclusion criteria were adults who were diagnosed with type 2 diabetes for at least 1 year and visited the clinic for routine follow-up. Patients who were pregnant or had psychiatric/psychological disorders that caused cognitive impairments could not complete the interviews were excluded from the study. In additions, patients with severe health problems such as life-threatening diseases, recent acute complications or injuries were also excluded.

All participants were asked to evaluate difficulty of understanding the items by interview after they finished taking the DDS with the following questions: “How do you feel about the questionnaire?” and “Is there any difficulty in understanding the questionnaire?”. Regardless of the answer, participants were asked to suggest modifications to improve clarity and appropriateness of each item with regards to their cultural background, which was the face validity of lay people [26].

2.2. Statistical analysis

Data entry was performed by Epidata 3.1 and statistical analysis was conducted using Stata 14.0.

Frequencies and percentages were used to describe categorical variables, medians and interquartile range were used to describe quantitative variables. Content validity was determined based on experts concurrence using content validity index for items (I-CVI). I-CVI was computed as the number of experts giving rating 3 or 4 to an item divided by the total number of experts. Based on guidelines by Lynn et al. [25], when there are five or fewer experts, a consensus of all experts must be obtained to justify the item is content-valid and equivalent with an I-CVI of 1.00. When there are more than five members in the expert panel, I-CVI must reach a minimum of 0.83, which means a disagreement is allowed.

To adjust for chance agreement, multi-rater kappa statistic was calculated [27]. First, the probability of chance agreement was obtained by the following formula:

P C = [ N!/A! ( N-A ) ! ] * ( 0 .5 ) N

Pc: probability of chance agreement

N: number of experts in a panel

A: number of experts rated 3or4toan item

Kappa was computed using the following formula:

K= ( I-CVI-P C ) / ( 1-P C )

Kappa was interpreted using the following criteria: 0.40 – 0.59 = fair, 0.60 – 0.74 = good, > 0.74 = excellent [27].

Internal consistency was measured using Cronbach’s alpha. Values from 0.70 to 0.95 are considered as acceptable range of Cronbach’s alpha [28].

2.3. Ethical approval

This study has been approved by the Biomedical Research Ethics Committee at the University of Medicine and Pharmacy at Ho Chi Minh city, Vietnam (Approval number: 113/DHYD-HDDD, March 21, 2018).

3. RESULTS

3.1. Expert committee review

All linguistic experts agreed that the translation correctly and fully rendered the meaning of words from the original instrument. I-CVI value was 1.00, which was interpreted as excellent for 17 items. The instrument was then evaluated by content experts and received I-CVI value from 0.83 – 1.00, corresponding to kappa value range from 0.82 – 1.00, which was also interpreted as excellent equivalence and clarity.

Most content expert committee members agreed to include the subject “tôi” and remove the word rằng” to improve the clarity of the instrument. The term “tiểu đuờng” was replaced by “đái tháo đuờng” as it is a more formal translation of “diabetes” nationwide in Vietnam. Items 1, 3, 4, 5, 8, 9, 10, 14, 15, 16, 17 archived a concordance rate of 100% among expert committee members and were therefore not subject to any modifications. Other items went through some simple grammatical changes or word replacement for corresponding synonymous. The terms “không am hiểu lắm” (item 2), “cảm thấy” (item 6), “sẽ biến chứng” (item 7), “không quan tâm lắm” (item 11), “chua tuân thủ lắm” (item 12), “khó khân đến nhuờng nào” (item 13) were replaced by “chua hiểu đầy đủ”, “nhận thấy”, “sẽ có nhũng biến chứng”, “không quan tâm đầy đủ”, “chua tuân thủ chặt chẽ”, “su khó khăn khi phải sông chung với bệnh đái tháo đuờng”, respectively, to ensure comprehension of the population.

After modification of terminology, the prefinal version was obtained, back-translated, reviewed by the first developer of the original intrument and pretested.

3.2. Pretesting

A total of 31 patients agreed to participate in pretesting. There were 25 patients (81.6%) answered that the items were “easy to understand” and 6 patients (19.4%) answered that the items were “very easy to understand”. All patients stated that no modification was needed for 17 items, and that they were able to complete the instrument within 15 minutes.

Table 2. Content validity and modified kappa of 17 items
Relevance Clarity
Item A I-CVI PC Kappa A I-CVI PC Kappa
1 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
2 3/3 1,00 0,13 1,00 5/6 0,83 0,09 0,82
3 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
4 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
5 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
6 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
7 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
8 3/3 1,00 0,13 1,00 5/6 0,83 0,09 0,82
9 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
10 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
11 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
12 3/3 1,00 0,13 1,00 5/6 0,83 0,09 0,82
13 3/3 1,00 0,13 1,00 5/6 0,83 0,09 0,82
14 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
15 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
16 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
17 3/3 1,00 0,13 1,00 6/6 1,00 0,02 1,00
Download Excel Table

Participant sociodemographic characteristics and clinical data are described in Table 5. Participants were aged between 41 and 72 years, with diabetes duration range from 1 to 24 years.

The overall Cronbach’s alpha for the Vietnamese version of DDS was 0.94. Cronbach’s alpha was lowest in “Physician distress” subscale (0.76) and highest in “Interpersonal distress” subscale (0.93). All 17 items had corrected item-total correlationvalue of greater than 0.40.

4. DISCUSSION

The translation guidelines by Guillemin et al. [24] applied in this study were also used by Chew et al. [20] to translate the Malaysian version of DDS. Nevertheless, due to the lack of consensus and evidence in existing cross-cultural adaptation methods [29], any step which was not strictly instructed in the mentioned guidelines were modified with credible reasons based on other guidelines’ suggestions. The essential role of the back translation step is controversial [29], Therefore, in this study, back translations were used only as references to suggest the better between two forward translated version, not the determining factor to make a decision. Crucial decisions were made base on evaluation and consensus among committees rather than opinion of any individual [30], Membership in the committees were organized with an aim of increasing the number and credibility of experts in later stages of review. This technique was expected to ensure any bias remaining from the previous stages would be revised and corrected in the later stages by more experienced experts. Moreover, back translation of the prefinal version was submitted to the first developer of the original instrument to review for its equivalent with the English version, as proposed by Beaton et al. [30] The face and content validity were checked at the same time as the adaptation with focus group and committees using qualitative and quantitative method, respectively, as proposed in literature [29].

Except minor changes in grammar and word replacements, no significant modification required to fit the context of Vietnamese culture. This was similar to most other translated versions of the DDS in Asian population such as Hong Kong [17], Malaysia [20], Indonesia [31]. In Thailand, the term “doctof’ was replaced by “doctor or nurse” because of the prominent role of nurses in the inpatient healthcare service [19], but this was not the case as this study was conducted at the secondary hospital where patients prefer spending most time with doctors. The Vietnamese version of DDS met equivalence criteria to the original instrument because it was evaluated by the researchers, experts, first author of the original instrument and the patients. Most items received an agreement of 100% in the analysis performed by the rating of committee ofjudges and patients, which resulted in excellent content and face validity.

The Vietnamese version of DDS showed good internal consistency as all subscales had Cronbach’s alpha greater than 0.70. Cronbach’s alpha was lowest in “Physician distress” subscale (0.76), especially reflected in the item-total correlation value (0.50) of item 11 “Feeling that my doctor doesn’t take my concerns seriously enough”. It could be explained by the hospital overload in Vietnam that reduced time length of physical examination and consultation. Therefore, doctors did not have enough time to take more concerns of their patients, while their priorities were to provide knowledge (item 2) and instructions on how to manage diabetes (item 5). In this study, “Physician distress” subscale had the lowest Cronbach’s alpha compared to other subscales, but its value was similar to Brazillian version (0.77) of DDS [22]. Overall, Cronbach’s alpha of the Vietnamese version was similar to previous studies [17-21], especially the original DDS [14], demonstrated good reliability.

Table 3. Demographic characteristics and clinical data of participants (n=31)
Characteristics Frequency (%)
Gender
 Female 17 (54.3)
 Male 14 (45.2)
Religion
 Irreligion 16(51.6)
 Buddhism 8 (25.8)
 Christianity 7 (22.6)
Occupation
 Pensioner 13 (41.9)
 Manual laborer 8 (25.8)
 Housewife 7 (22.6)
 Officer 3 (9.7)
Educational status
 Literate 2 (6.4)
 Primary school 6(19.4)
 Secondary school 8 (25.8)
 High school 6(19.4)
 Further education 9 (29.0)
Financially secure
 Satisfied 27 (87.1)
 Dissatisfied 4(12.9)
Marital status
 Married 28 (90.3)
 Divorced 2 (6.5)
 Single 1 (3.2)
Diabetes treatment
 Oral hypoglycemic agent 22 (71.0)
 Insulin or combination of insulin and oral hypoglycemic agent 9 (29.0)
Glycemic control
 Satisfactory (HbAlc ≤ 7.0%) 14 (53.8)
 Unsatisfactory (HbAlc > 7.0%) 12 (46.2)
Median (IQR)
Age (years) 62 (54 – 66)
HbA1c (%) 6.9 (6.3 – 9.1)
Diabetes duration (years) 8(4 – 12)
Download Excel Table
Table 4. Internal consistency of the Vietnamese version of DDS (n = 31)
Subscales Items Mean (SD) Item – total correlation Cronbach’s alpha
Emotional burden (EB) 1 2.09 (1.58) 0.90 0.90
4 1.45 (0.92) 0.68
7 2.35 (1.58) 0.80
10 2.06 (1.48) 0.92
14 1.96 (1.58) 0.91
Physician disticss (PD) 2 1.39 (0.92) 0.91 0.76
5 1.32 (0.75) 0.75
11 1.16 (0.37) 0.50
15 1.58 (1.20) 0.87
Regimen distress (RD) 3 1.90 (1.44) 0.77 0.91
6 2.03 (1.38) 0.86
8 1.77 (1.23) 0.79
12 2.16(1.32) 0.94
16 1.58 (1.26) 0.93
Interpersonal distress (ID) 9 1.29 (0.90) 0.96 0.93
13 1.42 (0.96) 0.89
17 1.26 (0.96) 0.96
Total DDS 0.94
Download Excel Table

This study was the first to systematically translate and culturally adapt the DDS into Vietnamese language, allow other studies to evaluate diabetes distress in Vietnamese outpatients. However, further studies is needed to assess other psychometric properties of this instrument, especially the agreement between the brief instrument DDS2 developed by Fisher et al. [32] with 2 items for screening diabetes distress in clinical practice as proposed by the Canadian Diabetes Association [15] and this full DDS version with 17 items in Vietnamese culture.

There are some limitations in this study. Due to convenience sampling, the percentages of participants with high school and further education graduation added up to 48.4%. Highly educated patients might be more likely to agree to participate in the study and tend to answer that the questionnaire was easy to understand with regards to their educational background. The sample size was small and restricted to only those who were diagnosed with type 2 diabetes for at least one year to ensure all participants were fully experienced with diabetes treatment, healthcare services and self-management. These established conditions are important when assessing the patients perceptions of the instrument but they just served the purpose of evaluating the face validity of the DDS. Therefore, future studies with larger sample size and greater diversity are needed to prove other psychometric properties of the DDS.

5. CONCLUSION

In conclusion, the Vietnamese version of DDS found satisfactory results as regards the translation and cultural adaptation process. This instrument is equivalent to the original English version, reliable, face-valid, content-valid, and ready for collecting data and assessing diabetes distress among individuals with type 2 diabetes in Vietnam.

ACKNOWLEDGEMENTS

We thank Dr. Quyen G. To, School of Exercise and Nutrition Sciences, Queensland University of Technology for his consultations on study design and statistical analysis; Assoc. Prof. An L. Pham, Dr. Khanh Q. Tran, Dr. Lynh CT. Phan, Dr. Quynh TP. Lai, Dr. Thuan M. Le, MPH. Uyen NT. Le for participating as content expert reviewers; Tien TT. Le, Nguyet T. Nguyen, Oanh TK. Nguyen for participating as linguistic expert reviewers; Assoc. Prof. William H. Polonsky, Behavioral Diabetes Institute and University of California, San Diego for reviewing the final back translated version. We thank Vy L. Ngo, Vy DK. Tran, Phuong M. Truong for translating the instrument. We thank the patients for participating, physicians and nurses of the Endocrinology outpatient clinic at Trung Vuong Hospital for assisting in data collection. We also thank the reviewers for their useful comments.

REFERENCES

1.

Danaei G, Lu Y, Singh G, Stevens G, Cowan M, Farzadfar F, et al. Cardiovascular disease, chronic kidney disease, and diabetes mortality burden of cardiometabolic risk factors from 1980 to 2010: a comparative risk assessment. The Lancet. 2014; 2(2):634-47

2.

NCD Risk Factor Collaboration. Worldwide trends in diabetes since 1980: a pooled analysis of 751 population-based studies with 4.4 million participants. The Lancet. 2016; 387(10027):1513-30.

3.

Ministry of Health. National survey on the risk factors of non-communicable diseases (STEPS) VietNam, 2015. 2016.

4.

Ho-Pham LT, Do TT, Campbell LV, Nguyen TV. HbAlc-Based Classification Reveals Epidemic of Diabetes and Prediabetes in Vietnam. Diabetes Care. 2016; 39(7):e93-4

5.

Khue NT. Diabetes in Vietnam. Annals of global health. 2015; 81(6):870-3

6.

Engström MS, Leksell J, Johansson UB, Gudbjömsdottir S. What is important for you? A qualitative interview study of living with diabetes and experiences of diabetes care to establish a basis for a tailored Patient-Reported Outcome Measure for the Swedish National Diabetes Register. BMJ open. 2016; 6(3)e010249

7.

Egede LE, Dismuke CE. Serious psychological distress and diabetes: a review of the literature. Current psychiatry reports. 2012; 14(1):15-22

8.

Robinson DJ, Luthra M, Vallis M. Canadian Diabetes Association Clinical Practice Guidelines Expert Committee: Diabetes and Mental Health. Canadian Journal of Diabetes. 2013; 37:S87-92

9.

Snoek FJ, Bremmer MA, Hermanns N. Constructs of depression and distress in diabetes: time for an appraisal. The Lancet Diabetes & Endocrinology. 2015; 3(6):450-60

10.

Wong EM, Afshar R, Qian H, Zhang M, Elliott TG, Tang TS. Diabetes Distress, Depression and Glycemic Control in a Canadian-Based Specialty Care Setting. Canadian journal of diabetes. 2017; 41(4):362-5

11.

Fisher L, Mullan JT, Arean P, Glasgow RE, Hessler D, Masharani U. Diabetes distress but not clinical depression or depressive symptoms is associated with glycemic control in both cross-sectional and longitudinal analyses. Diabetes care. 2010; 33(1):23-8

12.

American Diabetes Association. Standards of medical care in diabetes—2014. Diabetes care. 2014; 37(1):S14-80

13.

Berry E, Lockhart S, Davies M, Lindsay JR, Dempster M. Diabetes distress: understanding the hidden struggles of living with diabetes and exploring intervention strategies. Postgraduate medical journal. 2015; postgradmedj-2014:133017

14.

Polonsky WH, Fisher L, Earles J, Dudl RJ, Lees J, Mullan J, et al. Assessing psychosocial distress in diabetes: development of the diabetes distress scale. Diabetes care. 2005; 28(3):626-31

15.

Canadian Diabetes Association. Using the Diabetes Distress Scale. [accessed on 17 May 2018]. Available from: http://guidelines.diabetes.ca/cdacpg_resources/Using-DDS.pdf.

16.

Fisher L, Hessler DM, Polonsky WH, Mullan J. When is diabetes distress clinically meaningful? Establishing cut points for the Diabetes Distress Scale. Diabetes care. 2012; 35(2):259-64

17.

Ting RZ, Nan H, Mandy W, Kong AP, Ma RC, Wong RY, et al. Diabetes-related distress and physical and psychological health in Chinese type 2 diabetic patients. Diabetes care. 2011; 34(5):1094-6

18.

Graue M, Haugstvedt A, Wentzel-Larsen T, Iversen MM, Karlsen B, Rokne B. Diabetes-related emotional distress in adults: reliability and validity of the Norwegian versions of the Problem Areas in Diabetes Scale (PAID) and the Diabetes Distress Scale (DDS). International journal of nursing studies. 2012; 49(2):174-82

19.

Thanakwang K, Thinganjana W, Konggumnerd R. Psychometric properties of the Thai version of the Diabetes Distress Scale in diabetic seniors. Clinical interventions in aging. 2014; 9:1353

20.

Chew BH, Mukhtar F, Sherina M, Paimin F, Hassan N, Jamaludin N. The reliability and validity of the Malay version 17-item Diabetes Distress Scale. Malaysian family physician: the officialjoumal of the Academy ofFamily Physicians of Malaysia. 2015; 10(2):4.

21.

Chin YW, Lai PSM, Chia YC. The validity and reliability of the English version of the diabetes distress scale for type 2 diabetes patients in Malaysia. BMC family practice. 2017; 18(1):4

22.

Apolinario PP, Trevisan DD, Rodrigues RCM, Jannuzzi FF, Ferreira JF, de Oliveira HC, et al. Psychometric Performance of the Brazilian Version of the Diabetes Distress Scale in Patients With Diabetes Mellitus Type 2. Journal of nursing measurement. 2016; 24(2):101E-13

23.

Martinez-Vega IP, Doubova SV, Aguirre-Hemandez R, Infante-Castañeda C. Adaptation and validation of the Distress Scale for Mexican patients with type 2 diabetes and hypertension: a cross-sectional survey. BMJ open. 2016; 6(3)e009723

24.

Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of clinical epidemiology. 1993; 46(12):1417-32

25.

Lynn MR. Determination and quantification of content validity. Nursing research. 1986.

26.

DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. Journal of Nursing scholarship. 2007; 39(2):155-64

27.

Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar AR. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of caring sciences. 2015; 4(2):4

28.

Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Intemationaljoumal of medical education. 2011; 2:53

29.

Epstein J, Santo RM, Guillemin F. A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of clinical epidemiology. 2015; 68(4):435-41

30.

Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000; 25(24):3186-91

31.

Farm BAS, Perwitasari DA, Thobari JA, Cao Q, Krabbe PF, Postma MJ. Translation, Revision, and Validation of the Diabetes Distress Scale for Indonesian Type 2 Diabetic Outpatients with Various Types of Complications. Value in health regional issues. 2017; 12:63-73

32.

Fisher L, Glasgow RE, Mullan JT, Skaff MM, Polonsky WH. Development of a brief diabetes distress screening instrument. The Annals of Family Medicine. 2008; 6(3):246-52