MedPharmRes
University of Medicine and Pharmacy at Ho Chi Minh City
Original article

Validity and reliability of the UTBAS-6 scale for Vietnamese adults who stutter

Hanh Thi Bich Trana,*https://orcid.org/0000-0002-6652-0071, Nguyen Do Nguyenbhttps://orcid.org/0000-0002-7193-9010, Rachael Unicombchttps://orcid.org/0000-0001-5614-4597, Laura Hoffmandhttps://orcid.org/0000-0002-2133-4486, Sally Hewatc,ehttps://orcid.org/0000-0002-7043-7086
aFaculty of Nursing – Medical Technology, University of Medicine and Pharmacy at Ho Chi Minh City, Vietnam
bFaculty of Public Health, University of Medicine and Pharmacy at Ho Chi Minh City, Vietnam
cSchool of Health Science, The University of Newcastle, Australia
dSchool of Allied Health, Exercise & Sports Sciences, Charles Sturt University, Australia
eOST Therapy, Shenzhen, China
*Address correspondence: to Hanh Thi Bich Tran at the Faculty of Nursing – Medical Technology, University of Medicine and Pharmacy at Ho Chi Minh City, Vietnam; E-mail: hanhtranpt@ump.edu.vn

© Copyright 2023 MedPharmRes. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Oct 22, 2022; Revised: Feb 17, 2023; Accepted: Mar 08, 2023

Published Online: Oct 30, 2023

Abstract:

Introduction:

To date no study has investigated speech-related social anxiety for Vietnamese adults who stutter. To carry out such a study, a culturally and linguistically relevant assessment tool is required but is not yet available. The objectives of this study were to translate and adapt the UTBAS-6 scale into Vietnamese and evaluate the validity and reliability of the Vietnamese version of the scale for use with Vietnamese adults who stutter.

Methods:

The translation process included forward and backward translation, synthesis, and expert review. The final version was administered to 34 Vietnamese adults who stutter. Content validity was assessed by experts working in the field of speech and language therapy. Face validity was assessed by study participants. Convergent and divergent validities were used to determine the construct validity. Cronbach’s alpha was used to test the internal consistency and intraclass correlation coefficient to determine test-retest reliability.

Results:

S-CVIs of “Relevance” and “Clarity” of the scale were in the range of 0.83-1.00, showing a high consensus of the expert panel. All participants stated that the Vietnamese version was related to stuttering and was easy to understand. The convergent validity was at 88.9% of the items, and the divergent validity was at 61.1% of the items. Alpha coefficients of three subscales and total scale were greater than 0.7. The test-retest reliability of the scales was moderate.

Conclusions:

The results of the study provided preliminary information on the validity and reliability of the Vietnamese version of the UTBAS-6 scale. Further studies with a representative and larger sample size are needed to ensure the accuracy of the findings.

Keywords: Adults who stutter; social anxiety; Unhelpful Thoughts and Beliefs about Stuttering (UTBAS-6); validity; reliability

1. INTRODUCTION

Stuttering is a disorder of speech fluency that impacts the communication of an individual [1]. There is evidence to suggest that the relationship between fluency disorders and anxiety may commence in childhood [2]. In addition to the observable features of the disorder (e.g., repeated movements, fixed postures, superfluous behaviors, etc.), it is well-reported that stuttering can have a potential negative impact on the quality of life of the stutterers [3], [4], [5], particularly social functioning and mental health [6], [7]. Stuttering can also impact an individual’s job performance, academic achievement, and employment opportunities [8], [9], [10].

The Unhelpful Thoughts and Beliefs about Stuttering scale (UTBAS) is a tool that can be used to screen for indicators of speech-related social anxiety in adults who stutter [11], [12]. The original UTBAS scale (developed in English) includes 66 items that comprehensively measure an individual’s thoughts and beliefs about their own stuttering. Completion of the original scale is time intensive, therefore a brief version was developed to use in clinical settings. The brief version of the scale, UTBAS-6, includes 6 items and has been proven to be a valid and reliable tool [1]. To date, the UTBAS-6 scale has been translated into other languages such as Japanese (UTBAS-J) [13] and Turkish (UTBAS-TR) [14]. Translation of the tool into Turkish followed the recommended translation process [14], however, the forward translation process reported by Chu et al. [13] was different from the recommendation that at least two people should translate the scale independently [15]. Further, the pilot test was carried out on 5 people who did not stutter [13]. Both studies did not report neither content validity nor face validity.

To date, speech related social anxiety for Vietnamese adults who stutter has not been investigated. However, in order to conduct such research, a culturally and linguistically relevant assessment tool is required but is not yet available. The purpose of this study is to evaluate the validity and reliability of the Vietnamese version of the UTBAS-6 scale in adults who stutter.

2. MATERIALS AND METHOD

2.1. Study settings

The study was carried out nationwide online from 01/2/2021 to 30/4/2021 for Vietnamese adults who stutter.

2.2. Study design and participants

It is recommended that a study evaluating the validity and reliability of a scale requires a sample size of 5-10 times the number of items on the scale [16], [17]. Therefore, 34 adults who stutter were recruited for this study. Participants were recruited via the online self-help group for people who stutter in Vietnam, called “Echo Vietnam”. This group was established to connect individuals who stutter into a community to provide support, share exercises to improve their communication and connect with other communities of people who stutter (Facebook address of Echo Vietnam: https://www.facebook.com/groups/133766986662954).

Study information was sent directly to the Echo Vietnam group members and posted on the Facebook page of the Rehabilitation department, Faculty of Nursing-Medical technology, University of Medicine and Pharmacy at Ho Chi Minh City. Potential participants who were interested in the study were required to contact a researcher via e-mail/phone call/message, and those who met the following criteria were included in the study: Vietnamese adults aged 18 years or older, diagnosed as developmental stuttering by a Vietnamese trained speech and language therapists experienced in management of stuttering in adults. Participants were excluded if diagnosed as acquired stuttering or having lived outside Vietnam in a period of 12 months or more.

2.3. Translation of the UTBAS-6 scale into Vietnamese

The UTBAS-6 [1] includes six items (Table 1), scored under three subscales: Frequency of unhelpful thoughts (Frequency subscale), degree of belief in these thoughts (Belief subscale), and degree of anxiety from these thoughts (Anxiety subscale). Each subscale contains same six questions, and respondents would rate each question on a 5-point Likert scale (1=never or not at all, 2=rarely or a little, 3=sometimes or somewhat, 4=often or a lot, 5=always or totally). The total score (the sum of 6 item scores) is converted to deciles, Iverach et al. recommends that where a score falls within or above the fifth decile, appropriate referrals to relevant psychological professionals take place [1]. However, the authors also caution that scores below the fifth decile do not necessarily indicate that a psychological issue may not be present and that clinicians additionally use other information to make clinical decisions regarding psychological referral as required [18].

Table 1. The final Vietnamese version of the UTBAS-6 scale in contrast to the original
Item Original UTBAS-6 item Final Vietnamese item post-translation
1 I’ll never be successful because of my stutter. Tôi sẽ không bao giờ thành công bởi vì sự nói lắp của mình.
2 People will think I’m incompetent because I stutter. Mọi ngựời sẽ cho rằng tôi kém cỏi bởi vì tôi nói lắp.
3 People will think I’m strange. Mọi ngựời sẽ nghĩ rằng tôi khác thựờng.
4 I don’t want to go – people won’t like me. Tôi không muốn ra ngoài – mọi ngựời sẽ không thích tôi.
5 What’s the point of even trying to speak – it never comes out right. Thậm chí khi cố gắng nói cũng không có nghĩa lý gì – sẽ không bao giờ nói ra đựợc ngay.
6 I’ll never finish explaining my point – they’ll misunderstand me. Tôi sẽ không bao giờ giải thích hết quan điểm của mình - Mọi ngựời sẽ hiểu lầm tôi.
Download Excel Table

The translation and cross-cultural adaptation process used in this study were based on standard guidelines from Beaton et al. [15]. The procedure consisted of five steps: forward translation, backward translation, synthesis, expert panel review, and pretesting (Figure 1).

mpr-7-3-67-g1
Figure 1. Translation process
Download Original Figure

The original version of the UTBAS-6 scale was independently forward translated into Vietnamese by two independent translators. The 2 translated versions were designated as V1 and V2. These were synthesized into V3 by the researchers and reviewed by Vietnamese experts to become the pre-final V4 version. The V4 was backward translated into English by two Vietnamese translators who were independent of the study and did not know the original version. The two backward translated E1 and E2 versions were synthesized into the E3 version. This version was sent to five experts who worked in the field of speech and language therapy (Vietnamese and international speech therapists) and were experienced in management of stuttering [17]. The experts were asked to rate the “Clarity” (semantic and idiomatic equivalence) and “Relevance” (experiential and conceptual equivalence) of the Vietnamese-translated UTBAS-6 scale using a 4-point Likert scale (1=cannot be used, not relevant/clear, 2=cannot be used, item needs some revisions, 3=quite relevant/clear, may be used with some minor revisions, 4=highly relevant/clear). The experts were also asked for any modification to ensure equivalence between the translated version and the original scale [19], [20] (Table 1). A final translated version was confirmed once consensus achieved.

2.4. Data collection

The Vietnamese UTBAS-6 scale was sent to all consenting participants via e-mail. Participants completed a scale online, and were also asked to suggest modifications to improve the translated scale for face validity [21]. To ascertain test-retest reliability, 3 weeks after the first survey participants were requested to complete the same online survey.

To evaluate the face validity of the Vietnamese version of the UTBAS-6 scale, participants were requested to answer questions “The items were relevant to your stuttering” and “The scale was easy for you to understand”. The answers were based on a Likert 5-point scale (1=strongly disagree, 2=disagree, 3=slightly agree, 4=agree, 5=strongly agree), and if level l or 2 was chosen, the participants would be asked for the reasons and any suggestions to modify the scale.

2.5. Data analysis

Epidata Entry Client software was used for data entry and statistical analysis were conducted using Stata 14.0.

Content validity

This analysis was based on the expert’s rating when reviewing the E3 version. The content validity was determined via the content validity index (CVI). There were two kinds of CVI: Item-CVI (I-CVI) and Scale-level CVI (S-CVI) [19]. I-CVI was computed as the number of experts giving ratings at level 3 (Quite relevant/clear) or level 4 (Highly relevant/clear) to an item divided by the total number of experts. S-CVI was calculated using the number of items in a tool that have achieved a rating of 3 or 4 values. There were two methods for calculating S-CVI, one was the Universal Agreement among experts (S-CVI/UA), and the other was the Average CVI (S-CVI/Ave) [20]. S-CVI/UA was calculated by adding all items with I-CVI rated at level 3 or 4 divided by the total number of items, while S-CVI/Ave which was a less conservative method was calculated by taking the sum of the I-CVIs divided by the total number of items. I-CVI score of >0.79 is considered excellent, between 0.7 and 0.79 is average, and <0.7 is poor [20]. The content validity was excellent when S-CVI/UA ≥0.8 and S-CVI/Ave ≥0.9 [20]. A kappa statistic was conducted to control risk of chance agreement [20]. Criteria for evaluating kappa is that the values >0.74 = excellent, 0.6-0.74 = good, 0.4-0.59 = fair [22].

Face validity

Face validity was determined by the percentage of each level rated by the participants to the questions whether the Vietnamese version was relevant to stuttering, or easy to understand. Ten out of 34 participants answered these questions.

Construct validity

Construct validity was determined through convergent and divergent validity, also evaluated through the relation between the three subscales. A subscale had convergent validity when its items have correlation coefficients >0.4 [23], [24]. An item had discriminatory value (i.e. between the Frequency scale and the Belief scale) when the correlation coefficient for that item and the rest of items in a scale (i.e. the Frequency scale) was lower than the correlation coefficients of that item and the remaining items in the Belief scale [25].

Reliability

Cronbach’s alpha was used to examine the internal consistency of the scale. The scale has internal consistency when the value of alpha ≥0.7 [26]. Test-retest reliability was evaluated by intraclass coefficient correlation (ICC). ICC was interpreted by the rule of thumb: >0.9 = Very good, 0.75-0.9 = Good, 0.5-0.75 = Moderate, <0.5 = Poor [27].

3. RESULTS

3.1. Demographic characteristics

Most of participants were young adult males with a high educational level and living in urban areas. The mean age (±SD) was 27.2 (±5.4) (Table 2).

Table 2. Demographic characteristics of participants (n=34)
Characteristic Frequency Percentage (%)
Male 26 77
Educational level
 High school 3 9
 College/University 28 82
 Postgraduate 3 9
Career
 Office employees 17 50
 Student 8 23
 Medical staff 6 18
 Businessman 2 6
 Worker 1 3
Single 27 79
Living area
 Urban 27 79
 Rural 7 21
Age* 27.2 ±5.4 (19-40)

Mean ± standard deviation; (min-max)

Download Excel Table
3.2. Content validity of the Vietnamese version of UTBAS-6

In terms of “Relevance”, there were 5 items that had the values of I-CVI and kappa as 1.00. This suggested that there was very good equivalence between the translation and the original (Table 3), except item 5, two experts rated it at level 2 and suggested some revisions to have the same meaning with the original. In terms of “Clarity”, I-CVIs of the Vietnamese version of the UTBAS-6 scale were in the range of 0.80-1.00 (I-CVI values >0.79), the kappa values of each item were in the range 0.76-1.00 (>0.74), which indicated very good agreement of expert panel [20]. S-CVIs of “Relevance” and “Clarity” of the scale were in the range of 0.83-1.00, indicating that the scale had a high consensus with the expert panel.

Table 3. Content validity of the Vietnamese version of the UTBAS-6 scale (n=5)
Item Clarity Relevance
A I-CVI Pc K A I-CVI Pc K
1. I will never be successful because of my stuttering. 5/5 1.00 0.03 1.00 5/5 1.00 0.03 1.00
2. People will think I am incapable/incompetent due to my stutter. 5/5 1.00 0.03 1.00 5/5 1.00 0.03 1.00
3. People will think I am different. 5/5 1.00 0.03 1.00 4/5 0.80 0.16 0.76
4. I do not want to go out - people will not like me. 5/5 1.00 0.03 1.00 4/5 0.80 0.16 0.76
5. Even when I try to say something that is meaningful - I can’t say it straight away. 3/5 0.60 0.31 0.42 4/5 0.80 0.16 0.76
6. I will never finish my explanation - people will misunderstand me. 5/5 1.00 0.03 1.00 5/5 1.00 0.03 1.00
S-CVI/Ave = 0.93
S-CVI/UA = 0.83
S-CVI/Ave = 0.90
S-CVI/UA = 1.00

A: The number of experts rated the item as a 3 or 4 on a 4-point scale

I-CVI: Item-content validity index; S-CVI: Scale-content validity index; S-CVI/Ave is averages of the item-level CVIs; S-CVI/UA: universal agreement among experts that was the proportion of items rated at level 3 or 4.

Pc: Probability of chance agreement

K: Modified kappa statistic coefficient

Download Excel Table
3.3. Face validity of the Vietnamese version of the UTBAS-6 scale

All ten participants stated that the Vietnamese version of the UTBAS-6 scale was related to stuttering and easy to understand (Table 4) but suggested changes to the term “mức độ thường xuyên” (frequency) clearer in the Vietnamese version.

Table 4. Face validity of the Vietnamese version of the UTBAS-6 scale (n=10)
Relevance Clarity
Number of raters % Number of raters %
Level 1 0 0 0 0
Level 2 0 0 0 0
Level 3 1 10 4 40
Level 4 5 50 4 40
Level 5 4 40 2 20
Download Excel Table
3.4. Construct validity of the Vietnamese version of the UTBAS-6 scale

Convergent validity: Table 5 presents the correlation coefficients in each scale, and between each subscale with the total scale. The cells of the table were numbered from 1 to 9 in parentheses. Cell 1 showed that the Frequency scale had 4/6 items (66.7%) with correlation coefficients greater than 0.4, those were items 2, 4, 5, and 6. All 6 items (100%) of the Belief or Anxiety scales had correlation coefficients greater than 0.4 as seen in cells 5 and 9 respectively. When analyzing the three subscales within the total scale, there were 16/18 items (88.9%) that had correlation coefficients greater than 0.4 (cells 1, 5, and 9).

Table 5. Convergent and divergent validity of the Vietnamese version of the UTBAS-6 scale (n=34)
Item Correlation coefficients
Frequency Belief Anxiety
Frequency (1) (2) (3)
1. I will never be successful because of my stuttering. 0.35 0.49 0.58
2. People will think I am incapable/incompetent due to my stutter. 0.52 0.49 0.52
3. People will think I am different. 0.29 0.35 0.47
4. I do not want to go out - people will not like me. 0.48 0.50 0.53
5. Even when I try to say something that is meaningful - I can’t say it straight away. 0.61 0.25 0.51
6. I will never finish my explanation - people will misunderstand me. 0.57 0.38 0.46
Belief (4) (5) (6)
1. I will never be successful because of my stuttering. 0.39 0.61 0.45
2. People will think I am incapable/incompetent due to my stutter. 0.48 0.57 0.37
3. People will think I am different. 0.29 0.45 0.37
4. I do not want to go out - people will not like me. 0.27 0.49 0.55
5. Even when I try to say something that is meaningful - I can’t say it straight away. 0.66 0.68 0.60
6. I will never finish my explanation - people will misunderstand me. 0.53 0.54 0.60
Anxiety (7) (8) (9)
1. I will never be successful because of my stuttering. 0.51 0.63 0.65
2. People will think I am incapable/incompetent due to my stutter. 0.51 0.64 0.71
3. People will think I am different. 0.39 0.59 0.61
4. I do not want to go out - people will not like me. 0.50 0.53 0.55
5. Even when I try to say something that is meaningful - I can’t say it straight away. 0.62 0.28 0.46
6. I will never finish my explanation - people will misunderstand me. 0.77 0.42 0.51
Download Excel Table

Divergent validity: The correlation coefficients of items 1, 3, and 4 of the Frequency scale with the Belief scale (cell 2) and the Anxiety scales (cell 3) were greater than those with the Frequency scale (cell 1) (Table 5), indicating a poor divergence. Similarly, items 4 and 6 of the Belief scale showed poor divergence with the Anxiety scale, as seen in cell 5 and 6. Meanwhile, all items of the Belief scale indicated good divergence with the Frequency scale, as seen in cell 4 and 5. The Anxiety scale indicated good divergence with the Belief scale since all the correlation coefficients between the Anxiety scale and the Belief scale (cell 8) were less than those of the Anxiety scale with itself (cell 9). However, items 5 and 6 of the Anxiety scale indicated poor divergence with the Frequency scale. In summary, only 11 out of 18 items (61.1%) of the total scale had good divergent validity. The Frequency, Belief, Anxiety, and total scales were strongly correlated with all correlation coefficients greater than 0.6 (Table 6).

Table 6. Correlation of subscales of the Vietnamese version of the UTBAS-6 scale (n=34)
Frequency Belief Anxiety Total scale
Frequency 1
Belief 0.61 1
Anxiety 0.77 0.71 1
Total scale 0.88 0.87 0.93 1
Download Excel Table
3.5. Reliability

Alpha coefficients of the Frequency, Belief, Anxiety scales, and the total scale were greater than 0.7 which indicated that the scale had internal consistent reliability (Table 7).

Table 7. Cronbach’s alpha of the Vietnamese version of the UTBAS-6 scale (n=34)
Item Scale
Frequency Belief Anxiety
1. I will never be successful because of my stuttering. 0.73 0.75 0.77
2. People will think I am incapable/incompetent due to my stutter. 0.68 0.76 0.76
3. People will think I am different. 0.74 0.78 0.77
4. I do not want to go out - people will not like me. 0.69 0.78 0.79
5. Even when I try to say something that is meaningful - I can’t say it straight away. 0.65 0.73 0.81
6. I will never finish my explanation - people will misunderstand me. 0.66 0.77 0.80
Total 0.73 0.80 0.81
Download Excel Table

ICCs of the Frequency and Anxiety scales were greater than 0.7, which showed that 2 of these subscales had test-retest reliability. However, the Belief scale had poor test-retest reliability with an ICC of 0.52, and the confidence interval of 95% for ICC was (-0.07 to 0.78) (Table 8). In summary, the test-retest reliability of the scales was moderate [27].

Table 8. ICC of the Vietnamese version of the UTBAS-6 scale (n=26)
Scale ICC (Confidence interval 95% for ICC)
Frequency 0.74 (0.42 - 0.89)
Belief 0.52 [(-0.07) - 0.78]
Anxiety 0.71 (0.36 - 0.87)
Total scale 0.72 (0.37 - 0.88)
Download Excel Table

4. DISCUSSION

The validation results of the Vietnamese version of the UTBAS-6 scale indicated that the scale has high content and face validity. The convergent validity was at 88.9% of the items, and the divergent validity was at 61.1% of the items. Alpha coefficients of three subscales and total scale were greater than 0.7, and test-retest reliability was moderate.

4.1. The characteristics of the study sample

The survey sample with 34 subjects was quite small, and not necessarily representative of the community of stutters in Vietnam. However, it was interesting to see some common characteristics of adults who stutter among the study group that were consistent with findings from previous studies. Previous studies revealed the number of men who stutter was higher than women [28]. Most of participants were single possibly because of their young age, however, stuttering was a less attractive feature which could be a barrier for establishing intimate relationships [29].

4.2. Content validity of the Vietnamese version of the UTBAS-6 scale

The content validity of the Vietnamese version of the UTBAS-6 scale was considered excellent based on the value of the corresponding index. The evaluation of the content validity of a scale needs a panel with at least five experts working in the field in which the scale is used to have the appropriate level of control over the chance of consensus [19], [22], and experts should be people speaking target language of study [20]. However, speech and language therapy is a new profession in Vietnam and few people work in the stuttering field. The expert panel of this study included two Vietnamese and three Australian speech-language pathologists ensured the content validity of the Vietnamese version of the UTBAS-6 scale.

4.3. Face validity of the Vietnamese version of the UTBAS-6 scale

Both Turkish and Japanese studies did not report any information regarding face validity of the UTBAS-6 [13], [14]. In this study, face validity was determined through feedback from participants on the translated scale. Although only ten participants responded to the face validity related questions, all agreed that all items of the scale related to stuttering and the scale was understandable and clear.

4.4. Construct validity of the Vietnamese version of the UTBAS-6 scale

The UTBAS-J [13] and UTBAS-TR [14] determined construct validity by comparing with other scales. Because there were no other available Vietnamese scales to use in a comparison, this study assessed construct validity by using convergent and divergent validities. The Vietnamese version of the UTBAS-6 scale had good convergent validity, but the divergent validity was moderate due to the impact of small sample size and some factors.

Some participants had received treatment and their stuttering condition improved, and this could influence their thoughts and beliefs about stuttering. The severity of stuttering might be higher among non-participants, therefore, the choice of an answer for a question might deviate toward mild stuttering. In addition, when evaluating face validity, some participants suggested that it should be made clear the term “mức độ thường xuyên” (how frequently) in the Vietnamese version. An unclear term definition might result in non-valid data. Although generally assessed as having face validity, it is necessary to review each item.

This study was one of four studies in a research project about stuttering in Vietnam, and online self-rating survey answering 3 sets of quantitative questionnaires at the same time might influence the quality of raw data. Furthermore, using the same question to measure three different domains may confuse the respondents.

4.5. Reliability of the Vietnamese version of the UTBAS-6 scale

Alpha coefficients in this study were smaller than those of the UTBAS-TR scale [14] and the UTBAS-J scale [13]. However, these two studies validated the full UTBAS scale, so they had much more items and a larger sample size. Although fewer items, the Vietnamese version of the UTBAS-6 scale showed good internal consistency reliability. Paired t-test was used in the two above studies to test the difference in mean scores between time 1 and time 2, but ICC was used in this study because the sample size was small (26 respondents were enrolled in the analysis) and furthermore ICC was more appropriate than paired t-test for evaluating test-retest reliability. However, given a wide confidence interval of ICC estimate a study with a larger sample size is needed.

4.6. Strengths and limitations of the study

This study strictly followed the recommended translation process to ensure the equivalence between the Vietnamese version of the UTBAS-6 scale and the English original. Beside content validity and construct validity, the study also assessed face validity to confirm the validity of the Vietnamese version. People who stutter usually avoid communication situations, so online made it more accessible for them. However, this study had some limitations. As discussed in construct validity, the study sample size was small, not representative, biased toward mild stuttering subjects, and information bias might occur.

Conclusion

This is the first study among Vietnamese adults who stutter providing preliminary information of the validity and reliability of the Vietnamese version of the UTBAS-6 scale. The results of the study indicated that the scale is valid and reliable. However, further studies with a representative and larger sample size are needed to ensure the accuracy of the findings.

ETHICAL STATEMENT

The study was approved by the ethical committee of the University of Medicine and Pharmacy at Ho Chi Minh City, Vietnam (No. 62/HÐÐÐ-ÐHYD on January 28th, 2021).

FUNDING

The authors received no financial support for the research, authorship, and/or publication of this article.

CONFLICT OF INTEREST

The authors declare that there is no conflict of interest.

ACKNOWLEDGEMENTS

We would like to thank the following people for their assistance in the translation process: Dr. Ben T. Pham (Hanoi National University of Education), Dr. Thao B. Huynh (Gia An 115 hospital), Ha T.T. Duong (Le Thanh Tong high school), Minh N. Nguyen (University of Medicine and Pharmacy at Ho Chi Minh City), Lien V.T.K. Nguyen (University of Medicine and Pharmacy at Ho Chi Minh City), Nguyen H.Q. Vo (Intel Products Company). We thank Mr. Tuan N. Pham (University of Medicine and Pharmacy at Ho Chi Minh City) for his support in statistical analysis. We also thank our participants for dedicating their time to assist with this study.

AUTHORS’ CONTRIBUTION

Sally Hewat, Rachael Unicomb, Laura Hoffman conceptualized and input into the research in areas including ethical approval/considerations, research design, data collection. Nguyen Do Nguyen verified the analytical methods. Hanh Thi Bich Tran wrote the paper with input from all authors.

REFERENCES

1.

Iverach L, Heard R, Menzies R, Lowe R, O’Brian S, Packman A, et al. A Brief Version of the Unhelpful Thoughts and Beliefs About Stuttering Scales: The UTBAS-6. Journal of speech, language, and hearing research : JSLHR. 2016; 59(5):964-72

2.

Cummins RA. Fluency disorders and life quality: subjective wellbeing vs. health-related quality of life. Journal of fluency disorders. 2010; 35(3):161-72

3.

Craig A. The association between quality of life and stuttering. Journal of fluency disorders. 2010; 35(3):159-60

4.

Koedoot C, Bouwmans C, Franken MC, Stolk E. Quality of life in adults who stutter. Journal of communication disorders. 2011; 44(4):429-43

5.

Yaruss JS. Assessing quality of life in stuttering treatment outcomes research. Journal of fluency disorders. 2010; 35(3):190-202

6.

Blumgart E, Tran Y, Craig A. Social anxiety disorder in adults who stutter. Depression and anxiety. 2010; 27(7):687-92

7.

Craig A, Blumgart E, Tran Y. The impact of stuttering on the quality of life in adults who stutter. Journal of fluency disorders. 2009; 34(2):61-71

8.

McAllister J, Collier J, Shepstone L. The impact of adolescent stuttering on educational and employment outcomes: evidence from a birth cohort study. Journal of fluency disorders. 2012; 37(2):106-21

9.

Bricker-Katz G, Lincoln M, Cumming S. Stuttering and work life: an interpretative phenomenological analysis. Journal of fluency disorders. 2013; 38(4):342-55

10.

Klein JF, Hood SB. The impact of stuttering on employment opportunities and job performance. Journal of fluency disorders. 2004; 29(4):255-73

11.

Iverach L, Menzies R, Jones M, O’Brian S, Packman A, Onslow M. Further development and validation of the Unhelpful Thoughts and Beliefs About Stuttering (UTBAS) scales: relationship to anxiety and social phobia among adults who stutter. International journal of language & communication disorders. 2011; 46(3):286-99

12.

St Clare T, Menzies RG, Onslow M, Packman A, Thompson R, Block S. Unhelpful thoughts and beliefs linked to social anxiety in stuttering: development of a measure. International journal of language & communication disorders. 2009; 44(3):338-51

13.

Chu SY, Sakai N, Mori K, Iverach L. Japanese normative data for the Unhelpful Thoughts and Beliefs about Stuttering (UTBAS) Scales for adults who stutter. Journal of fluency disorders. 2017; 51:1-7

14.

Aydin Uysal A, Ege P. Reliability and validity of the UTBAS-TR (The Unhelpful Thoughts and Beliefs Scale-the Turkish version) in the Turkish population. International journal of speech-language pathology. 2020; 22(1):24-9

15.

Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000; 25(24):3186-91

16.

Erkoc SB, Isikli B, Metintas S, Kalyoncu C. Hypertension Knowledge-Level Scale (HK-LS): a study on development, validity and reliability. International journal of environmental research and public health. 2012; 9(3):1018-29

17.

Tsang S, Royse CF, Terkawi AS. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi journal of anaesthesia. 2017; 11(Suppl 1):S80-s9

18.

Onslow M. Stuttering and its treatment: Eleven lectures: Australian stuttering research centre. 2019.

19.

Lynn MR. Determination and quantification of content validity. Nursing research. 1986

20.

Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar AR. Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. Journal of caring sciences. 2015; 4(2):165-78

21.

Shultz KS, Whitney DJ, Zickar MJ. Measurement theory in action: Case studies and exercises: Routledge. 2020

22.

Rodrigues IB, Adachi JD, Beattie KA, MacDermid JC. Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord. 2017; 18(1):540

23.

DeVon HA, Block ME, Moyle‐Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. Journal of Nursing scholarship. 2007; 39(2):155-64

24.

Grobler A, Joubert YT. Psychological Capital: Convergent and discriminant validity of a reconfigured measure. South African Journal of Economic and Management Sciences. 2018; 21(1):1-14

25.

Perrot B, Bataille E, Hardouin J-B. validscale: A Command to Validate Measurement Scales. The Stata Journal. 2018; 18(1):29-50

26.

Tavakol M, Dennick R. Making sense of Cronbach’s alpha. International journal of medical education. 2011; 2:53

27.

Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of chiropractic medicine. 2016; 15(2):155-63

28.

Yairi E, Ambrose N, Cox N. Genetics of stuttering: a critical review. Journal of speech and hearing research. 1996; 39(4):771-84

29.

Van Borsel J, Brepoels M, De Coene J. Stuttering, attractiveness and romantic relationships: the perception of adolescents and young adults. Journal of fluency disorders. 2011; 36(1):41-50