The present study assessed the validity and reliability of the WHO-OHSQ questionnaire for children and adolescents after translation and back-translation. The questionnaire demonstrated clarity and fluency, and its results were consistent when repeated under the same conditions. Cronbach's alpha analysis indicated an acceptable level of internal consistency and reliability. The questionnaire was multifactorial, and the concurrent validity survey showed that only four questions had a significant relationship with the three additional questions.
In this study, all the questions were initially translated into Persian. After translating and back-translating the fourteen questions, no differences were found between the parallel translations. Due to cultural differences and disagreements with the Education Department, the question about smoking was removed from the questionnaire. In the pilot phase, it was observed that individuals who read the questionnaire for the first time had difficulty understanding the difference between rural, urban, and peri-urban areas. Therefore, the location question was modified to two choices: Rural and urban. These modifications were also observed in other studies (
17).
The internal consistency of the WHO-OHSQ questionnaire was assessed using Cronbach's alpha coefficient. The results showed a value of 0.656 for students under 12 years old and 0.643 for students over 12 years old. It was also shown that this value remained higher than 0.6 if any of the questionnaire items were removed. When the internal correlation of a question is low, Cronbach's alpha decreases. If the low value of Cronbach's alpha is due to the internal correlation of the question, one solution is to modify the questionnaire by removing the questions that do not have a significant impact on its value. Also, it is important for the questions of the questionnaire to follow the same Likert scale, which was not observed in this questionnaire (
26). However, studies suggest that a Cronbach's alpha of 0.6 or higher is acceptable for this age group (
17,
27-
29). Therefore, it can be concluded that the internal consistency of the questionnaire is acceptable.
A similar study was conducted on the Arabic version of the index, with an average age of 16 ± 1.04 (adolescent group), which resulted in a Cronbach's alpha value of 0.72. This value is borderline and close to the value obtained in our study (
16). In the Chilean language version, with an average age of 12 years (children's group), an alpha value of 0.62 was obtained for this index, confirming the results of our study (
17). In addition, the internal consistency of binary answer questions was measured using the Kuder-Richardson-20 index. The calculated value was 0.39 for participants under the age of 12 and 0.376 for those over the age of 12, which, according to the range between 0 - 1 for this index, is an intermediate value. In the Chilean version of the study, the Kuder-Richardson-20 index was equal to 0.2 (
14).
The reliability of the questionnaire was evaluated using the test-retest method. The results demonstrated that the questionnaire produced consistent scores for individuals over time. The ICC coefficient for the questionnaire was found to be between 0.81 and 0.97 for both age groups. When the coefficient is above 0.9, it is considered very excellent, and between 0.8 and 0.9 is excellent (
26). Our Arabic counterpart's coefficient was found to be 0.89 on average, which confirms our study's results (
16). In a study conducted on the Chilean version of the questionnaire, the ICC coefficient was not calculated (
17).
During the examination of the relationship between the questionnaire's main question and three additional questions, it was discovered that describing oral health, the number of times feeling toothache in the last 12 months, and problems related to biting and chewing are significantly related to their corresponding questions. However, questions related to nutrition, which are associated with oral health risk factors, do not show any significant relationship with these three additional questions. Since most participants in the study had good oral health and brushing habits, these results could be influenced by their good dental health. It should be mentioned that in none of the studies concerning this questionnaire has the validity been measured while adding questions. However, in other validation-related studies, the validity has been determined by comparing the questionnaire's questions with a gold standard question (
30).
The exploratory factor analysis showed that the KMO index value was 0.71 for children under 12 years old and 0.68 for those over 12 years old. These values are considered acceptable for conducting the exploratory factor analysis (
31). After conducting a conventional varimax rotation, seven factors were identified for the age group below 12 years, while eight factors were identified for the age group above 12 years. This indicates that oral problems and risk factors related to oral health cannot be easily classified into two separate domains. The results also indicate that this tool can be multidimensional. Generally, including more questions in the tool can lead to a more accurate measurement of a dimension. The results of a study conducted in Chile confirmed the findings of our study. However, in a study that focused on the Arabic version of the tool, factor analysis was not performed (
13,
14).
Due to the spread of the Coronavirus disease, it was not possible to measure a gold standard along with the questionnaire to compare its results. It is recommended that future studies use the objective criterion DMFT to check the correlation between DMFT and questionnaire questions. Also, information was collected online during the school holidays, which naturally limits the study's population to those who have access to the internet. It is suggested that the results of this study be re-evaluated by referring to schools for future studies. Another limitation of this study was not using a standard measure such as the quality of life score related to oral health to measure concurrent validity. To measure the concurrent validity, it is suggested to measure the relationship between the quality of life score related to oral health and the questionnaire questions on a smaller number of people. However, one of the strengths of this study was its large sample size, which can confirm the accuracy of the analysis performed.
5.1. Conclusions
The Persian version of the WHO-OHSQ, designed for children and adolescents, is a reliable questionnaire over time. If the questionnaire is repeated and the responses from individuals in the same population are collected, it yields similar results. It has internal consistency, but it is a multi-factor questionnaire. Along with clinical studies, it can provide information about a person's oral health habits, chewing and biting problems, satisfaction with the appearance of teeth, and other related factors.