Abstract
Background:
A significant part of chronic disease control and prevention depends on patients' access to appropriate information.Objectives:
The present study aims to evaluate Persian websites that provide information about chronic diseasesMethods:
In the current quantitative-descriptive survey study, data were collected by determining the core websites' ratio using the purposive sampling method and by using HONcode, Discern, and Silberg tools. The data were then analyzed through descriptive and correlation statistics using SPSS software version 21.Results:
Based on the results, the Persian core websites for chronic diseases had average scores of 49.10%, 39.59%, and 49.95% based on HONcode, Discern, and Silberg criteria, respectively. Additionally, a significant positive relationship was observed between the results of the Discern and Silberg tools for evaluating chronic disease websites. However, HONcode scores were not significantly related to those of Discern and Silberg.Conclusions:
The Persian websites for chronic diseases were qualitatively unfavorable based on the HONcode, Discern, and Silberg criteria, and the results of the three tools were not convergent. To help users, credible websites should be introduced or redesigned to meet international standards.Keywords
Chronic Diseases Health Information Website Quality Assurance Online Health Information HONcode Criteria Discern Criteria Silberg Criteria
1. Background
Chronic diseases are among the largest crises for health systems in both developed and developing countries (1). According to World Health Organization (WHO) reports, chronic diseases account for 60% of all deaths worldwide (2, 3). Better patient knowledge impacts the management and prevention of chronic diseases and improves individuals' quality of life (4-6). Studies at Temple University demonstrated that cancer patients using credible websites for information are more inclined toward different treatments (7). Additionally, patients' access to basic information about their diseases helps strengthen their trust in doctors and positively affects the treatment process (8).
In the healthcare context, it is safer to use high-quality resources than to rely on public search engines (8, 9). The average public user lacks the necessary skills to evaluate health information retrieved from the Internet, making this activity challenging (10-12). Therefore, various methods and tools have been developed by international organizations to support users and minimize the risks of applying false information. The use of tools to check the quality of medical information on the web is not limited to a particular country or language (11, 13).
Although there has been some research into evaluating the quality of websites according to country of origin and types of websites (6, 13-16), the findings are contradictory and inconclusive. Research in this area is still in its infancy, and no work has yet investigated website quality in the field of chronic disease care. Today, Persian websites are widely utilized, although less attention is paid to their quality (16-19).
In the present study, Persian websites for chronic diseases were evaluated using the HONcode, Discern, and Silberg tools. Furthermore, the relationship between the results of these tools was examined by determining the correlation between the scores related to the evaluation of Persian websites.
2. Objectives
The results of the study reflect the current situation of Persian information dissemination related to chronic diseases on the Internet and can serve as a guide to direct users to reliable sources of information. Finally, health policymakers can use these results to expand equitable access for all individuals to health information resources through the World Wide Web.
3. Methods
In this quantitative study, samples were selected using a free text search and purposive sampling. Ten keywords, including hypertension, asthma, stomach cancer, lung cancer, myocardial infarction, emphysema, stroke, chronic bronchitis, and leukemia, were searched on Google, retrieving 100 homepages for each search (1,000 sites in total). The search was conducted between July 18 and August 28, 2022. After viewing each site's homepage, its internal links were identified using www.MOZ.com. The formula Au = T/N was applied to identify and introduce main websites, where Au refers to the index identifying the main website, T illustrates the total links to research websites, and N indicates the number of websites.
Following core ratio calculation, websites with numerical coefficients greater than the core ratios were selected as samples. In the second step, each core website was evaluated based on the HONcode, Discern, and Silberg tools. Additionally, the assessment checklist was completed through direct referral by the researcher to the sites, and feedback from five physicians active in the field of chronic disease was applied to ensure the accuracy of the data collected. The researchers have expertise in library and medical information and have previously published articles on the topic of evaluating online health information resources. Only physicians who met the following criteria were invited to participate in this study: (1) Iranian physicians with at least one year of experience in the medical profession, and (2) active Iranian physicians who use the internet and social media to share health information with colleagues or patients.
Next, correlations between chronic disease assessment website scores were determined using the HONcode, Discern, and Silberg tools with SPSS statistical software version 21. In the study, the titles of the websites and the names of the owners were not directly mentioned, and their identities were not revealed to protect their personal information.
4. Results
As shown in Table 1, the in-links of two websites are above one million, accounting for about half of the total in-links. The core ratio of the selected websites was calculated to be 134,130. Comparing the in-links of each website with the core ratio revealed that only 14 websites met the inclusion criteria of the study.
In-link Frequency from Persian Websites that Provide Information About Chronic Diseases
| In-link Frequency | 1 - 132000 | 132001 - 264000 | 264001 - 528000 | 528001 - 660000 | 660001 - 792000 | 792011 - 924051 | More Than 1000000 | Total |
|---|---|---|---|---|---|---|---|---|
| Websites frequency | 79 | 3 | 8 | 0 | 1 | 1 | 2 | 94 |
| Total link | 1060113 | 611513 | 3218988 | 0 | 666641 | 924051 | 6127161 | 12608287 |
| Core website ratio | 134130 |
As shown in Table 2, regarding the evaluation using HONcode criteria, the w7 and w14 websites acquired the highest credibility (85.71% of the total score), while the w8 website achieved the least credibility (7.14%). The results related to Discern criteria demonstrated that the maximum and minimum credibility were attained by w14 (80% of the total score) and w12 and w13 (6.66%), respectively. These websites were also determined to be the most and least credible based on the Silberg criteria. Considering the sum of the scores obtained using the HONcode, Discern, and Silberg tools, the maximum and minimum credibility were determined to be w14 and w12, with 81.51% and 10.52% of the total scores, respectively.
Persian Websites Assessment Scores Based on the Honcode, Discern and Silberg Criteria
| Website Code | Score | |||
|---|---|---|---|---|
| Honcode 14% | Dsicern 15% | Silberg 9% | Total 38% | |
| W1 | 857.14)) | 9 (60.00) | 5 (55.55) | 32 (84.21) |
| W2 | 6 (42.85) | 6 (40.00) | 2 (22.22) | 14 (36.84) |
| W3 | 6 (42.85) | 10 (66.66) | 2 (22.22) | 18 (47.36) |
| W4 | 857.14)) | 5 (33.33) | 5 (55.55) | 18 (47.36) |
| W5 | 11 (78.57) | 8 (53.33) | 4 (44.44) | 23 (60.52) |
| W6 | 6 (42.85) | 6 (40.00) | 2 (22.22) | 14 (36.84) |
| W7 | 12 (85.71) | 2 (13.33) | 5 (55.55) | 19 (50.00) |
| W8 | 1 (7.14) | 2 (13.33) | 2 (22.22) | 5 (13.15) |
| W9 | 7 (50.00) | 6 (40.00) | 5 (55.55) | 18 (47.36) |
| W10 | 10 (71.42) | 9 (60) | 5 (55.55) | 24 (63.15) |
| W11 | 7 (50.00) | 7 (46.66) | 4 (44.44) | 18 (47.36) |
| W12 | 2 (14.28) | 1 (6.66) | 1 (11.11) | 4 (10.52) |
| W13 | 3 (21.42)) | 1 (6.66) | 1 (11.11) | 5 (13.15) |
| W14 | 12 (85.71) | 12 (80.00) | 7 (77.77) | 31 (81.57) |
As summarized in Table 3, the Pearson's correlation coefficient between HONcode and Discern criteria is -0.009. given that -1 < r < 1, a partial inverse linear correlation was observed between these criteria for examining Persian websites for chronic diseases. The level of significance for the correlation coefficient between HONcode and Discern criteria was 0.564 (P-value). Therefore, the first hypothesis of the study was rejected, indicating no positive correlation between the criteria.
Correlation Between Honcode, Discern and Silberg Criteria for Persian Core Websites Assessment
| Pearson Correlation | Correlation Coefficient (r) | P-Value |
|---|---|---|
| Honcode | ||
| Discern | -0.009 | 0.977 |
| Silberg | 0.169 | 0.564 |
| Discern and Silberg | 0.597 | 0.024 |
Additionally, the Pearson's correlation coefficient between HONcode and Silberg criteria, as well as between Discern and Silberg criteria, was determined to be 0.169 and 0.597, respectively. Since 0 < r < +1, a partial direct linear correlation was observed between HONcode and Silberg criteria, as well as between Discern and Silberg criteria. The level of significance for the correlation coefficient between HONcode and Silberg was 0.977, and for Discern and Silberg, it was 0.24. Therefore, no significant positive correlation was observed between HONcode and Silberg criteria, while a positive correlation was found between Discern and Silberg criteria.
5. Discussion
The results of the study indicated that HONcode criteria were present in only 10.49% of Persian websites for chronic diseases. Previous research has shown that HONcode indices are less emphasized in Persian health websites (16, 20). For example, none of the Persian language websites on Ebola meet all eight HONcode criteria (16). Additionally, the present study highlighted the difficulty of assessing the true quality of Persian websites for chronic diseases using these criteria. Regarding non-Persian websites, some researchers found that many Internet-based resources do not achieve an acceptable score based on these criteria. For instance, only 35% of Yahoo directory pages meet some of the information evaluation criteria in the HONcode tool (21).
Furthermore, the evaluated websites achieved an average of 39.59% of the Discern criteria. Previous research demonstrated the inappropriateness of using Discern criteria to evaluate the quality of Persian websites. Zahedi et al. found a mean score of 89.41% for Persian addiction websites (19). Some researchers emphasized that ad insertion policies should be clear and distinct from the main content to prevent confusion among ordinary users (16, 22, 23). Additionally, the use of HONcode, Discern, and Silberg tools for examining the quality of information on Persian chronic disease websites was challenging and did not yield convergent results. Previous studies have reported the difficulty of evaluating the quality of health website pages and the lack of efficiency in detecting incorrect information using current health website evaluation tools (12, 24, 25). Despite the high number of health information quality evaluation tools, only a few can be effectively utilized by the public (26, 27).
Based on the results of the present study, the HONcode, Discern, and Silberg tools are not suitable criteria for judging the quality of information on Persian websites for chronic diseases. Some researchers have mentioned that tools for evaluating Internet health information quality are moving towards different and unknown goals, despite developing in the same direction (28). Additionally, the results of the present study showed no significant positive correlation between the HONcode and Discern criteria for examining the intended websites, while the Discern criteria were positively and significantly correlated with the Silberg criteria. Furthermore, a positive correlation was observed between HONcode and Silberg criteria, although it was insignificant. However, some researchers have noted the lack of a significant positive correlation between information quality criteria and appearance indices on Persian web pages related to public health (17, 18, 20). According to Robbins, trust in health websites is not significantly related to their appearance indices (29).
5.1. Conclusions
The results of the present study show that the HONcode, Discern, and Silberg tools are inappropriate for evaluating Persian websites for chronic diseases. Additionally, no significant positive correlation was found between the HONcode and Discern criteria for evaluating the intended websites, while the Discern criteria were significantly and positively related to the Silberg criteria. However, a positive and insignificant correlation was observed between the HONcode and Silberg criteria. It is worth noting that the use of the HONcode, Silberg, and Discern tools for evaluating public health information quality requires necessary expertise, which ordinary users may not possess. Therefore, measures should be taken to train and empower users to enhance their health literacy levels.
5.2. Limitations and Suggestions for Future Studies
This study has several limitations.
(1) The study used the first 100 web pages resulting from a single search term in Google. This method has limitations as the sample of 14 websites was not based on a sample size calculation, but conducting such a calculation would have been extremely time-consuming and beyond the scope of this study.
(2) The Internet constantly changes, so each time a search term is entered into a search engine, the results may vary slightly. However, this method makes our study more generalizable because patients are likely to perform only a single search and are unlikely to use the same search term multiple times to find different websites.
(3) The results of the Google search in this study only produced Persian-language websites, and this study only analyzed websites in Persian (non-Persian-language websites were excluded).
(4) Using ten selected keywords as the search terms, rather than multiple search terms that patients might use, was another limitation.
(5) Using websites from a single search engine could potentially impact the results since other websites of different quality may have been missed. However, this is unlikely as a relatively large sample was used, containing websites that may have appeared in other search engines.
(6) Due to the subjective nature of some criteria in the existing tools, examiner bias could have impacted the results.
Based on the findings of this study, further research should be conducted on evaluating Persian health websites and applying different evaluation checklists, as well as understanding the criteria and indices of health content quality. Users should first be empowered and trained to increase their health literacy levels, and then health organizations can introduce credible resources to the public. The following suggestions are proposed for future research:
(1) Evaluate how Persian language users (and users of other languages) judge health information quality.
(2) Develop codes of conduct to help the authors, owners, and users of health websites.
(3) Define native quality labels for different languages to mark credible websites.
Acknowledgements
References
-
1.
Beaglehole R, Yach D. Globalisation and the prevention and control of non-communicable disease: the neglected chronic diseases of adults. Lancet. 2003;362(9387):903-8. [PubMed ID: 13678979]. https://doi.org/10.1016/S0140-6736(03)14335-8.
-
2.
Madan AK, Frantzides CT, Pesce CE. The quality of information about laparoscopic bariatric surgery on the Internet. Surg Endosc. 2003;17(5):685-7. [PubMed ID: 12618943]. https://doi.org/10.1007/s00464-002-8610-7.
-
3.
Portz JD. A review of web-based chronic disease self-management for older adults. Gerontechnol. 2017;16(1):12-20. [PubMed ID: 30705614]. [PubMed Central ID: PMC6350903]. https://doi.org/10.4017/gt.2017.16.1.002.00.
-
4.
Wang C, Lang J, Xuan L, Li X, Zhang L. The effect of health literacy and self-management efficacy on the health-related quality of life of hypertensive patients in a western rural area of China: a cross-sectional study. Int J Equity Health. 2017;16(1-11).
-
5.
Ozduran E, Hanci V. Evaluating the readability, quality, and reliability of online information on sjogren's syndrome. Indian J Rheumatol. 2023;18(1):16. https://doi.org/10.4103/injr.injr_56_22.
-
6.
Carlisle A, Patterson T, Bonnar J. A quality analysis of internet patient information for immediate, sequential, bilateral cataract surgery (ISBCS). Eur J Ophthalmol. 2024;34(3):754-8. [PubMed ID: 37792539]. https://doi.org/10.1177/11206721231204828.
-
7.
Wand Y, Wang RY. Anchoring data quality dimensions in ontological foundations. Communications of the ACM. 1996;39(11):86-95. https://doi.org/10.1145/240455.240479.
-
8.
Rew L, Saenz A, Walker LO. A systematic method for reviewing and analysing health information on consumer-oriented websites. J Adv Nurs. 2018. [PubMed ID: 29845648]. https://doi.org/10.1111/jan.13726.
-
9.
Rahmatizadeh S, Valizadeh-Haghi S, Nasibi-Sis H, Motahari-Nezhad H. Readability and credibility evaluation of most-visited health websites based on eBizMBA and Alexa global ranking. Frontiers Health Inform. 2024;13:191. https://doi.org/10.30699/fhi.v13i0.567.
-
10.
Mazza VA, Lima VF, Carvalho A, Weissheimer G, Soares LG. Online information as support to the families of children and adolescents with chronic disease. Rev Gaucha Enferm. 2017;38(1). e63475. [PubMed ID: 28443972]. https://doi.org/10.1590/1983-1447.2017.01.63475.
-
11.
Willis E, Royne MB. Online Health Communities and Chronic Disease Self-Management. Health Commun. 2017;32(3):269-78. [PubMed ID: 27218836]. https://doi.org/10.1080/10410236.2016.1138278.
-
12.
Khalilizadeh Ganjalikhani M, Hesabi A, Ketabi S. Evaluating linguistic comprehensibility of Persian healthcare translations in multilingual contexts: a case study of health translations website from the Victorian Government of Australia. Int J Multilingualism. 2023:1-18. https://doi.org/10.1080/14790718.2023.2236150.
-
13.
Rahmatizadeh S, Valizadeh-Haghi S. Evaluating the trustworthiness of consumer-oriented health websites on diabetes. Lib Philosophy Practice. 2018;2018.
-
14.
Perez-Lopez FR. An evaluation of the contents and quality of menopause information on the World Wide Web. Maturitas. 2004;49(4):276-82. [PubMed ID: 15531123]. https://doi.org/10.1016/j.maturitas.2004.07.006.
-
15.
Ogunwale B, Clarke J, Young D, Mohammed A, Patil S, Meek RM. Direct to consumer advertising via the Internet, a study of hip resurfacing. Scott Med J. 2009;54(1):10-3. [PubMed ID: 19291928]. https://doi.org/10.1258/rsmsmj.54.1.10.
-
16.
Ansari M, Hamzehei R, Valizadeh-Haghi S. Persian language health websites on Ebola disease: less credible than you think? J Egypt Public Health Assoc. 2020;95(1):2. [PubMed ID: 32813057]. [PubMed Central ID: PMC7364698]. https://doi.org/10.1186/s42506-019-0027-4.
-
17.
Ghalavand H, Eskrootchi R, Alibeyk MR, Haghani H. The relationship between information quality and external quality markers in Persian public health web pages. J Health Administr. 2012;15(47).
-
18.
Samadbeik M, Ahmadi M, Mohammadi A, Mohseni Saravi B. Health information on internet: quality, importance, and popularity of persian health websites. Iran Red Crescent Med J. 2014;16(4). e12866. [PubMed ID: 24910795]. [PubMed Central ID: PMC4028768]. https://doi.org/10.5812/ircmj.12866.
-
19.
Zahedi R, Taheri B, Shahrzadi L, Tazhibi M, Ashrafi-rizi H. Quality of persian addiction websites: a survey based on silberg, discern and wqet instruments (2011). Acta Inform Med. 2013;21(1):46-50. [PubMed ID: 23572862]. [PubMed Central ID: PMC3610591]. https://doi.org/10.5455/AIM.2012.21.46-50.
-
20.
Mokhtarzadeh M. Information Quality in Persian Health Website: A Literature reviw. H J Man. 20`5;4(2):45-59.
-
21.
Stvilia B, Mon L, Yi YJ. A model for online consumer health information quality. Jo Am Soc Inform Sci Technol. 2009;60(9):1781-91. https://doi.org/10.1002/asi.21115.
-
22.
Shim M, Jo HS. What quality factors matter in enhancing the perceived benefits of online health information sites? Application of the updated DeLone and McLean Information Systems Success Model. Int J Med Inform. 2020;137:104093. [PubMed ID: 32078918]. https://doi.org/10.1016/j.ijmedinf.2020.104093.
-
23.
Fidler M, Lavbič D. Improving information quality of Wikipedia articles with cooperative principle. Online Inform Rev. 2017;41(6):797-811. https://doi.org/10.1108/oir-01-2016-0003.
-
24.
Breckons M, Jones R, Morris J, Richardson J. What do evaluation instruments tell us about the quality of complementary medicine information on the internet? J Med Internet Res. 2008;10(1). e3. [PubMed ID: 18244894]. [PubMed Central ID: PMC2483844]. https://doi.org/10.2196/jmir.961.
-
25.
Zhu Y, Song T, Zhang Z, Yu P. Developing an Instrument to Evaluate the Quality of Dementia Websites. Healthcare (Basel). 2023;11(24). [PubMed ID: 38132053]. [PubMed Central ID: PMC10742665]. https://doi.org/10.3390/healthcare11243163.
-
26.
Bernstam EV, Walji MF, Sagaram S, Sagaram D, Johnson CW, Meric-Bernstam F. Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer. Cancer. 2008;112(6):1206-13. [PubMed ID: 18266210]. https://doi.org/10.1002/cncr.23308.
-
27.
Alassaf MS, Hasubah SM, Sharbib SH, Alhammad R, Othman AA, Alsulaimani MA, et al. Assessment of Quality and Readability of Web-Based Arabic Knowledge About Cleft Lip and/or Palate: An Infodemiology Study. Cleft Palate Craniofac J. 2023:10556656231223900. [PubMed ID: 38158230]. https://doi.org/10.1177/10556656231223861.
-
28.
Gagliardi A, Jadad AR. Examination of instruments used to rate quality of health information on the internet: chronicle of a voyage with an unclear destination. BMJ. 2002;324(7337):569-73. [PubMed ID: 11884320]. [PubMed Central ID: PMC78993]. https://doi.org/10.1136/bmj.324.7337.569.
-
29.
Robins D, Holmes J, Stansbury M. Consumer health information on the Web: The relationship of visual design and perceptions of credibility. J Am Soc InformSciTechnol. 2010;61(1):13-29.