Evaluation of the Impact of Webinar Training in Comparison to Conventional Training on COVID-19 Risk Perception in Emergency Medical Technicians

authors:

avatar Seyyed Mohammad Reza Hosseini ORCID 1 , avatar Mohammad Azim Mahmodi ORCID 1 , * , avatar Amir Mirhaghi ORCID 2

School of Nursing and Midwifery, Birjand University of Medical Sciences, Birjand, Iran
School of Nursing and Midwifery, Mashhad University of Medical Sciences, Mashhad, Iran

how to cite: Hosseini S M R, Mahmodi M A, Mirhaghi A . Evaluation of the Impact of Webinar Training in Comparison to Conventional Training on COVID-19 Risk Perception in Emergency Medical Technicians. Mod Care J. 2021;18(2):e116139. https://doi.org/10.5812/modernc.116139.

Abstract

Background:

The COVID-19 pandemic has affected in countless ways conventional teaching methods and led to a sudden shift in teaching methods toward distance teaching.

Objectives:

Hence, this study aimed to evaluate the impact of webinar training compared to conventional training on the risk perception of COVID-19 in emergency medical technicians (EMTs).

Methods:

This quasi-experimental study selected 70 EMTs employed at the emergency medical services (EMS) affiliated to the Birjand University of Medical Sciences via convenience sampling. The participants were randomly designed into a webinar training group (n = 35) and a conventional training group (n = 35). The risk perception of COVID-19 was evaluated using a researcher-made questionnaire (40 questions) at baseline and immediately after teaching. The study data were analyzed using SPSS V.26, descriptive (frequency, mean, and standard deviation), and inferential statistics (t-test, ANOVA, and chi-square test).

Results:

All the 70 participants completed the questionnaire. The mean score of COVID-19 risk perception in both groups improved following teaching (P < 0.001). However, there was no statistically significant difference between the groups immediately after training (P = 0.76). Also, independent t-test and one-way ANOVA showed that the mean score of COVID-19 risk perception had no significant difference with the participants’ demographic data in the two groups (P > 0.05).

Conclusions:

The webinar in the form of distance teaching can be as effective as conventional teaching in improving COVID-19 risk perception. Therefore, a webinar format can be used during pandemics of infectious diseases when conventional training is impossible.

1. Background

The COVID-19 outbreak was detected in Wuhan, China, in December 2019, which rapidly led to a worldwide pandemic (1-3). In Iran, the COVID-19 outbreak was officially announced on February 18, 2020 (4). So far (April 21, 2021), the COVID-19 pandemic has infected near 2,286,927 people across Iran, of whom over 67,525 people have lost their lives.

According to the nature of their work, healthcare workers are always at risk of infectious diseases (5). In a study, the rate of disease transmission to healthcare workers was reported as 29% (6). In Iran, more than 6,000 healthcare workers have been infected by COVID-19, and more than 150 of them have died (7).

Healthcare workers, especially emergency medical technicians (EMTs), who are the mainstay of healthcare in prehospital services, have always been at risk of infectious diseases. The spread of the new virus has multiplied the risk. On the other hand, given the large number of EMTs infected with COVID-19, there is a gap between their knowledge and performance. In this regard, Brotons et al. (8) reported a lack of disease risk perception as one of the possible causes of the gap between knowledge and performance of healthcare workers in preventing diseases and promoting their health.

Training preventive measures in prehospital services on COVID-19 risk perception could improve protective behaviors in EMTs. On the other hand, many countries have applied social distancing measures to reduce the spread of COVID-19, which has also restrained conventional teaching (9). Nowadays, to overcome this problem, regarding recent advances in network technology, methods for the simultaneous delivery of distance education, such as webinars, are rising. Of course, distance education has been in place for some time (10-12). Since distance education gives more flexibility to students, many have considered it the preferred mode of teaching in the future. A study on surgical skills training indicated that web-based distance learning was a feasible alternative to face-to-face surgical skills teaching (9). Due to certain advantages of distance education, this type of teaching has become necessary during the COVID-19 pandemic when social contact is minimal. A webinar, supported by synchronous platforms, such as Adobe Acrobat Connect, is a real-time online interaction between an instructor and a variety of geographically segregated learners (13). Hence, it is worthwhile to evaluate this type of training method.

2. Objectives

Since evidence to evaluate the potential of webinar education is limited to few studies, this study aimed to evaluate the impact of webinar training compared to conventional training on COVID-19 risk perception in EMTs using preventive measures training in prehospital services as an educational intervention.

3. Methods

3.1. Study Design

This quasi-experimental study was conducted in 2021. The research population consisted of all EMTs employed at the emergency medical services (EMS) affiliated to the Birjand University of Medical Sciences, Southern Khorasan Province, Iran. Since no similar study was found in this regard, considering a confidence level of 95%, a power of 80%, and an effect size of 0.7, the sample size in each group was estimated to be 32. To avoid the effects of potential dropouts and increase the accuracy of the measurement, we selected 35 participants for each group.

3.2. Participants

Seventy EMTs with no COVID-19 symptoms were selected through convenience sampling based on predetermined inclusion criteria. The inclusion criteria were EMTs with at least one year of experience in EMS and willingness to participate in the study. EMTs who incompletely filled out their questionnaires were excluded. The participants were randomly allocated into one of the two groups of conventional training (n = 35) and webinar training (n = 35) using a random-numbers table.

3.3. Intervention

The conventional training group received a live PowerPoint presentation of preventive measures in prehospital services on COVID-19 risk perception during 6 hours in a regular classroom with the implementation of health protocols. Also, the webinar group received the same training simultaneously via an individual computer or mobile device hosted on the Adobe Acrobat Connect conferencing platform. Preventive measures included teaching hand hygiene, donning and doffing of personal protective equipment (8), cardiopulmonary resuscitation, and Do’s and Don’ts in the COVID-19 pandemic.

3.4. Data Collection

An online survey was used to collect data to prevent the spread of COVID-19. A researcher-made questionnaire was designed on Google Form, and a link was sent to the participants on WhatsApp groups. The questionnaire consists of questions related to demographics data and COVID-19 risk perception. The data in the demographic questionnaire consisted of gender, age category, marital status, educational status, work experience, and workplace. Questions related to risk perception consisted of 40 items in eight main dimensions, namely background knowledge of COVID-19 (eight items), perception of the seriousness of COVID-19 (three items), perception of susceptibility to COVID-19 (three items), perceived efficacy of preventive measures (five items), EMS factors (six items), family environment factors (five items), social factors (five items) and motivating/hindering factors (five items). The items of the dimensions were scored on a 5-point Likert-type scale (1) completely disagree; 2, disagree; 3, undecided; 4, agree; and 5, completely agree). The questionnaire was prepared based on the available articles (4, 14-17).

The mean score of COVID-19 risk perception was calculated by summing the scores of the questions and dividing them by the number of participants. Thus, the mean score of COVID-19 risk perception would be 40 to 200. At two time points, the data were collected. The first point of data collection was baseline (the day before teaching), and the next point of time was immediately after the intervention.

By content validity index (CVI) calculation, the content validity of the questionnaire was assessed. Hence, seven experts were requested to comment on the relevance of each item of the questionnaire on a 4-point Likert-type scale as follows: (1) Irrelevant; (2) somehow relevant; (3) relevant; and (4) completely relevant. Accordingly, the CVI of each item was calculated by dividing the number of experts rating that item as 3 or 4 by the total number of experts (n = 7). Finally, CVI values in this study were obtained from 0.87 to 1, with the total CVI value being 0.94.

The reliability assessment of the questionnaire was performed using a pilot study with 30 EMTs who were not included in the present study. The Cronbach’s alpha of the questionnaire and its dimensions were 0.87 and 0.71 to 0.92, respectively.

3.5. Ethics Considerations

The Ethics and Research Committee of the Birjand University of Medical Sciences approved the study protocol (approval code: IR.BUMS.REC.1400.014). Firstly, the objectives and procedures of the study were explained to the participants. Then, they were informed that they would be free to withdraw from the study at any time.

3.6. Statistical Analysis

The Shapiro-Wilk test was performed to ensure the normal distribution of the data. A value of P > 0.05 confirmed that the data were normally distributed. Therefore, parametric statistics were used. The paired t-test was applied to compare the mean scores of risk perception before and immediately after teaching within each group, and an independent t-test was used to compare the groups. Also, one-way ANOVA was used for data analysis, and the chi-square test was used to compare the demographic data between the groups. For all the tests, the level of significance was set at P < 0.05. Analysis of the study data was performed using SPSS software, version 26.

4. Results

All the 35 EMTs from the conventional training group attended classroom-based teaching. Of them, 20 held an associate’s degree, and 15 held a bachelor’s degree. Also, of the EMTs, 33 were male, and two were female. All the 35 EMTs from the distance training group watched and listened to the lecture simultaneously using the webinar. They comprised 17 EMTs with an associate’s degree and 18 EMTs with a bachelor’s degree. There were 33 males and two females in this group. In terms of the participants’ demographic data, there was no statistically significant difference between the study groups (P > 0.05; Table 1).

Table 1.

Comparison of Demographic Data Between Groups

Demographic DataGroupP-Valuea
Conventional Training, No. (%)Webinar Training, No. (%)
Gender1.00
Male33 (94.3)33 (94.3)
Female 2 (5.7)2 (5.7)
Age, y0.462
20 - 2917 (48.6)13 (37.1)
30 - 39 16 (45.7)21 (60)
40 - 49 2 (5.7)1 (2.9)
Marital status0.339
Single19 (54.3)15 (42.9)
Married 16 (45.7)20 (57.1)
Educational status0.473
Associate20 (57.1)17 (46.8)
Bachelor’s15 (42.9)18 (51.4)
Workplace0.339
Urban EMS19 (54.3)15 (42.9)
Rural EMS 16 (45.7)20 (57.1)
Work experience, y0.209
1 - 514 (40)8 (22.9)
6 - 10 10 (28.6)11 (31.4)
11 - 15 8 (22.9)13 (37.1)
> 163 (8.6)3 (8.6)

The independent t-test revealed that the mean score of COVID-19 risk perception was not significantly different between the two groups before the intervention (P = 0.79; Table 2). However, the paired sample t-test demonstrated that the mean score of COVID-19 risk perception was significantly improved immediately after training across the two groups (P < 0.001). There was also no statistically significant difference between the groups immediately after training (P = 0.76; Table 2). The independent t-test also indicated no significant difference between the groups based on the mean score of COVID-19 risk perception domains evaluated immediately after teaching (P > 0.05; Table 3). Moreover, the mean score of COVID-19 risk perception immediately after teaching had no significant difference with the participants’ demographic data in the two study groups (P > 0.05; Table 4).

Table 2.

Comparison of Mean Scores of COVID-19 Risk Perception Pre- and Post-Educational Intervention Within and Between Groups

GroupBaselineImmediately after teachingP-Valuea
Conventional training group149.28 ± 28.81174.60 ± 20.03< 0.001
Webinar training group151.31 ± 33.33173.28 ± 15.52< 0.001
P-valueb0.790.76
Table 3.

Comparison of Mean Scores of COVID-19 Risk Perception Domains Evaluated After Teaching Between Groups

Domains of COVID-19 risk perceptionConventional Training, Mean ±SDWebinar Training, Mean ±SDP-Valuea
knowledge of COVID-1929.14 ± 3.7828.88 ± 4.860.80
perception of the seriousness of COVID-1912.71 ± 2.4511.57 ± 3.100.09
perception of susceptibility to COVID-1911.74 ± 2.9411.51 ± 3.330.76
perceived efficacy of preventive measures22.20 ± 3.2621.31 ± 4.340.33
EMS factors26.28 ± 5.1925.94 ± 4.470.77
family environment factors18.94 ± 3.6718.25 ± 4.070.46
social factors19.85 ± 3.5819.25 ± 4.210.54
motivating/hindering factors19.31 ± 3.7818.65 ± 5.040.54
Table 4.

Comparison of Mean Scores of COVID-19 Risk Perception After Teaching Based on Demographic Data

Demographic DataConventional Training, Mean ±SDWebinar Training, Mean ±SD
Gender
Male174.41 ± 20.30172.66 ± 15.60
Female181.30 ± 17.32183.50 ± 13.43
P-valuea0.750.34
Age, y
20 - 29178.50 ± 28.99177.00 ± 14.13
30 - 39177.08 ± 17.89171.28 ± 16.57
40 - 49172.80 ± 21.35170.60 ± 10.16
P valueb0.540.81
Marital status
Single173.31 ± 19.79178.40 ± 14.72
Married175.68 ± 20.72169.45 ± 15.34
P-valuea0.730.09
Educational status
Associate176.00 ± 22.70176.35 ± 14.52
Bachelor’s173.78 ± 16.48170.38 ± 16.28
P-valuea0.650.21
Workplace
Urban EMS171.82 ± 17.66173.26 ± 13.64
Rural EMS177.22 ± 22.23173.30 ± 17.15
P-valuea0.430.99
Work experience, y
1 - 5173.25 ± 24.08182.00 ± 12.89
6 - 10183.92 ± 16.62174.09 ± 15.97
11 - 15163.50 ± 14.86170.69 ± 15.45
> 16166.50 ± 12.02158.33 ± 10.96
P-valueb0.120.13

5. Discussion

This study aimed to evaluate the impact of webinar training compared to conventional training on COVID-19 risk perception in EMTs using preventive measures training in prehospital services as an educational intervention. The findings showed that both groups significantly improved their COVID-19 risk perception immediately after preventive measures teaching. This finding is consistent with the findings of Alnabelsi et al. (18), who investigated traditional teaching compared to synchronous e-learning using otolaryngological emergencies teaching as an educational intervention. In his study, a statistically significant difference was found between the two groups regarding test scores before and after the intervention. Besides, to support this finding, the results of several studies on the use of e-learning compared to traditional training were acquired, indicating no overall difference in these modes of teaching delivery in terms of knowledge (19-22).

The study by Bernard et al. revealed that classroom instruction had a significant difference in overall achievement outcomes compared to e-learning, which is inconsistent with our results (23). This difference may be attributed to the different methods used. In their meta-analysis study, most previous studies compared asynchronous e-learning to classroom instruction. In contrast, in our study, two teaching methods synchronously presented by an instructor were compared.

The disruption of conventional medical education across the world in the COVID-19 pandemic has led to the use of webinars to maintain teaching and learning. In a study, the use of webinars in 2020 compared to the same period in 2019 was reported to increase by more than 300% (24).

A webinar is a form of communication that connects learners and tutors using the Internet simultaneously (25). With a webinar, a presenter can share a presentation with their audience without physically being available. It is an effective way because interaction can be compelling during a webinar. Intelligent tools are necessary to direct that interaction, especially when there are many participants (26). Therefore, a webinar offers different interactive opportunities including asking questions, chatting, surveying, and administering tests. In the teaching and educational viewpoint, webinars are engaging because of the very high degree of interaction that helps participants learn and understand more quickly.

Formerly, other studies assessed the evidence regarding the benefits of webinar teaching as an educational intervention for health professionals. Edward Christopher Yo et al. (27) mentioned that the use of webinars for health professionals training in Indonesia was well-received amidst the outbreak pandemic. Also, Bhattarai et al. (28) reported that teaching through a webinar was an invaluable instrument for medical education, particularly during the need of social distancing. The findings of the mentioned studies are in line with those of the present study.

Synchronous online teaching has a unique advantage similar to conventional training in terms of the ability to provide immediate feedback and educational support (29). Moreover, it provides logistical, instructional, and financial advantages over conventional teaching (30). The ability of EMTs to participate in the learning process from any geographical location is the logistical advantage of the webinar format. While it provides interaction between EMTs and instructors in real-time, it eliminates travel costs that is the financial benefit of the webinar format. Also, the opportunity for EMTs to utilize rich multimedia resources is the instructional advantage of this format.

One limitation of the study was that it was a self-reported survey, leading to a significant bias. Another limitation was the small number of the participants, which, overall, limits the generalizability of our results. Therefore, these limitations should be considered in future studies, and further studies are needed before a definitive conclusion can be drawn. In addition, further research is also necessary to assess the sustainability of webinar learning as an online educational intervention for learners.

5.1. Conclusions

In general, the present study results showed that webinar training was as practical as conventional training in terms of education. Thus, providing relevant training through webinars may fill the gap created by the suspension of conventional training, especially during the COVID-19 outbreak that restrictions are applied. Although the present study’s findings cannot be generalized to other curricula or educational settings, it seems that at least the webinar teaching format is indicated to be an acceptable alternative to conventional teaching. Further studies are needed to support this conclusion. Hence, health policymakers should consider the possibility of expanding webinar training to improve staff performance, particularly during the country’s lockdown for infectious diseases prevention.

Acknowledgements

References

  • 1.

    Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497-506. https://doi.org/10.1016/s0140-6736(20)30183-5.

  • 2.

    World Health Organization. World Health Organization coronavirus disease 2019 (COVID-19) situation report. 2020.

  • 3.

    Zhong Y, Liu W, Lee TY, Zhao H, Ji J. Risk perception, knowledge, information sources and emotional states among COVID-19 patients in Wuhan, China. Nurs Outlook. 2021;69(1):13-21. [PubMed ID: 32980153]. [PubMed Central ID: PMC7442898]. https://doi.org/10.1016/j.outlook.2020.08.005.

  • 4.

    Taghrir MH, Borazjani R, Shiraly R. COVID-19 and Iranian Medical Students; A Survey on Their Related-Knowledge, Preventive Behaviors and Risk Perception. Arch Iran Med. 2020;23(4):249-54. [PubMed ID: 32271598]. https://doi.org/10.34172/aim.2020.06.

  • 5.

    Gan WH, Lim JW, Koh D. Preventing Intra-hospital Infection and Transmission of Coronavirus Disease 2019 in Health-care Workers. Saf Health Work. 2020;11(2):241-3. [PubMed ID: 32292622]. [PubMed Central ID: PMC7102575]. https://doi.org/10.1016/j.shaw.2020.03.001.

  • 6.

    Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA. 2020;323(11):1061-9. [PubMed ID: 32031570]. [PubMed Central ID: PMC7042881]. https://doi.org/10.1001/jama.2020.1585.

  • 7.

    Samadipour E, Ghardashi F, Zardosht R, Borzoee F, Navipour E. Assessment the Risk Perception of Health Care Workers of Covid-19 Disease. Preprint. 2020. https://doi.org/10.21203/rs.3.rs-104039/v1.

  • 8.

    Brotons C, Bjorkelund C, Bulc M, Ciurana R, Godycki-Cwirko M, Jurgova E, et al. Prevention and health promotion in clinical practice: the views of general practitioners in Europe. Prev Med. 2005;40(5):595-601. [PubMed ID: 15749144]. https://doi.org/10.1016/j.ypmed.2004.07.020.

  • 9.

    Co M, Chu KM. Distant surgical teaching during COVID-19 - A pilot study on final year medical students. Surg Pract. 2020. [PubMed ID: 32837531]. [PubMed Central ID: PMC7361811]. https://doi.org/10.1111/1744-1633.12436.

  • 10.

    Casey DM. A Journey to Legitimacy: The Historical Development of Distance Education through Technology. TechTrends. 2008;52(2):45-51. https://doi.org/10.1007/s11528-008-0135-z.

  • 11.

    Rice KL. A Comprehensive Look at Distance Education in the K–12 Context. J Res Technoln Educ. 2006;38(4):425-48. https://doi.org/10.1080/15391523.2006.10782468.

  • 12.

    Guri-Rosenblit S. ‘Distance education’ and ‘e-learning’: Not the same thing. High Educ. 2005;49(4):467-93. https://doi.org/10.1007/s10734-004-0040-0.

  • 13.

    Nelson LS. Learning outcomes of webinar versus classroom instruction among baccalaureate nursing students: A randomized controlled trial. Texas Woman's University; 2010.

  • 14.

    Asemahagn MA. Factors determining the knowledge and prevention practice of healthcare workers towards COVID-19 in Amhara region, Ethiopia: a cross-sectional survey. Trop Med Health. 2020;48(1). https://doi.org/10.1186/s41182-020-00254-3.

  • 15.

    Olum R, Chekwech G, Wekha G, Nassozi DR, Bongomin F. Coronavirus Disease-2019: Knowledge, Attitude, and Practices of Health Care Workers at Makerere University Teaching Hospitals, Uganda. Front Public Health. 2020;8:181. [PubMed ID: 32426320]. [PubMed Central ID: PMC7204940]. https://doi.org/10.3389/fpubh.2020.00181.

  • 16.

    Al-Ashwal FY, Kubas M, Zawiah M, Bitar AN, Mukred Saeed R, Sulaiman SAS, et al. Healthcare workers' knowledge, preparedness, counselling practices, and perceived barriers to confront COVID-19: A cross-sectional study from a war-torn country, Yemen. PLoS One. 2020;15(12). e0243962. [PubMed ID: 33306750]. [PubMed Central ID: PMC7732096]. https://doi.org/10.1371/journal.pone.0243962.

  • 17.

    Abdel Wahed WY, Hefzy EM, Ahmed MI, Hamed NS. Assessment of Knowledge, Attitudes, and Perception of Health Care Workers Regarding COVID-19, A Cross-Sectional Study from Egypt. J Community Health. 2020;45(6):1242-51. [PubMed ID: 32638199]. [PubMed Central ID: PMC7340762]. https://doi.org/10.1007/s10900-020-00882-0.

  • 18.

    Alnabelsi T, Al-Hussaini A, Owens D. Comparison of traditional face-to-face teaching with synchronous e-learning in otolaryngology emergencies teaching to medical undergraduates: a randomised controlled trial. Eur Arch Otorhinolaryngol. 2015;272(3):759-63. [PubMed ID: 25308244]. https://doi.org/10.1007/s00405-014-3326-6.

  • 19.

    Hortos K, Sefcik D, Wilson SG, McDaniel JT, Zemper E. Synchronous videoconferencing: impact on achievement of medical students. Teach Learn Med. 2013;25(3):211-5. [PubMed ID: 23848327]. https://doi.org/10.1080/10401334.2013.797344.

  • 20.

    Garland KV. E-learning vs. classroom instruction in infection control in a dental hygiene program. J Dent Educ. 2010;74(6):637-43. [PubMed ID: 20516303].

  • 21.

    de Jong N, Verstegen DM, Tan FE, O'Connor SJ. A comparison of classroom and online asynchronous problem-based learning for students undertaking statistics training as part of a Public Health Masters degree. Adv Health Sci Educ Theory Pract. 2013;18(2):245-64. [PubMed ID: 22477027]. [PubMed Central ID: PMC3622737]. https://doi.org/10.1007/s10459-012-9368-x.

  • 22.

    Olivet J, Zerger S, Greene RN, Kenney RR, Herman DB. Online Versus Face-To-Face Training of Critical Time Intervention: A Matching Cluster Randomized Trial. Am J Distance Educ. 2016;30(4):237-49. [PubMed ID: 28919668]. [PubMed Central ID: PMC5596928]. https://doi.org/10.1080/08923647.2016.1232107.

  • 23.

    Bernard RM, Abrami PC, Lou Y, Borokhovski E, Wade A, Wozney L, et al. How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature. Rev Educ Res. 2016;74(3):379-439. https://doi.org/10.3102/00346543074003379.

  • 24.

    Ismail ,I, Abdelkarim A, Al-Hashel JY. Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When less is more. PLoS One. 2021;16(4). e0250241. [PubMed ID: 33861799]. [PubMed Central ID: PMC8051773]. https://doi.org/10.1371/journal.pone.0250241.

  • 25.

    Frehywot S, Vovides Y, Talib Z, Mikhail N, Ross H, Wohltjen H, et al. E-learning in medical education in resource constrained low- and middle-income countries. Hum Resour Health. 2013;11(1). https://doi.org/10.1186/1478-4491-11-4.

  • 26.

    Gegenfurtner A, Zitt A, Ebner C. Evaluating webinar‐based training: a mixed methods study of trainee reactions toward digital web conferencing. Int J Train Develop. 2020;24(1):5-21. https://doi.org/10.1111/ijtd.12167.

  • 27.

    Yo EC, Witjaksono AN, Fitriani DY, Werdhani RA, Parikesit D. Assessing webinar outcomes for health professionals: a perspective from Indonesia during coronavirus disease 2019 pandemic. Korean J Med Educ. 2021;33(2):87-96. [PubMed ID: 34062640]. [PubMed Central ID: PMC8169372]. https://doi.org/10.3946/kjme.2021.190.

  • 28.

    Bhattarai D, Sharma A, Sengupta P. Utility and perceptions about web-based academics among physicians during COVID-19 pandemic. J Family Med Prim Care. 2021;10(2):699-705. [PubMed ID: 34041064]. [PubMed Central ID: PMC8138408]. https://doi.org/10.4103/jfmpc.jfmpc_2041_20.

  • 29.

    Chen N, Ko H, Lin T; Kinshuk. A model for synchronous learning using the Internet. Innovat Educ Teach Int. 2006;42(2):181-94. https://doi.org/10.1080/14703290500062599.

  • 30.

    Hannum W. Web-based training: advantages and limitations. Web-based traigning, New Jersey, Educational Technology Publications; 2001. 7 p.