Is It Time to Revise the Competency-Based Assessment? Objective Structured Clinical Examination and Technology Integration

authors:

avatar Haniye Mastour ORCID 1 , avatar Nazanin Shamaeian Razavi ORCID 2 , *

Department of Medical Education, School of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
Department of Midwifery, School of Nursing and Midwifery, Torbat Heydariyeh University of Medical Sciences, Torbat Heydariyeh, Iran
Shiraz E-Medical Journal: Vol.24, issue 9; e138785
published online: September 16, 2023
article type: Letter
received: July 3, 2023
accepted: August 15, 2023
DOI: https://doi.org/10.5812/semj-138785

how to cite: Mastour H, Shamaeian Razavi N. Is It Time to Revise the Competency-Based Assessment? Objective Structured Clinical Examination and Technology Integration. Shiraz E-Med J. 2023;24(9):e138785. https://doi.org/10.5812/semj-138785.

Dear Editor,

Objective structured clinical examination (OSCE) has long been a gold standard in clinical assessment for medical and healthcare professionals (1). However, the emergence of virtual OSCE has revolutionized the examination method, especially in the context of remote and online learning. Virtual OSCE, also known as V-OSCE or E-OSCE, is a relatively recent development in medical education and assessment (2, 3). The global coronavirus disease 2019 (COVID-19) pandemic significantly impacted medical education and clinical assessments. Social distancing measures and restrictions on in-person gatherings have necessitated exploring alternative assessment methods. Virtual OSCE has emerged as a viable solution to ensure the continuity of clinical assessment while prioritizing the safety of students, faculty, and standardized patients (3, 4).

Virtual OSCE offers greater accessibility and flexibility compared to traditional in-person assessments. It eliminates geographical barriers, allowing students from remote areas or those facing travel constraints to participate in assessments without needing physical presence. In addition, virtual OSCE enables students to complete assessments at their convenience, accommodating different schedules and reducing logistical challenges (4, 5). With the increasing familiarity and comfort levels of students and educators with technology, adopting virtual OSCE has become more feasible. Students are often tech-savvy and accustomed to using various digital platforms, which facilitates their engagement and participation in virtual assessments. Faculty members have also become more adept at designing and conducting virtual assessments, supported by training and resources provided by educational institutions (3-5).

Virtual OSCE offers unique opportunities for pedagogical enhancements. It allows for integrating virtual patient simulations, interactive feedback mechanisms, and standardized patient encounters in a controlled environment. These advancements can enrich the learning experience, promote critical thinking, and provide immediate feedback to learners, enhancing their clinical skills and decision-making abilities (4, 5).

Several platforms can conduct virtual OSCEs, each with features and capabilities. The choice of platform may depend on different factors, such as institution preferences, available technology, and specific requirements for virtual OSCE. Diverse platforms, namely Zoom, Microsoft Teams, WebEx, and Google Meet can be utilized for virtual OSCEs (2, 6, 7). These platforms provide video and audio communication, screen sharing, and breakout room functionalities for real-time assessments (7, 8). The video conferencing option allows the examiner, examinee, and standard patient to communicate via webcam and microphone. Moreover, the screens can be shared to help demonstrate visual materials, including radiographs or diagnostic images, to simulate a realistic clinical environment. Other features, such as breakout rooms, facilitate dividing participants into groups for the parallel rotation of students through different stations or individual assessments. On most platforms, text-based chat and polling functionality can be utilized for communication, interaction, and gathering feedback from participants during virtual OSCE (7-9).

Many educational institutions use learning management systems (LMS), such as Moodle, Blackboard, Canvas, or Brightspace. These platforms can be adapted to host virtual OSCE stations, allowing students to access cases, submit recordings, and receive feedback within the LMS environment. Some virtual OSCEs utilize dedicated simulated patient encounter platforms (7, 9-11). These platforms simulate patient interactions through pre-recorded videos or interactive interfaces. Examples of such platforms include CASUS, MedEdPORTAL, and MedU (7, 9-12). Virtual reality (VR) technologies are also being explored for virtual OSCEs. The VR platforms create immersive environments where students can interact with virtual patients and perform clinical tasks. Some platforms, such as Osso VR and Oxford Medical Simulation, offer VR-based medical simulations (13).

When selecting a platform for virtual OSCEs, it is essential to consider different factors, including ease of use, security features, technical requirements, scalability, and compatibility with assessment tools and institutional infrastructure. Moreover, it is recommended to ensure compliance with data protection regulations and maintain patient confidentiality throughout the virtual OSCE process (2, 5).

Virtual OSCEs come with their own set of challenges that need to be addressed for a successful implementation. Virtual OSCEs rely heavily on technology, and technical difficulties can disrupt the assessment process. Issues, such as internet connectivity problems, audio/video glitches, or platform-related challenges, can impact the smooth running of the assessment (14, 15). In addition, ensuring standardization across virtual OSCE stations and cases can be challenging and requires careful development of cases, training of standardized patients (if used), and establishing consistent criteria for assessment and scoring. Replicating the authenticity of face-to-face clinical encounters in a virtual environment can be difficult. Virtual interactions may lack the tactile and sensory elements present in in-person encounters, which can affect the realism of the assessment (16, 17). Assessing non-verbal communication cues and physical examination skills can be more challenging in a virtual setting. Limited camera angles and reduced ability to observe physical interactions may impact the assessment of specific skills (2, 5, 6, 15). Students and examiners may require training and support to become familiar with the virtual platforms and tools used for virtual OSCEs. Ensuring everyone involved is comfortable and competent in technology use is crucial for a successful assessment (2, 6, 16, 17). Implementing virtual OSCEs may require dedicated resources, including technology infrastructure, equipment, and technical support. Institutions need to ensure they have the necessary resources in place to support the virtual assessment process. Addressing these challenges requires careful planning, practical training, and continuous evaluation of the virtual OSCE process. Institutions and educators should continuously adapt and refine their virtual OSCE strategies based on feedback and the best-emerging practices in the field (12, 14).

To sum up, it is important to note that while virtual OSCE has gained traction recently, it does not entirely replace the value of in-person clinical competency-based assessments. It is often used as a complement or alternative when face-to-face assessments are not feasible (2, 5, 12). The decision to implement virtual OSCE is context-dependent. It requires careful consideration of educational objectives, resource availability, the feasibility of technology as an infrastructure, and the specific needs of the learners and institutions involved (2, 5, 7).

References

  • 1.

    Khan KZ, Ramachandran S, Gaunt K, Pushkar P. The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: an historical and theoretical perspective. Med Teach. 2013;35(9):e1437-46. [PubMed ID: 23968323]. https://doi.org/10.3109/0142159X.2013.818634.

  • 2.

    Hopwood J, Myers G, Sturrock A. Twelve tips for conducting a virtual OSCE. Med Teach. 2021;43(6):633-6. [PubMed ID: 33078984]. https://doi.org/10.1080/0142159X.2020.1830961.

  • 3.

    Mak V, Krishnan S, Chuang S. Students' and Examiners' Experiences of Their First Virtual Pharmacy Objective Structured Clinical Examination (OSCE) in Australia during the COVID-19 Pandemic. Healthcare (Basel). 2022;10(2). [PubMed ID: 35206942]. [PubMed Central ID: PMC8871798]. https://doi.org/10.3390/healthcare10020328.

  • 4.

    Deville RL, Fellers CM, Howard ML. Lessons learned pivoting to a virtual OSCE: Pharmacy faculty and student perspectives. Curr Pharm Teach Learn. 2021;13(11):1498-502. [PubMed ID: 34799065]. https://doi.org/10.1016/j.cptl.2021.06.046.

  • 5.

    Chan SCC, Choa G, Kelly J, Maru D, Rashid MA. Implementation of virtual OSCE in health professions education: A systematic review. Med Educ. 2023;57(9):833-43. [PubMed ID: 37080907]. https://doi.org/10.1111/medu.15089.

  • 6.

    Blythe J, Patel NSA, Spiring W, Easton G, Evans D, Meskevicius-Sadler E, et al. Undertaking a high stakes virtual OSCE ("VOSCE") during Covid-19. BMC Med Educ. 2021;21(1):221. [PubMed ID: 33879139]. [PubMed Central ID: PMC8057662]. https://doi.org/10.1186/s12909-021-02660-5.

  • 7.

    Updike WH, Cowart K, Woodyard JL, Serag-Bolos E, Taylor JR, Curtis SD. Protecting the Integrity of the Virtual Objective Structured Clinical Examination. Am J Pharm Educ. 2021;85(6):8438. [PubMed ID: 34315707]. [PubMed Central ID: PMC8341239]. https://doi.org/10.5688/ajpe8438.

  • 8.

    Hannan TA, Umar SY, Rob Z, Choudhury RR. Designing and running an online Objective Structured Clinical Examination (OSCE) on Zoom: A peer-led example. Med Teach. 2021;43(6):651-5. [PubMed ID: 33626286]. https://doi.org/10.1080/0142159X.2021.1887836.

  • 9.

    Lee S, Lee H, Hwang H. New approach to learning medical procedures using a smartphone and the Moodle platform to facilitate assessments and written feedback. Kosin Med J. 2022;37(1):75-82. https://doi.org/10.7180/kmj.22.010.

  • 10.

    Kerkstra RL, Rustagi KA, Grimshaw AA, Minges KE. Dental education practices during COVID-19: A scoping review. J Dent Educ. 2022;86(5):546-73. [PubMed ID: 34978714]. [PubMed Central ID: PMC9015347]. https://doi.org/10.1002/jdd.12849.

  • 11.

    Moroz S, Andrade R, Walsh L, Richard CL. Student Performance on an Objective Structured Clinical Exam Delivered Both Virtually and In-Person. Am J Pharm Educ. 2023;87(7):100088. [PubMed ID: 37380265]. https://doi.org/10.1016/j.ajpe.2023.100088.

  • 12.

    Nowell L, Dhingra S, Carless-Kane S, McGuinness C, Paolucci A, Jacobsen M, et al. A systematic review of online education initiatives to develop students remote caring skills and practices. Med Educ Online. 2022;27(1):2088049. [PubMed ID: 35694798]. [PubMed Central ID: PMC9196772]. https://doi.org/10.1080/10872981.2022.2088049.

  • 13.

    Antoniou PE, Pears M, Schiza EC, Frangoudes F, Pattichis CS, Wharrad H, et al. Eliciting Co-Creation Best Practices of Virtual Reality Reusable e-Resources. Virtual Worlds. 2023;2(1):75-89. https://doi.org/10.3390/virtualworlds2010005.

  • 14.

    Zulkifly HH, Zaki IAH, Karuppannan M, Mohd Noordin Z. Virtual OSCE: Experience and challenges with a large cohort of pharmacy students. Pharm Educ. 2022;22(1):23-32. https://doi.org/10.46542/pe.2022.221.2332.

  • 15.

    Loda T, Erschens RS, Nevins AB, Zipfel S, Herrmann-Werner A. Perspectives, benefits and challenges of a live OSCE during the COVID-19 pandemic in a cross-sectional study. BMJ Open. 2022;12(6). e058845. [PubMed ID: 36691253]. [PubMed Central ID: PMC9170794]. https://doi.org/10.1136/bmjopen-2021-058845.

  • 16.

    Elnaem MH, Akkawi ME, Nazar NIM, Ab Rahman NS, Mohamed MHN. Malaysian pharmacy students' perspectives on the virtual objective structured clinical examination during the coronavirus disease 2019 pandemic. J Educ Eval Health Prof. 2021;18:6. [PubMed ID: 33910270]. [PubMed Central ID: PMC8089464]. https://doi.org/10.3352/jeehp.2021.18.6.

  • 17.

    Liu CM, Huang PS, Chang YC. Perspectives on the challenge and change of COVID-19 crisis on dental education. J Dent Sci. 2021;16(3):1039-40. [PubMed ID: 33903814]. [PubMed Central ID: PMC8059982]. https://doi.org/10.1016/j.jds.2021.04.006.