A Medication Assessment Tool to Evaluate Prescribers’ Adherence to Practice Guidelines in Acute-Phase Schizophrenia Treatment: Development and Psychometric properties

authors:

avatar Atefeh Akbari 1 , avatar Hamid Sharif Nia 2 , avatar Mehran Zarghami ORCID 3 , avatar Paria Azari ORCID 4 , avatar Fatemeh Hendouei 5 , avatar Narjes Hendouei 6 , *

Department of Pharmacotherapy, Student Research Committee, School of Pharmacy, Mazandaran University of Medical Sciences, Sari, Iran
Department of Nursing, School of Nursing and Midwifery Amol, Mazandaran University of Medical Sciences, Sari, Iran
Psychiatry and Behavioral Sciences Research Center, Addiction Institute, and Department of Psychiatry, School of Medicine, Mazandaran University of Medical Sciences, Sari, Iran
Psychiatry and Behavioral Sciences Research Center, Addiction Institute, Mazandaran University of Medical Sciences, Sari, Iran
Psychiatric Research Center, Roozbeh Hospital, Tehran University of Medical Sciences, Tehran, Iran
Psychiatry and Behavioral Sciences Research Center, Addiction Institute, and Department of Pharmacotherapy, School of Pharmacy, Mazandaran University of Medical Sciences, Sari, Iran
Iranian Journal of Psychiatry and Behavioral Sciences: Vol.17, issue 1; e133703
published online: March 29, 2023
article type: Research Article
received: December 6, 2022
revised: February 6, 2023
accepted: February 9, 2023
DOI: https://doi.org/10.5812/ijpbs-133703

how to cite: Akbari A, Sharif Nia H, Zarghami M , Azari P, Hendouei F, et al. A Medication Assessment Tool to Evaluate Prescribers’ Adherence to Practice Guidelines in Acute-Phase Schizophrenia Treatment: Development and Psychometric properties. Iran J Psychiatry Behav Sci. 2023;17(1):e133703. https://doi.org/10.5812/ijpbs-133703.

Abstract

Background:

Studies showed that the adherence to practice guidelines is associated with a higher quality of care and better patient’s outcomes. In psychiatric practice, there is a quality gap between Practice guidelines (PGs) and routine clinical practice for the patients with schizophrenia which potentially hinders their recovery. One of the important reasons for this persistent gap is the lack of systematic methods to evaluate prescribers’ adherence to practice guidelines.

Objectives:

This study aimed to develop and validate a medication assessment tool (MAT) to evaluate prescribers’ adherence to pharmacotherapy recommendations in PGs during the acute phase of schizophrenia (APSCZ) in Iran (MATAPSCZ).

Methods:

This methodological cross-sectional study was conducted from August 2021 to April 2022. According to the literature review and discussions in the research group, an item pool of 91 items was developed. Then face and content validity of the scale were evaluated. Then, exploratory factor analysis (EFA) was used to specify the factor structure. At last, the reliability and responsiveness of the scale were assessed. The study sample consisted of 200 Iranian psychiatrists and final-year psychiatry residents.

Results:

Eleven items were merged in qualitative content validity. Then, sixteen and six items were excluded from the scale in terms of having low content validity ratios and corrected item-total correlation, respectively. In exploratory factor analysis, the remaining 48 items were classified into six factors, which included 50.1% of the total variance. Based on the results, Cronbach’s alpha, and McDonald’s omega of all factors were higher than 0.7, AIC was 0.2 to 0.4 for all factors, and the intraclass correlation coefficient for MATAPSCZ was 0.914. The standard error of measurement was ± 4.5, and the percentage of minimum detectable change for the tool was calculated to be 6.15%, which indicates its excellent responsiveness.

Conclusions:

The MATAPSCZ has acceptable psychometric properties and could be a useful tool to evaluate prescribers’ adherence to practice guidelines pharmacotherapy recommendations during the APSCZ.

1. Background

Schizophrenia is a complicated, persistent mental health illness, inflicting several self-care, occupational, and cognitive damages with the expected prevalence of 4.6 - 7.2 per 1000 general population (1). It is the fifth leading cause of disability in the world (2). According to the Global Burden of Disease Study 2017 (GBD 2017), 19.78 million patients were suffering schizophrenia, which represents a high global burden, i.e., 0.51% of the all-cause disability-adjusted life years (DALYs) were due to schizophrenia (3).

People who suffer from schizophrenia experience increased rates of morbidity from general medical conditions and a higher probability of premature death than the general population (3-5). Antipsychotic medications are the cornerstone of evidence-based treatment to reduce symptoms and improve the condition of schizophrenic patients (6, 7). Treatment of schizophrenia can be extremely difficult since patients vary significantly in terms of the intensity, type, and frequency of symptoms (8, 9). Therefore, it is necessary to optimize the care of people with schizophrenia to reduce the significant economic and human costs of these disorders (10, 11).

Recent studies show that the quality of care for mental disorders is suboptimal (4, 12), particularly in low-and-middle-income countries (LMICs) (13, 14). It is estimated that approximately 70% of people with schizophrenia do not have access to effective mental health care in these countries (14, 15). These studies reveal that there is a persistent quality gap between the evidence-based practice standards and the care provided in these countries (4, 13, 14). They point to the lack of standardized infrastructure, measures, and policies to consistently measure the quality of care as the most important reasons for this persistent gap in mental health care quality (4, 12).

The assessment of the clinical quality of care requires an intense document base which can act as a measurement principle to evaluate the treatment processes (13, 16, 17). Practice guidelines (PGs) are evidence-based recommendations for treating the patients with specific problems (18). Medication assessment tools (MATs) which are, according to standards, suggested by practice guidelines, have been applied in the evaluation of the medication therapy management of numerous illnesses (19) and considered as clinical audit tools to compare routine care of patients with PGs recommendations (10, 17, 18, 20, 21). Providing a valid and reliable quality measure derived from PGs recommendations, and adopting the measures to regional or national conditions for application in routine practices is a critical starting point in detecting the variations in practice across settings and geographic areas and improving the quality of mental health care (4, 10, 17). As far as we know, studies that have assessed psychiatrists’ adherence to PGs to manage the schizophrenia fall into two categories (22-27). First are studies that used medical record data to evaluate guideline adherence (24, 26). Documentation in medical records was assumed to accurately reflect clinical practice in these studies. However, this is an accepted assumption, differences in the results of these studies could reflect real variation in adherence, as well as differences in the adequacy of medical documentation by physicians, especially in developing countries, that medical records aren’t often kept completely and may not reflect reality (17, 21, 26). In the second group of studies, in addition to using medical records, interviews were also conducted with the patients to collect data (22, 23, 25, 27). The lack of using a valid and reliable tool for assessing the clinicians’ adherence rate and the lack of assessment of care’s multiple aspects are the weaknesses of these studies. Further, data from some studies of the first and second groups were collected when many atypical antipsychotic drugs had not yet been introduced (25-27), which limits the ability of their results to evaluate whether atypical agents were prescribed based on PGs.

According to the most recent population-based survey in Iran, the prevalence of mental diseases is 29.7%, (28) and roughly 3% of health care spending is allocated to mental health (29). In 2001, the prevalence of schizophrenia and emotional disorders in Iran was 17% (30). In Iran, as in many other developing countries, there is a lack of appropriately designed national guidelines to help healthcare providers in their care of patients in psychiatry; that causes healthcare workers to use different types of international guidelines in the treatment of their patients (17, 31).

To the best of our knowledge, no study has so far designed a reliable and valid tool to evaluate the clinicians’ prescribed practices for pharmacotherapy of schizophrenia in Iran. This tool can be used as a self-assessment tool by psychiatrists as well as for peer review or for organized efforts by health care professionals to improve the care of patients with schizophrenia.

2. Objectives

This study aims to develop and validate a MAT to evaluate prescribers’ adherence to pharmacotherapy recommendations in PGs during the acute phase of schizophrenia (APSCZ) in Iran (MATAPSCZ).

3. Methods

This cross-sectional study was conducted among Iranian psychiatrists and psychiatric trainees studying the final year of residency [final-year or postgraduate year 4 (PGY-4) psychiatry residents] in all the nationally recognized institutions from August 2021 to April 2022. In this study, the term participants refer to both psychiatrists and psychiatric trainees.

The research was divided into two phases: (1) item generation and (2) item reduction.

3.1. Phase 1: Item Generation

The item generation process was developed through an extensive review of literature and research group discussion to produce an initial item pool.

Due to the lack of a national PG for the treatment of schizophrenia in Iran, a variety of recognized psychiatric references are used to treat patients with schizophrenia. Therefore, some exploratory work was done prior to the initiation of the study to determine which PGs could be used in this study to measure psychiatrists’ adherence to pharmacotherapy recommendations in the management of patients during the acute phase of schizophrenia. According to the literature review, high-quality, and up-to-date English PGs for the treatment of schizophrenia were found (32-34). Nine of members of the expert panels were contacted individually for an unstructured meeting and all agreed that among these PGs, the American Psychiatric Association (APA) Practice Guideline third edition (35), and the psychosis and schizophrenia in adults, the National Institute for Health and Care Excellence (NICE) Guideline on Treatment and Management edition 2014 (36) are the most followed guidelines in Iran. If the data were insufficient or vague in the previous sources, Kaplan and Sadock’s Comprehensive Textbook of Psychiatry tenth edition (37), and Kaplan and Sadock’s Synopsis of Psychiatry Behavioral Sciences/Clinical Psychiatry eleventh edition (38) were used, which are reference books for psychiatrists while studying in Iran. In addition, Applied Therapeutics the Clinical Use of Drugs eleventh edition (39) textbook, and the Maudsley Prescribing Guidelines in Psychiatry thirteenth edition (40) were utilized. The expert panels also agreed with all the mentioned references. Following the literature review, an initial item pool was created. The research team checked and modified items based on their grammar, writing, overlap, and similarity at frequent meetings. Next, the MATAPSCZ was prepared for psychometric evaluation.

3.2. Phase 2: Item Reduction

At this phase, the psychometric features of the 91-item MATAPSCZ were evaluated regarding face, content and construct validity, and reliability.

3.2.1. Face Validity

Quantitative and qualitative face validity were employed for the MATAPSCZ. Ten participants (six psychiatrists and four PGY-4 psychiatry residents) assessed the face validity of the 91-item tool. To conduct qualitative face validity, items were surveyed with respect to their relevancy, difficulty, and ambiguity (41).

Quantitative face validity was assessed by asking the same ten participants to evaluate items on a five-point Likert scale for their suitability. Each item’s impact score was calculated, and it was considered acceptable if the score was above 1.5 (impact score = frequency (%) × suitability) (41).

3.2.2. Content Validity

Qualitative and quantitative evaluations of the content validity of the MATAPSCZ were conducted by an expert panel. Our expert panel consisted of six clinical psychiatrist professionals with over 15 years of work experience in the psychiatry department, three clinical pharmacist professionals, and one professional psychometrician. At least the professional title of our experts was associate professor and they all had experience in the development and psychometric assessment of a scale. In the qualitative approach, the expert panel evaluated wording and grammar of the items along with item scaling and allocating (42). Also, after each item, a space was considered for the experts to provide scientific suggestions to improve the items or make comments. The Content validity ratio (CVR) and modified kappa coefficient (K) were evaluated in quantitative content validity (41). The experts checked content validity ratio (CVR) to assess items’ essentiality in a three-point Likert scale (41). If experts consider an answer as "not essential," or "useful but not essential", they must justify their decisions. The result was interpreted using the Lawshe rule. As experts were ten persons, the lowest acceptable CVR score was equal to 0.62 according to Lawshe (43).

The item relevancy for the K assessment was evaluated by ten experts to eliminate the effect of chance for each item. To assess K to eliminate the effect of chance for each item. Modified kappa was calculated for every item. Kappa values greater than 0.75 were considered excellent (41).

The results and comments of each of the qualitative and quantitative approaches of content validity were analyzed and summarized by the research team in order to guide the revision of the tool. Doubts about comments or suggestions were cleared with experts face-to-face, by email, or by phone.

3.2.3. Item Analysis

An item analysis was performed before determining the construct validity, in order to detect the probable problems with items based on the corrected item-total correlation. Using convenience sampling, 30 psychiatrists were chosen and fulfilled the MATAPSCZ online form. The correlation coefficient between items less than 0.32 or higher than 0.9 was considered to exclude items (41).

3.2.4. Construct Validity

The inclusion criteria were: Iranian psychiatrists or PGY-4 psychiatry residents in all the nationally recognized institutions who were involved in direct patient care with acute schizophrenia and able to use email or social networks like WhatsApp or Telegram. The exclusion criteria were Iranian psychiatrists or PGY-4 psychiatry residents who didn’t completely answer all questions of the questionnaire.

The sample size was measured using the rule of thumb that regards 200 participants were considered sufficient for answering the MATAPSCZ (44). The participants were obtained using convenience sampling through medical schools or the Iranian Psychiatric Association (IPA) across the different provinces. Psychiatrists and psychiatric trainees whose addresses and contact information were available in the medical schools or provincial branches or who were introduced through colleagues were included.

The data were collected through an online questionnaire. Electronic polling (Epoll) survey software was used in creating the online questionnaire, and the participants received its URL link via email or social networks, including Telegram or WhatsApp. Only the questionnaires that were filled until the end stage were considered completed. It was possible for the corresponding author to check the number of completed questionnaires by entering a username and password.

The questionnaire used for construct validity had two parts. Participants’ demographic characteristics were the subject of the first part. Sociodemographic questions were included in the MATAPSCZ for collecting information about age and gender, academic position and year of experience in managing patients with schizophrenia. In the second part, participants were asked to respond to every item of MATAPSCZ on a five-point Likert-type scale (“always,” “often,” “sometimes,” “rarely,” and “never”) according to their clinical practice in the management of patients with APSCZ. A maximum-likelihood exploratory factor analysis (MLEFA) method and a varimax rotation were used to evaluate the construct validity of the MATAPSCZ. In order to evaluate the sample adequacy, Kaiser-Meyer-Olkin (KMO) and Bartlett’s tests were conducted. Kaiser-Meyer-Olkin with values greater than 0.7 were considered good (45). Horn’s parallel analysis was used to identify the number of latent factors (41). A factor loading of 0.3 was used for determining whether items exist in latent factors, as calculated by the following formula:

CV=5.152(n-2)

where “CV” is the number of extractable factors and “n” is the sample size (41). Finally, the items containing communalities < 0.2 were eliminated from EFA (41).

3.2.5. Reliability

Reliability was evaluated using internal consistency and stability. Internal consistency was assessed by Cronbach’s alpha (α), McDonald’s omega (Ω), and the average inter-item correlation (AIC). Coefficient’s α and Ω values greater than 0.7 and AIC between 0.2 - 0.4 were regarded as acceptable internal consistency (41). Evaluation of the intraclass correlation coefficients (ICC) of the MATAPSCZ with a two-way random effects model was used to measure the stability. To this aim, the test-retest method was used on 26 participants (20 psychiatrists and 6 PGY-4 psychiatry residents) with a time interval of 2 weeks. An ICC value more than 0.8 is an acceptable value of stability (41). Furthermore, the standard error of measurement (SEM) was computed for the scale (SEM = SD Pooled × √1 – ICC), which evaluates the errors of the tool score (46).

3.2.6. Responsiveness

The responsiveness or sensitivity of a tool shows its ability to detect changes over time (42). The following formula was used to calculate the minimum detectable change (MDC) to assess responsiveness in this study (41, 42):

MDC=SEM×2×1.96
MDC%=MDCmean×100

MDC 30% is acceptable, and less than 10% is considered as excellent (42).

3.2.7. Multivariate Normality and Outliers

Skewness, kurtosis, and Outliers were used to evaluate univariate distributions. Multivariate normality was also assessed (46). Mahalanobis distance evaluation was used to assess the Multivariate outliers. Items with a Mahalanobis distance of P < 0.001 were considered to be multivariate outliers (41). Demographic characteristics were described using descriptive statistics (means and standard deviations for quantitative data, frequencies, and percentages for qualitative data). We used SPSS26 and JASP 0.15.0.0 for statistical analysis.

3.3. Ethical Considerations

This study was approved by the Research Ethics Committee of Mazandaran University of Medical Sciences (IR.MAZUMS.REC.1400.373) (Approval Date: 2021-07-28). In all stages, participants were informed of the purpose of the study. Moreover, participants gave oral informed consent before filling out the face and content validity. Participation or non-participation of the residents of psychiatry in the study did not affect the approval score of their residency period. The participants could leave the study whenever they wanted, and they were assured of anonymity and data confidentiality.

In addition, in the online survey scale, all information included in the consent form was provided in the initial part of the questionnaire. The research’s purpose, the number of items, the affiliation of researcher, email for questions, and study’s ethical code were included as well. Further, participants were informed about their voluntary participation and anonymity of their responses in the form of group data. The online survey items could only be viewed by participants who accepted to take part and clicked the “next button”.

4. Results

4.1. Phase 1: Item Generation

Following the review of literature and research group discussion, in order to compare care provided to schizophrenic patients with guideline-recommended care, we defined three main aspects of pharmacotherapy: “Physical and laboratory assessments for patients before drug treatment initiation,” “General principles of drug treatment,” and “Physical and laboratory assessments for patients during drug treatment.” There were 100 items in the initial item pool. Of these, 91 items were included as items of the MATAPSCZ.

4.2. Phase 2: Item Reduction

4.2.1. Face Validity, Content Validity, and Item Analysis

In the qualitative face validity step, according to the participant’s feedback, ten items were ambiguous to the participants, which were rewritten and modified. In the quantitative face validity, all items obtained an impact score higher than 1.5, which was acceptable. During the assessment of content validity, according to the expert panel suggestion in the qualitative approach, eleven items were merged, and nine items were rewritten; so, the items were reduced to 80 items. In the quantitative content validity step, we removed 16 items with CVR less than 0.62. The total number of MATAPSCZ was reduced from 80 to 64 items. Then the experts had suggestions for editing the order of the items, which were applied after a decision by the research team. According to the results of the kappa value, the kappa for all items was is > 0.75 which was an excellent value. During the item analysis step, six items had a correlation coefficient of less than 0.32 and were removed, and factor analysis was conducted on the MATAPSCZ with 58 items (Figure 1).

Flow chart of two phases of the study (CVR, content validity ratio; CVI, content validity index; EFA, exploratory factor analysis).
Flow chart of two phases of the study (CVR, content validity ratio; CVI, content validity index; EFA, exploratory factor analysis).
Figure 1.

Flow chart of two phases of the study (CVR, content validity ratio; CVI, content validity index; EFA, exploratory factor analysis).

4.2.2. Construct Validity

Out of the 320 distributed MATAPSCZ survey, 200 were collected back and checked for completion and validity. Of these, 17% were PGY-4 psychiatry residents (see Appendix 1 in supplementary file, which shows the demographic characteristics of the participants who responded to the MATAPSCZ).

The sample was adequate for the construct validity step according to the results of KMO (0.825) and Bartlett’s value 6873.456 (P < 0.001). In this step, 10 items were eliminated since their communality values, and factor loadings were below 0.2 and 0.3, respectively, and after varimax rotation, six factors were extracted (48 items) such as “physical and laboratory assessments for a patient before starting an antipsychotic drug” (15 items), “general pharmacotherapy approaches and evaluation of the treatment response” (12 items), “general principles for selection of an antipsychotic drug” (6 items), “physical and laboratory assessments for a patient taking an antipsychotic drug” (8 items) “indications for the administration of an injectable antipsychotic drug” (4 items) and “Indications for the prescription of an antipsychotic drug in a lower dose” (3items) were extracted. These six factors explained 50.1% of the total variance of prescribers’ adherence to evidence-based PGs in the management of patients with APSCZ (see Appendix 2 in supplementary file, which shows the details of factor analysis results of the six factors of the MATAPSCZ).

4.2.3. Reliability and Responsiveness

Internal consistency showed that Cronbach’s alpha, and McDonald’s omega of all factors were higher than 0.7 and AIC was 0.2 to 0.4 for all factors. Therefore, the internal consistency of the scale was acceptable (see Appendix 3 in Supplementary file, which shows. The indices of internal consistency of the MATAPSCZ). The overall ICC for MATAPSCZ was 0.914 (CI 95: 0.792 to 0.965), that showed strong stability of the scale over time. For the scale, the SEM was ± 4.5, indicating that the participants’ scores tend to have a 4.5 value distribution around their "true" score. The MDC% for the tool was calculated to be 6.15%, which indicates its excellent responsiveness.

5. Discussion

To the best of our knowledge, this is the first effort to develop and evaluate the psychometric properties of MAT using pharmacotherapy recommendations extracted from international PGs to assess the prescribing practices in managing patients during the acute phase of schizophrenia. Our findings showed that the final MATAPSCZ had an acceptable level of validity and reliability, included 48 items and six factors, namely “physical and laboratory assessments for a patient before starting an antipsychotic drug,” “general pharmacotherapy approaches and evaluation of the treatment response,” “general principles for selection of an antipsychotic drug,” “physical and laboratory assessments for a patient taking an antipsychotic drug,” “indications for the administration of an injectable antipsychotic drug” and “indications for the prescription of an antipsychotic drug in a lower dose” which explained 50.1% of the total extracted variance.

Factor extraction aims to maximize the explained variance (46). The highest values for the explained variance were related to “physical and laboratory assessments for a patient before starting an antipsychotic drug” (15.4%) and “general pharmacotherapy approaches and evaluation of the treatment response” factors (10.2%).

Based on the findings of Cronbach’s alpha, AIC, and McDonald’s omega, the MATAPSCZ revealed excellent internal consistency. Besides, this scale has strong stability with the acceptable value of ICC. The scale’s SEM was estimated. It is extremely important for SEM to be smaller. In fact, SEM measures the score’s accuracy of any participant. Moreover, the evaluation of the responsiveness of the tool showed a desirable result. These assessments are an essential area of consensus-based standards for the selection of health measurement instruments (COSMIN) (42) which were not reported in previous studies evaluating the adherence of psychiatrists to PGs for the management of schizophrenia.

The first and fourth extracted factors were labelled “physical and laboratory assessments for a patient before starting an antipsychotic drug” and “physical and laboratory assessments for a patient taking an antipsychotic drug,” which comprised 15 items and 8 items, respectively.

Side effects are of clinical importance because they are associated with reduced quality of life and treatment adherence which may lead to the recurrence of the underlying psychiatric disorder (47). Therefore, medical and laboratory evaluations are important in ensuring the safe initiation and monitoring of suitable treatments (38). PGs have no definite standard for the frequency of monitoring, thus, judgments regarding monitoring individuals for side effects, physical conditions, or abnormities in laboratory tests are essentially related to the clinical circumstances (35, 48).

The second and sixth extracted factors were “general pharmacotherapy approaches and evaluation of the treatment response” and “indications for the prescription of an antipsychotic drug in a lower dose” with 12 items and 3 items, respectively.

The main goal of the management of APSCZ with antipsychotic medication is to decrease acute symptoms to bring the individuals back to their baseline function levels (35). Evidence-based standards for schizophrenia have suggested antipsychotic dosage ranges, including the initial, typical, and maximum daily doses (35, 37, 39), which should be individualized depending on the illness stage (e.g., first episode vs. later stages) (33, 35), age (33, 35), mental condition (35, 49), concomitant physical health issues, receiving multiple medications (35), somatic condition with special attention to side effects (35, 50), need for urgent treatment (51), and the medication formulation (35). Determining the ideal dose of antipsychotic during acute treatment is both difficult and important because there is generally a delay between the start of treatment and complete therapeutic response (35, 37). The existing evidence proposes that patients who have not shown minimal improvement (at least a 20% reduction) in symptoms by around two weeks on a therapeutic dose are less likely to exhibit much improvement (at least a 50% reduction) in symptoms at 4 - 6 weeks (35, 52). As a result, checking the patient’s clinical status for 2 - 4 weeks is reasonable on a therapeutic dose unless the patient exhibits unpleasant side effects (35, 37).

According to PGs, clozapine is recommended for patients suffering from treatment-resistant schizophrenia (TRS), but there is a substantial difference in definitions provided for TRS in practice and clinical trials (35, 53). A prevalent definition regarding clinical purposes is that a patient’s symptoms have exhibited no response or inadequate response to two antipsychotics trials from different classes over at least six weeks with a therapeutic and tolerable dose of each antipsychotic (35, 53). At least 30% of patients with TRS respond to clozapine (54). American Psychiatric Association (35) and Comprehensive Textbook of Psychiatry, tenth edition (37) also recommend clozapine for patients with schizophrenia who are prone to suicide attempts or patients whose risk of suicide remains substantial despite other treatments.

Monitoring of clozapine plasma levels is not recommended routinely, but it is mentioned in some of the PGs as a suggested method for the optimization of clozapine treatment (55). In Iran, the plasma level of clozapine is not measured routinely, and if no response is evident after receiving an adequate duration and target dose (typically 300 - 450 mg/day) and clozapine is well-tolerated, psychiatrists increase the dose and wait for a response.

The third factor was “general principles for selection of an antipsychotic drug,” with six items.

Most PGs for schizophrenia now consider either first-or second-generation antipsychotics (other than clozapine) as potential first-line choices for the treatment depending on factors such as patient’s treatment history (if any), medical comorbidities and concurrent medications, potential cost concerns, history of the adverse effects of particular agents, the existing treatment formulations, capacity for drug-drug interactions, pharmacokinetic considerations, and patients’ or caregivers’ preferences (35, 39). If information about a patient is unavailable, particularly in newly diagnosed patients with no prior treatment, medication history for a first-degree relative with schizophrenia may be beneficial in selecting an agent for the patient in a similar manner (39).

The fifth factor was labelled “indications for the administration of an injectable antipsychotic drug” consisting of four items.

The application of antipsychotic long-acting injections (LAIs) (depots) is suggested when a patient prefers this type of treatment or when there is poor or uncertain adherence to oral treatments (35). The findings of a meta-analysis revealed that LAIs diminished relapse rates compared with oral antipsychotics (56). Also, a Finnish naturalistic investigation demonstrated that using LAIs resulted in a threefold decrease in the rates of rehospitalization compared with the oral application of a similar antipsychotic (57).

5.1. Limitations

The present study has some limitations. First, this study was conducted in the Iranian psychiatrist setting. Therefore, the results may not be generalizable to other countries. Second, in terms of there is a lack of national PG for treatment of schizophrenia in Iran, MATAPSCZ was developed using the European and American guidelines, NICE (38) and APA (35) that are in accordance with the guidelines used by the psychiatrists in the management of patients with schizophrenia in Iran. Using an online questionnaire for data collection was another limitation. Although, online Survey has some benefits, but the lack of face-to-face communication, the inability to verify the participant’s status, and the accuracy of the answers are online survey limitations. The fourth limitation is that confirmatory factor analysis was not performed due to the need for a larger number of participants to fill out the survey. It is recommended to perform it to confirm the construct validity of the tool in future studies.

5.2. Future Research

This study is the first step in forming a structure for further studies to evaluate individual patients, provide feedback to clinicians, identify barriers, and monitor continuous quality improvement in the pharmacotherapy of patients in the acute phase of schizophrenia. Moreover, the MATAPSCZ can be used as a valid tool to survey the association between treatment recommendation conformance to patient outcome, and cost impact in future studies.

5.3. Conclusions

The study showed that the MATAPSCZ consisting of 48 items with six factors had acceptable validity and reliability to evaluate prescribers’ adherence to PGs in the management of patients with APSCZ. The MATAPSCZ will provide evidence-based quality indicators to enhance the care of patients during the acute phase of schizophrenia. To characterize the most updated evidence and recommendations, this tool must be regularly checked when updating the guidelines.

Acknowledgements

References

  • 1.

    Samaei A, Moradi K, Bagheri S, Ashraf-Ganjouei A, Alikhani R, Mousavi SB, et al. Resveratrol adjunct therapy for negative symptoms in patients with stable schizophrenia: A double-blind, randomized placebo-controlled trial. Int J Neuropsychopharmacol. 2020;23(12):775-82. [PubMed ID: 33372679]. [PubMed Central ID: PMC7770519]. https://doi.org/10.1093/ijnp/pyaa006.

  • 2.

    Kim CB, Ock M, Jung YS, Kim KB, Kim YE, Kim KA, et al. Estimation of years lived with disability using a prevalence-based approach: Application to major psychiatric disease in Korea. Int J Environ Res Public Health. 2021;18(17). [PubMed ID: 34501645]. [PubMed Central ID: PMC8431236]. https://doi.org/10.3390/ijerph18179056.

  • 3.

    He H, Liu Q, Li N, Guo L, Gao F, Bai L, et al. Trends in the incidence and DALYs of schizophrenia at the global, regional and national levels: Results from the global burden of disease study 2017. Epidemiol Psychiatr Sci. 2020;19(e91):11. [PubMed ID: 31928566]. [PubMed Central ID: PMC7214712]. https://doi.org/10.1017/S2045796019000891.

  • 4.

    Kilbourne AM, Beck K, Spaeth-Rublee B, Ramanuj P, O'Brien RW, Tomoyasu N, et al. Measuring and improving the quality of mental health care: A global perspective. World Psychiatry. 2018;17(1):30-8. [PubMed ID: 29352529]. [PubMed Central ID: PMC5775149]. https://doi.org/10.1002/wps.20482.

  • 5.

    Denis F, Pelletier J, Chauvet-Gelinier J, Rude N, Trojak B. Oral Health Is a Challenging Problem for Patients with Schizophrenia: A Narrative Review. Iran J Psychiatry Behav Sci. 2018;12(1). e8062. https://doi.org/10.5812/ijpbs.8062.

  • 6.

    Stroup TS, Gray N. Management of common adverse effects of antipsychotic medications. World Psychiatry. 2018;17(3):341-56. [PubMed ID: 30192094]. [PubMed Central ID: PMC6127750]. https://doi.org/10.1002/wps.20567.

  • 7.

    Stroup TS, Gerhard T, Crystal S, Huang C, Tan Z, Wall MM, et al. Comparative effectiveness of adjunctive psychotropic medications in patients with schizophrenia. JAMA Psychiatry. 2019;76(5):508-15. [PubMed ID: 30785609]. [PubMed Central ID: PMC6495353]. https://doi.org/10.1001/jamapsychiatry.2018.4489.

  • 8.

    Xiao J, Huang J, Long Y, Wang X, Wang Y, Yang Y, et al. Optimizing and individualizing the pharmacological treatment of first-episode schizophrenic patients: Study protocol for a multicenter clinical trial. Front Psychiatry. 2021;12:10-1. [PubMed ID: 33716817]. [PubMed Central ID: PMC7947302]. https://doi.org/10.3389/fpsyt.2021.611070.

  • 9.

    Lally J, MacCabe JH. Antipsychotic medication in schizophrenia: A review. Br Med Bull. 2015;114(1):169-79. [PubMed ID: 25957394]. https://doi.org/10.1093/bmb/ldv017.

  • 10.

    Wobrock T, Weinmann S, Falkai P, Gaebel W. Quality assurance in psychiatry: quality indicators and guideline implementation. Eur Arch Psychiatry Clin Neurosci. 2009;259 Suppl 2(Suppl 2):S219-26. [PubMed ID: 19876682]. [PubMed Central ID: PMC3085766]. https://doi.org/10.1007/s00406-009-0072-7.

  • 11.

    Ahmadkhaniha HR, Bani-Hashem S, Ahmadzad-Asl M. Depot Typical antipsychotics versus oral atypical antipsychotics in relapse rate among patients with schizophrenia: A Five -Year historical cohort study. Iran J Psychiatry Behav Sci. 2014;8(1):66-71. [PubMed ID: 24995032]. [PubMed Central ID: PMC4078695].

  • 12.

    Luther L, Fukui S, Garabrant JM, Rollins AL, Morse G, Henry N, et al. Measuring quality of care in community mental health: Validation of concordant clinician and client quality-of-care scales. J Behav Health Serv Res. 2019;46(1):64-79. [PubMed ID: 29651600]. [PubMed Central ID: PMC6185830]. https://doi.org/10.1007/s11414-018-9601-3.

  • 13.

    Docherty M, Shaw K, Goulding L, Parke H, Eassom E, Ali F, et al. Evidence-based guideline implementation in low and middle income countries: lessons for mental health care. Int J Ment Health Syst. 2017;11(8):16-1. [PubMed ID: 28070218]. [PubMed Central ID: PMC5217244]. https://doi.org/10.1186/s13033-016-0115-1.

  • 14.

    Le PD, Eschliman EL, Grivel MM, Tang J, Cho YG, Yang X, et al. Barriers and facilitators to implementation of evidence-based task-sharing mental health interventions in low- and middle-income countries: A systematic review using implementation science frameworks. Implement Sci. 2022;17(1):25-1. [PubMed ID: 35022081]. [PubMed Central ID: PMC8756725]. https://doi.org/10.1186/s13012-021-01179-z.

  • 15.

    Charlson FJ, Ferrari AJ, Santomauro DF, Diminic S, Stockings E, Scott JG, et al. Global Epidemiology and Burden of Schizophrenia: Findings From the Global Burden of Disease Study 2016. Schizophr Bull. 2018;44(6):1195-203. [PubMed ID: 29762765]. [PubMed Central ID: PMC6192504]. https://doi.org/10.1093/schbul/sby058.

  • 16.

    Funk M, Lund C, Freeman M, Drew N. Improving the quality of mental health care. Int J Qual Health Care. 2009;21(6):415-20. [PubMed ID: 19841029]. https://doi.org/10.1093/intqhc/mzp048.

  • 17.

    Hanefeld J, Powell-Jackson T, Balabanova D. Understanding and measuring quality of care: Dealing with complexity. Bull World Health Organ. 2017;95(5):368-74. [PubMed ID: 28479638]. [PubMed Central ID: PMC5418826]. https://doi.org/10.2471/BLT.16.179309.

  • 18.

    Al-Taweel D, Awad A. Development and validation of medication assessment tools to evaluate prescribing adherence to evidence-based guidelines for secondary prevention of coronary heart disease in post-acute coronary syndromes patients in Kuwait. PLoS One. 2020;15(11). e0241633. [PubMed ID: 33253267]. [PubMed Central ID: PMC7704004]. https://doi.org/10.1371/journal.pone.0241633.

  • 19.

    Al-Taweel DM, Alsuwaidan M. A medication assessment tool to evaluate prescribers' adherence to evidence-based guidelines in bipolar disorder. Int J Clin Pharm. 2017;39(4):897-905. [PubMed ID: 28653259]. https://doi.org/10.1007/s11096-017-0498-3.

  • 20.

    Joosen MCW, van Beurden KM, Rebergen DS, Loo M, Terluin B, van Weeghel J, et al. Effectiveness of a tailored implementation strategy to improve adherence to a guideline on mental health problems in occupational health care. BMC Health Serv Res. 2019;19(1):281. [PubMed ID: 31053125]. [PubMed Central ID: PMC6499945]. https://doi.org/10.1186/s12913-019-4058-5.

  • 21.

    Milchak JL, Carter BL, James PA, Ardery G. Measuring adherence to practice guidelines for the management of hypertension: An evaluation of the literature. Hypertension. 2004;44(5):602-8. [PubMed ID: 15381676]. [PubMed Central ID: PMC1414061]. https://doi.org/10.1161/01.HYP.0000144100.29945.5e.

  • 22.

    Keller WR, Fischer BA, McMahon R, Meyer W, Blake M, Buchanan RW. Community adherence to schizophrenia treatment and safety monitoring guidelines. J Nerv Ment Dis. 2014;202(1):6-12. [PubMed ID: 24375205]. [PubMed Central ID: PMC4228984]. https://doi.org/10.1097/NMD.0000000000000093.

  • 23.

    Owen RR, Thrush CR, Kirchner JE, Fischer EP, Booth BM. Performance measurement for schizophrenia: Adherence to guidelines for antipsychotic dose. Int J Qual Health Care. 2000;12(6):475-82. [PubMed ID: 11202601]. https://doi.org/10.1093/intqhc/12.6.475.

  • 24.

    Howes OD, Vergunst F, Gee S, McGuire P, Kapur S, Taylor D. Adherence to treatment guidelines in clinical practice: Study of antipsychotic treatment prior to clozapine initiation. Br J Psychiatry. 2012;201(6):481-5. [PubMed ID: 22955007]. https://doi.org/10.1192/bjp.bp.111.105833.

  • 25.

    Buchanan RW, Kreyenbuhl J, Zito JM, Lehman A. The schizophrenia PORT pharmacological treatment recommendations: Conformance and implications for symptoms and functional outcome. Schizophr Bull. 2002;28(1):63-73. [PubMed ID: 12047023]. https://doi.org/10.1093/oxfordjournals.schbul.a006927.

  • 26.

    Goldman M, Healy DJ, Florence T, Simpson L, Milner KK. Assessing conformance to medication treatment guidelines for schizophrenia in a community mental health center (CMHC). Community Ment Health J. 2003;39(6):549-55. [PubMed ID: 14713061]. https://doi.org/10.1023/b:comh.0000003015.68850.f2.

  • 27.

    Lehman AF, Steinwachs DM. Patterns of usual care for schizophrenia: Initial results from the Schizophrenia Patient Outcomes Research Team (PORT) Client Survey. Schizophr Bull. 1998;24(1):11-32. [PubMed ID: 9502543]. https://doi.org/10.1093/oxfordjournals.schbul.a033303.

  • 28.

    Noorbala AA, Maleki A, Bagheri Yazdi SA, Faghihzadeh E, Hoseinzadeh Z, Hajibabaei M, et al. Survey on mental health status in iranian population aged 15 and above one year after the outbreak of COVID-19 Disease: A population-based study. Arch Iran Med. 2022;25(4):201-8. [PubMed ID: 35942991]. https://doi.org/10.34172/aim.2022.35.

  • 29.

    Hosseini Jebeli SS, Rezapour A, Hajebi A, Moradi-Lakeh M, Damari B. Scaling-up a new socio-mental health service model in Iran to reduce burden of neuropsychiatric disorders: An economic evaluation study. Int J Ment Health Syst. 2021;15(1):47. [PubMed ID: 34016121]. [PubMed Central ID: PMC8139035]. https://doi.org/10.1186/s13033-021-00468-w.

  • 30.

    Taheri Mirghaed M, Abolghasem Gorji H, Panahi S. Prevalence of Psychiatric Disorders in Iran: A Systematic Review and Meta-analysis. Int J Prev Med. 2020;11(21):7-1. [PubMed ID: 32175061]. [PubMed Central ID: PMC7050223]. https://doi.org/10.4103/ijpvm.IJPVM_510_18.

  • 31.

    Olayemi E, Asare EV, Benneh-Akwasi Kuma AA. Guidelines in lower-middle income countries. Br J Haematol. 2017;177(6):846-54. [PubMed ID: 28295193]. https://doi.org/10.1111/bjh.14583.

  • 32.

    Gaebel W, Riesbeck M, Wobrock T. Schizophrenia guidelines across the world: A selective review and comparison. Int Rev Psychiatry. 2011;23(4):379-87. [PubMed ID: 22026495]. https://doi.org/10.3109/09540261.2011.606801.

  • 33.

    Remington G, Addington D, Honer W, Ismail Z, Raedler T, Teehan M. Guidelines for the Pharmacotherapy of Schizophrenia in Adults. Can J Psychiatry. 2017;62(9):604-16. [PubMed ID: 28703015]. [PubMed Central ID: PMC5593252]. https://doi.org/10.1177/0706743717720448.

  • 34.

    Keating D, McWilliams S, Schneider I, Hynes C, Cousins G, Strawbridge J, et al. Pharmacological guidelines for schizophrenia: A systematic review and comparison of recommendations for the first episode. BMJ Open. 2017;7(1):10-1. [PubMed ID: 28062471]. [PubMed Central ID: PMC5223704]. https://doi.org/10.1136/bmjopen-2016-013881.

  • 35.

    Keepers GA, Fochtmann LJ, Anzia JM, Benjamin S, Lyness JM, Mojtabai R, et al. Practice guideline for the treatment of patients with schizophrenia. 3rd ed. Washington, USA: American Psychiatric Association; 2020.

  • 36.

    National Collaborating Centre for Mental Health (UK). Psychosis and Schizophrenia in Adults: Treatment and Management. London, UK: National Inst Health Care Excellence (UK); 2014.

  • 37.

    Sadock BJ, Sadock VA, Ruiz P. Kaplan & sadock's comprehensive textbook of psychiatry. 10th ed. Philadelphia, USA: Wolters Kluwer; 2017.

  • 38.

    Sadock BJ, Sadock VA, Ruiz P. Kaplan And Sadock's synopsis of psychiatry behavioral sciences/clinical psychiatry. 11th ed. Philadelphia, USA: Wolters kluwer; 2014.

  • 39.

    Zeind CS, Carvalho MG. Applied therapeutics, the clinical use of drugs. 11th ed. Philadelphia, USA: Wolters Kluwer; 2018.

  • 40.

    Taylor DM, Barnes TR, Young AH. The Maudsley prescribing guidelines in psychiatry. 13th ed. London, UK: John Wiley & Sons; 2018.

  • 41.

    Hosseini L, Sharif Nia H, Ashghali Farahani M. Development and psychometric evaluation of family caregivers' hardiness scale: A sequential-exploratory mixed-method study. Front Psychol. 2022;13:807049. [PubMed ID: 35432109]. [PubMed Central ID: PMC9010881]. https://doi.org/10.3389/fpsyg.2022.807049.

  • 42.

    Ebadi A, Taghizadeh Z, Farmahini Farahani M. Development and psychometric evaluation of Sexual and Reproductive Health Assessment Scale for women with educable intellectual disability (SRH-WIDS): A sequential exploratory mixed-method study. BMC Womens Health. 2022;22(1):173. [PubMed ID: 35568943]. [PubMed Central ID: PMC9107694]. https://doi.org/10.1186/s12905-022-01755-5.

  • 43.

    Lawshe CH. A Quantitative Approach to Content Validity. Pers Psychol. 1975;28(4):563-75. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x.

  • 44.

    MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychol Methods. 1999;4(1):84-99. https://doi.org/10.1037/1082-989x.4.1.84.

  • 45.

    Ebadi A, Sharifnia S, Zareiyan A, Zarshenas L. Principles of scale development in health science. Tehran, Iran: Jame-e-negar; 2017. Persian.

  • 46.

    Rahmatpour P, Peyrovi H, Sharif Nia H. Development and psychometric evaluation of postgraduate nursing student academic satisfaction scale. Nurs Open. 2021;8(3):1145-56. [PubMed ID: 34482656]. [PubMed Central ID: PMC8046041]. https://doi.org/10.1002/nop2.727.

  • 47.

    Haddad PM, Fleischhacker WW, Peuskens J, Cavallaro R, Lean ME, Morozova M, et al. SMARTS (Systematic Monitoring of Adverse events Related to TreatmentS): The development of a pragmatic patient-completed checklist to assess antipsychotic drug side effects. Ther Adv Psychopharmacol. 2014;4(1):15-21. [PubMed ID: 24490026]. [PubMed Central ID: PMC3896136]. https://doi.org/10.1177/2045125313510195.

  • 48.

    Minjon L, van den Ban E, de Jong E, Egberts TCG, Heerdink ER. Monitoring of Metabolic, Cardiac, and Endocrine Indicators in Youth Treated With Antipsychotics as Reported by Health Care Professionals. J Clin Psychopharmacol. 2018;38(5):489-93. [PubMed ID: 30113929]. https://doi.org/10.1097/JCP.0000000000000936.

  • 49.

    Hasan A, Falkai P, Wobrock T, Lieberman J, Glenthoj B, Gattaz WF, et al. World Federation of Societies of Biological Psychiatry (WFSBP) guidelines for biological treatment of schizophrenia - a short version for primary care. Int J Psychiatry Clin Pract. 2017;21(2):82-90. [PubMed ID: 28498090]. https://doi.org/10.1080/13651501.2017.1291839.

  • 50.

    Hasan A, Falkai P, Wobrock T, Lieberman J, Glenthoj B, Gattaz WF, et al. World Federation of Societies of Biological Psychiatry (WFSBP) Guidelines for Biological Treatment of Schizophrenia, part 1: Update 2012 on the acute treatment of schizophrenia and the management of treatment resistance. World J Biol Psychiatry. 2012;13(5):318-78. [PubMed ID: 22834451]. https://doi.org/10.3109/15622975.2012.696143.

  • 51.

    Galletly C, Castle D, Dark F, Humberstone V, Jablensky A, Killackey E, et al. Royal australian and new zealand college of psychiatrists clinical practice guidelines for the management of schizophrenia and related disorders. Aust N Z J Psychiatry. 2016;50(5):410-72. [PubMed ID: 27106681]. https://doi.org/10.1177/0004867416641195.

  • 52.

    Samara MT, Leucht C, Leeflang MM, Anghelescu IG, Chung YC, Crespo-Facorro B, et al. Early improvement as a predictor of later response to antipsychotics in schizophrenia: A diagnostic test review. Am J Psychiatry. 2015;172(7):617-29. [PubMed ID: 26046338]. https://doi.org/10.1176/appi.ajp.2015.14101329.

  • 53.

    Howes OD, McCutcheon R, Agid O, de Bartolomeis A, van Beveren NJ, Birnbaum ML, et al. Treatment-resistant schizophrenia: Treatment response and resistance in psychosis (trrip) working group consensus guidelines on diagnosis and terminology. Am J Psychiatry. 2017;174(3):216-29. [PubMed ID: 27919182]. [PubMed Central ID: PMC6231547]. https://doi.org/10.1176/appi.ajp.2016.16050503.

  • 54.

    Drosos P, Bronnick K, Joa I, Johannessen JO, Johnsen E, Kroken RA, et al. One-year outcome and adherence to pharmacological guidelines in first-episode schizophrenia: Results From a consecutive Cohort study. J Clin Psychopharmacol. 2020;40(6):534-40. [PubMed ID: 33136922]. [PubMed Central ID: PMC7643791]. https://doi.org/10.1097/JCP.0000000000001303.

  • 55.

    Nielsen J, Young C, Ifteni P, Kishimoto T, Xiang YT, Schulte PF, et al. Worldwide differences in regulations of clozapine use. CNS Drugs. 2016;30(2):149-61. [PubMed ID: 26884144]. https://doi.org/10.1007/s40263-016-0311-1.

  • 56.

    Leucht S, Tardy M, Komossa K, Heres S, Kissling W, Salanti G, et al. Antipsychotic drugs versus placebo for relapse prevention in schizophrenia: A systematic review and meta-analysis. Lancet. 2012;379(9831):2063-71. [PubMed ID: 22560607]. https://doi.org/10.1016/S0140-6736(12)60239-6.

  • 57.

    Tiihonen J, Haukka J, Taylor M, Haddad PM, Patel MX, Korhonen P. A nationwide cohort study of oral and depot antipsychotics after first hospitalization for schizophrenia. Am J Psychiatry. 2011;168(6):603-9. [PubMed ID: 21362741]. https://doi.org/10.1176/appi.ajp.2011.10081224.