The Effects of Health Transformation Plan Implementation on the Performance Indicators of Public Hospitals

authors:

avatar Ali Reza Yusefi ORCID 1 , avatar Peivand Bastani ORCID 2 , avatar Shima Bordbar 3 , avatar Ahmad Sadeghi 4 , * , avatar Seyede Zohre Hesami 5

Ph.D. Candidate of Health Services Management, Student Research Committee, School of Management and Medical Informatics, Shiraz University of Medical Sciences, Shiraz, IR Iran
Assistant Profesor, Health Human Resources Research Center, School of Management and Medical Informatics, Shiraz University of Medical Sciences, Shiraz, IR Iran
MA Student of Health Economics, Student Research Committee, School of Management and Medical Informatics, Shiraz University of Medical Sciences, Shiraz, Iran
Assistant Professor, Department of Public Health, Esfarayen Faculty of Medical Sciences, Esfarayen, IR Iran
BSc in Health Information Technology, Student Research Committee, School of Health Management and Medical Information Sciences, Shiraz University of Medical Sciences, Shiraz, IR Iran

how to cite: Yusefi A R, Bastani P, Bordbar S, Sadeghi A, Hesami S Z. The Effects of Health Transformation Plan Implementation on the Performance Indicators of Public Hospitals. Health Scope. 2018;7(S):e62566. https://doi.org/10.5812/jhealthscope.62566.

Abstract

Background:

The Health Transformation Plan (HTP) is one of the recent reforms adopted in the health system of Iran.

Objectives:

This study aimed to investigate the effect of implementing of the HSRP on the performance indicators of teaching hospitals in Iran.

Methods:

This descriptive-analytic study was carried out in 10 teaching hospitals of Shiraz University of Medical Sciences in 2017. After referring to the concerned hospitals, 10 performance indicators were extracted and analyzed at 2 stages (before (2013) and after (2015) implementing of the HSRP). Paired sample t-test was run in the SPSS software23 to compare the obtained data.

Results:

Investigating the mean differences of performance indicators before and after the implementation of the HSRP indicated a significant increase (P < 0.05) for the indicators of bed occupancy ratio, inpatient to constructed beds ratio, the mean length of stay, frequency of patients admitted in the clinical and para clinical sectors, frequency of emergency and elective operations, as well as frequency of cesarean and normal delivery. However, the hospital bed turnover rate revealed a significant decrease compared to the year prior to the implementation of the HSRP (P < 0.05).

Conclusions:

The implementation of the health reform plan has been accompanied by significant changes in the performance indicators of the hospitals. Regarding the reduction of the normal delivery rate in comparison with caesarean section after the implementation of the plan, it is suggested to improve the awareness and culture of mothers and society regarding the importance and benefits of natural delivery through the intersectional interactions.

1. Background

In order to meet the needs of the community with regard to their mission over time and given the rapid pace of technological change, increased expectations of individuals to use the most recent and best technologies, increased service costs, resource shortages, dominance of the market economy over service providing organizations and its unpleasant effects on the health market as well as issues such as poverty and transition of diseases, the health systems undoubtedly require reforms (1, 2). All countries are actually seeking reforms and innovations in their health system in order to achieve a universal access to services, justice, quality, and fair payments in the system (3-5). On the other hand, 2 important features of health and treatment make the reforms inevitable in this sector. First, health is one of the individuals’ basic needs and rights and the other is the rapid pace of changes and transformations. The transformations in the appearance of diseases, evolution of health concepts, and the advancement of technology in terms of diagnosis, treatment, and provision of services indicate the fast speed of changes in health (6-9).

In this regard, one of the most recent reforms in the health system of the Islamic Republic of Iran is called “Health Transformation Plan (HTP)”. In accordance with its general duties, missions, and upstream documents, especially the 20-year vision document, health legislation in the 5th development plan and the 11th government program, the Ministry of Health and Medical Education, as the main custodian of the country’s health system, initiated the HSRP, in May 2014, with 3 approaches to financial protection of individuals, access to health services and improved quality of services (10-12). In spite of the short lifetime of this plan, several studies have investigated it from different perspectives. In their study, Heidarian and Vahdat (2015) stated that the plan has succeeded in reducing the patients’ out-of-pocket expenses in public hospitals located in Isfahan (Iran), therefore, the patients’ out-of-pocket expenses, after the implementation of the HSRP, decreased within the range of 23% to 64% (13). Rooeintan et al. (2016) assessed the impact of healthcare reform plan on the rate of vaginal delivery and caesarean section in Shiraz (Iran) and showed that healthcare reform has led to an increase in the number of vaginal deliveries in hospitals affiliated to Shiraz University of Medical Sciences (14). In addition, Faridfar et al. (2016) examined the effect of the HSRP on different types of clinical, paraclinical, surgical, and patient satisfaction indicators in Hazrat-e-Rasoul hospital in Tehran (Iran) and the results showed an increase in the frequency of admissions in clinics and paraclinics as well as in patient satisfaction (15).

Since hospitals are one of the largest and most important health service providers that play an important role in improving community health and also in view of the growing expenditures of health care, more attention to the hospitals` performance seems necessary (16-19).

The performance assessment of health care providers, including hospitals, can provide decision-makers with timely and relevant information related to the efficiency of these centers in order to monitor their status and current activities (20-22). This information informs the program managers and policymakers and would provide the grounds for monitoring the national goals and assessing relevant policies. Timely monitoring and evaluation of reforms can provide evidence to guide the more proper implementation of reforms (23, 24).

2. Objectives

Considering the vital role of monitoring and evaluation of each project in determining its effectiveness, this study aimed to evaluate the effect of the implementation of the HSRP on the performance indicators of teaching hospitals affiliated with Shiraz University of Medical Sciences in 2017. The findings can be implemented in planning, policy making, and reviewing the plan as well as in finding the most suitable executive solutions in this field. Therefore, in view of the general objectives of the health reform plan to increase the quantitative and qualitative services to patients in the hospital complex and also a need for a profound understanding of the evaluation ofthe mentioned plan by policymakers at the top of the decision making system and executive managers in hospitals for efficient use of limited resources and achieving the effectiveness ofthe results, this research can be used as an objective example applied by policymakers at different levels of implementation.

3. Methods

The present research was a descriptive-analytic study and longitudinally carried out in 10 teaching hospitals affiliated to Shiraz University of Medical Sciences in 2017. Regarding the implementation of the HSRP in all hospitals affiliated to the ministry of health since May 2014, some selected performance indicators were examined in the concerned hospitals. In order to evaluate the performance of the hospital, several indicators are used, among which the bed occupancy rate (BOR), bed turnover rate (BTR), and average length of stay (ALS) are the most important and most often-used indicators for assessing the hospital efficacy and have been used in well-known hospital performance measurement models such as Pabon and Lasso’s (25, 26).

The bed occupancy rate (BOR) is a measure of utilization of the available bed capacity. It indicates the percentage of beds occupied by patients in a defined period of time, usually a year. It is the amount of occupied beds, which is relative to the bed of the day to the active bed in a given period. The bed turnover interval for the average length of time (in days) that elapses between the discharge of one inpatient and the admission of the next inpatient to the same bed at specialty level/significant facility, over any period of time. The average length of stay (ALOS) is often used as an indicator of efficiency. All other things being equal, a shorter stay will reduce the cost per discharge and shift care from inpatient to less expensive post-acute settings. The ALOS refers to the average number of days that patients spend in the hospital (25).

In addition, some other indicators including inpatient to constructed beds ratio, frequency of patients admitted in the clinical and para clinical sectors, frequency of emergency, and elective operations and frequency of cesarean and normal delivery were also concerned since they reflect the performance of the hospitals.

The data gathering method was field data collection. Information was collected through referring to the existing records and documents prior to (2013) and after (2015) implementation of health reform plan. Thus, the statistical information needed for the study was collected by providing a registration form which its reliability was approved by 6 faculty members of Shiraz school of Management and Medical Informatics by referring to the hospital medical statistics department, each month, separately.

Regarding the ethical considerations, 1st a research letter was received from the vice-chancellor of Shiraz’ Management and Medical Informatics School and the letter of university preservation department received. Then, they were referred to each of the mentioned hospital’s management and after doing demanded coordination, necessary data were collected.

To analyze the data, Excel and SPSS software version 23, as well as descriptive statistics, frequency, and paired sample t-test were used (Regarding normal distribution of data). The level of significance was set at α = 0.05.

4. Results

With regard to the findings, the highest mean values for each of the indicators including BOR, inpatient to constructed beds ratio, BTR, ALS, patients admitted in the clinical and para clinical sectors, emergency and elective operations, as well as cesarean and normal delivery in 2013 were 75.07 in August, 0.77 in December, 2.24 in April, 4.64 in April, 2329.28 in December, 19130.57 in May, 211.5 in June, 575.75 in October, 290.5 in August, and 519 in September, respectively (Table 1).

Table 1.

Mean Values of Performance Indicators in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences by Months Prior to the Implementation of the Health Transformation Plan (2013)

Indicator MonthBORInpatient to Constructed Beds RatioBTRALSaPatients Admitted in Clinical SectorsPatients Admitted in Para Clinical SectorsEmergency OperationsElective OperationsCesarean DeliveryNormal Delivery
April65.160.722.244.64176615718.85188.17289.37245.5349
May72.870.731.214.211984.4219130.57203561.5231.5379.5
June74.430.741.014.122038.1418783.42211.5505257400.5
July72.980.741.244.36222518490.42210.5575288506.5
August75.070.751.054.172237.8517677208.34549.37290.5491.5
September74.070.761.064.332281.4218013.14154.84574.5275519
October74.870.761.124.292171.2817917.42203.5578.75262440.5
November72.860.761.324.262060.4217292.14196.67545244458.5
December73.430.771.184.232329.2818270.28200.34522.62282467
January70.850.771.274.122028.4217780.85128.67506.5270.5428.5
February72.260.751.193.992116.1417812.28182.5543.25278.5454
March73.660.751.303.932087.5716987.42182.16464.62243424.5

Further, the highest mean values for each of the indicators including BOR, inpatient to constructed beds ratio, BTR, ALS, patients admitted in the clinical and para clinical sectors, emergency and elective operations, and cesarean and normal delivery in 2015 following the implementation of the HSRP were related to November (89.15), December and January (0.81), April (1.66), December (5.95), January (2929.28), January (22755.42), July (237.83), September (719. 12), August (437), and July (631.5) (Table 2).

Table 2.

Mean Values of Performance Indicators in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences by Months Following the Implementation of the Health Transformation Plan (2015)

Indicator MonthBORInpatient to Constructed Beds RatioBTRALSaPatients Admitted in Clinical SectorsPatients Admitted in Para Clinical sectorsEmergency OperationsElective OperationsCesarean DeliveryNormal Delivery
April72.690.751.664.832096.2818842.28219.67419.27319474.5
May80.970.761.035.272437.1421722.71220.83651.5336.5557
June81.150.771.015.382479.7122305.71239679.25368.5560
July82.030.770.935.392478.2822381.42237.83673.5393631.5
August84.750.790.795.362538.1422734.85230.5697.5437603.5
September82.730.801.075.552538.8522693.85203.67719.12396.5526.5
October81.920.800.955.85251621443.57226.5637324516.5
November89.150.801.045.752542.7121389190.83660.12344483
December80.330.811.095.952795.1421840.42181.5649.75360.5479.5
January81.560.811.075.522929.2822755.42148.84690.87342.5460.5
February79.630.791.135.31272922301.42201.5616.87346509
March79.750.791.015.032458.8521510.28200.5557.75293442

A comparison of the mean differences in the performance indicators before and after the implementation of the HSRP using the paired sample t-test indicated a statistically significant increase for the indicators of bed occupancy ratio, inpatient to constructed beds ratio, the mean length of stay, frequency of patients admitted in the clinical and para clinical sectors, frequency of emergency and elective operations, and frequency of cesarean and normal delivery (P < 0.05). On the other hand, the hospital bed turnover rate revealed a significant decrease, compared to the year prior to the implementation of the HSRP (P < 0.05) (Table 3). The changes in the indicators studied during the year before and after implementation of the HSRP are shown in Figures 1 - 4.

Table 3.

The Difference Between the Performance Indicators of Teaching-Treatment Hospitals Affiliated to Shiraz University of Medical Sciences Prior to and Following the Implementation of Health Transformation Plan (2013 - 2015)

Performance Indicator20132015P Value
BOR72.70 ± 2.6580.55 ± 2.910.001
Inpatient to constructed beds ratio0.75 ± 0.010.78 ± 0.010.001
BTR1.26 ± 0.321.06 ± 0.200.001
ALS4.22 ± 0.185.40 ± 0.290.001
Patients admitted in clinical sectors2110.16 ± 153.582553.00 ± 209.420.000
Patients admitted in para clinical sectors17822.81 ± 892.0521826.74 ± 1068.470.000
Emergency operations189.18 ± 24.92208.43 ± 26.300.003
Elective operations517.95 ± 79.66637.71 ± 80.550.000
Normal delivery25.443 ± 74.5029.520 ± 19.580.001
Cesarean delivery264.33 ± 22.80359.20 ± 38.240.000
Normal to cesarean delivery ratea1.67 ± 0.131.46 ± 0.010.002
Comparison of the Mean Number of Emergency and Elective Operations in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of the Health System Reform Plan
Comparison of the Mean Number of Emergency and Elective Operations in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of the Health System Reform Plan
Comparison of the Mean Number of Normal and Cesarean Deliveries in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of Health Transformation Plan
Comparison of the Mean Number of Normal and Cesarean Deliveries in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of Health Transformation Plan
Comparison of the Average Number of Patients Admitted in the Clinical and Para Clinical sectors Of Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and after the implementation of Health Transformation Plan
Comparison of the Average Number of Patients Admitted in the Clinical and Para Clinical sectors Of Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and after the implementation of Health Transformation Plan
Comparison of the Mean Values of Bed Occupancy Rate, Inpatient to Constructed Beds Ratio, BTR and ALS in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of Health Transformation Plan
Comparison of the Mean Values of Bed Occupancy Rate, Inpatient to Constructed Beds Ratio, BTR and ALS in Teaching Hospitals Affiliated to Shiraz University of Medical Sciences Before and After the Implementation of Health Transformation Plan

5. Discussion

In the present study, the hospital performance indicators prior to and following the implementation of the HSRP with a time interval of 12 months were investigated in 10 teaching hospitals affiliated to Shiraz University of Medical Sciences. The results indicated that after the implementation of the HSRP, significant changes were made in the performance indicators of the examined hospitals. The findings of other similar studies in this field show the positive effects of the HSRP, which partly confirms the findings of the current study. In the Faridfar et al. study (2016), it was shown that the HSRP has had a great impact on the number of admissions, surgeries, and patients’ satisfaction (15). The findings of a study in Isfahan suggested that implementation of the HSRP could reduce the patients’ out-of-pocket expenses (13). Furthermore, the results of the Bahadori et al. study (2015) concluded that the reform can lead to a decrease in the overall costs of healthcare and hospitals as well and improve the cost effectiveness of services (11). According to research findings, the BOR indicator increased by 8% and enhanced from 72.7 to 80.55. However, the BTR decreased from 1.26 to 1.06. The average length of stay also increased from 4.22 to 5.40. One of the reasons for this could be the lower proportion of treatment costs paid by patients in the public sector in comparison with the private sector after the implementation of the HSRP and shifting them to public hospitals to receive health care, consequently. In this case, the public hospitals’ bed occupancy rate will increase and bed turnover intervals will decrease. In addition, average length of stay for patients will increase, ultimately. Similar studies conducted in the hospitals affiliated to Bushehr University of Medical Sciences (Iran) also came to the conclusion that the plan has enhanced the bed occupancy rate and the average length of stay and the bed turnover ratio has also been steadily increasing (27). Also, the results of the study by Sajadi et al. (2017) showed that BOR, ALOS, and BTR indicators have been increasing since the implementation of the HSRP (28).

The number of patients admitted in the clinical and para clinical sections was also one of the other indicators concerned in this study, which showed an incremental increase following the implementation of the HSRP. Clinical admissions may be increased due to reasons such as lower costs in the public sector, the implementation of resident physicians’ package, and the efficient use of specialized and specialist assistants in the hospitals. On the other hand, regarding the increase in para clinic admissions, it can be attributed to the increase in admissions due to the implementation of the HSRP in the examined period, since each single admission in the hospital requires diagnostic examinations, thus increasing in the number of para clinical admissions is expectable consideringupward trend in general admissions.

The findings of the Faridfar et al. study (2016), on the Hazrat-e-Rasoul hospital in Tehran (Iran), reflected an increase in the number of admissions in clinics and para clinics after the implementation of the plan (15). Among the other indicators studied in this study was the number of emergency and elective operations. These indicators have been increasing over the years following the implementation of the HSRP. An increase in the number of operations seems to not be surprising with regard to the increased number of admissions after the implementation of the plan. The findings were in a similar vein with the Faridfar et al. findings, suggesting an increase in all surgical operations in 2015 compared to 2013 (15).

The increased number of normal deliveries in the concerned hospitals was another impact of this plan. Although, the average number of normal deliveries increased after the implementation of the HSRP, the average normal to cesarean delivery ratio decreased in 2015, compared to 2013. In fact, the number of cesarean deliveries has increased with an increase in the number of normal deliveries. This noticeable issue indicates that HSRP wasn’t successful in meeting one of its goals, which is to reduce the rate of caesarean section and increase in normal delivery rate; however, there is a great way to achieve this goal.

Meanwhile, the report of Iran’s national institute for health research explains that the implementation of the plan after 1 year resulted in a 10.2% decrease in the total rate of cesarean delivery compared to the corresponding rate at the beginning of the plan (29). Pirouzi et al. (2016) claimed that the rate of cesarean delivery in the Kurdistan (Iran) province over a year after the implementation of the plan decrease by 14%, compared to the corresponding rate in 2013 (30), which is not consistent with this study. The reasons for not paying attention to normal delivery are simply not due to the financial factor that has been taken into account by the reform plan and other factors (cultural, medical) that are also involved. Therefore, this issue requires more cooperation from organizations outside the ministry of health in order to promote culture and raise mothers and society awareness.

Mentioning the limitations of the current study, the dispersion of hospitals, time consuming data collection process, which were broken down by the Medical Registry Unit of some hospitals delayed the collection of information. The inherent limitations of the research was the differences between the examined hospitals and the combination of services provided by them, which is in view of the purpose of the study on the impact of the reform plan on the performance indicators in total. Therefore, the average of the status of the indicators was used. Furthermore, we were not able to compare the reform with other studies because no similar reforms had been implemented in other countries.

5.1. Conclusions

The performance indicators in the hospitals significantly differed before and after the implementation of the HSRP. It can be concluded that by implementing the HSRP and changing the tariffs for health services and care, the willingness to admit to study centers and receive health care has increased, either because of the client’s request or the offer and willingness of the service provider. This has increased the bed occupancy rate and the average length of stay by increasing the number of active beds. Among the indicators, the normal delivery rate to cesarean section has been reduced after implementation of the reform plan in comparison with the pre-implementation, which is contrary to one of the general objectives of the plan. Therefore, in order to achieve the goal of decreasing the rate of cesarean delivery and promoting natural delivery, in addition to informing mothers about natural delivery and its advantages, it is recommended that suitable cultural platforms be provided by policy makers through intersectional cooperation.

Acknowledgements

References

  • 1.

    Rajabi F, Esmailzadeh H, Rostamigooran N, Majdzadeh R, Doshmangir L. Future of health care delivery in iran, opportunities and threats. Iran J Public Health. 2013;42(Supple1):23-30. [PubMed ID: 23865012].

  • 2.

    Ghijben P, Gu Y, Lancsar E, Zavarsek S. Revealed and Stated Preferences of Decision Makers for Priority Setting in Health Technology Assessment: A Systematic Review. Pharmacoeconomics. 2017. [PubMed ID: 29124632]. https://doi.org/10.1007/s40273-017-0586-1.

  • 3.

    Frenk J, Gonzalez-Pier E, Gomez-Dantes O, Lezana MA, Knaul FM. Comprehensive reform to improve health system performance in Mexico. Lancet. 2006;368(9546):1524-34. [PubMed ID: 17071286]. https://doi.org/10.1016/S0140-6736(06)69564-0.

  • 4.

    Viacava F, Bellido JG. Health, access to services and sources of payment, according to household surveys. Cien Saude Colet. 2016;21(2):351-70. [PubMed ID: 26910144]. https://doi.org/10.1590/1413-81232015212.19422015.

  • 5.

    Bagcchi S. India launches mental health policy to improve access to services. BMJ. 2014;349:g6471. [PubMed ID: 25348517]. https://doi.org/10.1136/bmj.g6471.

  • 6.

    Lee JJY, Thompson CL, Shaik MA, Wan E, Chen CL, Dong YH. Service use, advance planning and lifestyle changes following cognitive screening in primary healthcare in Singapore. Int Psychogeriatr. 2018;30(1):139-45. [PubMed ID: 28927472]. https://doi.org/10.1017/S1041610217001971.

  • 7.

    Fisher M, Baum F, Kay A, Friel S. Are changes in Australian national primary healthcare policy likely to promote or impede equity of access? A narrative review. Aust J Prim Health. 2017;23(3):209-15. [PubMed ID: 28583251]. https://doi.org/10.1071/PY16152.

  • 8.

    Frenk J. The global health system: strengthening national health systems as the next step for global progress. PLoS Med. 2010;7(1). e1000089. [PubMed ID: 20069038]. https://doi.org/10.1371/journal.pmed.1000089.

  • 9.

    McDonough JE. Health system reform in the United States. Int J Health Policy Manag. 2014;2(1):5-8. [PubMed ID: 24596894]. https://doi.org/10.15171/ijhpm.2014.02.

  • 10.

    Piroozi B, Moradi G, Nouri B, Mohamadi Bolbanabad A, Safari H. Catastrophic Health Expenditure After the Implementation of Health Sector Evolution Plan: A Case Study in the West of Iran. Int J Health Policy Manag. 2016;5(7):417-23. [PubMed ID: 27694669]. https://doi.org/10.15171/ijhpm.2016.31.

  • 11.

    Bahadori M, Ravangard R, Alimohammadzadeh K, Hosseini SM. Plan and road map for health reform in Iran. BMJ. 2015;351:h4407. [PubMed ID: 26285708]. https://doi.org/10.1136/bmj.h4407.

  • 12.

    Moradi-Lakeh M, Vosoogh-Moghaddam A. Health Sector Evolution Plan in Iran; Equity and Sustainability Concerns. Int J Health Policy Manag. 2015;4(10):637-40. [PubMed ID: 26673172]. https://doi.org/10.15171/ijhpm.2015.160.

  • 13.

    Heidarian N, Vahdat SH. The impact of healthcare reform plan to pay out of pocket Patients in the government hospitals of Isfahan. J Med Council Islamic Republic Iran. 2015;33(3):187-94.

  • 14.

    Rooeintan F, Borzabad PA, Yazdanpanah A. The Impact of Healthcare Reform Plan on the Rate of Vaginal Delivery and Cesarean Section in Shiraz (Iran) in 2015. Electron Physician. 2016;8(10):3076-80. [PubMed ID: 27957306]. https://doi.org/10.19082/3076.

  • 15.

    Faridfar N, Alimohammadzadeh K, Seyedin SH. The impact of health system reform on clinical, paraclinical and surgical indicators as well as patients' satisfaction in Rasoul-e-Akram hospital in 2013 to 2014. Razi J Med Sci. 2016;22(140):92-9.

  • 16.

    Bastani P, Vatankhah S, Salehi M. Performance Ratio Analysis: A National Study on Iranian Hospitals Affiliated to Ministry of Health and Medical Education. Iran J Public Health. 2013;42(8):876-82. [PubMed ID: 26056642].

  • 17.

    Curry LA, Brault MA, Linnander EL, McNatt Z, Brewster AL, Cherlin E, et al. Influencing organisational culture to improve hospital performance in care of patients with acute myocardial infarction: a mixed-methods intervention study. BMJ Qual Saf. 2018;27(3):207-17. [PubMed ID: 29101292]. https://doi.org/10.1136/bmjqs-2017-006989.

  • 18.

    Canaway R, Bismark M, Dunt D, Kelaher M. Public reporting of hospital performance data: views of senior medical directors in Victoria, Australia. Aust Health Rev. 2017. https://doi.org/10.1071/ah17120.

  • 19.

    Zhang H, Hu H, Wu C, Yu H, Dong H. Impact of China's Public Hospital Reform on Healthcare Expenditures and Utilization: A Case Study in ZJ Province. PLoS One. 2015;10(11). e0143130. [PubMed ID: 26588244]. https://doi.org/10.1371/journal.pone.0143130.

  • 20.

    Chalmers LM, Ashton T, Tenbensel T. Measuring and managing health system performance: An update from New Zealand. Health Policy. 2017;121(8):831-5. [PubMed ID: 28610840]. https://doi.org/10.1016/j.healthpol.2017.05.012.

  • 21.

    Si SL, You XY, Liu HC, Huang J. Identifying Key Performance Indicators for Holistic Hospital Management with a Modified DEMATEL Approach. Int J Environ Res Public Health. 2017;14(12):934. https://doi.org/10.3390/ijerph14080934.

  • 22.

    Najafizada SAM, Sivanandan T, Hogan K, Cohen D. Ranked Performance of Canada’s Health System on the International Stage: A Scoping Review. Healthcare Policy. 2017;13(1):59-73. https://doi.org/10.12927/hcpol.2017.25191.

  • 23.

    Barry SP, Diarra-Nama AJ, Kirigia JM, Bakeera S, Somanje H. Monitoring and evaluation of health sector reforms in the WHO African Region. East Afr Med J. 2009;86(1 Suppl):S25-32. [PubMed ID: 19563138].

  • 24.

    Hasan Y, Parviz SS, Bahram N. Health System Reform Plan and Performance of Hospitals: an Iranian Case Study. Mater Sociomed. 2017;29(3):201-6. [PubMed ID: 29109667]. https://doi.org/10.5455/msm.2017.29.201-206.

  • 25.

    Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon Lasso and Data Envelopment Analysis: a complementary approach to hospital performance measurement. Glob J Health Sci. 2014;6(4):107-16. [PubMed ID: 24999147]. https://doi.org/10.5539/gjhs.v6n4p107.

  • 26.

    Sajjadi H, Sajjadi Z, Hadi M. Is there a method for the simultaneous comparison of key hospital performance indicators. Health Inform Manage. 2011;8(1):71-81.

  • 27.

    Mosavirigi SA, Mahrami M, Montazerolfarag R, Dehghanitafti A, Dorahaki M, Barati O. Reviews and comparisons of hospital performance indicators before and after the implementation of the healthcare reform package design therapeutic hospitals of Bushehr University of Medical Sciences. Tolooebehdasht. 2017;15(6):107-19.

  • 28.

    Sajadi HS, Sajadi ZS, Sajadi FA, Hadi M, Zahmatkesh M. The comparison of hospitals' performance indicators before and after the Iran's hospital care transformations plan. J Educ Health Promot. 2017;6:89. [PubMed ID: 29114557]. https://doi.org/10.4103/jehp.jehp_134_16.

  • 29.

    Iran National Institute of Health Research. National conference to review the performance of eleventh government in the field of health. 2015. Available from: http://nihr.tums.ac.ir/wpcontent/uploads/2015/06/ebook.pdf.

  • 30.

    Piroozi B, Moradi G, Esmail Nasab N, Ghasri H, Farshadi S, Farhadifar F. Evaluating the effect of health sector evolution plan on cesarean rate and the average costs paid by mothers: A case study in Kurdistan province between 2013-2015. J Hayat. 2016;22(3):245-54.