In this section, five major articles including Elbasha et al., 2007, Brisson et al., 2007, Kulasingam et al., 2007, Bergeron et al., 2008, Kulasingam et al., 2008 and Chesson et al., 2008 have been addressed in a thematic order as follows:
Choice of Interventions or alternative interventions
Elbasha et al., 2007:
The rationale for choosing alternatives is clear and precise in terms of addressing the current status of care (no vaccination strategy) alongside all possible vaccination options. Different conditions must be considered when applying the results.
Brisson et al., 2007:
This study compares vaccination of young girls with anti HPV 16/18 and anti HPV 6/11/16/18 versus no vaccination plan. The latter represents the “do nothing” option, which is the current practice in the study site (Canada). Evidently, the status quo of service provision in the country must be assessed before trying to universalize the results.
Kulasingam et al., 2007 (Australia):
The rationale for selecting alternative interventions is clear and appropriate. The new approach to population-based immunization has been compared to the current standard practice in Australia. Nevertheless, it must be noted that the base strategy of cervical cancer screening alone may not be a suitable representative of the routine care practice in countries, which have already begun HPV vaccination. In sensitivity analysis, different vaccination programs (in different populations) have been considered, which may be logical and acceptable for other countries.
Bergeron et al., 2008:
Both interventions are reported clearly and elaborately enough. In addition, the choice of alternative strategy is very well justified. This strategy consists of screening from 25 to 65 years of age every three years in France.
Kulasingam et al., 2008 (UK):
Two options selected for prevention of cervical cancer are completely described. The profile of the population study, vaccination program and screening tests are mentioned.
Chesson et al., 2008:
No vaccination scenario as the second strategy was appropriate.
Validity of effectiveness and Benefit index estimation
Elbasha et al., 2007:
Parameters of effectiveness have been adopted from published studies. However, the authors do not mention their search strategy or inclusion criteria. Also, the reason for selecting these particular estimates is not mentioned. The study mentions a review of literature but fails to indicate its strategies and methodology for review. Also, the information of the initial studies is not mentioned, making it impossible to assess validity of data from the initial studies. QALY estimation uses a decision-making tree model. The methods used for estimating desirability weights are not mentioned and are simply said to have been derived from published studies. Interest has been conducted appropriately. QALY is a good choice since it considers the most important health aspects (survival and quality of life) and provides a basis for comparison with other healthcare interventions.
Brisson et al., 2007:
Model parameters are derived from published studies. However, the authors do not mention the search strategies or inclusion criteria for selecting the initial studies. In addition, the study design is not specified. In general, it is difficult to evaluate the quality of effectiveness data in these studies. Using QALY as an index of benefits makes it possible to compare the findings of this study with others addressing vaccination programs and other interventions. The desirability coefficients for adjusted life expectancy based on quality of life are derived from published literature, but the study does not mention the method used for evaluating different health states. The interest rate of health benefits in the future is appropriate.
Kulasingam et al., 2007 (Australia):
Clinical data, for the most part, adopted from published studies, which are not mentioned, except in the case of data derived from the national database. Therefore, it is impossible to evaluate the validity of these estimations objectively without information regarding the scope, sample size, and follow-up procedures of the original studies, which served as source. However, extensive sensitivity analysis and choice of the most acceptable analysis value improve the power of clinical estimations. Using two benefit indices, with expected QALY values smaller than LY values, suggests the importance of evaluating quality of life in women with cancer.
Bergeron et al., 2008:
The authors do not mention using a systematic review of the literature for finding all relevant effectiveness and clinical data. An explanation on the method of integrating and summarizing data obtained from studies has not been provided. Nevertheless, a summary about all parameters used in the model and their sources has been mentioned in the study. In addition, sources of desirability estimations are clearly mentioned.
Kulasingam et al., 2008 (UK):
Effectiveness data are obtained from a spectrum of published studies. However, the selection strategy is not mentioned. Clinical outcomes used for evaluating the advantages of two preventive strategies were selected in favor of vaccination and screening strategy. Some health benefits were excluded from the study. Desirability coefficients were adopted from a published and an unpublished study under supervision of experts and authors, which may cause some degree of bias. The reported data do not allow for evaluating methods of desirability assessment. The model structure is not presented visually. Nevertheless, a comprehensive description of different health states and possible transmissions has been provided.
Chesson et al., 2008:
The databases were relevant and valid. The treatment effects were based on trials, which characterized by high internal validity. The clinical and the utility valuations derived from the literature. The use of QALYs was appropriate because they capture the impact of the disease on patients’ health.
Validity of cost estimation
Elbasha et al., 2007:
It appears that cost analysis is performed from the payer’s point of view. All cost groups have been included in the analysis. Different cost groups are reported, although details of costs are not mentioned. The authors maintain that including indirect costs would reduce the desirability cost and thus improve the appeal of vaccination strategies. No specific source has been provided for this information. Mentioning the reference year of reported costs makes it easy to convert the costs for different time periods. Costs have not been statistically analyzed, but the changes in estimation of major costs have been included in sensitivity analysis.
Brisson et al., 2007:
Economical analysis is performed from the payer’s point of view, and all major cost items seem to have been included in the analysis. Uncertainty of cost data and consumed resources are addressed in sensitivity analysis. Future costs are interested appropriately. These factors improve the applicability of the findings. Moreover, the reference year of cost estimations are mentioned clearly, which makes it easier for future calculations.
Kulasingam et al., 2007 (Australia):
The cost groups considered in the study appear to be appropriate for the approach taken to analysis. Details of cost items are not given and some expenses are mentioned generally. Costs are obtained from national health care services, which reflect the local accounting systems. Consumed resources are obtained from published studies. Key assumptions of the study are addressed in sensitivity analysis.
Bergeron et al., 2008:
The economical viewpoints used are clearly expressed. It seems that all cost items are considered based on their relation to the two viewpoints adopted. Sources of cost data (mainly from official French sources or articles published in France) are well presented. In addition, the authors have appropriately reported the time period of the study, interest rate, reference year of prices and currencies.
Kulasingam et al., 2008 (UK):
The costs considered in the model are an appropriate reflection of the viewpoint adopted (NHS). Methods of cost-assessment, modifications, sources of cost data and cost-service unit are presented appropriately and elaborately. Costs are modified for inflation rate. Nevertheless, the cost results of each strategy are not reported. Moreover, cost information is not mentioned for values consumed from each source.
Chesson et al., 2008:
The perspective was societal. The analysis of costs followed a similar approach to the clinical analysis, in that macro-categories were presented without a detailed breakdown of items. The cost estimates varied in the sensitivity analysis.
Analysis and findings
Elbasha et al., 2007:
The authors state that their findings generally agree with those of previous studies. Nevertheless, the study yields considerable discrepancies with findings of other economic evaluations, which the authors attempt to account for. The study deals briefly with the issue of applicability of its findings in the section of sensitivity analysis. Alternative scenarios are considered in this section. The authors have also highlighted some strengths of their analysis, including use of reliable data, clarity and flexibility. Also, certain limitations of the study have been mentioned, including the fact that the model deals mainly with HPV transmission from the opposite sex. Nevertheless, many assumptions of the study are biased towards different vaccination strategies.
Brisson et al., 2007:
The authors do not seem to be biased in presenting their findings. Furthermore, the conclusion is a good reflection of the scope of analysis. The authors compare their findings with those from other countries and to some extent have managed to justify the discrepancies in desirability cost ratios.
Kulasingam et al., 2007 (Australia):
Cost and benefits are appropriately integrated. However, the overall sum of costs and benefits are only presented graphically and only the cost-effectiveness ratios are mentioned. Sensitivity analysis has been conducted and reported appropriately. A wide range of possible scenarios and alternative assumptions are addressed in sensitivity analysis, which indicates the power of the study.
Bergeron et al., 2008:
Details of the Markov model, which was used for modeling costs and outcomes of each intervention, are presented, but relevant diagrams are lacking in the text. The model was previously designed for the United States and then modified for the European status. Although a series of univariate sensitivity analyses were included to measure uncertainty of model findings, using a probabilistic sensitivity analysis may have provided a more comprehensive understanding of the model’s overall uncertainty. Methods and results are sufficiently explained. The limitations of the study are mentioned in the discussion section.
Kulasingam et al., 2008 (UK):
Crude costs and health outcomes are integrated as cost-effectiveness ratios. Observational epidemiologic data in England confirm the validity of parameters related to cervical cancer risk. Univariate sensitivity analyses are comprehensive and address all key parameters in an acceptable spectrum. While accepting the limitations of the study, the authors have attempted to justify them. These include the lack of powerful data on desirability coefficients of the health states in questions, lack of a probabilistic sensitivity analysis, and possibility of underestimating health benefits. The authors have compared their findings with those or other studies and discussed the possible applicability of their results.
In general, appropriate methods are used for the study. However, the study has limitations in estimating desirability, cost reports and lack of probabilistic sensitivity analysis. It appears that the authors have provided a correct discussion of their analysis.
Chesson et al., 2008:
The ICERs were presented in this study. The method of this study was mentioned online. The sensitivity analysis investigated the issue of uncertainty, using a deterministic approach, which was useful in terms of identifying the most influential model inputs.
Based on the modeling of cost effectiveness, six studies have been selected and categorized as follows:
Brisson et al., 2007, Kulasingam et al., 2007, Bergeron et al., 2008, and Kulasingam et al., 2008 made use Morkov Models
Elbasha et al., 2007, and Chesson et al., 2008 made use of Dynamic Models
A number of limitations are included in all discussed models. The studies, which used Markov models, did not take into account the herd immunity, which may result in underestimating the cost effectiveness of vaccination. The studies that used dynamic transmission models did not consider the homosexual and bisexual effect of vaccination, which is not very important in Iran.
Among these six models and based on the available epidemiologic data in Iran, Chesson
et al. 2008, is simplified and it requires substantially fewer assumptions than the other more complex Markov and hybrid models do. Therefore, we decided to use this model for the evaluation of cost effectiveness of Gardasil in Iran. On the other hand, this simplified model was compared to previous complicated Markov, hybrid and dynamic models like the Markov model of Goldie et al (
45), the Markov model of Sanders and Taira (
46), the hybrid model of Taira
et al. (
47), and the dynamic model of Elbasha
et al. (
25). The findings were consistent with those from other published cost-effectiveness models (
48).
Another advantage of this model is that there is no need to model the probability of HPV acquisition, the possible progression from HPV infection to CIN I, CIN II, CIN III and cervical cancer, and the probability of HPV transmission, which are not available in Iranian epidemiologic data. Age-specific incidence rates of cervical cancer (ASIR CC) is available in Iran. It is mentioned in 2008 population-based cancer registries in Iran. This model needs the following data which are available in Iran:
Age-specific incidence rates of cervical cancer
Treatment cost of HPV adverse health outcomes
Costs Averted by vaccination
QALYs Saved by vaccination