PMCID: 7751211 (link)
Year: 2020
Reviewer Paper ID: 6
Project Paper ID: 26
Q1 - Title(show question description)
Explanation: The title of the manuscript specifies that the study is a cost-effectiveness analysis, which is a type of economic evaluation, comparing pembrolizumab with standard chemotherapy for treating platinum-resistant recurrent or metastatic head and neck squamous cell carcinoma in China.
Quotes:
-
Cost-effectiveness of pembrolizumab for treatment of platinum-resistant recurrent or metastatic head and neck squamous cell carcinoma in China: an economic analysis based on a randomised, open-label, phase III trial
Q2 - Abstract(show question description)
Explanation: The abstract of the manuscript is structured, providing a clear overview of the context, key methods, results, and alternative analyses involved in the study. Each section of the abstract is clearly labeled and describes the objectives, design, outcomes, and conclusions of the study alongside sensitivity analyses performed.
Quotes:
-
Background: Pembrolizumab was recently demonstrated to have survival benefit in patients with recurrent or metastatic head and neck squamous cell carcinoma (r/mHNSCC). However, the cost-effectiveness of pembrolizumab versus chemotherapy in China remains uncertain.
-
Design: A Markov model consisting of three health states (stable, progressive and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOC in platinum-resistant r/mHNSCC.
-
Results: The total mean cost of pembrolizumab and SOC was US$45 861 and US$41 950, respectively. As for effectiveness, pembrolizumab yielded 0.31 QALYs compared with 0.25 QALYs for SOC therapy.
-
Sensitivity analyses: were conducted to test the uncertainties surrounding model parameters. The univariate sensitivity analysis indicated that utility values for progressive state...
-
Conclusions: Pembrolizumab is not likely to be a cost-effective strategy compared with SOC therapy in patients with platinum-resistant r/mHNSCC in China.
Q3 - Background and objectives(show question description)
Explanation: The introduction provides detailed context for the study by outlining the global significance of head and neck squamous cell carcinoma (HNSCC), the standard treatment options, and the recent advancements with pembrolizumab. It presents the study's objective, which is to evaluate the cost-effectiveness of pembrolizumab compared to standard treatment, thereby highlighting its practical relevance for decision-making in policy or practice. This context positions the study in terms of its clinical and economic significance.
Quotes:
-
Head and neck squamous cell carcinoma (HNSCC) represents a major global cause of cancer-associated morbidity and death, with a worldwide incidence of 550 000 cases and 380 000 deaths per year.
-
Checkpoint inhibitors of the programmed cell death protein 1 (PD-1) have shown impressive effects on a number of cancers.
-
The objective of this study was to evaluate the cost-effectiveness of pembrolizumab compared with standard treatment in order to find a more cost-effective therapy in the treatment of r/mHNSCC in China.
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript does not mention the development of a specific health economic analysis plan, nor does it indicate any availability of such a plan. Instead, it outlines the methods and model used for the cost-effectiveness analysis but does not refer to an economic analysis plan document or its availability.
Quotes:
-
Patient and public involvement: There was patient representation in the KEYNOTE-040 trial. However, patients or the public were not involved in this cost-effectiveness analysis.
-
To our knowledge, this is the first cost-effectiveness analysis comparing pembrolizumab with methotrexate, docetaxel or cetuximab in treating patients with r/mHNSCC.
Q5 - Study population(show question description)
Explanation: The manuscript does provide details about the study population's clinical characteristics, particularly eligibility related to the progression of head and neck squamous cell carcinoma after platinum-based therapy. Although specific demographic or socioeconomic details are not extensively covered, clinical characteristics crucial to the study's context are clearly described.
Quotes:
-
The target patients in the model were in line with the eligibility criteria for the randomised, open-label, phase III clinical trial (KEYNOTE-040). This included patients with HNSCC that progressed during or after platinum-containing therapy for recurrent and/or metastatic disease.
-
Patients that recurred or progressed within 3-6 months of platinum-containing therapy for locally advanced disease were also included.
Q6 - Setting and location(show question description)
Explanation: The manuscript provides relevant contextual information, specifically related to the setting and location, as the study focuses on the cost-effectiveness of pembrolizumab within the healthcare context of China. This context influences the findings due to particular economic conditions and healthcare practices in China.
Quotes:
-
This analysis aimed to describe the cost-effectiveness of pembrolizumab versus standard-of-care (SOC) therapy in r/mHNSCC in China.
-
Costs and outcomes were discounted at an annual rate of 3.0%. Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.
-
A large incremental cost and a slight benefit in health outcome led to the high ICER exceeding WTP threshold... An evaluation of pembrolizumab compared with chemotherapy for the treatment of PD-L1-positive NSCLC in China resulted in an ICER of US$103 128 per QALY.
Q7 - Comparators(show question description)
Explanation: The manuscript provides a clear description of the interventions being compared, pembrolizumab and standard-of-care therapy (SOC), detailing the drugs involved in the SOC and the rationale for including pembrolizumab based on its survival benefits shown in previous trials.
Quotes:
-
"Pembrolizumab was recently demonstrated to have survival benefit in patients with recurrent or metastatic head and neck squamous cell carcinoma (r/mHNSCC)."
-
"For patients with failure of first-line platinum therapy, the commonly used drug is methotrexate. The second-line drugs paclitaxel or docetaxel have a certain salvage effect if the first-line therapy does not receive the taxane. Cetuximab is also suitable for patients who have not been exposed to this drug or have poor Karnofsky performance status (KPS) score."
-
"In recent years, anti-PD-1 drugs have developed rapidly...Pembrolizumab...is also widely used in HNSCC...according to the recommendations for indications approved by FDA and several guidelines such as the National Comprehensive Cancer Network and the Chinese Society of Clinical Oncology."
-
"The recently reported KEYNOTE-040 study found a survival benefit in patients with platinum-resistant recurrent or metastatic disease who received pembrolizumab."
Q8 - Perspective(show question description)
Explanation: The manuscript specifies that the perspective adopted in the study was the payer's perspective in China. This perspective was chosen to determine the cost-effectiveness of pembrolizumab in the Chinese healthcare context, considering treatment costs and other healthcare expenditures incurred from the viewpoint of those who are responsible for funding healthcare in China.
Quotes:
-
Cost data were acquired for the payer's perspective in China.
-
Costs due to severe (grade 3-4) treatment-related adverse events were either derived from the literature or calculated from the payer's perspective in China.
Q9 - Time horizon(show question description)
Explanation: The time horizon for the study is 30 years, which is appropriate as it ensures all patients are expected to die, aligning with the chronic nature of the disease and providing a comprehensive understanding of long-term cost-effectiveness.
Quotes:
-
The simulation was conducted in 3-week cycles for a period of 30 years, during which all patients were expected to die.
Q10 - Discount rate(show question description)
Explanation: The manuscript specifies a discount rate of 3.0% annually as part of the cost-effectiveness model. The rate is mentioned in the context of discounting costs and outcomes. However, the rationale for choosing this specific rate is not discussed in detail within the provided text.
Quotes:
-
"Costs and outcomes were discounted at an annual rate of 3.0%."
-
"All costs in the model were adjusted to US dollars based on the 2018 average exchange rate (US$ 1=$6.6174) and discounted at a rate of 3% annually."]}
Q11 - Selection of outcomes(show question description)
Explanation: The manuscript identifies quality-adjusted life years (QALYs) as the measure of benefit in the cost-effectiveness analysis of pembrolizumab. Furthermore, it discusses the health states and utilities, such as stable and progressive states, which directly tie to how benefits (measured as QALYs) are quantified in this study.
Quotes:
-
The primary outcome was incremental cost-effectiveness ratios (ICERs), which were calculated as the cost per quality-adjusted life years (QALYs).
-
Effectiveness was measured in quality-adjusted life years (QALY), which is equal to the survival time of the patient in a certain health state multiplied by the health utility value (quality of life weight) during that period.
Q12 - Measurement of outcomes(show question description)
Explanation: The outcomes to capture benefits and harms were measured using incremental cost-effectiveness ratios (ICERs) per quality-adjusted life years (QALYs), which incorporate both the effectiveness and the quality of life. This approach accounts for both benefits and harms by evaluating the cost per QALY gained.
Quotes:
-
The primary outcome was incremental cost-effectiveness ratios (ICERs), which were calculated as the cost per quality-adjusted life years (QALYs).
-
Effectiveness was measured in quality-adjusted life years (QALY), which is equal to the survival time of the patient in a certain health state multiplied by the health utility value (quality of life weight) during that period.
-
The cost-effectiveness of pembrolizumab versus methotrexate, docetaxel or cetuximab was assessed by incremental cost-effectiveness ratio (ICER), which is expressed as the incremental cost between the two treatment approaches per QALY gained.
Q13 - Valuation of outcomes(show question description)
Explanation: The population used in the study consisted of patients with HNSCC that progressed during or after platinum-containing therapy, including those who recurred within 3-6 months of therapy for advanced disease. A Markov model was developed to measure and value the outcomes using ICERs based on QALYs derived from health utility scores and transition probabilities from the KEYNOTE-040 trial.
Quotes:
-
"The target patients in the model were in line with the eligibility criteria for the randomised, open-label, phase III clinical trial (KEYNOTE-040). This included patients with HNSCC that progressed during or after platinum-containing therapy for recurrent and/or metastatic disease."
-
"A Markov model consisting of three health states (stable, progressive, and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOC..."
-
"The primary outcome was incremental cost-effectiveness ratios (ICERs), which were calculated as the cost per quality-adjusted life years (QALYs)."
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The costs in the study were valued from the payer's perspective in China, considering direct medical costs and using monetary metrics like US dollars based on exchange rates. The analysis included costs associated with the therapeutic regimens, adverse events, and other direct healthcare expenses, adjusted to 2018 values.
Quotes:
-
Cost data were acquired for the payer's perspective in China.
-
All aspects of direct medical costs for treating the disease, including the cost for pembrolizumab or standard therapy, imaging and laboratory tests, hospitalisation, administration for stable state, and the cost for subsequent therapy in progressive disease, were taken into account.
-
All costs in the model were adjusted to US dollars based on the 2018 average exchange rate (US$ 1=$6.6174) and discounted at a rate of 3% annually (table 1).
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript provides details about the date of the estimated resource quantities and unit costs as well as the currency and year used for conversion. The costs are adjusted to US dollar equivalent values based on the 2018 average exchange rate.
Quotes:
-
All costs in the model were adjusted to US dollars based on the 2018 average exchange rate (US$ 1=$6.6174) and discounted at a rate of 3% annually (table 1).
-
Time cost was estimated at US$35.73 per day on the basis of the average monthly salary in China in 2018.
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript discusses the use of a Markov model, describing its structure, the rationale for using such a model, and how it was constructed, including various inputs and assumptions. The model is publicly available through TreeAge Software as mentioned in the methods section.
Quotes:
-
A Markov model consisting of three health states (stable, progressive and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOC in platinum-resistant r/mHNSCC.
-
We conducted a Markov model using TreeAge Pro Suite (TreeAge Software, Williamstown, Massachusetts, USA) to simulate treatments, adverse events, costs, survival and quality of life among simulated patients ...
-
Model structure. (A) Abbreviated decision tree and Markov model; and (B) model states and transitions.
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript details several methods for analyzing, statistically transforming data, and validating the Markov model used in the study. A Markov model was utilized for cost-effectiveness analysis, and various sensitivity analyses were conducted to account for uncertainty in model parameters.
Quotes:
-
A Markov model consisting of three health states (stable, progressive and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOC in platinum-resistant r/mHNSCC.
-
Transition probabilities of every state were calculated based on the following equation: P (1 month)=1-00.5(1/median time to event). The equation was derived from P=1-e-R and R=-ln(0.5)/(time to event/number of treatment cycles).
-
Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.
-
Probabilistic sensitivity analysis (PSA) was performed using a second-order Monte Carlo simulation.
Q18 - Characterizing heterogeneity(show question description)
Explanation: The article does not specifically describe methods for estimating variability of results for different sub-groups. The focus is on the overall cost-effectiveness of pembrolizumab versus standard of care, utilizing a Markov model and sensitivity analyses of parameters but does not mention subgroup analyses or methods for examining variability across different patient sub-groups specifically.
Quotes:
-
Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.
-
Univariate analysis was performed for model parameters subject to uncertainty. The value of parameters was varied one at a time by +-20%.
Q19 - Characterizing distributional effects(show question description)
Explanation: The manuscript does not provide specific details on how the impacts were distributed among different individuals or any adjustments made for priority populations. The analysis is based on a Markov model and does not mention individual distribution or population adjustments.
Quotes:
-
The manuscript only mentions, 'The target patients in the model were in line with the eligibility criteria for the randomised, open-label, phase III clinical trial (KEYNOTE-040)'
-
'Patients were randomly assigned to receive either pembrolizumab or investigator's choice of SOC therapy.'
Q20 - Characterizing uncertainty(show question description)
Explanation: The manuscript describes the use of both univariate and probabilistic sensitivity analyses to characterize uncertainty in the cost-effectiveness analysis model. These methods are typical in health economic evaluations to assess the robustness of the model's outcomes when parameters are varied.
Quotes:
-
Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.
-
Univariate analysis was performed for model parameters subject to uncertainty.
-
In order to evaluate the robustness of the model to further address the uncertainty in model input parameters, probabilistic sensitivity analysis (PSA) was performed using a second-order Monte Carlo simulation.
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript specifies that while there was patient representation in the KEYNOTE-040 clinical trial, patients, the public, or other stakeholders were not involved in the cost-effectiveness analysis of pembrolizumab which is the primary study discussed in the manuscript.
Quotes:
-
There was patient representation in the KEYNOTE-040 trial. However, patients or the public were not involved in this cost-effectiveness analysis.
Q22 - Study parameters(show question description)
Explanation: The manuscript reports all analytic inputs or study parameters, including values, their ranges, and specific distributional assumptions for each parameter. Additionally, it includes the sources for these parameters, ensuring transparency about the uncertainty and assumptions made in the analysis.
Quotes:
-
Transition probabilities of every state were calculated based on the following equation: P (1 month)=1-00.5(1/median time to event).
-
The variables with the most impact on the ICER included utility values for progressive state, probability from stable to progressive in the SOC group, as well as cost of pembrolizumab.
-
Parameters for cost-effectiveness model...Variable Value Range Distribution Source Minimum Maximum
-
Transition probabilities ... Progression from stable state 0.281 0.225 0.337 Beta
-
Utilities ... Stable state 0.650 0.500 1.000 Beta
-
Cost ... Pembrolizumab 5421 4337 6506 Gamma Calculated
-
In order to evaluate the robustness of the model to further address the uncertainty in model input parameters, probabilistic sensitivity analysis (PSA) was performed using a second-order Monte Carlo simulation.
Q23 - Summary of main results(show question description)
Explanation: The manuscript reports the mean values for costs and QALYs, which are key components of cost-effectiveness analysis. It provides a summary through the incremental cost-effectiveness ratio (ICER) that is an appropriate overall measure for summarizing cost-effectiveness outcomes.
Quotes:
-
The total mean cost of pembrolizumab and SOC was US$45,861 and US$41,950, respectively.
-
As for effectiveness, pembrolizumab yielded 0.31 QALYs compared with 0.25 QALYs for SOC therapy.
-
The ICER for pembrolizumab versus SOC was US$65,186/QALY, which was higher than the willingness-to-pay threshold (WTP) of US$28,130/QALY in China.
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript discusses the impact of uncertainty on analytic judgments, particularly with sensitivity analysis that includes variations in discount rates. The choice of discount rate is reported as part of the sensitivity analysis, indicating that the effect of discount rate variation on findings was considered.
Quotes:
-
Sensitivity analysis...The value of parameters was varied one at a time by +-20% except for discount rate ranging from 0% to 8%.
-
All costs in the model were adjusted to US dollars...and discounted at a rate of 3% annually.
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not indicate that patient, service recipient, general public, community, or stakeholder involvement made a difference to the approach or findings of the study. Although there was patient representation in the KEYNOTE-040 trial, the specific cost-effectiveness analysis of the study did not involve patients or the public.
Quotes:
-
There was patient representation in the KEYNOTE-040 trial. However, patients or the public were not involved in this cost-effectiveness analysis.
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript did not address ethical or equity considerations and their impact on patients, policy, or practice. While the findings and limitations were reported, the ethical implications were not discussed.
Quotes:
-
"The main limitation of the study is that resource use in clinical trials may not represent resources in real clinical practice since clinical trials are conducted in a selected population meeting the inclusion and exclusion criteria."
-
"Pembrolizumab is not likely to be a cost-effective strategy compared with SOC therapy in patients with platinum-resistant r/mHNSCC in China."
SECTION: TITLE
Cost-effectiveness of pembrolizumab for treatment of platinum-resistant recurrent or metastatic head and neck squamous cell carcinoma in China: an economic analysis based on a randomised, open-label, phase III trial
SECTION: ABSTRACT
Background
Pembrolizumab was recently demonstrated to have survival benefit in patients with recurrent or metastatic head and neck squamous cell carcinoma (r/mHNSCC). However, the cost-effectiveness of pembrolizumab versus chemotherapy in China remains uncertain.
Objective
This analysis aimed to describe the cost-effectiveness of pembrolizumab versus standard-of-care (SOC) therapy in r/mHNSCC in China.
Design
A Markov model consisting of three health states (stable, progressive and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOCA Markov model consisting of three health states (stable, progressive and dead) was developed to compare the cost and effectiveness of pembrolizumab with SOC in platinum-resistant r/mHNSCC. Model inputs for transition probabilities and toxicity were collected from the KEYNOTE-040 trial, while health utilities were estimated from a literature review. Cost data were acquired for the payer's perspective in China.. Costs and outcomes were discounted at an annual rate of 3.0%. Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.0%. Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.Sensitivity analyses were conducted to test the uncertainties surrounding model parameters.
Outcome measures
The primary outcome was incremental cost-effectiveness ratios (ICERs), which were calculated as the cost per quality-adjusted life years (QALYs).The primary outcome was incremental cost-effectiveness ratios (ICERs), which were calculated as the cost per quality-adjusted life years (QALYs).
Results
The total mean cost of pembrolizumab and SOC was US$45 861 and US$41 950, respectively. As for effectiveness, pembrolizumab yielded 0.31 QALYs compared with 0.25 QALYs for SOC therapy. The ICER for pembrolizumab versus SOC was US$65 186/QALY, which was higher than the willingness-to-pay threshold (WTP) of US$28 130/QALY in China. The univariate sensitivity analysis indicated that utility values for progressive state, probability from stable to progressive in the SOC group, as well as cost of pembrolizumab were the three most influential variables on ICER. The probabilistic sensitivity analysis demonstrated that standard therapy was more likely to be cost-effective compared with pembrolizumab at a WTP value of US$28 130/QALY. Results were robust across both univariate analysis and probabilistic sensitivity analysis.
Conclusions
Pembrolizumab is not likely to be a cost-effective strategy compared with SOC therapy in patients with platinum-resistant r/mHNSCC in China.
Trial registration number
NCT02252042; Post-results.
SECTION: INTRO
Strengths and limitations of this study
Pembrolizumab was recently approved to have survival benefit in patients with recurrent or metastatic head and neck squamous cell carcinoma (r/mHNSCC); however, the cost-effectiveness of pembrolizumab in treating r/mHNSCC remains unknown.
To our knowledge, this is the first cost-effectiveness analysis comparing pembrolizumab with methotrexate, docetaxel or cetuximab in treating patients with r/mHNSCC.
The main limitation of the study is that resource use in clinical trials may not represent resources in real clinical practice since clinical trials are conducted in a selected population meeting the inclusion and exclusion criteria.
Introduction
Head and neck squamous cell carcinoma (HNSCC) represents a major global cause of cancer-associated morbidity and death, with a worldwide incidence of 550 000 cases and 380 000 deaths per year. After definitive treatment, approximately 30%-40% of patients with HNSCC will progress and about 50%-60% will have recurrent disease. Platinum-based systemic chemotherapy regimens are commonly used in the first-line treatment of patients with recurrent or metastatic HNSCC (r/mHNSCC). For patients with failure of first-line platinum therapy, the commonly used drug is methotrexate. The second-line drugs paclitaxel or docetaxel have a certain salvage effect if the first-line therapy does not receive the taxane. Cetuximab is also suitable for patients who have not been exposed to this drug or have poor Karnofsky performance status (KPS) score.
Checkpoint inhibitors of the programmed cell death protein 1 (PD-1) have shown impressive effects on a number of cancers. In recent years, anti-PD-1 drugs have developed rapidly in advanced HNSCC. The Food and Drug Administration (FDA) of the USA continuously approved the indications of pembrolizumab and nivolumab for treatment of recurrent or metastatic HNSCC. Indications of pembrolizumab approved by the China Food and Drug Administration include melanoma, non-small cell lung cancer and oesophageal cancer. Besides, due to the excellent tumour treatment effect, pembrolizumab is also widely used in HNSCC, small cell lung cancer, classic Hodgkin's lymphoma, primary mediastinal large B cell lymphoma, urothelial carcinoma, gastric cancer, cervical cancer, colorectal cancer and many other cancer types according to the recommendations for indications approved by FDA and several guidelines such as the National Comprehensive Cancer Network and the Chinese Society of Clinical Oncology.
The recently reported KEYNOTE-040 study found a survival benefit in patients with platinum-resistant recurrent or metastatic disease who received pembrolizumab. In this clinical trial, patients were randomly assigned to receive pembrolizumab or standard-of-care (SOC) (docetaxel, methotrexate, or cetuximab). The study showed that the median overall survival was 8.4 months (95% CI 6.4 to 9.4) in the pembrolizumab group and 6.9 months (95% CI 5.9 to 8.0) in the SOC group. Thus, pembrolizumab extended the median overall survival by 1.5 months. Also, patients in the pembrolizumab group had a favourable safety profile compared with patients in the SOC group. Although there is a significant improvement in the treatment of patients with r/mHNSCC, the prognosis remains relatively poor and the economic value of pembrolizumab in this population remains unknown. The objective of this study was to evaluate the cost-effectiveness of pembrolizumab compared with standard treatment in order to find a more cost-effective therapy in the treatment of r/mHNSCC in China.
SECTION: METHODS
Methods
Trial background
The target patients in the model were in line with the eligibility criteria for the randomised, open-label, phase III clinical trial (KEYNOTE-040). This included patients with HNSCC that progressed during or after platinum-containing therapy for recurrent and/or metastatic disease.The target patients in the model were in line with the eligibility criteria for the randomised, open-label, phase III clinical trial (KEYNOTE-040). This included patients with HNSCC that progressed during or after platinum-containing therapy for recurrent and/or metastatic disease. Patients that recurred or progressed within 3-6 months of platinum-containing therapy for locally advanced disease were also included. Patients were randomly assigned to receive either pembrolizumab or investigator's choice of SOC therapy. The same treatment mixes as in the SOC arm (26.2% methotrexate, 44.4% docetaxel, 29.4% cetuximab) were assumed in our model without adoptions, as these represent standard of care. Patients assigned to the pembrolizumab arm received 200 mg every 3 weeks intravenously. In the SOC arm, patients received 40 mg/m2 body surface area of methotrexate per week intravenously (could be increased to 60 mg/m2 in the absence of toxicity), 75 mg/m2 of docetaxel every 3 weeks intravenously, or 250 mg/m2 of cetuximab per week intravenously following a loading dose of 400 mg/m2. Treatment continued until progression was confirmed on a scan obtained at least 4 weeks later or other criteria requiring discontinuation were met.
Patient and public involvement
There was patient representation in the KEYNOTE-040 trial. However, patients or the public were not involved in this cost-effectiveness analysis.There was patient representation in the KEYNOTE-040 trial. However, patients or the public were not involved in this cost-effectiveness analysis.
Model structure
We compared the cost-effectiveness of pembrolizumab with methotrexate, docetaxel or cetuximab in patients with platinum-resistant r/mHNSCC. We conducted a Markov model using TreeAge Pro Suite (TreeAge Software, Williamstown, Massachusetts, USA) to simulate treatments, adverse events, costs, survival and quality of life among simulated patients (figure 1). The abbreviated decision tree and Markov model are presented in figure 1A. Three mutually exclusive health states, progression-free (stable state), progressive disease (cancer progression) and death, were included in the state transition diagram (figure 1B). Patients started receiving pembrolizumab or standard chemotherapy in the stable state and could stay in or move to progressive disease or death at a cycle length due to their assigned transition probabilities. The simulation was conducted in 3-week cycles for a period of 30 years, during which all patients were expected to die. Transition probabilities of every state were calculated based on the following equation: P (1 month)=1-00.5(1/median time to event). The equation was derived from P=1-e-R and R=-ln(0.5)/(time to event/number of treatment cycles). The modelled overall survival curve is presented in online supplemental figure 1A. The survival curve extracted using Engauge Digitizer software (V.4.1; http://digitizer.sourceforge.net) from clinical trials is shown in online supplemental figure 1B.
SECTION: FIG
Model structure. (A) Abbreviated decision tree and Markov model; and (B) model states and transitions.
SECTION: METHODS
Cost
Since the therapeutic drugs were administered weekly or every 3 weeks in the KEYNOTE-040 trial, the cycle length of our model was 3 weeks. Therefore, all costs we provided were for every 3 weeks. All aspects of direct medical costs for treating the disease, including the cost for pembrolizumab or standard therapy, imaging and laboratory tests, hospitalisation, administration for stable state, and the cost for subsequent therapy in progressive disease, were taken into account. Since patients randomised to the SOC arm received one of three chemotherapy regimens, the drug acquisition cost was calculated as a weighted average cost based on the patient's number of each regimen in KEYNOTE-040. In addition, time cost was estimated at US$35.73 per day on the basis of the average monthly salary in China in 2018. Supportive care cost and terminal cancer cost were also included and extracted from published articles. The incidence of adverse events comes from the KEYNOTE-040 clinical trial. Costs due to severe (grade 3-4) treatment-related adverse events were either derived from the literature or calculated from the payer's perspective in China. Costs for grade 1-2 adverse events were deemed to be negligible. All costs in the model were adjusted to US dollars based on the 2018 average exchange raAll costs in the model were adjusted to US dollars based on the 2018 average exchange rate (US$ 1=$6.6174) and discounted at a rate of 3% annually (table 1).
SECTION: TABLE
Parameters for cost-effectiveness model
Variable Value Range Distribution Source Minimum Maximum Transition probabilities Pembrolizumab Progression from stable state 0.281 0.225 0.337 Beta Death from stable state 0.079 0.063 0.095 Beta Mortality after progression 0.104 0.083 0.125 Beta Standard chemotherapy Progression from stable state 0.260 0.208 0.312 Beta Death from stable state 0.096 0.076 0.115 Beta Mortality after progression 0.140 0.112 0.168 Beta Utilities Stable state 0.650 0.500 1.000 Beta Progressive state 0.520 0.200 0.700 Beta Cost Pembrolizumab 5421 4337 6506 Gamma Calculated Standard first 1439 1151 1727 Gamma Calculated Standard 1253 1002 1503 Gamma Calculated Administration 13 10 15 Gamma Calculated Test 154 123 185 Gamma Calculated Time cost 750 600 900 Gamma Calculated Severe adverse events Pembrolizumab 1227 981 1472 Gamma Calculated Standard 5855 4684 7027 Gamma Calculated Cancer progression 2555 1677 3620 Gamma Best supportive care 157.6 126.1 191.5 Gamma Terminal cancer care 2039.4 1631.5 2447.3 Gamma
SECTION: METHODS
Utilities and outcome measures
Effectiveness was measured in quality-adjusted life years (QALY), which is equal to the survival time of the patient in a certain health state multiplied by the health utility value (quality of life weight) during that period. In this study, health utility scores were obtained from the previously published literature, with an estimation of 0.65 in the stable state per year, 0.52 in the progression state per year and 0 in the death state (table 1).
The cost-effectiveness of pembrolizumab versus methotrexate, docetaxel or cetuximab was assessed by incremental cost-effectiveness ratio (ICER), which is expressed as the incremental cost between the two treatment approaches per QALY gained. Treatments were considered 'cost-effective' if the ICER was less than a willingness-to-pay threshold (WTP) of US$28 130 per QALY. The threshold of US$28 130 per QALY was three times China's per capita gross domestic product according to the WHO recommendations for cost-effectiveness analysis.
Sensitivity analysis
Univariate analysis was performed for model parameters subject to uncertainty.ubject to uncertainty. The value of parameters was varied one at a time by +-20% except for discount rate ranging from 0% to 8%. A tornado analysis was used to rank-order the following parameters in order of potential impact on the outputs. The parameters included cost of pembrolizumab, cost of standard care, cost for stable state, cost for progressive state, probability from stable to progression, probability from stable to death, and utility for stable and progressive state.
In order to evaluate the robustness of the model to further address the uncertainty in model input parameters, probabilistic sensitivity analysis (PSA) was performed using a second-order Monte Carlo simulation.probabilistic sensitivity analysis (PSA) was performed using a second-order Monte Carlo simulation. Every time the model was run, all parameters were varied over their defined distribution (gamma distributions for costs and beta distributions for values with a range between 0 and 1) simultaneously. The simulation included 1000 iterations.
SECTION: RESULTS
Results
Base case
All patients were dead in both arms at the termination of model simulation. Patients in the pembrolizumab group yielded 0.31 QALYs compared with 0.25 QALYs for patients in the SOC group. The total cost incurred was US$45 861 in the pembrolizumab group and US$41 950 in the SOC group. These results led to an ICER of US$65 186 per QALY higher than WTP, indicating that pembrolizumab is not cost-effective compared with SOC therapy.
Sensitivity analyses
The results of univariate sensitivity analyses are depicted in the tornado diagram in figure 2. The variables with the most impact on the ICER included utility values for progressive state, probability from stable to progressive in the SOC group, as well as cost of pembrolizumab. Within the +-20% range of each variable, ICER remained US$28 130 per QALY.
SECTION: FIG
Tornado plot of the univariate sensitivity analyses for pembrolizumab versus standard-of-care therapy. ICER, incremental cost-effectiveness ratio; PEM, pembrolizumab; QALY, quality-adjusted life year; WTP, willingness-to-pay threshold.
SECTION: RESULTS
Finally, PSA over 1000 iterations was performed to vary distributions of cost, survival and utility simultaneously. The cost-effectiveness acceptability curve is displayed in figure 3A. It was demonstrated that standard therapy was more likely to be cost-effective compared with pembrolizumab at a WTP value of US$28 130 per QALY. The scatterplot of the results of each iteration is shown in figure 3B. The majority of the points were above the WTP threshold line and falling in the first quadrant, indicating that pembrolizumab was not cost-effective versus standard care.
SECTION: FIG
Probabilistic sensitivity analyses for pembrolizumab versus standard-of-care (SOC) therapy. (A) Cost-effectiveness (CE) acceptability curve; and (B) cost-effectiveness plane. PEM, pembrolizumab; QALY, quality-adjusted life years; WTP, willingness to pay.
SECTION: DISCUSS
Discussion
To our knowledge, this is the first cost-effectiveness analysis comparing pembrolizumab with methotrexate, docetaxel or cetuximab in treating patients with r/mHNSCC. Clinical data were derived from the KEYNOTE-040 trial, which demonstrated improved overall survival for pembrolizumab versus SOC therapy. Model results suggested that if we considered the conventional WTP threshold of US$28 130 per QALY as our cut-off, pembrolizumab was not cost-effective compared with standard therapy in r/mHNSCC, providing an ICER of US$65 186 per QALY. A large incremental cost and a slight benefit in health outcome led to the high ICER exceeding WTP threshold. Moreover, both univariate sensitivity analysis and PSA demonstrated robust cost-effectiveness results to uncertainty of model input parameters.
Similar economic assessments of pembrolizumab for the treatment of non-small cell lung cancer (NSCLC) in China consistently led to the same conclusion. An evaluation of pembrolizumab compared with chemotherapy for the treatment of PD-L1-positive NSCLC in China resulted in an ICER of US$103 128 per QALY. However, the results may be diverse in different countries or cancer types. Georgieva et al suggested that first-line pembrolizumab for advanced NSCLC may be cost-effective compared with platinum-doublet chemotherapy in the USA but not in the UK, despite very similar ICER values in both countries. Sarfaty et al found that second-line pembrolizumab for advanced bladder cancer might be considered cost-effective in the USA but not in the UK and Australia. The difference in cost-effectiveness and WTP thresholds between countries likely explained the difference in findings related to the cost-effectiveness of pembrolizumab.
This analysis also had several limitations. Like most cost-effectiveness analyses, resources used in clinical trials might not represent resources in actual clinical practice since clinical trials are conducted in a selected population meeting the inclusion and exclusion criteria. Also, since clinical outcomes and utilities were based on previously published studies instead of prospective data, the results in this analysis may be biased. Additionally, pembrolizumab could be a cost-effective strategy for treating patients with r/mHNSCC in developed countries with WTP thresholds greater than US$80 000. Finally, although PSA can directly reflect the influence of model uncertainty on the results, it generally assumes that the parameters are independent of each other, which may affect the credibility of the results of pharmacoeconomic evaluation. Considering that the results are still stable when the random simulations are carried out for 1000 times, we believe these are credible.
Despite the above limitations, we still believe that our analysis is reasonable. The analysis was based on the China Guidelines for Pharmacoeconomic Evaluations and Manual and the joint recommendations of the Cost-Effectiveness in Health and Medicine. Furthermore, extensive sensitivity analyses presented in this manuscript were performed to evaluate uncertainty on the outcomes. In conclusion, although pembrolizumab improves overall survival in patients with r/mHNSCC, this therapy is not a cost-effective strategy compared with standard therapy in China.
SECTION: SUPPL
Supplementary Material
WX and HD contributed equally.
Contributors: Study conception and design: WX, HD and GY. Acquisition of data: QF, XZ, YT and GX. Analysis and interpretation of data: WX and HD. Drafting of the manuscript: WX and GY. All authors revised the first draft and agreed with the final version.
Funding: This research was supported by the Natural Science Foundation of Zhejiang Province (LQ18H160018) and the Natural Science Foundation of China (81903898).
Competing interests: None declared.
Patient consent for publication: Not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: No additional data are available.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.