PMCID: 9664295 (link)
Year: 2022
Reviewer Paper ID: 14
Project Paper ID: 51
Q1 - Title(show question description)
Explanation: The title of the study specifies that it is an 'Economic evaluation' and clearly mentions the interventions being compared, which are FLOT and ECF/ECX perioperative chemotherapy.
Quotes:
-
Economic evaluation of FLOT and ECF/ECX perioperative chemotherapy in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma.
Q2 - Abstract(show question description)
Explanation: The abstract provides a general and descriptive summary rather than a structured one that includes specific headings such as context, key methods, results, and alternative analyses. It lacks explicit distinct sections for each of these categories, and it predominantly focuses on the objective, design, primary outcome, and conclusion without detailing the methodology or alternative analyses.
Quotes:
-
Objective: The perioperative chemotherapy with fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) was recommended... However, the economic impact of FLOT chemotherapy in China remains unclear.
-
Design: We developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECX...
-
Outcome measures: The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).
-
Conclusions: For patients with locally advanced resectable tumours, the FLOT chemotherapy is a cost-effective treatment option compared with ECF/ECX in China.
Q3 - Background and objectives(show question description)
Explanation: The introduction of the manuscript provides a comprehensive overview of the context for the study, laying out the prevalence of gastric cancer, the current treatment options, and the need for more effective chemotherapy regimens. It highlights the specific investigational question of FLOT's cost-effectiveness compared to ECF/ECX within the context of Chinese healthcare policy. Furthermore, it addresses the practical relevance by discussing the economic burden and the need for cost-effective treatment solutions.
Quotes:
-
According to the latest global cancer burden data in 2020 released by the International Agency for Research on Cancer of the WHO, China ranked first in the cancer-related deaths with approximately 480 000 cases recorded. Gastric cancer is the third most prevalent malignant tumour in the world and the third leading cause of cancer-related death in China.
-
Considering the high prevalence of gastric or gastro-oesophageal junction cancer, and limited health resources in China, the therapeutical benefits of FLOT chemotherapy must be weighed against the economic burden that it has imposed.
-
This study aimed to evaluate whether the perioperative chemotherapy FLOT is cost-effective compared with ECF/ECX among patients with gastric and gastro-oesophageal junction adenocarcinoma from the perspective of Chinese medical system.
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript does not mention a health economic analysis plan being specifically developed or where it might be available. The focus is on using a Markov model based on the FLOT4 trial data, but there's no direct reference to an explicit, separate health economic analysis plan.
Quotes:
-
In response to the positive results from FLOT4 trial, FLOT chemotherapy is recommended for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma (class IIA) by the CSCO Guidelines for gastric cancer (2018 edition).
-
Based on the FLOT4 trial, a Markov model was constructed using Treeage Pro 2018 software to estimate the clinical outcomes of two perioperative chemotherapy regimens (FLOT and ECF/ECX) for patients with gastric and gastro-oesophageal junction adenocarcinoma in China.
-
A willingness-to-pay (WTP) threshold of US$31 513 was used in the current analysis. This is based on the WHO recommendation based on which a health intervention should be considered as cost-effective if the ICER is between one and three times the gross domestic product (GDP) per capita of that country.
Q5 - Study population(show question description)
Explanation: The manuscript does not provide specific details about the characteristics of the study population, such as age range, demographics, socioeconomic status, or clinical characteristics. It only mentions that the patient population analyzed mirrored those in the FLOT4 clinical trial.
Quotes:
-
The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma.
Q6 - Setting and location(show question description)
Explanation: The manuscript provides relevant contextual information about the study setting and location, which can influence the findings. It specifies the patient population as those in China, and the study is conducted from the perspective of the Chinese healthcare system, highlighting specific economic factors like drug costs and GDP relevant to China.
Quotes:
-
"The analysis aimed to compare the cost-effectiveness of FLOT versus epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) in patients with locally advanced resectable tumours in China."
-
"Costs were estimated from the perspective of Chinese healthcare system."
-
"Considering the high prevalence of gastric or gastro-oesophageal junction cancer, and limited health resources in China, the therapeutical benefits of FLOT chemotherapy must be weighed against the economic burden that it has imposed."]}
Q7 - Comparators(show question description)
Explanation: The interventions being compared, FLOT and ECF/ECX chemotherapy regimens, are clearly described in the manuscript. The rationale for their selection is based on previous trial comparisons and guidelines recommendations.
Quotes:
-
The perioperative chemotherapy with fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) was recommended by the Chinese Society of Clinical Oncology Guidelines for gastric cancer (2018 edition) for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma (class IIA).
-
In the phase II/III clinical trials of FLOT4, the researchers compared the perioperative chemotherapy fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) with the standard chemotherapy epirubicin, cisplatin, fluorouracil or capecitabine (ECF/ECX).
-
In response to the positive results from FLOT4 trial, FLOT chemotherapy is recommended for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma (class IIA) by the CSCO Guidelines for gastric cancer (2018 edition).
-
The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma.
Q8 - Perspective(show question description)
Explanation: The study adopted the perspective of the Chinese healthcare system to assess the economic impact of FLOT chemotherapy. This perspective was chosen to evaluate the cost-effectiveness and financial impact of the chemotherapy in a healthcare context specific to China, given the high prevalence of gastric cancer and limited health resources in the country.
Quotes:
-
Costs were estimated from the perspective of Chinese healthcare system.
-
This study aimed to evaluate whether the perioperative chemotherapy FLOT is cost-effective compared with ECF/ECX among patients with gastric and gastro-oesophageal junction adenocarcinoma from the perspective of Chinese medical system.
Q9 - Time horizon(show question description)
Explanation: The study uses a lifetime horizon, which is appropriate for capturing the long-term outcomes of chemotherapy treatments where survival benefits and costs accrue over a patient's lifetime. This allows for a comprehensive evaluation of cost-effectiveness given that the treatments affect long-term survival and quality of life.
Quotes:
-
From the perspective of Chinese medical system, we used a lifetime horizon and a half-cycle correction to estimate the total cost, quality-adjusted life year (QALY) and incremental cost-effectiveness ratio (ICER).
Q10 - Discount rate(show question description)
Explanation: The manuscript states that the annual discount rate for both costs and health outcomes was set at 5%. The rationale for choosing this rate aligns with the Chinese Guidelines for Pharmacoeconomic Evaluations, which recommend such a discount rate.
Quotes:
-
The annual discount rate for costs and health outcomes was set at 5%.
-
According to the Chinese Guidelines for Pharmacoeconomic Evaluations, the annual discount rate for both costs and health outcomes was set at 5%.
Q11 - Selection of outcomes(show question description)
Explanation: The article specifies that the primary outcome measure of benefit and harm was the incremental cost-effectiveness ratio (ICER) measured in cost per quality-adjusted life years (QALYs).
Quotes:
-
The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).
-
The economic and health results calculated by the model are displayed in table 4. The QALYs associated with the FLOT (4.08 QALYs) chemotherapy was longer than that with ECF/ECX (3.0 QALYs).
Q12 - Measurement of outcomes(show question description)
Explanation: The article specifies that outcomes were measured using incremental cost-effectiveness ratios (ICERs) which were expressed as costs per quality-adjusted life years (QALYs). The article describes how endpoints like progression-free survival (PFS) and overall survival (OS) were captured using a Markov model approach which begins with patients in the PFS state and progresses through health states.
Quotes:
-
The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).
-
The model comprised three mutually exclusive health states: progression-free survival (PFS), progressed survival (PS) and death. The Markov cycle length was set as 2 weeks to fit the treatment schedule of the two groups. At the beginning of the model, the whole cohort was in PFS state, and the transitions between health states in the model may occur during each Markov cycle.
-
Utility... The utility related to gastric cancer was taken from the literatures. Therefore, 0.68 (1-5 years) and 0.81 (5-10 years) were used as the utilities of patients with PFS health state in both groups.
Q13 - Valuation of outcomes(show question description)
Explanation: The manuscript describes the patient population and methods used in the study. It includes a description of the patient population, which mirrors the enrollees of the FLOT4 randomized controlled trial, and the methods involve comparative analysis using a Markov model to estimate health and economic outcomes based on quality-adjusted life years (QALYs).
Quotes:
-
The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma.
-
We developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECX in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma. Costs were estimated from the perspective of Chinese healthcare system. Clinical and utility inputs were derived from the FLOT4 phase II/III clinical trial and published literature.
-
The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The costs in the study were valued from the perspective of the Chinese healthcare system and included direct healthcare expenditures such as drug and administration costs, AE management, follow-up examination, second-line treatment, supportive treatment, and surgery costs.
Quotes:
-
Costs were estimated from the perspective of Chinese healthcare system.
-
From the perspective of Chinese medical system, we considered the direct healthcare expenditure costs in the model, including drug and administration costs, AE management costs, follow-up examination costs, second-line treatment costs, supportive treatment costs and surgery treatment costs.
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript specifies that the costs have been adjusted based on the 2020 consumer price index and mentions the conversion to the 2020 currency year using an exchange rate of US$1=$6.88.
Quotes:
-
"All costs used in the model were adjusted based on the consumer price index provided by the People's Bank of China and the US$ to $ in 2020 (US$1=$6.88)."
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript describes in detail the use of a Markov model, including its construction based on the FLOT4 trial, and the rationale for its use in estimating economic and health outcomes of the chemotherapy regimens. However, the manuscript does not explicitly state whether the model itself is publicly available for access.
Quotes:
-
We developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECX in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma.
-
Based on the FLOT4 trial, a Markov model was constructed using Treeage Pro 2018 software to estimate the clinical outcomes of two perioperative chemotherapy regimens (FLOT and ECF/ECX) for patients with gastric and gastro-oesophageal junction adenocarcinoma in China.
-
The model comprised three mutually exclusive health states: progression-free survival (PFS), progressed survival (PS) and death.
-
Data are available in a public, open access repository.
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript details specific methods for data analysis and statistical transformation, including the use of a Markov model, extrapolation techniques with survival curves, and statistical tests for model validation.
Quotes:
-
"We developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECX..."
-
"The transitions between health states in the model may occur during each Markov cycle. From the perspective of Chinese medical system, we used a lifetime horizon and a half-cycle correction to estimate the total cost, quality-adjusted life year (QALY) and incremental cost-effectiveness ratio (ICER)."
-
"GetDataGraph Digitizer software V.2.24 was used to extract datapoints from published PFS and OS curves... fitted with different parametric survival models (including exponential, weibull, lognormal and log-logistic)."
-
"The result of statistical goodness-of-fit test using Akaike information standard and Bayesian information criterion, the log-logistic distribution was selected for survival fitting."
Q18 - Characterizing heterogeneity(show question description)
Explanation: The article mentions the use of sensitivity analyses to assess the variation in cost-effectiveness estimates across different sub-groups. One-way sensitivity analysis and probabilistic sensitivity analysis were performed to evaluate how changes in parameters such as hazard ratios and costs affected the incremental cost-effectiveness ratios.
Quotes:
-
Sensitivity analyses were employed to assess the robustness of our result.
-
One-way sensitivity analysis was performed to investigate the impact of individual changes in model parameters on our model results.
-
We also performed a 10 000 repeated Monte Carlo probabilistic sensitivity analyses to evaluate the impact of simultaneous changes in parameters on the model results.
Q19 - Characterizing distributional effects(show question description)
Explanation: The manuscript does not mention any adjustments for priority populations or specific distribution of impacts among different individuals. The analysis focused on comparing the cost-effectiveness of two chemotherapy regimens (FLOT and ECF/ECX) without mentioning adjustments for different populations.
Quotes:
-
The analysis aimed to compare the cost-effectiveness of FLOT versus epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) in patients with locally advanced resectable tumours.
-
The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma.
Q20 - Characterizing uncertainty(show question description)
Explanation: The manuscript describes the use of sensitivity analyses to characterize sources of uncertainty in the analysis. Specifically, it employs one-way sensitivity analysis and Monte Carlo probabilistic sensitivity analysis to assess the impact of changes in model parameters on the results.
Quotes:
-
One-way sensitivity analysis was performed to investigate the impact of individual changes in model parameters on our model results, the results are shown as a tornado diagram.
-
We also performed a 10 000 repeated Monte Carlo probabilistic sensitivity analyses to evaluate the impact of simultaneous changes in parameters on the model results.
-
In the probabilistic sensitivity analyses... A lognormal distribution was applied for the cost data and a beta distribution was applied for the utility value, probability or proportion.
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript explicitly states that patients and/or the public were not involved in the design, conduct, reporting, or dissemination plans of the research, thus indicating that there was no engagement of these groups in the study design.
Quotes:
-
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Q22 - Study parameters(show question description)
Explanation: The manuscript provides detailed information about the analytic inputs, study parameters, and references, as well as information on uncertainty and distributional assumptions involved in the cost-effectiveness analysis of the chemotherapy regimens. Probabilistic sensitivity analyses were also conducted to assess uncertainty.
Quotes:
-
PFS and overall survival (OS) data were derived from the Kaplan-Meier survival curve in the trial. First, we used GetDataGraph Digitizer software V.2.24 to extract datapoints from published PFS and OS curves in the publications... these extracted point data were fitted with different parametric survival models... the log-logistic distribution was selected for survival fitting.
-
One-way sensitivity analysis was performed to investigate the impact of individual changes in model parameters... We also performed a 10,000 repeated Monte Carlo probabilistic sensitivity analyses to evaluate the impact of simultaneous changes in parameters on the model results, including cost data applied with a lognormal distribution and utility value with a beta distribution.
Q23 - Summary of main results(show question description)
Explanation: The manuscript reports the mean values for primary cost categories like drug, administration, and adverse event management costs, total costs for both chemotherapy regimens, as well as outcomes in terms of QALYs for both treatments. These were appropriately summarized using the incremental cost-effectiveness ratio (ICER), a standard measure in economic evaluations.
Quotes:
-
Compared with the cost of ECF/ECX regimen of US$45 311.91, the direct medical costs of FLOT regimen was increased by US$921.51 (US$46 233.42 vs US$45 311.91).
-
“The economic and health results calculated by the model are displayed in table 4. The QALYs associated with the FLOT (4.08 QALYs) chemotherapy was longer than that with ECF/ECX (3.0 QALYs), and the FLOT achieved an increase of 1.08 QALYs over the course of disease.”
-
The corresponding ICER of the FLOT regimen was US$850.68 per QALY.
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript reports on how uncertainty affected the economic evaluation of the FLOT regimen versus ECF/ECX. Sensitivity analyses were performed, including varying the discount rate, to assess the robustness of the economic model results. The effect of the choice of discount rate is specifically mentioned as a factor that could influence the model results, and it is included in the sensitivity analysis range from 0% to 8%.
Quotes:
-
The annual discount rate for costs and health outcomes was set at 5%.
-
In accordance with Chinese Guidelines for Pharmacoeconomic Evaluations, the discount rate in this analysis was assumed to vary between 0% and 8%.
-
The one-way sensitivity analysis showed that the most influential parameter on the model results was the HR of OS... Other sensitive parameters included the HR of PFS, the proportion of patients with ECF/ECX who underwent surgery and the discount rate.
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript explicitly states that there was no patient or public involvement in the design or approach of the study. This implies that such involvement did not influence the study's approach or findings.
Quotes:
-
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript mentions key findings about cost-effectiveness and limitations such as uncertainty beyond the trial period. However, there is no mention of ethical or equity considerations, nor the potential impact on policy or practice, particularly in terms of patient outcomes or societal implications.
Quotes:
-
There are some limitations in the current study. First, there is uncertainty regarding the outcomes of patients with gastric and gastro-oesophageal junction adenocarcinoma beyond the trial period, despite the use of validated extrapolation techniques.
-
Second, some potential bias lied in only direct medical costs were incorporated in the model; however, our sensitive analysis found that our results were almost unaffected by changes in costs.
-
Ethics approval: Not applicable.
SECTION: TITLE
Economic evaluation of FLOT and ECF/ECX perioperative chemotherapy in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma
SECTION: ABSTRACT
Objective
The perioperative chemotherapy with fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) was recommended by the Chinese Society of Clinical Oncology Guidelines for gastric cancer (2018 edition) for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma (class IIA). However, the economic impact of FLOT chemotherapy in China remains unclear. The analysis aimed to compare the cost-effectiveness of FLOT versus epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) in patients with locally advanced resectable tumours..
Design
We developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECXWe developed a Markov model to compare the healthcare and economic outcomes of FLOT and ECF/ECX in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma.. Costs were estimated from the perspective of Chinese healthcare system.Costs were estimated from the perspective of Chinese healthcare system. Clinical and utility inputs were derived from the FLOT4 phase II/III clinical trial and published literature. Sensitivity analyses were employed to assess the robustness of our result. The annual discount rate for costs and health outcomes was set at 5%.
Outcome measures
The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).The primary outcome of incremental cost-effectiveness ratios (ICERs) was calculated as the cost per quality-adjusted life years (QALYs).
Results
The base-case analysis found that compared with ECF/ECX, the use of FLOT chemotherapy was associated with an additional 1.08 QALYs, resulting in an ICER of US$851/QALY. One-way sensitivity analysis results suggested that the HR of overall survival and progression-free survival had the greatest impact on the ICER. Probabilistic sensitivity analysis demonstrated that FLOT was more likely to be cost-effective compared with ECF/ECX at a willingness-to-pay threshold of US$31 513/QALY.
Conclusions
For patients with locally advanced resectable tumours, the FLOT chemotherapy is a cost-effective treatment option compared with ECF/ECX in China.
Trial registration number
NCT01216644.
SECTION: INTRO
Strengths and limitations of this study
Perioperative fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) significantly improved overall survival compared with perioperative epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) in patients with locally advanced, resectable gastric or gastro-oesophageal junction adenocarcinoma. However, the cost-effectiveness of perioperative FLOT among Chinese patients remains unknown.
To our knowledge, this is the first cost-effectiveness analysis comparing FLOT with ECF/ECX for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma in China.
The use of data in clinical trials may not represent the data in real clinical practice because clinical trials have certain time constraints. For example, we used log-logistic distribution to extrapolate survival beyond the lifetime horizon of the trial.
Introduction
According to the latest global cancer burden data in 2020 released by the International Agency for Research on Cancer of the WHO, China ranked first in the cancer-related deaths with approximately 480 000 cases recorded. Gastric cancer is the third most prevalent malignant tumour in the world and the third leading cause of cancer-related death in China.
Although significant progress has been made in early detection, the prognosis of patients with resectable gastric and gastro-oesophageal junction adenocarcinoma is still poor. Perioperative chemotherapy, adjuvant chemotherapy and adjuvant chemoradiotherapy had demonstrated their superior survival benefit in patients with this disease when compared with a simple surgery. Based on this, perioperative chemotherapy is recommended as the preferred treatment for locally resectable diseases. For patients whose surgical scope is less than D2 lymph node dissection, postoperative chemoradiotherapy is the preferred treatment. Other treatment strategies, such as postoperative chemotherapy, are applicable to patients who have undergone primary lymph node dissection. In Asian countries, accumulating clinical evidence has shown that, compared with D2 gastrectomy alone, adjuvant chemotherapy after a D2 surgery significantly improves the tumour remission rate and R0 resection rate is associated with a favourable safety profile.
The Medical Research Council Adjuvant Gastric Infusion Chemotherapy trial was the first clinical trial to confirm the survival benefits of perioperative chemotherapy. In this trial, 503 patients with locally advanced resectable gastric and gastro-oesophageal junction adenocarcinoma were enrolled and were randomly assigned to receive three cycles of epirubicin, cisplatin and fluorouracil (ECF) chemotherapy or surgery alone. The survival rate in the chemotherapy group was significantly higher than the simple surgery group (5-year survival rate, 36% vs 23%). The FNCLCC/FFCD II/III trial (multicenter phase trial) also found that perioperative chemotherapy for gastric cancer provided greater survival benefits than the surgery alone. According to the trial evidence, the National Comprehensive Cancer Network Clinical (NCCN) Guidelines recommended perioperative chemotherapy as a routine regimen for advanced gastric cancer (class I evidence) in 2022, and a standard adjuvant chemotherapy for gastro-oesophageal adenocarcinoma. Subsequently, the Chinese Society of Clinical Oncology (CSCO) Guidelines recommended several chemotherapy regimens as preferred schemes, including cisplatin combined with fluorouracil (PF), improved ECF scheme, oxaliplatin combined with capecitabine, oxaliplatin combined with fluorouracil and oxaliplatin combined with S-1 (SOX). Although the great progress had been made on chemotherapies, the clinical prognosis of patients with advanced gastric or gastro-oesophageal junction cancer is still unsatisfactory, especially those with advanced cancers. In view of this, there is a pressing need for any novel chemotherapy regimen with a greater effectiveness than the existing ones.
In the phase II/III clinical trials of FLOT4, the researchers compared the perioperative chemotherapy fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) with the standard chemotherapy epirubicin, cisplatin, fluorouracil or capecitabine (ECF/ECX). Fluoropyrimidine and platinum combined with or without anthracycline are the most used chemotherapeutic regimen. In the FLOT4 trial, adding docetaxel to triple-drug regimen (FLOT regimen) was associated with improved survivals among patients with resectable gastric or gastro-oesophageal junction cancer with clinical stage CT2 or higher and lymph node positive (CN+) when compared with ECF/ECX regimen (50 months vs 35 months; HR=0.77; 95% CI, 0.63 to 0.94). In this phase II/III trial, the proportion of patients with complete regression of pathology was significantly higher in the FLOT group than that in the ECF/ECX group. In addition, compared with the ECF/ECX group, patients in the FLOT group had a lower incidence of grade 3-4 adverse events (AEs), including neutropenia, leucopenia, nausea, infection, fatigue and vomiting (25% vs 40%), but had the same incidence of serious chemotherapy-related AEs (27% in both groups).
In response to the positive results from FLOT4 trial, FLOT chemotherapy is recommended for patients with resectable gastric or gastro-oesophageal junction adenocarcinoma (class IIA) by the CSCO Guidelines for gastric cancer (2018 edition). However, its financial impact has not been studied yet from the perspective of Chinese healthcare system. Considering the high prevalence of gastric or gastro-oesophageal junction cancer, and limited health resources in China, the therapeutical benefits of FLOT chemotherapy must be weighed against the economic burden that it has imposed. This study aimed to evaluate whether the perioperative chemotherapy FLOT is cost-effective compared with ECF/ECX among patients with gastric and gastro-oesophageal junction adenocarcinoma from the perspective of Chinese medical system.
SECTION: METHODS
Methods
Patients and regimens
The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma.The patient population analysed in this study mirrored the patient enrolled in the FLOT4 randomised controlled trial, which assessed the clinical efficacy of FLOT and ECF/ECX chemotherapies in patients with gastric and gastro-oesophageal junction adenocarcinoma. In this study, a total of 716 patients were randomly assigned to receive FLOT (356 cases) or ECF/ECX (360 cases). Patients in the ECF/ECX group received three 3-week cycles preoperative chemotherapy and three 3-week cycles postoperative chemotherapy. The chemotherapy regimen for each 3-week cycle was epirubicin 50 mg/m2 on the first day, cisplatin 60 mg/m2 on the first day and continuous intravenous infusion of PF 200 mg/m2 or oral capecitabine 1250 mg/m2 from the first to the 21st days at the discretion of investigators. Patients in the FLOT group received four 2-week cycles preoperative chemotherapy and four 2-week cycles postoperative chemotherapy, which were docetaxel 50 mg/m2 on the first day, oxaliplatin 85 mg/m2 on the first day, calcium folinate 200 mg/m2 on the first day and 5-FU 2600 mg/m2 as 24 hours infusion the first day.
The operation was scheduled 4 weeks after the last preoperative chemotherapy. The interval between the two groups was 4 weeks (28 days). As per this clinical trial, patients may discontinue treatment due to unacceptable toxicity, disease progression, death or patient requirements. When patients experienced disease progression, they would receive second-line treatment, including irinotecan, calcium folinate and PF.
Patient and public involvement
There was patient representation in the FLOT4 trial. However, this cost-effectiveness analysis does not involve human participants.
Analytic model
Based on the FLOT4 trial, a Markov model was constructed using Treeage Pro 2018 software to estimate the clinical outcomes of two perioperative chemotherapy regimens (FLOT and ECF/ECX) for patients with gastric and gastro-oesophageal junction adenocarcinoma in China (figure 1).
SECTION: FIG
Markov model structure of fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) and epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) strategies for the treatment of patients with locally advanced, resectable gastric or gastro-oesophageal junction adenocarcinoma.
SECTION: METHODS
The model comprised three mutually exclusive health states: progression-free survival (PFS), progressed survival (PS) and death. The Markov cycle length was set as 2 weeks to fit the treatment schedule of the two groups. At the beginning of the model, the whole cohort was in PFS state, and the transitions between health states in the model may occur during each Markov cycle. From the perspective of Chinese medical system, we used a lifetime horizon and a half-cycle correction to estimate the total cost, quality-adjusted life year (QALY) and incremental cost-effectiveness ratio (ICER). According to the Chinese Guidelines for Pharmacoeconomic Evaluations, the annual discount rate for both costs and health outcomes was set at 5%. All costs used in the model were adjusted based on the consumer price index provided by the People's Bank of China and the US$ to $ in 2020 (US$1=$6.88). A willingness-to-pay (WTP) threshold of US$31 513 was used in the current analysis. This is based on the WHO recommendation based on which a health intervention should be considered as cost-effective if the ICER is between one and three times the gross domestic product (GDP) per capita of that country. At this point, it should be mentioned that this WTP threshold has been widely used in cost-effectiveness studies within global health. The GDP per capita in China was estimated at US$10 504 in 2020.
PFS and overall survival (OS) data were derived from the Kaplan-Meier survival curve in the trial. First, we used GetDataGraph Digitizer software V.2.24 to extract datapoints from published PFS and OS curves in the publications (http://getdata-graph-digitizer.com). Then, these extracted point data were fitted with different parametric survival models (including exponential, weibull, lognormal and log-logistic). According to the result of statistical goodness-of-fit test using Akaike information standard and Bayesian information criterion, the log-logistic distribution was selected for survival fitting. The two parameters of log-logistic distribution, scale parameters (theta) and shape parameters (kappa) are shown in table 1. Finally, we used the parameters to calculate survival rate, which is , where t is time. Figure 2 shows the log-logistic parameters estimated for the FLOT and ECF/ECX regimens.
SECTION: TABLE
Log-logistic parameters
Parameters Values Log-logistic survival model of PFS ECF/ECX theta=0.05168663kappa=1.004703 FLOT theta=0.03274242kappa=0.9957772 Log-logistic survival model of OS ECF/ECX theta=0.02849954kappa=1.369613 FLOT theta=0.022184kappa=1.279334
theta indicates scale and kappa indicates shape.
ECF/ECX, docetaxel, oxaliplatin, leucovorin, fluorouracil; FLOT, epirubicin, cisplatin, fluorouracil or capecitabine.
SECTION: FIG
The log-logistic curves of (A) disease-free survival and (B) overall survival. ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel; OS, overall survival; PFS, progression-free survival.
SECTION: METHODS
Utility
Since the quality of life data were not published along with the results of the FLOT4 trial, the utility related to gastric cancer was taken from the literatures. Gockel et al used the Gastrointestinal Life Quality Index to evaluate the quality of life of 338 patients with gastrectomy, and then estimated the utility of patients with PFS health state as 0.81. In addition, Sakamaki et al used the time trade-off to evaluate the utility of hospitalised patients with gastric cancer. In their study, the utilities of patients receiving intravenous chemotherapy and advanced care were 0.68 and 0.50, respectively. In the current model, we assumed that the utilities of the three health states were identical in both groups. Therefore, 0.68 (1-5 years) and 0.81 (5-10 years) were used as the utilities of patients with PFS health state in both groups. In addition, the utility of patients in PS health state was set to 0.5 and the utility of patients who survived for more than 10 years was set to 1.0. The disutility of AEs was calculated by multiplying the utility decrement due to AEs by the incidence of AEs. We assumed that all AEs occurred in the first cycle.
Cost
From the perspective of Chinese medical system, we considered the direct healthcare expenditure costs in the model, including drug and administration costs, AE management costs, follow-up examination costs, second-line treatment costs, supportive treatment costs and surgery treatment costs. Drug and administration costs, follow-up examination costs and drug price were extracted from the local health system. To calculate the dosage of chemotherapeutic drug, we assumed that a baseline patient's weight was 65 kg and body surface area was 1.72 m2.
After disease progressed, 25% of the patients in both groups who would receive second-line treatment and the second-line chemotherapy regimen was selected from the FLOT4 trial. When the patient experienced further disease progression, they would receive supportive treatments until death. The second-line chemotherapy regimen included intravenous injection of irinotecan 180 mg/m2 on days 1, calcium folinate 400 mg/m2 on days 1, PF 400 mg/m2 on day 1, continuous intravenous injection of PF 1200 mg/m2 for more than 24 hours on day 1 and day 2, and circulation every 14 days. Data of the costs for drug administration, supportive and surgery treatments were extracted from the published literature. The follow-up examination included CT or MRI every 3 months until disease progression, recurrence or death. The price of CT or MRI came from the local health system. According to expert suggestions and clinical practice, we calculated the grade 3-4 AEs with a significant difference (p0.05) between the two groups. Therefore, according to the data available in the FLOT4 trial, the following AEs were included in the model: vomiting (F/E:2%/8%), nausea (F/E:7%/16%), neutropenia (F/E:51%/39%), anaemia (F/E:3%/6%), infections (F/E:18%/9%) and diarrhoea (F/E:10%/4%). Costs for treating AEs were estimated by multiplying the cost per event by the incidence of each AE. The incidences of AEs were obtained from the FLOT4 trial and the unit cost were from the published literature. Table 2 lists all direct costs used in the model.
SECTION: TABLE
Baseline costs with ECF/ECX and FLOT perioperative chemotherapy in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma in China
Parameters Median Range Distribution Reference Costs, US$ Drug of FLOT per episode 352.1896 286.03-429.04 Lognormal Drug of ECF/ECX per episode 270.8938 220.00-330.00 Lognormal CT per 3 months* 60.2 30.1-90.3 Gamma MRI per 3 months* 123.3 61.7-185 Gamma Administration per episode 12.33 9.87-14.8 Lognormal Supportive care per episode 943.6 681.87-1347.66 Lognormal Surgery 13 638.2 10 910.56-16 365.84 Lognormal Expenditures on main adverse events (grade 3 or 4), US$ FLOT 808.36 424.81-1303.83 Lognormal ECF/ECX 507.04 253.64-840.57 Lognormal
*The range was assumed to be varied +-50%.
ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel.
SECTION: METHODS
Sensitivity analyses
One-way sensitivity analysis was performed to investigate the impact of individual changes in model parameters on our model results, the results are shown as a tornado diagram. The median, distribution and range of model input parameters are shown in tables 2 and 3, and the ranges corresponding to the model parameters were derived from the published literature or within a reasonable range (+-20% or +-50% of the base-case value). In accordance with Chinese Guidelines for Pharmacoeconomic Evaluations, the discount rate in this analysis was assumed to vary between 0% and 8%. We also performed a 10 000 repeated Monte Carlo probabilistic sensitivity analyses to evaluate the impact of simultaneous changes in parameters on the model results. In this probabilistic sensitivity analyses, each variable was randomly sampled from the appropriate distribution. A lognormal distributioWe also performed a 10 000 repeated Monte Carlo probabilistic sensitivity analyses to evaluate the impact of simultaneous changes in parameters on the model results. In this probabilistic sensitivity analyses, each variable was randomly sampled from the appropriate distribution. A lognormal distribution was applied for the cost data and a beta distribution was applied for the utility value, probability or proportion. The result of PSA was depicted by a cost-effectiveness acceptability curve (CEAC).
SECTION: TABLE
Baseline risks and utility values with ECF/ECX and FLOT perioperative chemotherapy in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma in China
Parameters Median Range Distribution Reference Risk for main adverse events in ECF/ECX arm (grade 3 or 4)* Nausea and vomiting 0.24 0.192-0.288 Beta Neutropenia 0.39 0.312-0.468 Beta Anaemia 0.06 0.048-0.072 Beta Diarrhoea 0.04 0.032-0.048 Beta Infections 0.09 0.072-0.108 Beta Risk for requiring second-line chemotherapy* 0.25 0.2-0.3 Beta Utility* 1-5 years in PFS for ECF/ECX arm 0.68 0.56-0.76 Beta 5-10 years in PFS for ECF/ECX arm 0.81 0.648-0.972 Beta 1-5 years in PFS for FLOT arm 0.68 0.56-0.76 Beta 5-10 years in PFS for FLOT arm 0.81 0.648-0.972 Beta Beyond 10 years for two arms 1 - - PS in two arms 0.5 0.4-0.6 Beta
*The range was assumed to be varied +-20%.
ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel; PFS, progression-free survival; PS, progression survival.
SECTION: RESULTS
Result
The economic and health results calculated by the model are displayed in table 4. The QALYs associated with the FLOT (4.08 QALYs) chemotherapy was longer than that with ECF/ECX (3.0 QALYs), and the FLOT achieved an increase of 1.08 QALYs over the course of disease. Compared with the cost of ECF/ECX regimen of US$45 311.91, the direct medical costs of FLOT regimen was increased by US$921.51 (US$46 233.42 vs US$45 311.91). The corresponding ICER of the FLOT regimen was US$850.68 per QALY. A detailed analysis of cost breakdown (table 5) shows that FlOT increased the second lines of treatment and supportive treatment costs in US$1080.41, plus US$473.34 in drug costs, but allows to save US$1264.89 in the management of the patient. Other cost groups were similar between treatments.
SECTION: TABLE
The base-case model results for two treatments
Model outcome Treatment strategy ECF/ECX FLOT Costs in PFS (US$) 16 250.09 16 060.58 Costs in PS (US$) 29 061.82 30 172.84 Costs of total (US$) 45 311.91 46 233.42 QALYs in PFS (QALY) 2.44 3.5 QALYs in PS (QALY) 0.56 0.58 QALYs of total (QALY) 3 4.08 CER (US$/QALY) 15 103.97 11 331.72059 ICER for FLOT (US$/QALY) - 850.68
ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel; ICER, incremental cost-effectiveness ratio; PFS, progression-free survival; PS, progressed survival; QALYs, quality-adjusted life years.
Cost breakdown base-case results
Cost breakdown (US$) FLOT ECF/ECX Incremental Cost of administration 380.28 336.72 43.56 Cost of management 493.33 1758.22 -1264.89 Second lines of treatment and supportive treatment 29 341.43 28 261.02 1080.41 Cost of adverse events 748.36 453.18 295.18 Cost of surgery 13 019.22 12 725.29 293.93 Drug costs 2250.81 1777.47 473.34
ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel.
SECTION: RESULTS
Tornado diagram (figure 3) revealed that the HR of OS was the most influential parameter in our model. When the HR of OS was increased from 0.63 to 0.94, the ICERs ranged from US$3868.18 per QALY to US$-16 856.98 per QALY. Other influential parameters included the HR of PFS, the proportion of surgery patients in the ECF/ECX chemotherapy group and the discount rate. Parameters that have a minor influence on the model included the proportion of AEs, such as nausea, diarrhoea and vomiting (grade 3 or 4). In generally, the ICERs remained below the WTP US$31 513 (three times of China's per capita GDP) within the fluctuation of all parameters.
SECTION: FIG
Tornado diagram for univariable sensitivity analyses. The grey dotted line represents the incremental cost-effectiveness ratio of US$850.6842 per quality-adjusted life year from the base-case results. ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel; OS, overall survival; PFS, progression-free survival.
SECTION: RESULTS
The ICER scatter plot (figure 4) shows the results of the probabilistic sensitivity analyses, including a set of points representing the incremental cost and benefit value pairs in Monte Carlo simulation (10 000 repetitions). The slash is the WTP threshold line, and 95% CIs of the estimates are surrounded by the ellipse. It can be seen from figure 4 that ICER is mostly distributed in the first and fourth quadrants and below the threshold line. The plot below the threshold line accounted for 99.5% of all scatter plots, indicating that the possibility of FLOT chemotherapy regimen being cost-effective compared with the ECF/ECX treatment was 99.5%.
SECTION: FIG
The results of Monte Carlo probabilistic sensitivity analysis for the strategies of fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) versus epirubicin, cisplatin plus fluorouracil or capecitabine (ECF/ECX) in scatter plots. The solid lines indicate the US$31 513 threshold. The estimates of 95% were surrounded in the ellipses. WTP, willingness to pay.
SECTION: RESULTS
The CEAC (figure 5) shows the cost-effectiveness probabilities of the FLOT chemotherapy generated by Markov Model simulation at different cost-effectiveness thresholds. The cost-effectiveness probability of the FLOT chemotherapy was increased with the increasing WTP thresholds. When the WTP threshold was greater than US$699.2/QALY, the probability of the FLOT chemotherapy being cost-effective was nearly 50% for patients with resectable gastric or gastro-oesophageal junction cancer. When the threshold exceeded US$17 090/QALY, the cost-effectiveness possibility of the FLOT chemotherapy reached 99%.
SECTION: FIG
Acceptability curves for the two strategies at willingness-to-pay (WTP) thresholds in locally advanced, resectable gastric or gastro-oesophageal junction adenocarcinoma patients. The vertical dashed line represents the threshold that the cost-effectiveness probability of fluorouracil, leucovorin, oxaliplatin plus docetaxel (FLOT) chemotherapy reached 99%, and the solid line represents the WTP threshold of US$10 504 (the per capita gross domestic product in China). ECF/ECX, epirubicin, cisplatin plus fluorouracil or capecitabine; FLOT, fluorouracil, leucovorin, oxaliplatin plus docetaxel.
SECTION: DISCUSS
Discussion
Since 2018, the FLOT chemotherapy regimen has occupied an important position in the CSCO guidelines in China and the NCCN in the USA. Although previous chemotherapy has proved to be effective in improving the OS of patients with advanced gastric cancer after resection, the prognosis of later-stage patients (stages IIIB and IIIC) is still suboptimal. Therefore, further clinical studies are needed to find more effective perioperative treatment for gastric cancer.
In recent years, the use of anthracycline and platinum drugs has sprouted in the field of perioperative treatment of resectable gastric cancer. Two published phase III studies have demonstrated the clinical efficacy of docetaxel in the treatment of advanced gastric cancer, involving docetaxel, oxaliplatin, S-1 and docetaxel combined with S-1. Moreover, oxaliplatin has showed favourable safety in the treatment of gastrointestinal tract, liver, kidney and bone marrow than cisplatin and carboplatin. Therefore, oxaliplatin has gradually replaced cisplatin in the current commonly used chemotherapy regimens. In the ARTIST-II trail, the SOX regimen showed superiority over single drug (S-1) in prolonging patient's survival. Two pivotal phase III trials from Japan and South Korea also found that oxaliplatin combined with folic acid and S-1 was associated with a clinically significant improvement among patients with advanced gastric cancer, when compared with S-1 plus cisplatin. Based on these positive results, docetaxel and oxaliplatin have been introduced into FLOT chemotherapy regimen. At present, FLOT regimen is considered as a preferred strategy for perioperative chemotherapy combined with surgery, including three chemotherapeutic drugs that suitable for patients with good performance status. Notably, for patients with good-to-moderate performance status and patients who are not able to tolerate the combination regimen of these three drugs, the two-drug combination regimen is recommended.
In China, the climbing incidence and mortality of gastric cancer have imposed considerable physical, psychological and economic burdens on the society, patients and their families. Therefore, it is very crucial to study the economic significance of this chemotherapy strategy in the field of medicine and policy. In this economic evaluation that compared with the ECF/ECX, the use of FLOT in patients with gastric and gastro-oesophageal junction adenocarcinoma achieved additional 1.08 QALY at an incremental cost of US$921.51, resulting in an ICER of US$850.68/QALY. Based on the WTP threshold set for this analysis, the FLOT strategy was considered to be cost-effective. However, due to the extreme imbalance of economic development in Chinese Mainland, the per capita GDP of the 32 provincial-level administrative regions varies greatly. The highest per capita GDP was reported in Beijing's per capita GDP (US$23 968) and the lowest was reported in Gansu's (US$5238). For the whole Chinese Mainland, the per capita GDP was US$10 504 and three times the per capita GDP was US$31 513. Because the ICERs of the FLOT strategy were much lower than three times the per capita GDP in Gansu province (US$15 714). This suggests that the FLOT perioperative chemotherapy regimen is more cost-effective than ECF/ECX in the treatment of locally advanced resectable gastric or gastro-oesophageal junction adenocarcinoma in all provincial-level administrative regions in Chinese Mainland.
The one-way sensitivity analysis showed that the most influential parameter on the model results was the HR of OS. Specifically, when the HR decreased from 0.94 to 0.63, the ICER of FLOT strategy versus ECF/ECX strategy ranged from US$-16 856.98 per QALY to US$3868.18 per QALY. The other sensitive parameters included the HR of PFS, the proportion of patients with ECF/ECX who underwent surgery and the discount rate. The change of HR for OS made ICER fluctuate the most, but the ICER was still less than WTP (US$10 504/QALY). Moreover, the ICER of FLOT strategy versus ECF/ECX strategy was always much lower than WTP regardless of the large fluctuation of model parameters. Consequently, we can conclude the uncertainty of parameters will not affect the robustness of our results.
It should be noted that, docetaxel prices played a more important role than the prices of other drugs in our model. From the perspective of patients with cancer, the use of high-priced new drugs might impose a heavy financial burden on the both social and patients, which likely leads to delay, abandonment and discontinuation of treatment. In recent years, the Chinese government has conducted a series of price negotiation with many pharmaceutical enterprises with the aim of reducing the price of oncology drugs. Fortunately, docetaxel passed the price negotiation and the consistency evaluation of generic drugs successfully in March 2021. This means that the market price of docetaxel will drop, which will make docetaxel less costly and more widely used in China. Since the implementation of the national drug centralised procurement policy and the generic drug consistency evaluation, we can expect that patients with cancer may benefit from these policies in China. To the best of our knowledge, this study is the first cost-effectiveness analysis of FLOT chemotherapy in patients with resectable gastric or gastro-oesophageal junction adenocarcinoma.
There are some limitations in the current study. First, there is uncertainty regarding the outcomes of patients with gastric and gastro-oesophageal junction adenocarcinoma beyond the trial period, despite the use of validated extrapolation techniques. Second, some potential bias lied in only direct medical costs were incorporated in the model; however, our sensitive analysis found that our results were almost unaffected by changes in costs. Third, another limitation of the current economic analysis was that other treatment strategies for advanced resectable gastric cancer have not been fully explored. With the successful application of targeted therapy and immunotherapy for advanced gastric cancer clinically, the pattern of perioperative treatment of resectable gastric cancer have been refreshed. For example, the research on treatment of HER-2 (Human epidermal growth factor recptor-2) positive gastric cancer has attracted considerable attentions in recent years. Meanwhile, combining the perioperative chemotherapy with targeted treatment was found to increase the pathological complete remission rate and improve OS benefit, while the safety is acceptable. Therefore, we can expect that receiving higher cost-targeted therapy can increase more cost-effectiveness.
SECTION: SUPPL
Supplementary Material
Contributors: Study design and supervision were contributed by HZ and XZ. Data analysis and interpretation were contributed by HZ, XZ and L-YS. Data collection was contributed by HZ and CW. Manuscript writing was contributed by HZ, XZ, S-JJ and QL. HZ is responsible for the overall content as guarantor. HZccepts full responsibility for the finished work and/or the conduct of the study, had access to the data, and controlled the decision to publish. Final approval of the manuscript was contributed by all of the authors.
Funding: This work was supported by the Provincial Natural Science Foundation (grant number 2021JJ80080).
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement
Data are available in a public, open access repository.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Not applicable.