(3) Economic Evaluation of Enhanced vs Standard Varenicline Treatment for Tobacco Cessation

Home

Questions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

Papers

PMCID: 11059041 (link)

Year: 2024

Reviewer Paper ID: 3

Project Paper ID: 9

Q1 - Title

Question description: Does the title clearly identify the study as an economic evaluation and specify the interventions being compared?

Explanation: The title of the manuscript clearly identifies the study as an economic evaluation, specifying that it involves an enhanced versus standard treatment of varenicline for tobacco cessation. This indicates that the study will compare different treatment strategies and assess their cost-effectiveness.

Quotes:

  • Economic Evaluation of Enhanced vs Standard Varenicline Treatment for Tobacco Cessation

Q2 - Abstract

Question description: Does the abstract provide a structured summary that includes the context, key methods, results, and alternative analyses?

Explanation: The abstract does not provide a structured summary explicitly organized into sections for context, methods, results, and alternative analyses. Instead, it delivers key points and findings in a narrative format without clearly defined sections or mention of alternative analyses.

Quotes:

  • Question: What is the cost-effectiveness of enhanced varenicline treatment (extended varenicline use or varenicline in combination with nicotine replacement therapy) among individuals trying to quit smoking?
  • Findings: In this economic evaluation of enhanced varenicline treatment for smoking cessation that included 1251 participants, the incremental cost-effectiveness ratio was $4579 per quality-adjusted life-year (QALY) for 12-week varenicline monotherapy. In contrast, 24-week varenicline combination therapy cost $90 000 000 per additional QALY relative to 12-week varenicline monotherapy.
  • Meaning: This study suggests that standard 12-week varenicline monotherapy is the most cost-effective treatment option for smoking cessation at the commonly cited threshold of $100 000/QALY.

Q3 - Background and objectives

Question description: Does the introduction provide the context for the study, the study question, and its practical relevance for decision-making in policy or practice?

Explanation: The introduction of the manuscript discusses the extent of the problem of smoking as a leading preventable cause of death, the challenges of mixed evidence on treatment strategies, and the rationale for the study to assess the cost-effectiveness of these methods, thus providing context, the study question, and its practical relevance for decision-making.

Quotes:

  • Smoking is the leading preventable cause of death and illness in the US, responsible for approximately 480 000 deaths annually or 1 in 5 deaths annually.
  • Available research presents mixed results about the effectiveness of combination varenicline therapy enhanced with a nicotine replacement therapy (NRT) patch vs varenicline alone.
  • This economic analysis informs patients, health care professionals, policy makers, and other stakeholders about the health and economic outcomes of standard varenicline monotherapy vs combination and extended varenicline treatment strategies.

Q4 - Health economic analysis plan

Question description: Was a health economic analysis plan developed, and if so, where is it available?

Explanation: The manuscript does not mention the development of a specific health economic analysis plan or its availability. It only describes the study's economic evaluation methods and adherence to certain reporting guidelines.

Quotes:

  • The study followed the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 reporting guideline.
  • This study is an economic evaluation alongside the QUITS randomized clinical trial.

Q5 - Study population

Question description: Are the characteristics of the study population (e.g., age range, demographics, socioeconomic, or clinical characteristics) described?

Explanation: The study describes the characteristics of the study population such as age, sex, race, and smoking behavior. It provides comprehensive demographic data in the results section and a detailed break down in tables.

Quotes:

  • Results: Of the 1251 participants, mean (SD) age was 49.1 (11.9) years, 675 (54.0%) were women, and 881 (70.4%) completed the 52-week follow-up.
  • Table: Total 287 (22.9%) were Black or African American, and 867 (69.3%) were White.
  • Methods: Inclusion criteria included... age 18 years or older, a desire to quit smoking, not currently engaged in smoking cessation treatment...

Q6 - Setting and location

Question description: Is relevant contextual information (such as setting and location) provided that may influence the findings of the study?

Explanation: The manuscript clearly specifies the setting and location of the study, noting that participants were recruited and the study was conducted in Madison and Milwaukee, Wisconsin. This is relevant contextual information as it may affect the generalizability of the findings to other settings.

Quotes:

  • "Study enrollment occurred in Madison and Milwaukee, Wisconsin, between November 11, 2017, and July 2, 2020."
  • "Study enrollment occurred at 1 research clinic in Madison, Wisconsin, and 1 research clinic in Milwaukee, Wisconsin, between November 11, 2017, and July 9, 2020."]}]},

Q7 - Comparators

Question description: Are the interventions or strategies being compared described, along with the rationale for their selection?

Explanation: The interventions or strategies being compared are described, specifically comparing standard and enhanced varenicline treatments, and the rationale for their selection is based on their potential effectiveness for smoking cessation and cost-effectiveness for health systems.

Quotes:

  • "To evaluate the cost-effectiveness of standard vs enhanced varenicline use (extended varenicline treatment or varenicline in combination with nicotine replacement therapy) among individuals trying to quit smoking."
  • "This economic evaluation examines the cost-effectiveness of varenicline monotherapy vs varenicline treatment in combination with patch nicotine replacement therapy for smoking cessation when both types of treatment are offered at standard of care and extended durations."
  • "Varenicline treatment for aiding smoking cessation has been shown to be effective for diverse populations of smokers and has been used with different strategies aimed at increasing its effectiveness."

Q8 - Perspective

Question description: What perspective(s) were adopted by the study, and why were they chosen?

Explanation: The study explicitly adopted a health care system perspective when evaluating the cost-effectiveness of the smoking cessation treatments. This perspective was chosen to assess the QUITS costs and effectiveness over a 12-month follow-up, aligning with the study's aim of comparing the economic impact of different treatment strategies.

Quotes:

  • The analysis was conducted from a health care system perspective based on QUITS costs and effectiveness over a 12-month follow-up.

Q9 - Time horizon

Question description: What is the time horizon for the study, and why is it appropriate?

Explanation: The time horizon of the study is 12 months, not 52 weeks, which is used as the follow-up period for certain outcomes but does not specify the entire time horizon for cost-effectiveness analysis. Moreover, the appropriateness of the 12-month period is not justified in terms of capturing long-term costs and health outcomes typically required in smoking cessation studies.

Quotes:

  • The analysis was conducted from a health care system perspective based on QUITS costs and effectiveness over a 12-month follow-up.
  • Main Outcomes and Measures: The primary outcome was 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level <=5 ppm) at 52 weeks.

Q10 - Discount rate

Question description: What discount rate(s) were used, and what was the rationale for choosing them?

Explanation: The manuscript states that a discount rate of 3% was used for converting incremental cost and quit rates to QALYs. The rationale for this choice is grounded in the broader practice of discounting future benefits in economic evaluations, as quit benefits are accrued at the end of life.

Quotes:

  • "A discount rate of 3% was used for the QALY conversion."
  • "Stapleton and West estimate life-years gained from stopping smoking at various ages, probabilities of relapse back to smoking, and discounting of future benefits (ie, life-years gained are accrued in the future, at the end of life) so that quit rate differentials can be converted into QALYs."

Q11 - Selection of outcomes

Question description: What outcomes were used as measures of benefit and harm?

Explanation: The manuscript uses 7-day point prevalence abstinence as the primary outcome to measure smoking cessation effectiveness and does not focus on harmful outcomes. This focus does not include direct measures of benefit and harm typically associated with health interventions, such as life-years gained or adverse events.

Quotes:

  • The primary outcome was 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level <=5 ppm) at 52 weeks.
  • The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579 per quality-adjusted life-year (QALY) added.

Q12 - Measurement of outcomes

Question description: How were the outcomes used to capture benefits and harms measured?

Explanation: The outcomes were measured in terms of incremental cost-effectiveness ratios (ICERs) and quality-adjusted life years (QALYs). The primary outcome was 7-day point prevalence abstinence, with abstinence biochemically confirmed by carbon monoxide levels, and used to assess cost per additional person who quit smoking and QALYs gained.

Quotes:

  • The primary outcome was 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level <=5 ppm) at 52 weeks.
  • The primary outcome was self-reported 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level <=5 ppm) at 52 weeks after the target quit day.
  • The incremental cost-effectiveness ratio (ICER), or cost per additional person who quit smoking, was calculated using decision tree analysis based on abstinence and cost for each arm of the trial.
  • The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579 per quality-adjusted life-year (QALY) added.

Q13 - Valuation of outcomes

Question description: What population and methods were used to measure and value the outcomes?

Explanation: The manuscript describes the QUITS randomized clinical trial, which evaluated the cost-effectiveness of varenicline monotherapy versus varenicline combined with a nicotine replacement therapy patch. The population comprised individuals who smoked daily and wanted to quit, and the primary outcome measured was 7-day point prevalence abstinence biochemically confirmed with exhaled carbon monoxide level at 52 weeks.

Quotes:

  • The study participants were individuals who smoked daily and who expressed an interest in quitting smoking by responding to study recruitment for the smoking cessation intervention trial.
  • The primary outcome was self-reported 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level <=5 ppm) at 52 weeks after the target quit day.

Q14 - Measurement and valuation of resources and costs

Question description: How were the costs valued in the study?

Explanation: The cost valuation in the study involves intervention costs including salaries, benefits, resources for counseling, and medications, and uses Medicare reimbursement rates for calculating the costs of counseling sessions and medications. However, these calculations do not factor in broader costs such as productivity losses or healthcare costs outside the scope of the intervention, indicating that the costs were not comprehensively valued.

Quotes:

  • Intervention costs included salaries, benefits, and resources for tobacco cessation counseling and tobacco cessation medications associated with the intervention. Medicare reimbursement rates of $34 per counseling session (Current Procedural Terminology codes 99406 and 99407), $392 per 28-day prescription of varenicline, and $84 per 28-day prescription of the NRT patch were applied to treatments received by the study participants.
  • All costs were reported in 2021 dollars. Costs for placebo medications were considered research costs and were not included in the evaluation.
  • Costs were calculated based on the actual treatments used by the participants.

Q15 - Currency, price, date, and conversion

Question description: What are the dates of the estimated resource quantities and unit costs, and what currency and year were used for conversion?

Explanation: The manuscript indicates that the resource quantities and unit costs were estimated for the years 2017 to 2020, and costs were converted into 2021 US dollars.

Quotes:

  • Study enrollment occurred in Madison and Milwaukee, Wisconsin, between November 11, 2017, and July 9, 2020.
  • All costs were reported in 2021 dollars.

Q16 - Rationale and description of model

Question description: If a model was used, was it described in detail, including the rationale for its use? Is the model publicly available, and where can it be accessed?

Explanation: The manuscript describes the decision tree analysis used for cost-effectiveness evaluation but does not provide detailed information about a model or indicate that a specific model for these analyses is publicly available for access.

Quotes:

  • The incremental cost-effectiveness ratio (ICER), or cost per additional person who quit smoking, was calculated using decision tree analysis based on abstinence and cost for each arm of the trial.
  • A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters and to determine 95% CIs for the ICER per additional individual who quit smoking.

Q17 - Analytics and assumptions

Question description: What methods were used for analyzing or statistically transforming data, extrapolation, and validating any models used?

Explanation: The manuscript does not detail methods for analyzing or statistically transforming data, extrapolation, or validating the models used. Instead, it mentions statistical analyses like the chi-square test, calculation of ICER, and sensitivity analysis, but does not delve deeply into model validation or data transformation methods.

Quotes:

  • Statistical analysis took place from May to October 2023. Cost-effectiveness was estimated by the incremental cost-effectiveness ratio (ICER)...
  • A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters...
  • The chi2 test was conducted to compare withdrawal rates and loss-to-follow-up rates across randomization groups.

Q18 - Characterizing heterogeneity

Question description: What methods were used to estimate how the results vary for different sub-groups?

Explanation: The article describes how subgroup analyses were conducted to determine variations in cost-effectiveness across different demographic and smoking-related factors.

Quotes:

  • "Subgroup analyses included differences in cost-effectiveness by age, race and ethnicity, educational level, prior use of varenicline, tobacco dependence, motivation to quit smoking, and confidence in quitting smoking."
  • "Subgroup analyses by age, sex, race and ethnicity, educational level, number of years smoking, prior use of varenicline, tobacco dependence, motivation to quit smoking, and confidence in quitting smoking did not reveal any subgroups for which the ICER was statistically significant at the $100 000/QALY level."

Q19 - Characterizing distributional effects

Question description: How were the impacts distributed across different individuals, and were adjustments made to reflect priority populations?

Explanation: The manuscript does not provide specific information on how impacts were distributed across different individuals nor if any adjustments were made to reflect priority populations. It focuses primarily on cost-effectiveness and general population outcomes, without detailing distributional impacts or priority adjustment.

Quotes:

  • Available evidence in the literature shows that race is associated with tobacco cessation treatment outcomes. Race and ethnicity were self-reported by participants using fixed choice responses. Study group enrollment was stratified by race and ethnicity to prevent chance association of this variable with treatment assignment.
  • Subgroup analyses by age, sex, race and ethnicity, educational level, number of years smoking, prior use of varenicline, tobacco dependence, motivation to quit smoking, and confidence in quitting smoking did not reveal any subgroups for which the ICER was statistically significant at the $100 000/QALY level.

Q20 - Characterizing uncertainty

Question description: What methods were used to characterize sources of uncertainty in the analysis?

Explanation: The manuscript describes the use of a combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis to characterize sources of uncertainty. These methodologies help to account for uncertainty in parameters and determine confidence intervals for the incremental cost-effectiveness ratio (ICER).

Quotes:

  • A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters and to determine 95% CIs for the ICER per additional individual who quit smoking.
  • The ICER per additional individual who quit smoking was calculated by drawing repeated random samples with replacement (N = 1000) from the observed distributions for cessation and health care costs to produce bootstrap estimates of the 95% CI.

Q21 - Approach to engagement with patients and others affected by the study

Question description: Were patients, service recipients, the general public, communities, or stakeholders engaged in the design of the study? If so, how?

Explanation: The provided manuscript does not mention any engagement with patients, service recipients, the general public, communities, or stakeholders in the design of the study. The methods section describes the recruitment process and study design but does not indicate any stakeholder engagement in the study's development phase.

Quotes:

  • The study participants were individuals who smoked daily and who expressed an interest in quitting smoking by responding to study recruitment for the smoking cessation intervention trial.

Q22 - Study parameters

Question description: Were all analytic inputs or study parameters (e.g., values, ranges, references) reported, including uncertainty or distributional assumptions?

Explanation: The manuscript does not provide all analytic inputs, study parameters, or account for uncertainty or distributional assumptions comprehensively. While it discusses some parameters like intervention costs, it does not provide a detailed breakdown of all parameters, values, ranges, or distributional assumptions used in the analysis.

Quotes:

  • Intervention costs included salaries, benefits, and resources for tobacco cessation counseling and tobacco cessation medications associated with the intervention.
  • A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters and to determine 95% CIs for the ICER per additional individual who quit smoking.

Q23 - Summary of main results

Question description: Were the mean values for the main categories of costs and outcomes reported, and were they summarized in the most appropriate overall measure?

Explanation: The manuscript reports mean values for both intervention costs and smoking cessation rates, the primary outcomes assessed in the study. These values, along with the incremental cost-effectiveness ratios (ICERs), were used as overall measures to summarize cost-effectiveness.

Quotes:

  • The total mean (SD) cost was $1175 ($365) for 12-week monotherapy, $1374 ($412) for 12-week combination therapy, $2022 ($813) for 24-week monotherapy, and $2118 ($1058) for 24-week combination therapy.
  • Tobacco cessation at 52 weeks was 25.1% (79 of 315) for 12-week monotherapy, 24.4% (76 of 311) for 24-week monotherapy, 23.6% (74 of 314) for 12-week combination therapy, and 25.1% (78 of 311) for 24-week combination therapy, respectively.
  • The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579 per quality-adjusted life-year (QALY) added.

Q24 - Effect of uncertainty

Question description: How did uncertainty about analytic judgments, inputs, or projections affect the findings? Was the effect of the choice of discount rate and time horizon reported, if applicable?

Explanation: The manuscript does not address the effect of uncertainty about analytic judgments, inputs, or projections on the findings, nor does it report on the specific impact of the choice of discount rate and time horizon on the results. Although a 3% discount rate is mentioned for QALY conversions, the sensitivity of results to this rate or time horizon is not elaborated.

Quotes:

  • A discount rate of 3% was used for the QALY conversion.
  • There is limited understanding on whether combining varenicline with the NRT patch or prolonging varenicline treatment duration increases smoking cessation rates and/or whether the combination or prolonged varenicline treatments are cost-effective.

Q25 - Effect of engagement with patients and others affected by the study

Question description: Did patient, service recipient, general public, community, or stakeholder involvement make a difference to the approach or findings of the study?

Explanation: The manuscript does not provide any evidence or mention of involvement from patients, service recipients, the general public, the community, or other stakeholders impacting the study's approach or findings. The focus is solely on the economic evaluation and clinical effectiveness of varenicline treatments without reference to any external involvement influencing the research.

Quotes:

  • This economic evaluation examines the cost-effectiveness of varenicline monotherapy vs varenicline treatment in combination with patch nicotine replacement therapy for smoking cessation when both types of treatment are offered at standard of care and extended durations.
  • This economic evaluation examines the cost-effectiveness of varenicline monotherapy vs varenicline treatment in combination with the NRT patch when both types of treatment are offered at standard of care and extended durations. This economic analysis informs patients, health care professionals, policy makers, and other stakeholders about the health and economic outcomes of standard varenicline monotherapy vs combination and extended varenicline treatment strategies.

Q26 - Study findings, limitations, generalizability, and current knowledge

Question description: Were the key findings, limitations, ethical or equity considerations, and their potential impact on patients, policy, or practice reported?

Explanation: The manuscript thoroughly discusses the key findings related to cost-effectiveness of varenicline treatments for smoking cessation, focusing on economic outcomes and statistical results. However, it does not include explicit discussions on ethical or equity considerations surrounding the implementation of these treatments.

Quotes:

  • This study suggests that standard 12-week varenicline monotherapy is the most cost-effective treatment option for smoking cessation at the commonly cited threshold of $100 000/QALY.
  • Our study demonstrated that among adults who smoked 5 or more cigarettes per day and who were interested in quitting smoking, 12-week varenicline monotherapy was the most cost-effective pharmacotherapy treatment.
  • The positive outcomes seen with modified varenicline pharmacotherapy in prior studies, involving either combination therapy or prolonged varenicline monotherapy, were not replicated in the QUITS trial.

SECTION: TITLE
Economic Evaluation of Enhanced vs Standard Varenicline Treatment for Tobacco Cessation

SECTION: ABSTRACT
Key Points

Question

What is the cost-effectiveness of enhanced varenicline treatment (extended varenicline use or varenicline in combination with nicotine replacement therapy) among individuals trying to quit smoking?


Findings

In this economic evaluation of enhanced varenicline treatment for smoking cessation that included 1251 participants, the incremental cost-effectiveness ratio was $4579 per quality-adjusted life-year (QALY) for 12-week varenicline monotherapy. In contrast, 24-week varenicline combination therapy cost $90 000 000 per additional QALY relative to 12-week varenicline monotherapy.


Meaning

This study suggests that standard 12-week varenicline monotherapy is the most cost-effective treatment option for smoking cessation at the commonly cited threshold of $100 000/QALY.


Importance

Smoking is the leading preventable cause of death and illness in the US. Identifying cost-effective smoking cessation treatment may increase the likelihood that health systems deliver such treatment to their patients who smoke.

Objective

To evaluate the cost-effectiveness of standard vs enhanced varenicline use (extended varenicline treatment or varenicline in combination with nicotine replacement therapy) among individuals trying to quit smoking.


Design, Setting, and Participants

This economic evaluation assesses the Quitting Using Intensive Treatments Study (QUITS), which randomized 1251 study participants who smoked into 4 conditions: (1) 12-week varenicline monotherapy (n = 315); (2) 24-week varenicline monotherapy (n = 311); (3) 12-week varenicline combination treatment with nicotine replacement therapy patch (n = 314); or (4) 24-week varenicline combination treatment with nicotine replacement therapy patch (n = 311). Study enrollment occurred in Madison and Milwaukee, Wisconsin, between November 11, 2017, and July 2, 2020. Statistical analysis took place from May to October 2023.

Main Outcomes and Measures

The primary outcome was 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level =5 ppm) at 52 weeks.

The primary outcome was 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level =5 ppm) at 52 weeks.
The incremental cost-effectiveness ratio (ICER), or cost per additional person who quit smoking, was calculated using decision tree analysis based on abstinence and cost for each arm of the trial.

Results

Of the 1251 participants, mean (SD) age was 49.1 (11.9) years, 675 (54.0%) were women, and 881 (70.4%) completed the 52-week follow-up.
Tobacco cessation at 52 weeks was 25.1% (79 of 315) for 12-week monotherapy, 24.4% (76 of 311) for 24-week monotherapy, 23.6% (74 of 314) for 12-week combination therapy, and 25.1% (78 of 311) for 24-week combination therapy, respectively. The total mean (SD) cost was $1175 ($365) for 12-week monotherapy, $1374 ($412) for 12-week combination therapy, $2022 ($813) for 24-week monotherapy, and $2118 ($1058) for 24-week combination therapy. The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579 per quality-adjusted life-year (QALY) added.The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579 per quality-adjusted life-year (QALY) added. The ICER for 24-week varenicline combination therapy relative to 12-week monotherapy was $92 000 000 per additional individual who quit smoking and $90 000 000 (95% CI, $15 703 to dominated or more costly and less efficacious) per additional QALY.

Conclusions and Relevance

This economic evaluation of standard vs enhanced varenicline treatment for smoking cessation suggests that 12-week varenicline monotherapy was the most cost-effective treatment option at the commonly cited threshold of $100 000/QALY. This study provides patients, health care professionals, and other stakeholders with increased understanding of the health and economic impact of more intensive varenicline treatment options.

This economic evaluation examines the cost-effectiveness of varenicline monotherapy vs varenicline treatment in combination with patch nicotine replacement therapy for smoking cessation when both types of treatment are offered at standard of care and extended durations.


SECTION: INTRO
Introduction

Smoking is the leading preventable cause of death and illness in the US, responsible for approximately 480 000 deaths annually or 1 in 5 deaths annually. Evidence-based strategies to aid smoking cessation include behavioral counseling and pharmacotherapy to lower nicotine reinforcement and withdrawal from nicotine. Varenicline treatment for aiding smoking cessation has been shown to be effective for diverse populations of smokers and has been used with different strategies aimed at increasing its effectiveness. Available research presents mixed results about the effectiveness of combination varenicline therapy enhanced with a nicotine replacement therapy (NRT) patch vs varenicline alone. Although one large study revealed a statistically significant difference in favor of combination varenicline and NRT patch therapy, 2 smaller studies did not show a statistically significant improvement with the combination treatment. A meta-analysis of the 3 studies revealed a statistically significant benefit associated with varenicline treatment enhanced with the NRT patch. In view of conflicting evidence, the American Thoracic Society chose to conditionally recommend varenicline plus the NRT patch rather than varenicline monotherapy for tobacco cessation until future studies explored this issue further. Most smoking cessation guidelines encourage varenicline monotherapy, NRT patch, bupropion, or a combination therapy with different types of NRT.

Some research shows that increased duration of smoking cessation pharmacotherapy may enhance its effectiveness. However, to our knowledge, limited research exists on the benefits associated with extended varenicline treatment. Two smoking relapse prevention studies and a Cochrane meta-analysis indicate that prolonged duration of varenicline treatment can increase long-term cessation rates from prior treatment among individuals who have quit smoking. There is limited understanding on whether combining varenicline with the NRT patch or prolonging varenicline treatment duration increases smoking cessation rates and/or whether the combination or prolonged varenicline treatments are cost-effective.

To fill this gap in literature, the Quitting Using Intensive Treatments Study (QUITS) randomized clinical trial compared the efficacy of extending varenicline treatment duration and/or offering varenicline treatment in combination with the NRT patch as a means of increasing smoking treatment effectiveness. The primary treatment outcome findings from the QUITS trial were published in a prior report.

This economic evaluation examines the cost-effectiveness of varenicline monotherapy vs varenicline treatment in combination with the NRT patch when both types of treatment are offered at standard of care and extended durations. This economic analysis informs patients, health care professionals, policy makers, and other stakeholders about the health and economic outcomes of standard varenicline monotherapy vs combination and extended varenicline treatment strategies.

SECTION: METHODS
Methods

This study is an economic evaluation alongside the QUITS randomized clinical trial. The analysis was conducted from a health care system perspective based on QUITS costs and effectiveness over a 12-month follow-up. The study followed the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 reporting guideline. The study participants were individuals who smoked daily and who expressed an interest in quitting smoking by responding to study recruitment for the smoking cessation intervention trial. The QUITS randomized clinical trial was approved by the University of Wisconsin Health Sciences Institutional Review Board. All participants provided written informed consent.

Available evidence in the literature shows that race is associated with tobacco cessation treatment outcomes. Race and ethnicity were self-reported by participants using fixed choice responses. Study group enrollment was stratified by race and ethnicity to prevent chance association of this variable with treatment assignment.

QUITS Study Design Overview

Recruitment occurred via community outreach (eg, social networking sites). Interested respondents were called for eligibility assessment, consent, baseline assessments, and randomization. Study enrollment occurred at 1 research clinic in Madison, Wisconsin, and 1 research clinic in Milwaukee, Wisconsin, between November 11, 2017, and July 9, 2020.

Inclusion criteria included English language proficiency, smoking 5 or more cigarettes per day during the past 6 months, exhaled carbon monoxide level of 5 ppm or greater, age 18 years or older, a desire to quit smoking, not currently engaged in smoking cessation treatment, no use of other tobacco products (pipe tobacco, cigars, snuff, e-cigarettes, or chewing tobacco) within the past 30 days, telephone access, willingness and ability to use both the NRT patch and varenicline, ability to attend clinic visits for the next 12 months, not currently pregnant, and agreement to use an acceptable birth control method. More details are provided in the report by Baker et al.

Randomization

Participants were randomized to medication condition (varenicline monotherapy vs combination varenicline and NRT patch) and treatment duration (12 weeks vs 24 weeks) via a database that used stratified permuted block randomization. SAS Proc Plan, version 9.4 (SAS Institute Inc) was used to stratify by site (Madison or Milwaukee), sex, race and ethnicity (Asian, Black or African American, Native American or Alaska Native, Native Hawaiian or Other Pacific Islander, or non-Hispanic White [hereinafter, White], other [including those who chose other or did not answer], or 1 race; groups were dichotimized as White and all other groups), and smoking heaviness (5-15 [low] or =16 [high] cigarettes/d), with a fixed block size of 4 based on the 4 unique treatment groups (in random order within each block). Participants were randomized by block, with one randomization block being White individuals and the other randomization block being individuals of all other races and ethnicities; the literature indicated that smoking cessation rates may vary by race and ethnicity between White individuals and those of all other race and ethnicity groups. The double-blind treatment assignment meant that all participants took pills and wore NRT patches for the same treatment length.

Interventions

Study medications were dispensed 1 week before target quit date and at the target quit date and were mailed to participants at week 10 after baseline. The 4 treatment conditions were created by the 2 x 2 factorial design: (1) varenicline monotherapy for 12 weeks: active varenicline from target quit date to week 13 and placebo varenicline from week 14 to week 25 plus placebo patch from baseline to week 25; (2) varenicline plus NRT patch for 12 weeks: active varenicline from target quit date to week 13 and placebo varenicline from week 14 to week 25 plus active NRT patch from baseline to week 13 and placebo patch from week 14 to week 25; (3) varenicline monotherapy for 24 weeks: active varenicline from target quit date to week 25 and placebo patch from baseline to week 25; and (4) varenicline plus NRT patch for 24 weeks: active varenicline from target quit date to week 25 plus active NRT patch from baseline to week 25.

To mask treatment assignment, all participants were given 24 weeks of varenicline pills and 26 weeks of NRT patches, with some medications being active and some placebo. Varenicline treatment started with one 0.5-mg varenicline pill for 3 days, two 0.5-mg pills for 4 days, and two 1-mg pills thereafter (to either week 13 or week 25). Active NRT patch use started at baseline and involved use of one 14-mg patch/d until either 13 weeks or 26 weeks after the target quit day. Placebo products had the same appearance and use instructions as the respective active products.

Cessation Counseling

All participants were scheduled for six 15-minute counseling sessions, with 3 sessions during face-to-face visits at study entry, week 2, and week 4 plus 3 more sessions by telephone call at weeks 1, 6, and 10. Counseling focused on instructions for medication use, support, coping skills, and motivation to quit. A manual was created to standardize the counseling, and the audio during the sessions was recorded for quality assurance assessment and feedback.

Assessments

Questionnaires assessing smoking history, nicotine use, nicotine dependence, and negative affect were conducted at study entry. Participants were contacted 52 weeks after the target quit day for a telephone assessment of smoking status, use of other nicotine products or cessation aids, medication use, and adverse events. Participants claiming abstinence from smoking at 52 weeks were invited for in-person biochemical verification.

Medication adherence was assessed by self-report for the 7 days prior to each study contact from week 1 to week 24 (2 visits and 6 telephone calls). Adherence to varenicline treatment was defined post hoc as taking 1 or 2 pills per day for 6 days or longer; adherence to treatment with the NRT patch was defined as using 1 patch per day for 6 days or longer.

Outcome Measures

The primary outcome was self-reported 7-day point prevalence abstinence (biochemically confirmed with exhaled carbon monoxide level =5 ppm) at 52 weeks after the target quit day.
COVID-19 restrictions prevented biochemical confirmation of abstinence for some participants from March to July 2020 (5.9% of the total sample [74 of 1251]).

Cost Measures

Intervention costs included salaries, benefits, and resources for tobacco cessation counseling and tobacco cessation medications associated with the intervention. Medicare reimbursement rates of $34 per counseling session (Current Procedural Terminology codes 99406 and 99407), $392 per 28-day prescription of varenicline, and $84 per 28-day prescription of the NRT patch were applied to treatments received by the study participants. All costs were reported in 2021 dollars.

Although all study participants were enrolled to receive 6 tobacco cessation counseling sessions and all were provided the full duration of varenicline and NRT patch, costs were calculated based on the actual treatments used by the participants. To simulate real-world prescribing of varenicline, costs were based on a 30-day starter pack of varenicline for all participants; if the participants reported being adherent to treatment, they were provided subsequent 28-day supplies until treatment conclusion. Similarly, NRT patch costs were based on active NRT patch group participants receiving the initial 14-day supply of patches and subsequent supplies of patches if the participant remained adherent to NRT patch treatment. If a participant reported treatment discontinuation, the cost of 1 additional month of medication was added, but costs were assumed to be zero thereafter. Costs for placebo medications were considered research costs and were not included in the evaluation.

Statistical Analysis

Statistical analysis took place from May to October 2023. Cost-effectiveness was estimated by the incremental cost-effectiveness ratio (ICER)
, calculated as follows:for comparing treatment condition i with treatment condition j.

To evaluate the ICER for each additional individual who quit smoking, participants in the trial were determined to be either tobacco abstinent (cessation = 1) or returned to smoking (cessation = 0) at the 52-week follow-up. Individual costs included the number of cessation counseling sessions completed and cessation medications used. Mean cessation rate and mean cost were computed for each randomization-outcome group based on whether the participants had completed the assigned treatment regimen, resulting in 8 treatment-outcome combinations (see Figure 1 for the pathway probabilities).

SECTION: FIG
Cost-Effectiveness Decision Tree

SECTION: METHODS
A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters and to determine 95% CIs for the ICER per additional individual who quit smoking.
A combination of probabilistic sensitivity analysis and Monte Carlo-based nonparametric bootstrap analysis was used to account for uncertainty in parameters and to determine 95% CIs for the ICER per additional individual who quit smoking. The ICER per additional individual who quit smoking was calculated by drawing repeated random samples with replacement (N = 1000) from the observed distributions for cessation and health care costs to produce bootstrap estimates of the 95% CI.

In addition, the ICER per additional participant who quit smoking was translated into a cost per additional quality-adjusted life-year (QALY) gained using conversion factors from Stapleton and West. Stapleton and West estimate life-years gained from stopping smoking at various ages, probabilities of relapse back to smoking, and discounting of future benefits (ie, life-years gained are accrued in the future, at the end of life) so that quit rate differentials can be converted into QALYs. We used Table 3, Section B from Stapleton and West(p468) to convert incremental cost and incremental quit rates to a cost per QALY using linear interpolation to estimate between table cells. A discount rate of 3% was used for the QALY conversion.

The chi2 test was conducted to compare withdrawal rates and loss-to-follow-up rates across randomization groups. All P values were from 2-sided tests, and results were deemed statistically significant at P = .05. Statistical tests of cost-effectiveness were conducted by determining if the bootstrap 95% CIs contained the cost-effectiveness threshold of $100 000/QALY. If the entire 95% CI for cost-effectiveness lay below the $100 000/QALY threshold, we concluded that the treatment was cost-effective at the P = .05 level. Subgroup analyses included differences in cost-effectiveness by age, race and ethnicity, educational level, prior use of varenicline, tobacco dependence, motivation to quit smoking, and confidence in quitting smoking.

SECTION: RESULTS
Results

Among the 1251 patients in the study, mean (SD) age was 49.1 (11.9) years, 675 (54.0%) were women, 576 (46.0%) were men, 287 (22.9%) were Black or African American, and 867 (69.3%) were White (Table 1). A total of 751 participants (60.0%) completed the assigned treatment, 966 (77.2%) completed 12-month follow-up, and 881 (70.4%) completed 52-week follow-up. A total of 117 enrolled participants (9.4%) withdrew from the study and 168 (13.4%) were lost to follow-up. There were no significant differences in withdrawal or loss to follow-up by study group. Participants smoked a mean (SD) of 16.0 (7.5) cigarettes/d prior to the intervention (Table 1).

SECTION: TABLE
Demographic and Smoking-Related Variables for Study Participants

Variable Patients, No. (%) All (N = 1251) Varenicline monotherapy Combination therapya 12 wk (n = 315) 24 wk (n = 311) 12 wk (n = 314) 24 wk (n = 311) Age, mean (SD), y 49.1 (11.9) 48.9 (12.4) 48.9 (12.3) 48.6 (11.4) 49.9 (11.5) Sex Male 576 (46.0) 144 (45.7) 144 (46.3) 143 (45.5) 145 (46.6) Female 675 (54.0) 171 (54.3) 167 (53.7) 171 (54.5) 166 (53.4) Race Asian 8 (0.6) 2 (0.6) 1 (0.3) 2 (0.6) 3 (1.0) Black or African American 287 (22.9) 70 (22.2) 78 (25.1) 71 (22.6) 68 (21.9) Native American or Alaska Native 14 (1.1) 5 (1.6) 2 (0.6) 3 (1.0) 4 (1.3) Native Hawaiian or Other Pacific Islander 3 (0.2) 1 (0.3) 2 (0.6) 0 0 White 867 (69.3) 219 (69.5) 214 (68.8) 221 (70.4) 213 (68.5) Otherb 44 (3.5) 12 (3.8) 6 (1.9) 12 (3.8) 14 (4.5) 1 Race category 27 (2.2) 6 (1.9) 7 (2.3) 5 (1.6) 9 (2.9) Ethnicity Hispanic 41 (3.3) 10 (3.2) 5 (1.6) 14 (4.5) 12 (3.9) No. of cigarettes/d, mean (SD) 16.0 (7.5) 15.9 (7.6) 16.2 (7.4) 16.0 (7.3) 16.0 (7.7) Motivation to quit, mean (SD)c 6.4 (0.9) 6.4 (0.9) 6.4 (0.8) 6.4 (0.9) 6.4 (0.9) Confidence in quitting, mean (SD)d 5.5 (1.3) 5.5 (1.4) 5.5 (1.3) 5.5 (1.3) 5.5 (1.3)

Combination therapy consisted of varenicline treatment in combination with nicotine replacement therapy patch.

Included those who chose the option "Other" as their racial category and those who did not provide any answer to the race question.

Measured on a scale of 1 to 7; 1 indicates not at all motivated to quit smoking and 7 indicates extremely motivated to quit smoking.

Measured on a scale of 1 to 7; 1 indicates not confident in quitting smoking and 7 indicates extremely confident in quitting smoking.

SECTION: RESULTS
Intervention Effectiveness and Costs

Tobacco cessation rates at the 52-week follow-up were 25.1% (79 of 315 participants) for 12-week monotherapy, 24.4% (76 of 311) for 24-week monotherapy, 23.6% (74 of 314) for 12-week combination therapy, and 25.1% (78 of 311) for 24-week combination therapy. The mean (SD) intervention cost was $1175 ($365)/person for 12-week monotherapy, $1374 ($412)/person for 12-week combination therapy, $2022 ($813)/person for 24-week monotherapy, and $2118 ($1058)/person for 24-week combination therapy treatment (Table 2). In contrast, maximum costs per individual were $1419 for 12-week monotherapy, $1671 for 12-week combination therapy, $2634 for 24-week monotherapy, and $3138 for 24-week combination therapy treatment if the participant adhered completely to the entire treatment regimen. Adherence to the assigned treatment varied by treatment group, with adherence rates highest in the 12-week varenicline monotherapy group (44.1% [139 of 315] fully adherent) and lowest in the 24-week combination therapy group (30.2% [94 of 311] fully adherent). As seen in the decision tree (Figure 1), mean costs were greater across all 4 groups among those who were tobacco abstinent at 52 weeks compared with those who were nonabstinent, indicating a positive association (r = 0.27 [95% CI, 0.22-0.32]) between treatment adherence and smoking cessation rates when controlling for treatment group assignment.

SECTION: TABLE
Costs and Efficacy of Tobacco Cessation Treatment Regimens

Outcome 12-wk Treatment group 24-wk Treatment group Varenicline monotherapy (n = 315) Combination therapy (n = 314)a Varenicline monotherapy (n = 311) Combination therapy (n = 311)a Participants fully adherent to treatment regimen, No. (%) 139 (44.1) 119 (37.9) 121 (38.9) 94 (30.2) Maximum cost per individual if fully adherent to treatment, $ 1419 1671 2634 3138 Cost per randomized individual, mean (SD), $ 1175 (365) 1374 (412) 2022 (813) 2118 (1058) 52-wk Smoking abstinent, No. (%) 79 (25.1) 74 (23.6) 76 (24.4) 78 (25.1)

Combination therapy consisted of varenicline treatment in combination with nicotine replacement therapy patch.

SECTION: RESULTS
Incremental Cost-Effectiveness Ratio

As seen in Figure 2, the plot of the cost-effectiveness plane indicated that 12-week varenicline monotherapy and 24-week varenicline combination therapy lay on the cost-effectiveness frontier. The 2 other treatment combinations, 24-week varenicline monotherapy and 12-week varenicline combination therapy, were dominated (ie, another treatment combination was both cheaper and more effective). The ICER for 12-week varenicline monotherapy was $4681 per individual who quit smoking and $4579/QALY added. On average, 12-week varenicline combination therapy cost $199 more than 12-week monotherapy but was 0.7% less efficacious, hence dominated. Similarly, 24-week varenicline monotherapy cost $847 more than 12-week monotherapy on average but was 1.5% less efficacious, thus also dominated. The slope of the cost-effectiveness curve from 12-week monotherapy to 24-week combination therapy was $92 000 000 per additional individual who quit smoking or $90 000 000 (95% CI, $15 703 to dominated) per additional QALY. The slope of the cost-effectiveness curve between 12-week varenicline monotherapy and 24-week varenicline combination therapy rests above the $100 000/QALY cost-effectiveness threshold.

SECTION: FIG
Cost-Effectiveness Plane

The dotted lines represent the cost-effectiveness frontier. All points above and to the left of the cost-effectiveness frontier are dominated (more costly and less efficacious) by a treatment option on the frontier. NRT indicates nicotine replacement therapy.

SECTION: RESULTS
Incorporating variability in the sensitivity analysis, the results indicate that at the threshold of $100 000/QALY, 47.1% of bootstrap simulations (471 of 1000) yielded 12-week monotherapy as the most cost-effective treatment. In 22.8% of simulations (228 of 1000), 24-week combination therapy was the most cost-effective at the $100 000/QALY threshold.

Subgroup Analyses

Subgroup analyses by age, sex, race and ethnicity, educational level, number of years smoking, prior use of varenicline, tobacco dependence, motivation to quit smoking, and confidence in quitting smoking did not reveal any subgroups for which the ICER was statistically significant at the $100 000/QALY level.
For female, older, White, and more highly educated individuals and for individuals who had used varenicline in a prior smoking cessation attempt, 24-week combination therapy (ie, the most intensive treatment) yielded higher cessation rates than did the less intensive treatment. However, even in the best case for more intensive treatment (age =50 years, for whom 24-week combination therapy cessation rates exceeded 12-week monotherapy by 29.9% to 26.7%), the ICER per additional QALY was $33 751/QALY (95% CI, $10 848-$184 982/QALY), with the 95% CI overlapping the $100 000/QALY threshold.

SECTION: DISCUSS
Discussion

Our study demonstrated that among adults who smoked 5 or more cigarettes per day and who were interested in quitting smoking, 12-week varenicline monotherapy (condition 1) was the most cost-effective pharmacotherapy treatment (ie, ICER = $4681 per additional individual who quit smoking and $4579/QALY). More intense varenicline protocols, which combined varenicline therapy with the NRT patch or that prolonged treatment exposure to varenicline from 12 weeks to 24 weeks, were found not to be cost-effective options at the threshold recommended by the literature of $100 000/QALY in contrast to standard 12-week varenicline monotherapy. No cost-effective increases in smoking abstinence or projected health benefits were revealed when the QUITS condition 1 participants undergoing 12 weeks of varenicline monotherapy were juxtaposed with each of the other 3 treatment condition groups side by side. Furthermore, increased treatment intensity without commensurate increases in effectiveness can meaningfully increase the ICERs associated with treatment (=$94 000 000 in the present study). In addition, adherence rates decreased with increased treatment intensity. In sum, our economic evaluation did not offer evidence that would support combining varenicline use with the NRT patch or extending exposure to varenicline therapy.

This cost-effectiveness analysis provides evidence to policy makers and stakeholders on the economic impact of the various intensive varenicline treatment strategies with similar clinical significance and informs their decisions on how limited health care resources could be leveraged to improve patient health outcomes. The positive outcomes seen with modified varenicline pharmacotherapy in prior studies, involving either combination therapy or prolonged varenicline monotherapy, were not replicated in the QUITS trial. Moreover, this pattern of findings was largely invariant across different patient subgroups (ie, age, sex, educational level, and prior varenicline use).

Limitations

This study has several limitations. First, COVID-19 restrictions from March to July 2020 made it impossible for some participants (6% of the total sample) to biochemically verify their self-report of abstinence at 52 weeks. However, the findings were not meaningfully altered when these individuals were treated as smoking or missing at follow-up for the analysis. Second, medication use decreased over the course of the study. Suboptimal adherence to a medication regimen is a known factor in clinical pharmacotherapy use. Third, in light of 13.4% of the sample being lost to follow-up at the 52-week follow-up and 9.4% of participants withdrawing from the study, data loss might have decreased the accuracy of the effect sizes observed in the trial and possibly diminished the estimation capacity to detect cost-effectiveness associated with enhanced varenicline treatment.

SECTION: CONCL
Conclusions

In this economic evaluation of standard vs enhanced varenicline treatment for smoking cessation, standard of care varenicline monotherapy was the most cost-effective smoking cessation treatment protocol. Extended varenicline treatment duration and/or the combined use of varenicline with the NRT patch were shown not to be cost-effective at the commonly cited $100 000/QALY threshold used in cost-effectiveness studies. The results also underscore the importance of supplementing the effectiveness evaluation with health economic analyses, as these can provide important complementary information on the relative values of different treatments.