PMCID: 7336401 (link)
Year: 2020
Reviewer Paper ID: 28
Project Paper ID: 110
Q1 - Title(show question description)
Explanation: The title clearly identifies the study as an economic evaluation and specifies the interventions being compared by mentioning 'Conventional Computed Tomographic Calcium Scoring vs full chest CTCS' and describes the analysis as a 'cost-effectiveness analysis.'
Quotes:
-
Conventional Computed Tomographic Calcium Scoring vs full chest CTCS for lung cancer screening: a cost-effectiveness analysis
Q2 - Abstract(show question description)
Explanation: The abstract provides a summary of the study but lacks a structured format that explicitly breaks down into context, key methods, results, and alternative analyses. It presents some components such as background, methods, and results, but does not clearly separate or explicitly enumerate all the sections mentioned in the question.
Quotes:
-
Background: Conventional CTCS images the mid/lower chest for coronary artery disease (CAD). ... Full-chest CTCS (FCT) may be a cost-effective screening tool for IPN.
-
Methods: A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD. ...
-
Results: In the base case analysis, a FCT will lead to an increase of 0.03 QALYs comparing to conventional CTCS (14.54 vs 14.51 QALY, respectively), ...
Q3 - Background and objectives(show question description)
Explanation: The introduction offers comprehensive context by discussing CTCS's usage in coronary artery disease screening and the incidental discovery of pulmonary nodules. It outlines the potential of FCT to improve lung cancer detection by covering the entire lung field, emphasizing the study's hypothesis and its implications for policy-making, particularly in lung cancer screening criteria.
Quotes:
-
Conventional computed tomographic calcium scoring (CTCS) is a radiographic study frequently used to screen for coronary artery disease (CAD) in asymptomatic patients. Non-cardiac findings are routinely identified on CTCS, including, most commonly, incidental pulmonary nodules (IPN), which are identified in 10-18% of patients.
-
With this in mind, we believed CTCS may be a missed opportunity to scan the entire lung field for the purposes of identifying more 'incidental' lung cancers. Lung cancer is the leading cause of cancer death in the United States.
-
We hypothesized that adding upper lung field to a calcium scoring test to image the 'full chest' (FCT) was more cost-effective than conventional CTCS to screen for CAD and lung cancer.
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript does not mention the development of a health economic analysis plan or provide any location where it could be accessed, such as a published repository or supplementary materials.
Quotes:
-
Supplementary information accompanies this paper at 10.1186/s12890-020-01221-8.
-
This study did not involve human subjects and was determined to be exempt from ethics and IRB approval by the University Hospitals Cleveland Medical Center Institutional Review Board.
Q5 - Study population(show question description)
Explanation: The manuscript describes the characteristics of the hypothetical study population, particularly focusing on age and clinical characteristics related to coronary artery disease (CAD) and incidental pulmonary nodules (IPNs).
Quotes:
-
A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA). We assumed a hypothetical population with an average age of 50 years who required a screening CTCS to screen for CAD.
-
Current expert consensus agreed that calcium score imaging is appropriate for asymptomatic patients who are 40-75 year old with a 5-20% 10 year atherosclerotic cardiovascular disease (ASCVD) risk.
-
Current smoker and former smoker are reported to be around 28 and 39% in patients requiring CTCS.
Q6 - Setting and location(show question description)
Explanation: The manuscript provides relevant contextual information about the setting and location. It specifies that the study is based on a hypothetical patient cohort that requires screening for coronary artery disease (CAD) and references the use of data from the National Lung Screening Trial (NLST) to inform the model. Details on demographics, such as age and risk factors for CAD, are also included, which are crucial context for understanding the findings.
Quotes:
-
'A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD.'
-
'We assumed a hypothetical population with an average age of 50 years who required a screening CTCS to screen for CAD.'
-
'The model was informed by results of the National Lung Screening Trial and literature review...'
Q7 - Comparators(show question description)
Explanation: The manuscript provides descriptions of the two strategies being compared: the conventional computed tomographic calcium scoring (CTCS) and the full-chest CTCS (FCT) for screening purposes. The rationale for selecting these interventions is linked to their potential effectiveness in detecting incidental pulmonary nodules (IPNs) and lung cancers.
Quotes:
-
"Conventional computed tomographic calcium scoring (CTCS) is a radiographic study frequently used to screen for coronary artery disease (CAD) in asymptomatic patients."
-
"We hypothesized that adding upper lung field to a calcium scoring test to image the 'full chest' (FCT) was more cost-effective than conventional CTCS to screen for CAD and lung cancer."
Q8 - Perspective(show question description)
Explanation: The manuscript indicates that the perspective adopted in the study was societal. This perspective was chosen to evaluate the cost-effectiveness of the full chest CTCS compared to conventional CTCS by using a common threshold for cost-effectiveness ($50,000/QALY) which is generally used in societal evaluations.
Quotes:
-
We used ICER of $50,000/QALY as the societal threshold of cost-effectiveness.
-
A protocol exhibited dominance if it was both life-saving and cost saving. If dominance was not achieved, ICER was calculated.
Q9 - Time horizon(show question description)
Explanation: The study uses a lifetime horizon, which is appropriate for capturing both the long-term benefits and costs associated with detecting and treating cancers identified through different screening methods. This allows the analysis of Quality-Adjusted Life Years (QALYs) and cost-effectiveness over an extensive period.
Quotes:
-
Patients who sustained fractures incurred fracture-specific costs and reductions in health utilities.
Q10 - Discount rate(show question description)
Explanation: The manuscript does not provide information about the discount rate(s) used in the analysis, nor does it explain the rationale for choosing any specific discount rate. This aspect of the economic evaluation is not covered in the methods or results sections provided.
Quotes:
-
The key variables of the model included the probabilities of incidental nodules in patients receiving CTCS and the rate of malignancy found in these nodules. These variables are shown in Table 1.
-
Results of the base case analysis were effectiveness and cost.
Q11 - Selection of outcomes(show question description)
Explanation: The outcomes used as measures of benefit and harm in the study were Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER). These outcomes assess the effectiveness in terms of life quality adjustments and the cost per additional QALY gained, respectively.
Quotes:
-
The analysis outcomes are Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER), which is generally considered beneficial when <$50,000/QALY.
-
Effectiveness was defined as quality adjusted life year (QALY) and cost reported in dollars ($), and incremental cost-effective ratio (ICER) was calculated from these outcomes.
-
In the base case analysis, a FCT will lead to an increase of 0.03 QALYs comparing to conventional CTCS (14.54 vs 14.51 QALY, respectively)... The incremental cost-effectiveness ratio (ICER) is $10,289/QALY, suggesting significant benefit.
Q12 - Measurement of outcomes(show question description)
Explanation: The outcomes capturing benefits and harms in the study were measured using Quality-Adjusted Life Years (QALYs) and Incremental Cost-Effectiveness Ratios (ICERs). These metrics were based on the management strategies for incidental pulmonary nodules, complications from invasive procedures, and cancer treatments as modeled from existing data, primarily from the NLST.
Quotes:
-
The analysis outcomes are Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER).
-
Effectiveness was defined as quality adjusted life year (QALY) and cost reported in dollars ($), and incremental cost-effective ratio (ICER) was calculated from these outcomes.
-
In the base case analysis, a FCT will lead to an increase of 0.03 QALYs...
Q13 - Valuation of outcomes(show question description)
Explanation: The manuscript describes a study methodology involving a cost-effectiveness decision tree model applied to a hypothetical population of 50-year-old patients who require CTCS for coronary artery disease screening. The outcomes were measured in terms of Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER).
Quotes:
-
A cost-effectiveness decision tree model ... was built using Treeage Pro 2018... We assumed a hypothetical population with an average age of 50 years who required a screening CTCS to screen for CAD.
-
Effectiveness was defined as quality adjusted life year (QALY) and cost reported in dollars ($), and incremental cost-effective ratio (ICER) was calculated from these outcomes.
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The costs in the study were estimated and reported in 2018 dollar values. This includes specific cost ranges for CTCS, invasive procedures, imaging follow-ups, and treatments for major and minor complications, as laid out in the table presented within the manuscript.
Quotes:
-
"Cost (in 2018 dollar value) Base Case ($) Range ($) Reference CTCS 382 156-467 Invasive procedure 12,321 638-18,970 Imaging follow-up 954 n/a Treating major complications 6524 3262 - 19,678 Treating minor complications 622 311-933 Cancer treatment 12,217 6109 - 32,304"
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript specifies that the resource quantities and unit costs are in the year 2018 and are reported in dollar values. This information is clearly detailed in the tables and sections discussing costs in the manuscript.
Quotes:
-
- 'Cost (in 2018 dollar value)'
-
- 'CTCS 382 156-467'
-
- 'Cancer treatment 12,217 6109 - 32,304'
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript provides a detailed description of the model used in the study, including the rationale for its use, which was to analyze the cost-effectiveness of full-chest CTCS versus conventional CTCS in detecting lung nodules. However, it does not mention the model being publicly available or where it can be accessed.
Quotes:
-
A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA).
-
The model was informed by results of the National Lung Screening Trial and literature review, including the rate of malignancy among patients receiving CTCS and the rate of malignancy in upper vs lower portions of the lung.
-
The key variables of the model included the probabilities of incidental nodules in patients receiving CTCS and the rate of malignancy found in these nodules.
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript describes the use of a cost-effectiveness decision tree model, based on the Treeage Pro 2018 software, which was informed by literature review and National Lung Screening Trial data. It also mentions Monte Carlo simulations and sensitivity analysis for variability testing and model performance,
Quotes:
-
A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA).
-
A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model.
-
Single-variable sensitivity analyses were also performed for percentage of MPNs and malignancy rate of MPNs.
Q18 - Characterizing heterogeneity(show question description)
Explanation: The manuscript does not describe any methods used to estimate how results vary for different sub-groups. Instead, it focuses on a decision tree model based on general population data and uses sensitivity and Monte Carlo analyses to test variability in general, not specifically targeting different sub-groups.
Quotes:
-
"A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA). We assumed a hypothetical population with an average age of 50 years who required a screening CTCS to screen for CAD."
-
"Monte Carlo simulation and sensitivity analysis... A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1."
Q19 - Characterizing distributional effects(show question description)
Explanation: The manuscript does not specifically discuss how impacts were distributed across different individuals or any adjustments made to reflect priority populations. The analysis focuses on cost-effectiveness rather than stratifying results by demographic or priority groups.
Quotes:
-
This study suggests that there is benefit to lung cancer screening in other populations as well.
-
The patient population who received calcium scoring imaging was different from the NLST inclusion criteria.
-
Current smoker and former smoker are reported to be around 28 and 39% in patients requiring CTCS.
-
While the NLST is currently the 'gold standard' study for lung cancer screening, we believe that using the criteria within that study as the only criteria to screen for lung cancer is overly stringent.
Q20 - Characterizing uncertainty(show question description)
Explanation: The manuscript describes methods used to characterize uncertainty in the analysis, specifically mentioning Monte Carlo simulations and sensitivity analysis to test the variability of their model.
Quotes:
-
"A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1."
-
"Single-variable sensitivity analyses were also performed for percentage of MPNs and malignancy rate of MPNs."
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention any engagement with patients, service recipients, the general public, communities, or stakeholders in the design of the study. The study is based on a decision tree model informed by literature reviews and other pre-existing data sources, without indicating any direct involvement or input from these groups.
Quotes:
-
"A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD."
-
"The model was informed by results of the National Lung Screening Trial and literature review."
-
"This study did not involve human subjects and was determined to be exempt from ethics and IRB approval."
Q22 - Study parameters(show question description)
Explanation: The manuscript provides detailed information about the analytic inputs, including base cases, ranges, and references for various model parameters. The study also outlines how uncertainty was assessed through Monte Carlo simulations and sensitivity analyses.
Quotes:
-
Major variables used in the model to analyze the cost effectiveness of full chest CT vs conventional calcium score CT (CTCS)... Base Case Range Reference... Percentage of patients with IPNs on CTCS 11.25% N/A... Malignancy rate of MPNs 3.67% 3.67-5.5%
-
A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1.
-
Single-variable sensitivity analyses were also performed for percentage of MPNs and malignancy rate of MPNs.
Q23 - Summary of main results(show question description)
Explanation: The manuscript reports mean values for the main categories of costs and outcomes and summarizes them appropriately using QALYs and ICER as overall measures. The results of both the base case analysis and the Monte Carlo simulation, including effectiveness (QALYs) and costs, are clearly presented.
Quotes:
-
The base case analysis represents the best estimation of the 'real' difference between patients receiving CTCS and FTS. Results of the base case analysis were effectiveness and cost.
-
In the base case analysis, a FCT will lead to an increase of 0.03 QALYs comparing to conventional CTCS (14.54 vs 14.51 QALY, respectively), which translates into an QALY increase of 16 days. The associated incremental cost for FCT is $278 ($1027 vs $748, FCT vs CTCS respectively).
-
The ICER was calculated to be $10,447/QALY.
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript does not explicitly discuss the effects of the choice of discount rate and time horizon on the findings. The method sections describe a decision tree analysis using cost-effectiveness inputs but do not detail how discount rates or time horizons influence the overall results.
Quotes:
-
A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD.
-
The analysis outcomes are Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER).
-
Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model.
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention any involvement from patients, service recipients, the general public, community, or stakeholders in the study approach or findings. The study revolves around cost-effectiveness analysis using a decision tree model and data from existing literature and trials, without any reference to direct input or involvement from these groups.
Quotes:
-
A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD.
-
The model was informed by results of the National Lung Screening Trial and literature review.
-
Our study has several limitations. Foremost, the patient population who received calcium scoring imaging was different from the NLST inclusion criteria.
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript includes key findings and discusses their potential impact on patients and policy, but does not address specific ethical or equity considerations. The limitations are mentioned, but ethical and equity considerations are explicitly noted as outside the study’s scope.
Quotes:
-
Our study has several limitations. Foremost, the patient population who received calcium scoring imaging was different from the NLST inclusion criteria.
-
This study did not involve human subjects and was determined to be exempt from ethics and IRB approval by the University Hospitals Cleveland Medical Center Institutional Review Board.
SECTION: TITLE
Conventional Computed Tomographic Calcium Scoring vs full chest CTCS for lung cancer screening: a cost-effectiveness analysis
SECTION: ABSTRACT
Background
Conventional CTCS images the mid/lower chest for coronary artery disease (CAD). Because many CAD patients are also at risk for lung malignancy, CTCS often discovers incidental pulmonary nodules (IPN). CTCS excludes the upper chest, where malignancy is common. Full-chest CTCS (FCT) may be a cost-effective screening tool for IPN.
Methods
A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD.
A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD.A decision tree was created to compare a FCT to CTCS in a hypothetical patient cohort with suspected CAD. (Figure) The design compares the effects of missed cancers on CTCS with the cost of working up non-malignant nodules on FCT. The model was informed by results of the National Lung Screening Trial and literature review The model was informed by results of the National Lung Screening Trial and literature review, including the rate of malignancy among patients receiving CTCS and the rate of malignancy in upper vs lower portions of the lung. The analysis outcomes are Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER) The analysis outcomes are Quality-Adjusted Life Year (QALY) and incremental cost-effectiveness ratio (ICER), which is generally considered beneficial when $50,000/QALY.
Results
Literature review suggests that rate of IPNs in the upper portion of the lung varied from 47 to 76%. Our model assumed that IPNs occur in upper and lower portions of the lung with equal frequency. The model also assumes an equal malignancy potential in upper lung IPNs despite data that malignancy occurs 61-66% in upper lung fields.
In the base case analysis, a FCT will lead to an increase of 0.03 QALYs comparing to conventional CTCS (14.54 vs 14.51 QALY, respectively), which translates into an QALY increase of 16 days. The associated incremental cost for FCT i.
In the base case analysis, a FCT will lead to an increase of 0.03 QALYs comparing to conventional CTCS (14.54 vs 14.51 QALY, respectively), which translates into an QALY increase of 16 days. The associated incremental cost for FCT is $278 ($1027 vs $748, FCT vs CTCS respectively. The incremental cost-effectiveness ratio (ICER) is $10,289/QALY, suggesting significant benefit. Sensitivity analysis shows this benefit increases proportional to the rate of malignancy in upper lung fields.
Conclusion
Conventional CTCS may be a missed opportunity to screen for upper lung field cancers in high risk patients. The ICER of FCT is better than screening for breast cancer screening (mammograms $80 k/QALY) and colon cancer (colonoscopy $6 k/QALY). Prospective studies are appropriate to define protocols for FCT.
SECTION: INTRO
Background
Conventional computed tomographic calcium scoring (CTCS) is a radiographic study frequently used to screen for coronary artery disease (CAD) in asymptomatic patients. Non-cardiac findings are routinely identified on CTCS, including, most commonly, incidental pulmonary nodules (IPN), which are identified in 10-18% of patient. Prior studies have shown that work up of these IPNs leads to improved lung cancer mortality. The benefit in lung cancer mortality is limited to the cancers in the lower lung fields. CTCS only images the mid and lower chest and does not include the upper lung fields. Observational studies suggest that pulmonary nodules are more common in the upper lung fields, as primary lung cancers. With this in mind, we believed CTCS may be a missed opportunity to scan the entire lung field for the purposes of identifying more "incidental" lung cancers.
Lung cancer is the leading cause of cancer death in the United States. Based on the success of the National Lung Cancer Screening Trial (NLST), the United States Preventive Service Task Force (USPSTF) recommends screening for lung cancer with low dose computed tomography (LDCT) in patients age 55-80 years who are current smokers (with a 30 pack-year smoking history) or have quit within 15 years. Although lung cancer screening was found to be beneficial in this cohort, it is unclear if there is benefit in other populations.
We hypothesized that adding upper lung field to a calcium scoring test to image the "full chest" (FCT) was more cost-effective than conventional CTCS to screen for CAD and lung cancer. We performed a decision analysis to analyze the potential cost/benefit of the FCT study relative to CTCS.
SECTION: METHODS
Methods
SECTION: FIG
Cost-Effectiveness Analysis Tree-Age Model
SECTION: METHODS
A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA). We assumed a hypothetical population with an average age of 50 years who required a screening CA cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA).A cost-effectiveness decision tree model (Fig. 1) was built using Treeage Pro 2018 (Williamstown, MA). We assumed a hypothetical population with an average age of 50 years who required a screening CTCS to screen for CAD. Patients would either receive a CTCS or FTS as their primary coronary imaging method. The rate of IPN was modeled based on literature review. The management of IPNs found on imaging was modeled using data from NLST. IPNs were managed with either invasive procedures for diagnosis or followed by serial imaging. The complications of the invasive procedures were categorized as death, major complications, minor complications, or event free survival. The utility of patients ranges from 0 (death) to 1 (perfect health). A disutility was applied to major and minor complications in the post-procedure periods. If cancer was diagnosed, appropriate cancer treatment was implemented and outcomes were based on NLST data. The outcome of the model was effectiveness and cost. Effectiveness was defined as quality adjusted life year (QALY) and cost reported in dollars ($), and incremental cost-effective ratio (ICER) was calculated from these outcomes.Effectiveness was defined as quality adjusted life year (QALY) and cost reported in dollars ($), and incremental cost-effective ratio (ICER) was calculated from these outcomes.
Missed pulmonary nodules (MPN)
In CTCS, some pulmonary nodules are not identified due to the limited lung volume included in this imaging modality. For the decision analysis, we assume that the amount of the MPN were proportional to the unscanned lung volume. Because CTCS only includes the lower half of the lung field, we assumed that the amount of MPN were equal to the identified IPNs in CTCS. This may underestimate the true number of IPNs as some studies suggest higher rate of IPNs in the upper lung fields. Despite data regarding the malignant potential of IPN in CTCS, the malignancy rate of the MPN is unknown. We assumed that the MPN malignancy rate was the same as the identified IPN, despite some suggestions that lung cancer is more common in the upper lung fields. Patient who received a CTCS and had MPNs were categorized as having either benign disease or malignancy. Those with malignancy were assumed to be present with lung cancer at later stages and received lung cancer treatment.
Variables
SECTION: TABLE
Major variables used in the model to analyze the cost effectiveness of full chest CT vs conventional calcium score CT (CTCS)
Possibilities Base Case Range Reference Percentage of patients with IPNs on CTCS 11.25% N/A Percentage of patients with MPNs on CTCS 11.25% 11.25-14.40% Malignancy rate of IPNs 3.67% N/A Malignancy rate of MPNs 3.67% 3.67-5.5% Percentage of IPNs had invasive diagnostic procedure 6.1% N/A Percentage of IPNs followed with imaging only 93.9% N/A Any complications caused by invasive diagnostic procedure 23.9% N/A Major complications after invasive diagnostic procedure 8.1% N/A Mortality caused by invasive diagnostic procedure 1.5% n/a Lifetime cancer recurrence rate 33% n/a Utility Base Case Range Reference Baseline utility 0.845 0.838-0.854 After lung cancer diagnosis 0.62 0.31-0.83 Major complication after invasive procedure 0.5 0.4-0.7 Minor complication after invasive procedure 0.7 n/a Cost (in 2018 dollar value) Base Case ($) Range ($) Reference CTCS 382 156-467 Invasive procedure 12,321 638-18,970 Imaging follow-up 954 n/a Treating major complications 6524 3262 - 19,678 Treating minor complications 622 311-933 Cancer treatment 12,21e CTCS 382 156-467 Invasive procedure 12,321 638-18,970 Imaging follow-up 954 n/a Treating major complications 6524 3262 - 19,678 Treating minor complications 622 311-933 Cancer treatment 12,217 6109 - 32,304
SECTION: METHODS
The key variables of the model included the probabilities of incidental nodules in patients receiving CTCS and the rate of malignancy found in these nodules. These variables are shown in Table 1. The rates of invasive procedures and complications from these procedures were modeled from NLST and are also listed.
Base case analysis
The base case analysis represents the best estimation of the "real" difference between patients receiving CTCS and FTS. Results of the base case analysis were effectiveness and cost. A protocol exhibited dominance if it was both life-saving and cost saving. If dominance was not achieved, ICER was calculated. We used ICER of $50,000/QALY as the societal threshold of cost-effectiveness.
Monte Carlo simulation and sensitivity analysis
A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1.
A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1.A Monte Carlo simulation of 10,000 iterations was performed to test the variability of the model. The major variables were randomly re-sampled in a reasonable range as listed in Table 1. Results are reported as median and 10-90th percentile. Single-variable sensitivity analyses were also performed for percentage of MPNs and malignancy rate of MPNs.Single-variable sensitivity analyses were also performed for percentage of MPNs and malignancy rate of MPNs.
SECTION: RESULTS
Results
Base case analysis
In the base case analysis, FCT is more cost-effective than CTCS, however, FCT does not dominate CTCS. FCT saves an additional 0.03 QALY (14.54 vs 14.51 QALY, FCT vs CTCS respectively) with an additional cost of $278 ($1027 vs $748, FCT vs CTCS respectively). The ICER was calculated to be $10,289/QALY.
Monte Carlo simulation
SECTION: TABLE
Monte Carlo Simulation Result of 10,000 iterations
Median [10th - 90th percentile] CTCS FCT Effectiveness (QALY) 14.51 [14.34-14.67] 14.54 [14.38-14.70] Cost ($) 747 [616-875] 1023 [861-1190] ICER ($/QALY) 10,447 [8039 - 13,186]
SECTION: RESULTS
A Monte Carlo simulation of 10,000 iterations was performed to assess the variability of the model. The median effectiveness is 14.54 QALY for FCT (14.38 to 14.70, 10th and 90th percentile) compared to 14.51 QALY for CTCS (14.34 to 14.67, 10th and 90th percentile), confirming the benefit found in the base case analysis. The median cost for FCT and CTCS are $1023 and $747, respectively. The median ICER was $10,447/QALY ($8039/QALY to $13,186/QALY, 10th and 90th percentile). These results are summarized in Table 2.
Sensitivity analysis
SECTION: FIG
Relationship of malignancy rate of missed pulmonary nodules vs Incremental Cost Effectiveness Ratio (ICER) of "full chest scan" vs conventional calcium score CT (FCT vs CTCS). Dashed line indicates the cost-effective threshold of $50,000/QALY. When the malignancy rate 1.59%, FCT becomes cost-effective, ie ICER $50,000/QALY
SECTION: RESULTS
Sensitivity analyses of the malignancy rate of MPNs were performed. If the malignancy rate of MPNs is higher than 1.59%, FCT becomes more cost-effective than CTCS (ICER $50,000/QALY). The ICER of FCT decreases with increased malignancy rate of MPNs (Fig. 2). However, the model is not sensitive to the rate of MPNs. The ICER of FCT continues to be at $10,289/QALY when the rate of MPNs varies from 1 to 30%.
SECTION: DISCUSS
Discussion
In our cost-effectiveness analysis, we showed that a full chest scan is cost-effective in patients requiring CT calcium scoring to screen for coronary artery disease because it saves lives from lung cancer. It saved 0.03 QALY (about 11 days of life) with an additional cost of $278 for a calculated ICER of $10,289/QALY. This result showed FCT was more cost-effective than CTCS. This benefit was further confirmed by Monte-Carlo simulation, which estimated the true ICER to be between $8039/QALY and $13,186/QALY. To put this result into perspective, implementation of mammogram for breast cancer screening has a reported ICER ranging from $60,000 to $80,000/QALY. Screening colonoscopy has an ICER of $15,000/QALY which is comparable to the calculated ICER of FCT. Both screening colonoscopy and mammogram are fully reimbursed by most insurances. While the NLST is currently the "gold standard" study for lung cancer screening, we believe that using the criteria within that study as the only criteria to screen for lung cancer is overly stringent. This study suggests that there is benefit to lung cancer screening in other populations as well. Coronary artery calcification is frequently identified in patients undergoing lung cancer screening with LDCT. NLST data have shown that the presence of coronary artery calcification is associated with a 3 fold increase in cardiovascular death. These studies suggest a concordance of CAD and lung cancer. Therefore, adding patients who are receiving CTCS to a lung cancer screening cohort is reasonable on several levels.
The actual benefit of FCT is likely underestimated in this study. The actual malignancy rate of the MPNs in this population was unknown, and estimation of this rate was intentionally conservative. Observational studies of pulmonary nodules based on locations suggest that the upper lung fields have more nodules than the lower lung fields and that upper lung nodules tended to have higher malignancy rate. These observational studies were part of our rationale to modify existing CTCS scanning protocols. Interestingly, one study noted that one patient undergoing CTCS developed lung cancer without incidental finding on CTCS suggesting possible missed nodules. In our model, we took a conservative approach in the base-case analysis by assuming an equal malignancy of upper and lower lung field nodules. Even with this assumption, the base-case analysis is cost-effective. Given the conservative nature of our estimates, the actual benefit of FCT may be even more cost-effective than our base-case analysis result. This was corroborated by the sensitivity analysis, which showed that the higher the malignant rate of the MPNs was, the lower the ICER of FCT would become.
Our study has several limitations. Foremost, the patient population who received calcium scoring imaging was different from the NLST inclusion criteria.the patient population who received calcium scoring imaging was different from the NLST inclusion criteria. NLST screened patients aged 55-75 years old who were current smokers or a former smoker who quit less than 15 years prior and with at least 30 pack year smoking history. The criteria for calcium score imaging is not specifically targeted to patient with history of tobacco use. Current expert consensus agreed that calcium score imaging is appropriate for asymptomatic patients who are 40-75 year old with a 5-20% 10 year atherosclerotic cardiovascular disease (ASCVD) risk. The ASCVD risk is calculated based on age, sex, race, smoking status, blood pressure, cholesterol levels, smoking status and diabetic status. Atherosclerotic cardiovascular disease shared risk factors with lung cancer which could explain the benefit of performing FCT on this population. Current smoker and former smoker are reported to be around 28 and 39% in patients requiring CTCS. We concede that as tobacco rates decrease, the malignancy rate in IPN will also decrease, thereby erasing the benefit of FCT. While this is a significant limitation, the sensitivity analysis suggests that an FCT protocol for screening coronary artery disease with CT scan will have benefit until the malignancy rate in MPN falls below 1.5%, which is much lower than current estimates. Our model is not sensitive to the amount of the MPNs but only to the malignancy rate of the MPNs. In another word, the cost-effectiveness benefit of FCT derives from identifying malignant pulmonary nodules. As many studies have shown, the majorities of incidental pulmonary nodules found on CTCS are benign. Workup of benign findings will not translate into survival benefit which is proven in our model.
As mentioned above, this study is an exploration of the potential benefit of FCT. In that regard, another weakness of this study is that FCT does not exist as an established imaging protocol. Imaging parameters are yet to be established. Our institution will be creating protocols for these studies and hope to standardize this for international adoption. We included a proposed FCT protocol in the supplemental material (Supplemental Figure 1). Other potential weaknesses of this study are that some outcomes of FCT are not modeled in the outcomes. For example, with increased lung field scanned, more incidental findings such as blebs and emphysematous change may found, and the burden of these findings are not included in the analysis. The increased workload of radiologists was not modelled in our analysis. Radiologists who read CTCS were required to recognize extracardiac findings as these were frequently found on the current CTCS. FCS would identify more extracardiac findings which would require more work of the reading radiologist to characterize these findings. However, we expected the increased workload of FCT would be limited because these extracardiac findings of FCT were similar to that found on CTCS. From a practical standpoint, it would be very difficult to model the increased workload in our current model due to the lack of actual data. We felt it would be better explored in a prospective study. Lastly, the increased radiation exposure to the upper lung fields were not included. Recent studies have shown that the radiation exposure for CTCS is about 1 mSv. Including additional apical lungs for FCT is likely resulting in a negligible increase of overall radiation exposure. Some studies have suggested high radiation exposure in cancer patient cohorts increase the risk of developing cardiovascular disease but the radiation exposure in the study was mainly from radiation therapy instead of diagnostic radiation.
The NLST included a strict inclusion criterion to reduce unnecessary screening and interventions. At the same time, it also prevented patients who might harbor lung cancers but did not meet the inclusion criteria from screening and early detection. Patients who were at high risk for lung cancers but did not meet the NLST criteria had a difficult time to obtain a screening LDCT and get insurance to pay for it. This practically excluded them from being screened for lung cancer. Because lung cancer is by far the leading cause of cancer in the United States, we advocate for a new lung screening strategy to combat this disease. With the theoretical benefit for FCT in our study, we recommend implementation of this protocol. Once implemented, prospective study of the true effectiveness and cost could then be realized.
SECTION: CONCL
Conclusion
We concluded in our cost-effectiveness analysis that FCT was more cost-effective than CTCS for screening for lung cancer and coronary artery disease among patients with risk factors for coronary artery disease. This is the first study to show this potential benefit of FCT. Protocols and prospective studies are needed to further establish FCT and realize its full potential.
SECTION: SUPPL
Supplementary information
SECTION: ABBR
Abbreviations
CAD
Coronary artery disease
CTCS
Conventional computed tomographic calcium scoring
FCT
Full-chest CTCS
ICER
Incremental cost-effectiveness ratio.
IPN
Incidental pulmonary nodules
LDCT
Low dose computed tomography
MPN
Missed pulmonary nodules
NLST
National Lung Cancer Screening Trial
QALY
Quality-adjusted life year
USPSTF
United States Preventive Service Task Force
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
SECTION: SUPPL
Supplementary information
Supplementary information accompanies this paper at 10.1186/s12890-020-01221-8.
SECTION: METHODS
Availability of data and materials
Not applicable.
Ethics approval and consent to participate
This study did not involve human subjects and was determined to be exempt from ethics and IRB approval by the University Hospitals Cleveland Medical Center Institutional Review Board.This study did not involve human subjects and was determined to be exempt from ethics and IRB approval by the University Hospitals Cleveland Medical Center Institutional Review Board.
Consent for publication
Not applicable.