PMCID: 7895873 (link)
Year: 2021
Reviewer Paper ID: 9
Project Paper ID: 38
Q1 - Title(show question description)
Explanation: The title does not identify the study as an economic evaluation or specify the interventions being compared. It only mentions the value of a new diagnostic test for prostate cancer and describes the analysis as a cost-utility analysis, which does not explicitly indicate it is an economic evaluation comparing interventions.
Quotes:
-
Title: The Value of a New Diagnostic Test for Prostate Cancer: A Cost-Utility Analysis in Early Stage of Development
Q2 - Abstract(show question description)
Explanation: The abstract is not structured and does not clearly delineate sections such as context, methods, results, and alternative analyses. It provides an overview of the background, objective, method, and a brief conclusion, but it lacks a distinct and organized structure that covers all the specified elements.
Quotes:
-
Background: Standard biopsy for prostate cancer diagnosis is an unpleasant and sometimes painful procedure...
-
Objective: The aim of this analysis was to investigate the health-economic value of introducing a new and more accurate diagnostic blood-based test...
-
Conclusion: A new blood-based test for prostate cancer has a significant potential to reduce the number of biopsies needed, resulting in reduced health care costs and improve patient care.
Q3 - Background and objectives(show question description)
Explanation: The introduction of the manuscript provides the context for the study, which is the need for improved diagnostic procedures for prostate cancer due to the limitations of current methods such as the PSA test and standard biopsy. It outlines the study question about assessing the health-economic value of a new blood-based diagnostic test. The practical relevance for decision-making is highlighted by discussing the potential to reduce unnecessary biopsies and improve early diagnosis, essential for health policy considerations.
Quotes:
-
Prostate cancer is one of the most common cancers and the third leading cause of cancer-related deaths among men in developed countries. One factor behind this dismal development is the lack of symptoms at an early stage of the disease, resulting in late diagnosis since the diagnostic tools available today are insufficient and not applicable to a population-based screening.
-
Due to these limitations, several diagnostic assays have been presented over the last years, such as, (1) STHLM3 that has shown to reduce unnecessary biopsies in prostate cancer with Gleason >= 7; (2) Prostate health Index (PHI) and (3) 4KScore.
-
Estimating the health economic value of introducing a new test in prostate cancer diagnosis before being fully developed, would generate important incentive to facilitate further development of new tests for prostate cancer diagnosis.
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript states that a health economic analysis was developed, but it does not explicitly mention a separate health economic analysis plan. However, it provides detailed descriptions of the methodologies and modeling used, following Swedish and international guidelines for economic evaluation.
Quotes:
-
This study was conducted in accordance with Swedish and international guidelines for economic evaluation.. The analysis has a health-care sector perspective, including only health-care costs.
-
Estimating the health economic value of introducing a new test in prostate cancer diagnosis before being fully developed, would generate important incentive to facilitate further development of new tests for prostate cancer diagnosis.
-
Health economic early-decision modeling is a well-established method to quantitatively estimate the likely health and cost consequences of a new test in the diagnostic pathway for prostate cancer, i.e. to screens for persons in need of a biopsy and previous health economic studies have shown a possibility to reduce unnecessary biopsies.
Q5 - Study population(show question description)
Explanation: The manuscript describes the age range of the study population as well as some clinical characteristics. It mentions a cohort of PSA-tested men aged 50-69 years and breaks down their PSA levels, which are critical to stratifying the risk of prostate cancer and guiding the diagnostic pathway in the study.
Quotes:
-
Among 31,250 men, age 50-69 years, 16.4% had a PSA between 3.0 and 9.9 microg/L and 28.9% a PSA of 2.0-9.9 microg/L.
-
Consequently, the objective of this study was to estimate the potential value of a new diagnostic blood-based test in prostate cancer in a cohort representing PSA tested men 50-69 years old.
-
We included 31,250 men, representing PSA-tested men aged 50-69 years in Region Skane, Sweden. Each man was assigned, (1) a starting age between 50 and 69 years, (2) an age-related PSA-value, based on aggregated registry data.
Q6 - Setting and location(show question description)
Explanation: The manuscript provides specific contextual information about the study setting and location, which is the Swedish region Skane. Details are given on the population size and the healthcare perspective from which the analysis is conducted, all of which can influence study outcomes.
Quotes:
-
The analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region Skane (population of 1.3 million).
-
The current study is based on the clinical guideline used in Sweden today were MRI guided biopsy and/or active surveillance are still not a general recommendation.
-
We included 31,250 men, representing PSA-tested men aged 50-69 years in Region Skane, Sweden.
Q7 - Comparators(show question description)
Explanation: The manuscript describes three different testing strategies, comparing them against current clinical practice, along with the rationale for each strategy's selection based on PSA values. Additionally, it discusses the selection of a new blood-based test due to limitations in current diagnostic tools and highlights its assumed 90% sensitivity and specificity in comparison to the existing methods.
Quotes:
-
In current clinical practice, men with PSA >= 3 microg/L or abnormal digital rectal examination (DRE) undergo prostate biopsy. In this study, three hypothetical testing strategies were evaluated and compared with current clinical practice.
-
The first strategy tested the same men as in current clinical practice, with a PSA value between 3.0 and 9.9 microg/L, aiming to reduce the need for biopsies. The second strategy tested an extended population with a PSA value between 2.0 and 9.9 microg/L. The third strategy, only tested men with a PSA value between 2.0 and 2.9 microg/L.
Q8 - Perspective(show question description)
Explanation: The study explicitly states in the methods section that the analysis was conducted from a health-care perspective. This choice includes only health-care costs, aligning with the focus on cost-effectiveness and resource utilization within the healthcare sector, without considering broader societal costs or individual patient costs.
Quotes:
-
The analysis has a health-care sector perspective, including only health-care costs.
Q9 - Time horizon(show question description)
Explanation: The article specifies a lifelong time horizon for the study, which is appropriate given the chronic and progressive nature of prostate cancer and its potential long-term outcomes. This allows the model to capture the full range of costs and health effects over the lifetime of the patients.
Quotes:
-
The model has a lifelong time horizon and it was assumed that only men with metastatic cancer could die from prostate cancer, while all men also had Swedish age-related other-cause mortality.
Q10 - Discount rate(show question description)
Explanation: The manuscript states that all health effects and costs were discounted at a yearly discount rate of 3%, following Swedish recommendations. This includes the costs used in the cost and utility input model in evaluating the new diagnostic test for prostate cancer.
Quotes:
-
All health effects and cost were discounted at a yearly discount rate of 3% following Swedish recommendations.
Q11 - Selection of outcomes(show question description)
Explanation: The manuscript explicitly mentions measuring outcomes such as the number of biopsies, cancer diagnosis, treatments, prostate cancer deaths, and quality-adjusted life-years (QALYs) as measures of benefit and harm in the evaluation of the new diagnostic test for prostate cancer.
Quotes:
-
Model outputs included number of biopsies, cancer diagnosis, treatments and death from prostate cancer. Total costs and QALYs were calculated based on modelled events.
-
The primary endpoints of the model were life-years gained, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratios for denosumab against the comparators.
-
Testing men with PSA 3.0-9.9 microg/L, as in current clinical practice, decreased the number of biopsies by 3595, detected 61 more cancers, resulting in and two more fatalities and subsequently a loss of 14 QALYs.
Q12 - Measurement of outcomes(show question description)
Explanation: The manuscript measures outcomes to capture the benefits and harms using Quality-adjusted life years (QALYs). This metric was utilized to assess the health outcomes of different testing strategies comparing them with current clinical practices, highlighting both potential health gains and losses.
Quotes:
-
Model outputs included number of biopsies, cancer diagnosis, treatments and death from prostate cancer. Total costs and QALYs were calculated based on modelled events.
-
The introduction of a new blood test for prostate cancer...detected 61 more cancers, resulting in and two more fatalities and subsequently a loss of 14 QALYs.
Q13 - Valuation of outcomes(show question description)
Explanation: The manuscript describes a discrete event simulation model to evaluate prostate cancer diagnostics and treatment aimed at men aged 50-69 years with varying PSA values, and the outcomes were valued using Quality-adjusted life years (QALYs).
Quotes:
-
In this study, we focus on the effect a new test would have if introduced as a screening tool at diagnosis, after a PSA test, which is why the patient groups in this study are divided based on their PSA value.
-
We constructed a Discrete Event Simulation (DES) model for evaluation of prostate cancer diagnostics and treatment. It uses micro-simulation techniques to simulate individual diagnostic pathways and capture competing event risks.
-
Health effects were quantified as Quality-adjusted life years (QALYs) and event-related QALY-losses were based on literature.
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The costs in the study were valued using 2017 Swedish currency (SEK) and included various health care-related aspects such as PSA tests, biopsies, and treatments. These cost inputs were sourced based on price lists from Swedish regional healthcare providers and were accumulated over the lifetime of the study cohort.
Quotes:
-
"Costs for curative treatments and hospitalization were obtained from the hospital administration and costs for PSAtest, prostate biopsy and diagnosis from price lists from the regional healthcare provider, Region Skane."
-
"All costs were calculated in Swedish currency (SEK) at 2017 price level."
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript states that resource quantities and unit costs were based on data from the Swedish region Skane in 2015 and that all costs were calculated in Swedish currency (SEK) at the 2017 price level. This provides the necessary information about the dates and currency for the cost conversions.
Quotes:
-
'Number of prostate-specific antigen (PSA) tests and distribution of PSA values by age group in Region Skane year 2015.'
-
'All costs were calculated in Swedish currency (SEK) at 2017 price level.'
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript provides some details about the model used, like it being a Discrete Event Simulation Model, but lacks a detailed rationale for its use. Furthermore, the model is proprietary to IHE, and its access is restricted to their discretion, making it not publicly available.
Quotes:
-
"We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths."
-
"The simulation model used to derive the analysis is the proprietary of IHE, and access to the model is at the discretion of IHE."
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript indicates the use of a Discrete Event Simulation model to evaluate the prostate cancer diagnostics and treatment pathways. It details the application of micro-simulation techniques, sensitivity analyses, and the calibration of progression risks using existing clinical trial data, describing the extrapolation and validation steps implicitly through these methods.
Quotes:
-
"We constructed a Discrete Event Simulation (DES) model for evaluation of prostate cancer diagnostics and treatment. It uses micro-simulation techniques to simulate individual diagnostic pathways and capture competing event risks."
-
"The model has a lifelong time horizon and it was assumed that only men with metastatic cancer could die from prostate cancer, while all men also had Swedish age-related other-cause mortality."
-
"Probabilistic sensitivity analysis across 1000 simulated cohorts."
-
"The risks of progression for GS6 cancers on active surveillance and radical treatment were calibrated by using the event rates for metastasis and all cause death in the Prostate Testing for Cancer and Treatment (ProtecT)."
Q18 - Characterizing heterogeneity(show question description)
Explanation: The manuscript does not specifically mention any methods used to estimate how results vary for different sub-groups. While the study used a Discrete Event Simulation Model to evaluate diagnostic pathways and included simulations for different PSA value ranges, it does not discuss specific methodologies for analyzing variations within sub-groups.
Quotes:
-
We constructed a Discrete Event Simulation (DES) model for evaluation of prostate cancer diagnostics and treatment. It uses micro-simulation techniques to simulate individual diagnostic pathways and capture competing event risks.
-
In this study, three hypothetical testing strategies were evaluated and compared with current clinical practice.
-
Model outputs included number of biopsies, cancer diagnosis, treatments and death from prostate cancer.
Q19 - Characterizing distributional effects(show question description)
Explanation: The manuscript does not provide details on how the impacts of the new diagnostic test were distributed across different individuals or any specific adjustments made to reflect priority populations. The focus is on testing strategies and economic impact based on PSA levels without mentioning targeted priority groups.
Quotes:
-
The second testing strategy of 9014 men with PSA between 2.0 and 9.9 microg/L reduced the number of biopsies by 2608. At the same time more cancer cases were initially detected, and six fewer men died from prostate cancer.
-
We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths. The analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region Skane (population of 1.3 million).
Q20 - Characterizing uncertainty(show question description)
Explanation: The manuscript specifically mentions the use of deterministic and probabilistic sensitivity analyses to characterize sources of uncertainty in the analysis. It describes how these analyses assessed potential value drivers and the robustness of the results.
Quotes:
-
Potential value drivers were tested by deterministic and probabilistic sensitivity analysis across 1000 simulated cohorts.
-
The probabilistic sensitivity analysis indicated that the results are robust. The results for each of the three strategies are shown in the cost-effectiveness planes in Fig. 2.
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention any engagement of patients, service recipients, the general public, communities, or stakeholders in the design of the study. The study utilized existing epidemiological data, treatment patterns, and healthcare costs from Sweden without input or participation from the groups in question.
Quotes:
-
"The analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region Skane."
-
"In this study, three hypothetical testing strategies were evaluated and compared with current clinical practice."
-
"This study was conducted in accordance with Swedish and international guidelines for economic evaluation.."
Q22 - Study parameters(show question description)
Explanation: The manuscript does not provide detailed reporting of all analytic inputs or study parameters, including ranges and references for values and assumptions related to uncertainty or distributional assumptions. While some parameters such as the sensitivity and specificity of tests are mentioned, the uncertainty or distributional assumptions associated with these inputs are not comprehensively detailed, leaving gaps in full transparency of the model's analytic inputs or study parameters.
Quotes:
-
"A 90% sensitivity and specificity of the new test was assumed."
-
"Costs for curative treatments and hospitalization were obtained from the hospital administration and costs for PSAtest, prostate biopsy and diagnosis from price lists from the regional healthcare provider, Region Skane (Table 3). The yearly cost for treating metastatic cancer was based on a recent health-economic evaluation by the Swedish Dental and Pharmaceutical Benefits Agency."
-
"For each testing strategy, the test value was calculated at a cost-neutral level, resulting in no increase in health care costs, and at a value of health of SEK 500,000 per QALY, which is the threshold between a moderate and a high cost per QALY used by the Swedish National Board of Health and Welfare."
Q23 - Summary of main results(show question description)
Explanation: The article provides mean values for cost and outcomes, specifically detailing cost in SEK and QALYs gained or lost. Additionally, these outcomes are summarized using overall measures like total QALYs and test value, which are appropriate for evaluating cost-effectiveness.
Quotes:
-
The total cost accumulated over the lifetime of the 31,250 men was 1.2 billion SEK... In total, the men generated 380,334 QALYs over their lifetimes.
-
The cost-neutral value of the test was SEK 4996 and the value of the test, at a value of health of SEK 500,000 per QALY was SEK 3622.
-
...test value was calculated at a ... value of health of SEK 500,000 per QALY, which is the threshold between a moderate and a high cost per QALY...
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript addresses the impact of uncertainty in analytical inputs on the findings, particularly by conducting sensitivity analyses. It reports how changes in test sensitivity, specificity, and discount rates affect the cost-effectiveness of prostate cancer diagnostic strategies. The article discusses a 3% discount rate, a standard practice for economic evaluations in Sweden.
Quotes:
-
All health effects and cost were discounted at a yearly discount rate of 3% following Swedish recommendations.
-
Potential value drivers were tested by deterministic and probabilistic sensitivity analysis across 1000 simulated cohorts.
-
The probabilistic sensitivity analysis indicated that the results are robust. The results for each of the three strategies are shown in the cost-effectiveness planes in Fig. 2.
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not mention any specific involvement of patients, service recipients, the general public, community, or stakeholders in shaping the approach or findings of the study. The focus is primarily on health economic modeling and simulation based on existing data and assumptions rather than input from these groups.
Quotes:
-
'We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths. The analysis was performed from a health care perspective.'
-
'This study was conducted in accordance with Swedish and international guidelines for economic evaluation.. The analysis has a health-care sector perspective, including only health-care costs.'
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript does not comprehensively address all the aspects listed in the question. While it discusses key findings and limitations, it lacks explicit details on ethical or equity considerations, and their potential impact on patients, policy, or practice. The focus is primarily on economic evaluation and model strategies without delving into broader ethical or policy implications.
Quotes:
-
A limitation with our study is that progression rates and metastasis risks were taken from international clinical studies and may differ from real-world data.
-
The value of a test is generally determined based on two types of value propositions... However, with an assumed sensitivity of the new test of 90% it will not identify as many prostate cancers as the current management, thus, the new test will result in loss of QALYs.
-
Our study aimed at identifying and analyzing some of these criteria and conditions in order to specify which factors are driving the value of the new test.
SECTION: TITLE
The Value of a New Diagnostic Test for Prostate Cancer: A Cost-Utility Analysis in Early Stage of Development
SECTION: ABSTRACT
Background
Standard biopsy for prostate cancer diagnosis is an unpleasant and sometimes painful procedure with a detection rate as low as around 50%. Consequently, an accurate blood-based test would be highly desirable to improve the predictive accuracy. However, the clinical value of a new blood test for diagnosing prostate cancer depends on its sensitivity and specificity, in relation to the selected target population.
Objective
The aim of this analysis was to investigate the health-economic value of introducing a new and more accurate diagnostic blood-based test to identify men in need of a biopsy to diagnose prostate cancer.
Method
We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths. The analysis was performed from a health care perspective.We developed a Discrete Event Simulation Model with outputs including number of biopsies, cancer diagnosis, treatments and prostate cancer deaths. The analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region SkaneThe analysis was performed from a health care perspective. It used epidemiologic data, treatment patterns, and health care costs from the Swedish region Skane (population of 1.3 million). A 90% sensitivity and specificity of the new test was assumed.
Results
Among 31,250 men, age 50-69 years, 16.4% had a PSA between 3.0 and 9.9 microg/L and 28.9% a PSA of 2.0-9.9 microg/L. Testing men with PSA 3.0-9.9 microg/L, as in current clinical practice, decreased the number of biopsies by 3595, detected 61 more cancers, resulting in and two more fatalities and subsequently a loss of 14 QALYs. Cost offsets could justify a test value of SEK 4996. Testing a larger population, PSA 2.0-9.9 microg/L prevented 6 deaths, added 50 QALYs, and could justify a value of the test of SEK 5165, given a value of health of SEK 500,000 per QALY.
Conclusion
A new blood-based test for prostate cancer has a significant potential to reduce the number of biopsies needed, resulting in reduced health care costs and improve patient care.
SECTION: INTRO
Key Points for Decision Makers
SECTION: TABLE
A new blood-based test for prostate cancer has the potential to reduce the number of biopsies needed and decrease health-care costs. If the test is used in an extended population it could also reduce the number of deaths from prostate cancer.
SECTION: INTRO
Introduction
Prostate cancer is one of the most common cancers and the third leading cause of cancer-related deaths among men in developed countries. One factor behind this dismal development is the lack of symptoms at an early stage of the disease, resulting in late diagnosis since the diagnostic tools available today are insufficient and not applicable to a population-based screening. The introduction of measuring Prostate-Specific Antigen (PSA) in blood in the mid-1980s, provided an important tool for monitoring of prostate cancer, and did result in tumor detection at a much earlier phase of the disease.
However, while the PSA test has high sensitivity it suffers from low specificity, resulting in an immense over diagnosis, with studies showing that only 25% (PSA values ranging between 4 and 10) to 53% (majority of PSA values ranging between 3 and 10) of men who are biopsied due to an elevated PSA actually have prostate cancer. Another limitation is the sensitivity of the systemic prostate biopsy, which may be as low as 48% for clinically significant prostate cancer, meaning that more than half of these cases are not diagnosed correctly with the standard procedure. However, recent studies on targeted biopsies after multiparametric magnetic resonance imaging (mpMRI) have shown improved diagnostic accuracy and reduced number of biopsies needed.
Despite such improved protocols to diagnose prostate cancer, there is a consistent problem with overdiagnosis and overtreatment, i.e. biopsies of men with slightly increased PSA values lead to detection of clinically insignificant tumors and side-effects after surgery or radiation therapy (RT). In addition, despite being an unpleasant and painful procedure the prostate biopsies are also accompanied with several adverse side-effects, such as infections and bleeding. Furthermore, not all men can undergo MRI for different reasons and pre-biopsy MRI is not yet implemented in guidelines.
Due to these limitations, several diagnostic assays have been presented over the last years, such as, (1) STHLM3 that has shown to reduce unnecessary biopsies in prostate cancer with Gleason = 7; (2) Prostate health Index (PHI) and (3) 4KScore. All three algorithms are based on proteins in the kallikrein family and have demonstrated an increased specificity reducing unnecessary biopsies but a limited sensitivity which results in failure to detect some cancers. Since many tests are being developed there is a need for an assessment to the potential value of these tests.
We have developed a solid technology platform for multiparametric protein expression profiling, using recombinant antibody fragments. This platform has successfully identified highly accurate diagnostic protein signatures in e.g. pancreatic cancer, as well as in other complex diseases. In a pilot study, we also demonstrated that it could potentially be used to develop a blood-based test for stratifying prostate cancer risk groups. However, further studies are needed to validate diagnostic tests for prostate cancer, where a sensitivity and specificity reaching over 90% would be desirable to further improve on current methods, which would significantly improve early diagnosis and reduce the number of prostate biopsies needed.
Estimating the health economic value of introducing a new test in prostate cancer diagnosis before being fully developed, would generate important incentive to facilitate further development of new tests for prostate cancer diagnosis. The current study is based on the clinical guideline used in Sweden today were MRI guided biopsy and/or active surveillance are still not a general recommendation. There are several tests proposed along the PC care pathway (e.g. to stratify for biopsy, to determine aggressiveness of the tumor and tests to monitor progression). While it would be interesting to analyze the difference a new test could make in all these pathways, in this study we focus on the effect a new test would have if introduced as a screening tool at diagnosis, after a PSA test, which is why the patient groups in this study are divided based on their PSA value.
Health economic early-decision modeling is a well-established method to quantitatively estimate the likely health and cost consequences of a new test in the diagnostic pathway for prostate cancer, i.e. to screens for persons in need of a biopsy and previous health economic studies have shown a possibility to reduce unnecessary biopsies. Consequently, the objective of this study was to estimate the potential value of a new diagnostic blood-based test in prostate cancer in a cohort representing PSA tested men 50-69 years old.
SECTION: METHODS
Methods
This study was conducted in accordance with Swedish and international guidelines for economic evaluation.. The analysis has a health-care sector perspective, including only health-care costs.This study was conducted in accordance with Swedish and international guidelines for economic evaluation.. The analysis has a health-care sector perspective, including only health-care costs.
SECTION: TABLE
Number of prostate-specific antigen (PSA) tests and distribution of PSA values by age group in Region Skane year 2015
PSA value (mug/l) Distribution (%) by age group 40 40-49 50-59 60-69 70-79 80-89 90+ All 1 74.3 64.8 48.2 31.3 25.9 22.5 18.7 35.7 1-1.9 21.4 27.1 30.5 27.7 23.6 17.3 13.9 25.8 2-2.9 2.6 5.3 10.5 15.8 16.2 12.6 11.5 13.4 3-3.9 0.9 1.3 4.8 9.4 10.5 9.9 8.3 8.0 4-4.9 0.3 0.6 2.3 5.5 7.4 6.9 5.7 5.1 5-5.9 0.0 0.4 1.3 3.2 4.6 5.9 5.0 3.2 6-6.9 0.2 0.1 0.8 2.1 2.9 4.4 4.2 2.1 7-7.9 0.0 0.0 0.4 1.3 2.0 3.1 3.5 1.4 8-8.9 0.0 0.0 0.3 0.9 1.4 2.7 2.8 1.0 9-9.9 0.1 0.1 0.2 0.5 1.1 1.8 1.3 0.7 10= 0.2 0.2 0.7 2.2 4.4 12.9 25.0 3.6 Total number of PSA-tests per age group 1516 4687 11,649 19,601 17,255 5829 599 61,136
SECTION: METHODS
We constructed a Discrete Event Simulation (DES) model for evaluation of prostate cancer diagnostics and treatment. It uses micro-simulation techniques to simulate individual diagnostic pathways and capture competing event risks.We constructed a Discrete Event Simulation (DES) model for evaluation of prostate cancer diagnostics and treatment. It uses micro-simulation techniques to simulate individual diagnostic pathways and capture competing event risks. We included 31,250 men, representing PSA-tested men aged 50-69 years in Region Skane, Sweden. Each man was assigned, (1) a starting age between 50 and 69 years, (2) an age-related PSA-value, based on aggregated registry data from PSA-testing in Region Skane (Table 1, Dr. Anna Joud, Lund University), and (3) a prostate cancer status, i.e. (a) no cancer, (b) Gleason 6 (GS6) cancer or (c) Gleason = 7 (GS = 7) cancer. All men were PSA-tested and diagnostic pathways were simulated based on PSA-test results, based on the standardized prostate cancer care pathway in Sweden.
SECTION: FIG
Flow charts for diagnosis of prostate cancer, for a current clinical practice, b testing strategy prostate-specific antigen (PSA) 3.0-9.9 microg/L, C) testing strategy PSA 2.0-9.9 microg/L and D) testing strategy PSA 2.0-2.9 microg/L. For simplicity of illustration digital rectal examination is not included in the flow chart
SECTION: METHODS
In current clinical practice, men with PSA = 3 microg/L or abnormal digital rectal examination (DRE) undergo prostate biopsy. In this study, three hypothetical testing strategies were evaluated and compared with current clinical practice.In this study, three hypothetical testing strategies were evaluated and compared with current clinical practice. The first strategy tested the same men as in current clinical practice, with a PSA value between 3.0 and 9.9 microg/L, aiming to reduce the need for biopsies (Fig. 1). The second strategy tested an extended population with a PSA value between 2.0 and 9.9 microg/L. The third strategy, only tested men with a PSA value between 2.0 and 2.9 microg/L. The tests were evaluated using assumed values of 90% sensitivity, for both GS6 and GS = 7 cancer, and 90% specificity.
SECTION: TABLE
Clinical parameters used in the model simulation
Parameter Value References Initial diagnostics Probability of an abnormal digital rectal examination 10% Assumption Biopsy sensitivity 48% Biopsy specificity 100% Assumption New test sensitivity 90% Assumption New test specificity 75/90% Assumption Time to incidental detection 7 years General treatment Radical treatment probability, low-grade 25% Active Surveillance probability, low-grade 75% Radical treatment probability, high-grade 80% Watchful waiting probability, high-grade 20% Active surveillance Probability of prostate-specific antigen (PSA) test 91% Probability of biopsy, year 1 81% Probability of biopsy, year 4 60% Probability of biopsy, year 7 53% Probability of biopsy, year 10/15/20/etc. 33% Probability of yearly repeat biopsies 13% Underlying yearly risks Progression, radical treatment 9% Progression, active surveillance 11% Progression, watchful waiting 11% Progression, undiagnosed 11% Metastasis, radical treatment 1% Metastasis, active surveillance (undetected) 3% Metastasis, watchful waiting 3% Metastasis, undiagnosed 3% Prostate cancer mortality 22%
SECTION: METHODS
Prostate biopsy was modeled at 48% sensitivity, 100% specificity and 4.2% risk of hospitalization based on a US Medicare population (Table 2). Any undetected cancer was incidentally detected after 7 years based on lead time in the European Randomized Study of Screening for Prostate Cancer (ERSPC). Men with GS6 cancer were assigned active surveillance (75%) or radical treatment (25%), while men diagnosed with GS = 7 cancer were assigned radical treatment (80%) or watchful waiting (20%), based on Swedish treatment pattern of today. Active surveillance was modeled according to the PRIAS-protocol and men with a GS = 7 cancer at biopsy were changed to radical treatment. Men on watchful waiting receive no further treatment, unless occurrence of metastasis.
In the model, we assume that prostate cancer advanced progressively from GS6 cancer to GS = 7 cancer to metastatic cancer (Fig. 3 in Appendix). The risks of progression for GS6 cancers on active surveillance and radical treatment were calibrated by using the event rates for metastasis and all cause death in the Prostate Testing for Cancer and Treatment (ProtecT). The risk of metastasis for GS = 7 cancer on radical treatment and watchful waiting were calibrated by using the corresponding event rates in the Prostate Cancer Intervention versus Observation Trial (PIVOT). The model has a lifelong time horizon and it was assumed that only men with metastatic cancer could die from prostate cancer, while all men also had Swedish age-related other-cause mortality.
SECTION: TABLE
Cost and utility input values
Value References Direct costs (SEK) PSA-test 394 Prostate biopsy 6527 Hospitalization 19,184 Prostate cancer diagnosis (urologist visit) 1794 Radical treatment 105,000 Hospital administration Metastatic cancer (yearly cost) 300,256 Utilities General population 0.8 Assumption Prostate cancer diagnosis, one-time loss - 0.017 Radical treatment, one-time loss - 0.238 Metastatic cancer, permanent reduction - 0.2
SECTION: METHODS
Costs for curative treatments and hospitalization were obtained from the hospital administration and costs for PSAtest, prostate biopsy and diagnosis from price lists from the regional healthcare provider, Region Skane (Table 3). The yearly cost for treating metastatic cancer was based on a recent health-economic evaluation by the Swedish Dental and Pharmaceutical Benefits Agency.. All costs were calculated in Swedish currency (SEK) at 2017 price level.ted in Swedish currency (SEK) at 2017 price level. Health effects were quantified as Quality-adjusted life years (QALYs) and event-related QALY-losses were based on literature. All health effects and cost were discounted at a yearly discount rate of 3% following Swedish recommendations.
Model outputs included number of biopsies, cancer diagnosis, treatments and death from prostate cancer. Total costs and QALYs were calculated based on modelled events.Model outputs included number of biopsies, cancer diagnosis, treatments and death from prostate cancer. Total costs and QALYs were calculated based on modelled events. For each testing strategy, the test value was calculated at a cost-neutral level, resulting in no increase in health care costs, and at a value of health of SEK 500,000 per QALY, which is the threshold between a moderate and a high cost per QALY used by the Swedish National Board of Health and Welfare. increase in health care costs, and at a value of health of SEK 500,000 per QALY, which is the threshold between a moderate and a high cost per QALY used by the Swedish National Board of Health and Welfare. Potential value drivers were tested by deterministic and probabilistic sensitivity analysis across 1000 simulated cohorts.d probabilistic sensitivity analysis across 1000 simulated cohorts. In the probabilistic sensitivity analysis, the risks of progression, metastasis, and prostate cancer death, as well as unit costs and utility values were randomized using normal distributions and a 10% standard error.
SECTION: RESULTS
Results
Current Clinical Practice
Modeling current clinical practice, with men having PSA = 3 microg/L or abnormal DRE being biopsied, resulted in 8706 biopsies. In total, 703 GS6, and 281 GS = 7 cancers were initially detected at the start of simulation, while 3082 men received curative treatment during the course of the simulation and 901 died from prostate cancer. The total cost accumulated over the lifetime of the 31,250 men was 1.2 billion SEK. The majority of this was from the treatment of metastatic cancer (793 million SEK for 1111 treated men) and radical treatment (273 million SEK 3082 treated men). In total, the men generated 380,334 QALYs over their lifetimes (on average 12.2 discounted QALYs per man).
Introduction of a New Diagnostic Test
After the initial modeling, a hypothetic new test was added to the diagnostic scheme to screen for those in need of a biopsy. The test was evaluated using three different testing strategies. The results are presented at a 90% sensitivity and specificity of the new test.
PSA Value Between 3.0 and 9.9 microg/L
SECTION: TABLE
Absolute values and incremental differences between the testing strategies and current clinical practice with 90% sensitivity and 90% specificity for the new test
Current clinical practice Tested prostate-specific antigen (PSA) range (microg/L) Absolute values Incremental differences 3.0-9.9 2.0-9.9 2.0-2.9 3.0-9.9 2.0-9.9 2.0-2.9 Initial events New test 0 5126 9014 3888 5126 9014 3888 Biopsy 8706 5111 6098 9693 - 3595 - 2608 987 GS6 cancer detection 703 657 918 963 - 45 215 260 GS = 7 cancer detection 281 266 328 344 - 16 47 62 Events during simulation Radical treatment 3082 3077 3099 3104 - 5 17 22 Cancer death 901 903 894 892 2 - 6 - 8 Cost and QALYs Total QALYs 380,334 380,320 380,384 380,398 - 14 50 64 Total Cost (million SEK) 1236 1210 1214 1240 - 26 - 22 4 Test value (SEK) Cost neutral 4996 2392 - 1042 Value of health SEK 500,000 3622 5165 7199
SECTION: RESULTS
In the first testing strategy, 5126 men with PSA values between 3.0 and 9.9 microg/L and normal DRE were tested, which resulted in 3595 fewer biopsies (Table 4). However, 45 less GS6 cancers and 16 less GS = 7 cancers were initially detected. Consequently, another five men did not receive curative treatment during the course of the simulation and two more men died from prostate cancer. While this testing strategy reduced health care costs by SEK 26 million it also led to a health loss of 14 QALYs. The cost-neutral value of the test was SEK 4996 and the value of the test, at a value of health of SEK 500,000 per QALY was SEK 3622.
PSA Value Between 2.0 and 9.9 microg/L
The second testing strategy of 9014 men with PSA between 2.0 and 9.9 microg/L reduced the number of biopsies by 2608. At the same time more cancer cases were initially detected, and six fewer men died from prostate cancer. The testing strategy lead to both a health gain and a cost reduction, with a test value of SEK 5165 at the same value of health as before.
PSA Value Between 2.0 and 2.9 microg/L
The third testing strategy, which only tested the 3888 men with PSA between 2.0 and 2.9 micro/L, lead to 987 more biopsies. However, 22 more patients received curative treatment and eight less died from prostate cancer. This strategy lead to a health gain but at a cost increase with a test value of SEK 7199 using the same value of health as before.
The Effect of a Changes in Sensitivity and Specificity
SECTION: TABLE
The value of the test (SEK) for sensitivity and specificity values ranging from 50 to 90%
Tested prostate-specific antigen (PSA) range (microg/L) Cost neutral Value of health SEK 500,000 3.0-9.9 2.0-9.9 2.0-2.9 3.0-9.9 2.0-9.9 2.0-2.9 Sensitivity 90% Specificity 90% 4996 2392 - 1042 3622 5165 7199 Specificity 80% 4447 1825 - 1632 3073 4598 6608 Specificity 70% 3897 1258 - 2222 2524 4031 6018 Specificity 60% 3347 690 - 2813 1974 3463 5427 Specificity 50% 2798 123 - 3403 1424 2897 4838 Sensitivity 80% Specificity 90% 5025 2439 - 970 2310 4060 6368 Specificity 80% 4476 1872 - 1560 1761 3493 5778 Specificity 70% 3927 1306 - 2151 1212 2926 5187 Specificity 60% 3377 738 - 2742 662 2359 4596 Specificity 50% 2827 171 - 3331 112 1792 4007 Sensitivity 70% Specificity 90% 5055 2472 - 933 951 2902 5475 Specificity 80% 4505 1905 - 1524 401 2335 4885 Specificity 70% 3956 1338 - 2114 - 148 1768 4295 Specificity 60% 3406 771 - 2705 - 698 1201 3704 Specificity 50% 2857 204 - 3294 - 1248 634 3114 Sensitivity 60% Specificity 90% 5089 2514 - 882 - 374 1790 4643 Specificity 80% 4540 1947 - 1472 - 924 1223 4052 Specificity 70% 3991 1380 - 2062 - 1473 656 3462 Specificity 60% 3441 812 - 2653 - 2023 88 2871 Specificity 50% 2891 245 - 3243 - 2572 - 479 2282 Sensitivity 50% Specificity 90% 5131 2568 - 812 - 1767 620 3766 Specificity 80% 4582 2001 - 1402 - 2316 52 3176 Specificity 70% 4033 1434 - 1992 - 2865 - 514 2586 Specificity 60% 3483 866 - 2583 - 3415 - 1082 1994 Specificity 50% 2933 299 - 3173 - 3965 - 1649 1405
SECTION: RESULTS
The impact of different assumptions of sensitivity and specificity on the value of the test is demonstrated in Table 5. For the first strategy the cost neutral value of the test varies from 2800 SEK for low specificity up to 5100 SEK for high specificity. For the second strategy the cost neutral value of the test varies from 100 SEK for low specificity up to 2500 SEK for high specificity. The third strategy does not generate a positive cost neutral value of the test for any of the sensitivity and specificity analyzed, since this strategy drives the health care costs upwards by diagnosing more prostate cancer patients.
However, by attaching a monetary value to the health gains, corresponding to SEK 500,000 per QALY gained, the third strategy gives the highest value of the test, of about SEK 7200. The better sensitivity and the specificity the more value will be attached to the test. Both the first and second strategy will generate positive values of the test, but only when sensitivity and specificity reached certain thresholds. For example, for strategy one sensitivity must reach 70% in combination with a specificity of at least 80% to generate a positive value.
Value Drivers
The value of the test depends on how the health care and treatment strategies are organized. In this analysis the differences in test values are demonstrated by three different testing strategies. The first strategy corresponds to current approach of testing men at PSA 3.0 and above. The second strategy assumes an extended testing of men with PSA 2.0 and above, and the third strategy is implementing the new test only for men with PSA values between 2.0 and 2.9.
The cost-neutral value of the first testing strategy (PSA 3.0-9.9 microg/L) was mainly driven by the price of biopsies, while the cost-neutral values for the second (2.0-9.9 microg/L) and the third (2.0-9.9 microg/L) testing strategies were affected by both the biopsy cost and the treatment cost of metastatic disease (Appendix Table 6). Biopsy cost remained an important value driver even when health effects were included at a value of health of SEK 500,000 per QALY. The value of all treatment strategies at this value of health was also affected by the biopsy sensitivity, time to incidental detection and risk of metastatic disease.
Probabilistic Sensitivity Analysis
SECTION: FIG
Cost-effectiveness planes of incremental costs (million SEK) and incremental quality-adjusted life years (QALYs) for each strategy compared to current clinical practice
SECTION: RESULTS
The probabilistic sensitivity analysis indicated that the results are robust. The results for each of the three strategies are shown in the cost-effectiveness planes in Fig. 2. The first testing strategy reduced health care costs in all simulations, with cost savings between SEK 19 million and SEK 31 million (95% confidence interval). The corresponding cost-neutral value of the test was SEK 3798 to SEK 6124 and the value of the test, at a value of health of SEK 500,000 per QALY was SEK 2727 to SEK 4029.
The second strategy was dominant in 98% of the simulations, with cost savings between SEK 13 million and SEK 31million and health gains between 2 and 111 QALYs (95% confidence interval). The related cost-neutral value of the test was SEK 1440 to SEK 3433 and the test value at the same value of health as before was SEK 3529 to SEK 7606.
The third strategy lead to health gains in more than 99% of the simulations but at a cost-increase in 82% of the simulations. The health gains ranged between 12 and 127 QALYs and the cost changes ranged from cost savings of SEK 6 million to a cost increase of SEK 12 million (95% confidence interval). The corresponding test value, at a value of health of SEK 500,000 per QALY was SEK 3068 to SEK 13,217.
SECTION: DISCUSS
Discussion
The adoption of a new test for prostate cancer for persons in need of a biopsy (PSA value in the range of 3.0-9.9 microg/L), with 90% sensitivity and specificity, has a potential to reduce health care costs due to a decrease in clinical resources used. However, at a sensitivity of 90% for the new test will result in fewer diagnosed patients with cancer compared to the current Swedish strategy with biopsies of all men with PSA value = 3. If the new test would be implemented in a region such as Region Skane in Sweden with a population of 1.3 million people, about 60 patients less would be diagnosed with prostate cancer, resulting in 2 additional deaths. However, in the same region we can expect reduced costs of about 26 million SEK.
The value of a test is generally determined based on two types of value propositions. The first one is related to the reduction of resources used as consequence of implementing the new test. The second value is the health gains due to the use of the new test. With a target population of men with PSA 3.0-9.9 microg/L cost offsets have a potential too justify a value per test of SEK 5000. However, with an assumed sensitivity of the new test of 90% it will not identify as many prostate cancers as the current management, thus, the new test will result in loss of QALYs, which will reduce the value of the new test to a total value of SEK 3600 when both types of value drivers are considered.
However, if a new test will be used to test an extended population, including men with PSA values between 2 and 2.9 in addition to men with PSA = 3, we will identify more patients with prostate cancer. This has the potential to reduce the number of deaths with prostate cancer and increase the number of QALYs. At the same time, we will expect cost offsets due to reduced number of biopsies and surgical procedures. The value of improved detection of prostate cancer and the subsequent treatment of cancer could justify a value of this new test in the magnitude of SEK 5200 per test if the society is willing to pay SEK 500,000 per QALY gained. From a health care perspective, assuming no value of health, the cost offsets generated by introducing the new test can justify a value for the test in the magnitude of SEK 2400.
A strength of the cost-effectiveness model is that it can be used to estimate the outcomes of many additional potential strategies. For example, we modeled a subpopulation of men with PSA value between 2.0 and 2.9 micro/L. This gave 987 fewer biopsies, 322 more prostate cancers detected and 8 less deaths. This resulted in 64 QALYs, additional costs of 4 million SEK and a test value of SEK 7199, if value of health per QALY again is assumed to be 500,000 SEK. The use of decision-analytic modelling also enables the estimation of results for several combinations of sensitivity and specificity for the new test. Another strength of our analysis is that we have used real world data, from Swedish registries, regarding the actual prevalence of PSA-testing and the distribution of PSA-values among tested men.
A limitation with our study is that progression rates and metastasis risks were taken from international clinical studies and may differ from real-world data. Additionally, there was only one publicly available risk equation for prostate cancer, which limited our possibility of varying cancer prevalence in the sensitivity analysis. Another limitation was the lack of data on the size of the disutility associated with a prostate biopsy. While this does not affect the cost-neutral value of the test, it would have increased the value of test at a value of health of SEK 500,000 per QALY for the first and second testing strategies, while decreasing it for the third testing strategy.
Early health economic assessment of new health care technologies is often used to identify which criteria must be met, and under what conditions they are expected to be cost-effective, i.e. good value for money. Our study aimed at identifying and analyzing some of these criteria and conditions in order to specify which factors are driving the value of the new test. First the analyses provided are intended to identify information gaps and to guide further research in the development of a test for prostate cancer. Secondly, economic modeling in early stages can identify parameters to which the estimates of value drivers are particularly sensitive. It is important to identify these parameters early in the development process in order to plan and priorities for future data collection. Thirdly, pricing of a new product starts early in the development process and understanding and collecting data for demonstration of the value of a new technology is a key driver for pricing. Early cost-effectiveness modeling is important to take customers and their value of health into account, understanding the payers value perceptions and integrate them into the development process.
SECTION: CONCL
Conclusion
In brief, a blood-based test, displaying 90% sensitivity and specificity would be a significant improvement for early diagnosis of prostate cancer.
SECTION: APPENDIX
Appendix
SECTION: FIG
Flow charts for treatment of prostate cancer for a GS = 7 at diagnosis, b GS6 at diagnosis
SECTION: TABLE
Results from the sensitivity analysis showing the base case test value and the incremental changes compared to the base case test value (SEK)
Tested (prostate-specific antigen) PSA range (microg/L) Cost neutral Value of health 500,000 3.0-9.9 2.0-9.9 2.0-2.9 3.0-9.9 2.0-9.9 2.0-2.9 Base case 4996 2392 - 1042 3622 5165 7199 Parameter tested Sensitivity of new test: 75% + 797 + 856 + 935 - 1462 - 1077 - 570 Biopsy sensitivity: 24% + 67 - 143 - 420 - 2192 - 1595 - 4709 Biopsy sensitivity: 72% - 75 + 128 + 397 - 837 + 1404 + 4362 Time to incidental detection: 4 years + 85 - 206 - 590 +711 - 1834 - 5193 Time to incidental detection: 10 years - 74 + 159 + 467 - 668 + 1501 + 4363 GS6, Active Surveillance: 100% + 41 - 128 - 351 +240 - 649 - 1823 GS6, active surveillance: 50% - 38 +100 +282 - 208 + 672 + 1834 GS = 7, radical treatment: 60% + 57 - 72 - 243 + 361 - 636 - 1952 GS = 7, radical treatment: 100% - 62 + 74 +253 - 338 + 671 + 2003 Progression risk: doubled - 105 + 293 +818 - 451 + 1310 + 3635 Progression risk: halved + 80 - 250 - 686 + 340 - 932 - 2610 Metastasis risk: doubled - 181 + 368 + 1092 - 1328 + 2233 + 6934 Metastasis risk: halved + 137 - 334 - 955 + 843 - 1826 - 5348 Radical treatment: no QoL loss +- 0 +- 0 +-0 - 206 +426 +1259 Active surveillance: QoL - 0.01 yearly +- 0 +- 0 +- 0 + 186 - 492 - 1387 PSA: zero cost - 48 +115 +330 - 48 + 115 + 330 Biopsy: zero cost - 3913 - 951 +2957 - 3913 - 951 + 2957 Radical treatment: zero cost - 182 + 377 + 1114 - 182 + 377 + 1114 Metastatic disease: zero cost + 389 - 857 - 2503 + 389 - 857 - 2503
SECTION: SUPPL
Data availability atatement
All data generated or analyzed during this study are included in this published article and its supplementary files. The simulation model used to derive the analysis is the proprietary of IHE, and access to the model is at the discretion of IHE. The model was shared with the manuscript reviewers upon request.