PMCID: 5051510 (link)
Year: 2016
Reviewer Paper ID: 15
Project Paper ID: 69
Q1 - Title(show question description)
Explanation: The title clearly identifies the study as an economic evaluation by mentioning 'Cost-effectiveness' and specifies the intervention being compared by referencing 'investing in sidewalks.' This directly indicates the nature of the study and the intervention under evaluation.
Quotes:
-
Cost-effectiveness of investing in sidewalks as a means of increasing physical activity: a RESIDE modelling study
Q2 - Abstract(show question description)
Explanation: The abstract of the manuscript is structured and includes key components such as context, methods, results, and alternative analyses. It begins with a background section providing the context of the study, followed by methods, results, and conclusion sections, which cover key aspects of the research.
Quotes:
-
Background: Studies consistently find that supportive neighbourhood built environments increase physical activity by encouraging walking and cycling.
-
Methods: Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods.
-
Results: Installing and maintaining an additional 10 km of sidewalk in an average neighbourhood was estimated to cost A$4.2 million over 30 years and gain 24 HALYs.
-
Sensitivity analyses were used to explore the impact of variations in population density, discount rates, sidewalk costs and the inclusion of unrelated healthcare costs in added life years.
Q3 - Background and objectives(show question description)
Explanation: The introduction provides the context by discussing the significance of physical inactivity in Australia and the potential of built environments to improve physical activity. It poses the study question on the cost-effectiveness of sidewalks as a means to enhance walkability. The introduction also explains the practical relevance by highlighting that such environmental interventions could be a cost-effective method to promote health, reducing disease burden and healthcare expenses.
Quotes:
-
'Physical inactivity is an important risk factor for many chronic diseases, including diabetes, cardiovascular disease and some types of cancer.'
-
'Creating supportive built environments can cause positive shifts in population levels of physical activity and significantly reduce the burden of disease and related healthcare spending.'
-
'This study considers the cost-effectiveness of spending to extend the length of sidewalks in a neighbourhood to increase levels of walking and improve health.'
Q4 - Health economic analysis plan(show question description)
Explanation: The manuscript does not mention the development of a specific health economic analysis plan or where it might be available. It discusses the methods and models used in the analysis, such as the multistate life table model and the economic evaluation stages, but it does not refer to an explicit plan or document beyond these descriptions.
Quotes:
-
This economic evaluation involved four stages: (1) estimate the effect of sidewalks on walking; (2) translate the expected increase in walking into a increase in HALYs gained and healthcare costs; (3) estimate the costs of extending sidewalk length and (4) derive estimate of economic value of investing in sidewalks to increase physical activity in terms of the cost per HALY gained.
-
A health sector perspective was used in which the costs of sidewalks (as a health-promoting intervention) were included.
-
The model to estimate health outcomes and healthcare costs is available on request from the first author of this study.
Q5 - Study population(show question description)
Explanation: The manuscript provides specific demographic, socioeconomic, and clinical characteristics of the study population. These include statistics on gender, marital status, presence of children at home, educational attainment, and obesity status.
Quotes:
-
The RESIDE data set contains information on 1813 people of whom 59% were women, 81% were married or in de facto relationships, 67% have children living at home, 22% were university educated and 53% were either overweight or obese (average BMI was 26.05).
Q6 - Setting and location(show question description)
Explanation: The manuscript provides contextual information about the study's setting and location, such as the emphasis on Perth, Australia, and the influence of residential density on the cost-effectiveness of installing sidewalks. This contextual information is critical for understanding the findings and their applicability to similar settings.
Quotes:
-
Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods.
-
In low-density cities such as in Australia, installing sidewalks in established neighbourhoods as a single intervention is unlikely to cost-effectively improve health.
-
Planning guidelines for Perth from 2003 suggest an average residential density of 9 dwellings/ha in low-density areas. Assuming an average of 2.55 adults per dwelling, this yields an estimate of 19 000 potential beneficiaries within a 1.6 km circular area.
Q7 - Comparators(show question description)
Explanation: The manuscript describes the intervention of installing additional sidewalks as well as the rationale for selecting this strategy. The authors explain that investing in sidewalks was chosen as a means to encourage walking and model its cost-effectiveness using data from the RESIDE study.
Quotes:
-
In this study, we assess the cost-effectiveness of increasing sidewalk availability as one means of encouraging walking.
-
Findings were adjusted for self-selection effects. Only one intervention is considered in this study; however, to impact on walking and health, there is a need for integrated built environment interventions.
-
While recognising the need to evaluate the complementary effects of each component of a neighbourhood that collectively enhances walkability, this paper begins this important work by focusing on one aspect, namely the presence of sidewalks.
Q8 - Perspective(show question description)
Explanation: The study adopted a health sector perspective to evaluate the cost-effectiveness of sidewalks as a health-promoting intervention, emphasizing the costs related to health gains and healthcare costs while incorporating sidewalks into established neighbourhoods.
Quotes:
-
A health sector perspective was used in which the costs of sidewalks (as a health-promoting intervention) were included.
-
An incremental cost-effectiveness ratio (ICER) is evaluated for the intervention by comparing model outcomes given current levels of physical activity with those that would be expected following an increase in the length of sidewalks in each neighbourhood.
Q9 - Time horizon(show question description)
Explanation: The article specifies that the study adopts a 'lifetime time horizon' for evaluating the cost-effectiveness of installing sidewalks, which allows for a comprehensive assessment of long-term health impacts and cost implications, making it suitable for capturing the sustained benefits of increased physical activity over time.
Quotes:
-
An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values.
Q10 - Discount rate(show question description)
Explanation: The manuscript states that costs and benefits were discounted at a rate of 3%, as well as other scenarios with different rates for sensitivity analysis. The rationale for the baseline 3% rate was the recommendation by the US Panel on Cost-Effectiveness in Health and Medicine.
Quotes:
-
"An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values. The 3% rate was chosen following the recommendation by the US Panel on Cost-Effectiveness in Health and Medicine.
-
"In addition, we vary the cost of sidewalk construction and maintenance, the residential density in the neighbourhood where the new sidewalks are located and the discount rate in a series of one- and two-way sensitivity analyses."
Q11 - Selection of outcomes(show question description)
Explanation: The manuscript uses health-adjusted life years (HALYs) as a measure of benefit to assess the gain in population health from increased walking due to added sidewalks. It also considers the reduction in healthcare costs as a benefit. For harm, it accounts for the healthcare costs incurred from prolonged life due to reduced mortality from increased physical activity.
Quotes:
-
Health outcomes considered included reductions in mortality and morbidity, and health-adjusted life years gained.
-
To translate the Heckman model estimates of walking as a function of sidewalk length into an estimate of gained HALYs and healthcare costs avoided, we used the mathematical model developed for the Assessing Cost-effectiveness in Prevention (ACE-Prevention) project.
-
The reduction in diseases related to physical inactivity lowers treatment cost in the short and medium term, but it also means that new healthcare costs may be incurred by people who now go on to develop unrelated conditions in their added years of life.
Q12 - Measurement of outcomes(show question description)
Explanation: The manuscript provides a detailed description of how outcomes were measured, specifically focusing on using health-adjusted life years (HALYs) to capture the benefits of increased walking, and how these were modeled using a multistate life table. It includes details on the translation of the increase in walking into health benefits and associated costs.
Quotes:
-
Multistate life table models were used to estimate HALYs associated with changes in walking frequency and duration.
-
To translate the Heckman model estimates of walking as a function of sidewalk length into an estimate of gained HALYs and healthcare costs avoided, we used the mathematical model developed for the Assessing Cost-effectiveness in Prevention (ACE-Prevention) project.
Q13 - Valuation of outcomes(show question description)
Explanation: The manuscript specifies that the study used data from the RESIDE study in Perth, Australia, involving a multistate life table model to estimate HALYs based on changes in walking frequency and duration. The study considered a population of an average neighborhood with 19,000 adult residents.
Quotes:
-
"Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods."
-
"Installing and maintaining an additional 10 km of sidewalk in an average neighbourhood with 19 000 adult residents was estimated to cost A$4.2 million over 30 years and gain 24 HALYs over the lifetime of an average neighbourhood adult resident population."
Q14 - Measurement and valuation of resources and costs(show question description)
Explanation: The costs in the study were valued in Australian dollars based on actual sidewalk replacement costs and were calculated for a 10 km sidewalk installation and maintenance over 30 years using 2010 values and a 3% discount rate.
Quotes:
-
The cost of installing a standard sidewalk was determined to be A$172 (2012/2013) per square metre based on estimates of actual sidewalk replacement costs obtained from council documents.
-
An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values.
Q15 - Currency, price, date, and conversion(show question description)
Explanation: The manuscript provides information about the currency, year, and dates of the estimated resource quantities and unit costs. It states that costs were discounted to 2010 values using Australian dollars (A$). The cost estimates for installing a standard sidewalk are given for 2012/2013.
Quotes:
-
"...costs and benefits were discounted at 3% (baseline scenario) to 2010 values..."
-
"The cost of installing a standard sidewalk was determined to be A$172 (2012/2013) per square metre..."
-
"...the intervention costs were assumed to be in Australian dollars (A$)."
Q16 - Rationale and description of model(show question description)
Explanation: The manuscript describes the use of a multistate life table model in detail but does not specify that the model is publicly available or where it might be accessed.
Quotes:
-
"The well-established multistate multicohort life table approach was used to estimate the potential health benefits of investing in sidewalks to encourage physical activity."
-
"We used the mathematical model developed for the Assessing Cost-effectiveness in Prevention (ACE-Prevention) project."
-
"Data sharing statement: The model to estimate health outcomes and healthcare costs is available on request from the first author of this study."
Q17 - Analytics and assumptions(show question description)
Explanation: The manuscript describes the statistical techniques used, including the Heckman two-staged regression model for estimating the relationship between sidewalk length and walking behavior. Multistate life table models were employed to estimate HALYs based on changes in walking frequency and duration.
Quotes:
-
A Heckman two-staged regression model had then been used to estimate the association between sidewalk length in the neighbourhood and (1) the proportion of people walking for transport or leisure in the neighbourhood, and (2) the total minutes spent walking in the neighbourhood in a usual week among those who reported any walking.
-
We applied a proportional multistate multicohort life table model in which five physical activity-related diseases were explicitly modelled, comparing the lifetime number of HALYs for a population that is exposed to the intervention with an identical population under status quo conditions.
Q18 - Characterizing heterogeneity(show question description)
Explanation: Sensitivity analyses were used specifically to explore variations related to residential density, sidewalk cost, and discount rates. Changes in these factors significantly affected the cost-effectiveness outcomes, indicating how different sub-groups (e.g., populations in varying density areas) might experience different results.
Quotes:
-
Sensitivity analyses were used to explore the impact of variations in population density, discount rates, sidewalk costs and the inclusion of unrelated healthcare costs in added life years.
-
In addition, we vary the cost of sidewalk construction and maintenance, the residential density in the neighbourhood where the new sidewalks are located and the discount rate in a series of one- and two-way sensitivity analyses.
Q19 - Characterizing distributional effects(show question description)
Explanation: The manuscript does not provide a detailed account of how the impacts were distributed across different individuals, nor does it mention specific adjustments made to reflect priority populations. The focus is on estimating the general cost-effectiveness of sidewalks in relation to population density, but not on individualized outcomes or prioritized groups.
Quotes:
-
'While sidewalks are important in supporting walking, these results show that investing in increasing the length of sidewalks in a neighbourhood, independent of other modifications to create a more walkable neighbourhood, is unlikely to be a cost-effective method of improving health at the existing (low) levels of residential density in Perth.'
-
'The analysis is limited to the outcomes associated with the most important diseases related to physical inactivity. Other health benefits, including improved safety for pedestrians, and broader social benefits... have not been included because we lack data on the impact on these measures.'
Q20 - Characterizing uncertainty(show question description)
Explanation: Sensitivity analyses and Monte Carlo simulation were used to characterize sources of uncertainty in the analysis. These methods explored variations in several parameters to determine their impact on cost-effectiveness outcomes.
Quotes:
-
Sensitivity analyses were used to explore the impact of variations in population density, discount rates, sidewalk costs and the inclusion of unrelated healthcare costs in added life years.
-
Ninety-five per cent uncertainty intervals (UIs) were determined for all outcome measures by Monte Carlo simulation (2000 iterations), using the Excel add-in tool Ersatz (Epigear, V.1.01). Uncertainty distributions around input parameters are described in table 1.
Q21 - Approach to engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not indicate any engagement of patients, service recipients, the general public, communities, or stakeholders in the design of the study. The focus was primarily on using existing data from the RESIDE study and modeling economic evaluations without mention of stakeholder involvement in study design.
Quotes:
-
Data for this stage of the evaluation were drawn from the RESIDential Environments Study (RESIDE) in Perth, Western Australia.
-
Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods.
Q22 - Study parameters(show question description)
Explanation: The manuscript includes a detailed description of analytic inputs and study parameters, including uncertainty or distributional assumptions. The parameters are outlined in tables such as Uncertainty input parameters and Evaluated scenarios, with specified distributions and ranges.
Quotes:
-
Ninety-five per cent uncertainty intervals (UIs) were determined for all outcome measures by Monte Carlo simulation (2000 iterations), using the Excel add-in tool Ersatz (Epigear, V.1.01).
-
Uncertainty input parameters
-
Uncertainty distributions around input parameters are described in table 1.
-
Scenarios Cost sidewalk per square metre (A$2010/m2) Residential density: dwelling per hectare (number of adults*) Discount rate (%) costs/health Other healthcare costs in added life years excluded
Q23 - Summary of main results(show question description)
Explanation: The manuscript provides mean values for the main categories of costs and outcomes, such as the cost of additional sidewalk installations and health-adjusted life years (HALYs) gained. The incremental cost-effectiveness ratio (ICER) is also provided as a summary measure of cost-effectiveness.
Quotes:
-
Installing and maintaining an additional 10 km of sidewalk in an average neighbourhood with 19 000 adult residents was estimated to cost A$4.2 million over 30 years and gain 24 HALYs over the lifetime of an average neighbourhood adult resident population.
-
The incremental cost-effectiveness ratio was A$176 000/HALY.
Q24 - Effect of uncertainty(show question description)
Explanation: The manuscript reports that uncertainty, particularly regarding the choice of discount rates, residential density, and population exposure, significantly impacted the cost-effectiveness findings. These factors were explicitly analyzed through sensitivity analyses.
Quotes:
-
"A health sector perspective was used in which the costs of sidewalks (as a health-promoting intervention) were included. An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values. The 3% rate was chosen following the recommendation by the US Panel on Cost-Effectiveness in Health and Medicine."
-
"Under the baseline scenario assumptions, there was 0% probability of this intervention being under A$60 000 per HALY (table 4 and figure 2)."
-
"The results are extremely sensitive to some of the assumptions made in the analysis, especially with respect to changes in residential density, which materially affects the number of people benefiting from the intervention (table 4). High residential density, or medium density if the cost of installing sidewalks is low, both generate ICERs consistently below the A$60 000 per HALY threshold (table 4 and figure 2)."
Q25 - Effect of engagement with patients and others affected by the study(show question description)
Explanation: The manuscript does not provide any information or evidence regarding the involvement of patients, service recipients, the general public, community, or stakeholders in influencing the approach or findings of the study. The study focuses on economic evaluations and modeling of infrastructure investments from a health and cost-effectiveness perspective.
Quotes:
-
This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
-
The analysis is limited to the outcomes associated with the most important diseases related to physical inactivity. Other health benefits, including improved safety for pedestrians, and broader social benefits such as those related to less reliance on motor vehicles, or to any increase in sense of community... have not been included...
Q26 - Study findings, limitations, generalizability, and current knowledge(show questiondescription)
Explanation: The manuscript reports on key findings and limitations regarding the cost-effectiveness of installing sidewalks, but does not explicitly address ethical or equity considerations in its discussion or conclusions. The focus is on cost-effectiveness and the elements of walkability, such as density and street connectivity, rather than ethical impacts or equity.
Quotes:
-
"While sidewalks are important in supporting walking, these results show that investing in increasing the length of sidewalks in a neighbourhood, independent of other modifications to create a more walkable neighbourhood, is unlikely to be a cost-effective method of improving health at the existing (low) levels of residential density in Perth."
-
"The analysis is limited to the outcomes associated with the most important diseases related to physical inactivity. Other health benefits, including improved safety for pedestrians, and broader social benefits such as those related to less reliance on motor vehicles... have not been included because we lack data on the impact on these measures."
-
"Thus, one cannot conclude from this work that investing in extending sidewalks is not cost-effective per se. Health gain is, to some extent, an externality or fortunate by-product of decisions that make neighbourhoods more walkable and ultimately more liveable."
SECTION: TITLE
Cost-effectiveness of investing in sidewalks as a means of increasing physical activity: a RESIDE modelling study
SECTION: ABSTRACT
Background
Studies consistently find that supportive neighbourhood built environments increase physical activity by encouraging walking and cycling. However, evidence on the cost-effectiveness of investing in built environment interventions as a means of promoting physical activity is lacking. In this study, we assess the cost-effectiveness of increasing sidewalk availability as one means of encouraging walking.
Methods
Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods.Using data from the RESIDE study in Perth, Australia, we modelled the cost impact and change in health-adjusted life years (HALYs) of installing additional sidewalks in established neighbourhoods. Estimates of the relationship between sidewalk availability and walking were taken from a previous study. Multistate life table models were used to estimate HALYs associated with changes in walking frequency and duration. Sensitivity analyses were used to explore the impact of variations in population density, discount rates, sidewalk costs and the inclusion of unrelated healthcare costs in added life years.Sensitivity analyses were used to explore the impact of variations in population density, discount rates, sidewalk costs and the inclusion of unrelated healthcare costs in added life years.
Results
Installing and maintaining an additional 10 km of sidewalk in an average neighbourhood with 19 000 adult residents was estimated to cost A$4.2 million over 30 years and gain 24 HALYs over the lifetime of an average neighbourhood adult resident population.Installing and maintaining an additional 10 km of sidewalk in an average neighbourhood with 19 000 adult residents was estimated to cost A$4.2 million over 30 years and gain 24 HALYs over the lifetime of an average neighbourhood adult resident population. The incremental cost-effectiveness ratio was A$176 000/HALY. However, sensitivity results indicated that increasing population densities improves cost-effectiveness.
Conclusions
In low-density cities such as in Australia, installing sidewalks in established neighbourhoods as a single intervention is unlikely to cost-effectively improve health. Sidewalks must be considered alongside other complementary elements of walkability, such as density, land use mix and street connectivity. Population density is particularly important because at higher densities, more residents are exposed and this improves the cost-effectiveness. Health gain is one of many benefits of enhancing neighbourhood walkability and future studies might consider a more comprehensive assessment of its social value (eg, social cohesion, safety and air quality).
SECTION: INTRO
Strengths and limitations of this study
The well-established multistate multicohort life table approach was used to estimate the potential health benefits of investing in sidewalks to encourage physical activity.
Health outcomes considered included reductions in mortality and morbidity, and health-adjusted life years gained.
Findings were adjusted for self-selection effects.
Effect estimates for the association of sidewalk availability with physical activity are potentially subject to recall bias.
Only one intervention is considered in this study; however, to impact on walking and health, there is a need for integrated built environment interventions.
Introduction
Physical inactivity is an important risk factor for many chronic diseases, including diabetes, cardiovascular disease and some types of cancer. In Australia, physical inactivity ranks eighth as a risk factor for death and ninth as a risk factor for disability adjusted life years (DALYs). Yet despite the known benefits, too few adults in Australia and elsewhere participate in levels of physical activity optimal for health. Even small increases in physical activity reduce the risk of chronic disease and provide health benefit. Creating supportive built environments can cause positive shifts in population levels of physical activity and significantly reduce the burden of disease and related healthcare spending.
There is increasing attention for the role of the built environment, and in particular neighbourhood urban form, in either facilitating or inhibiting physical activity. Several neighbourhood built environment characteristics, including the mix and diversity of land uses and destinations, population or residential density and street and pedestrian connectivity, are consistently found to be positively associated with physical activity, and in particular walking. Other built environment attributes are also important for supporting walking such as access to transit, availability and quality of sidewalks/footpaths, street appeal or aesthetics, and personal and traffic safety. These built environment characteristics collectively contribute to the 'walkability' of a neighbourhood, which is found to be positively associated with walking and other physical activity behaviours. Creating 'walkable' neighbourhoods would also produce cobenefits and meet other social objectives such as sustainable transportation, reduction in air pollution and traffic noise and increased social connectivity. If these health and social benefits could be realised at a reasonable cost, then environmental interventions that improve the walkability of residential neighbourhoods may be a cost-effective means of promoting health and well-being.
There are few economic evaluations of environmental interventions and most of the available evidence relates to designated walking trails or transport-related infrastructure, such as cycle paths. However, none of these studies adjusted effect estimates for bias introduced by residential self-selection and only one controls for other built environment characteristics. Self-selection refers to the bias introduced by residents who choose to live in neighbourhoods that facilitate walking because they prefer to walk, rather than the neighbourhoods causing them to walk more. A systematic review found the median benefit to cost ratio to be 5:1, suggesting that every $1 invested in transport-related infrastructure generates benefits worth $5 (including the financial value of reduced demand on the healthcare system). Despite this important finding, the authors hesitated from drawing policy-relevant conclusions citing a lack of transparency and variation in the methods employed in studies as a cause for concern. The need to account more accurately for the effect of built environment measures on physical activity was highlighted in a recent systematic review of transport economic evaluations.
Others have monetised the health benefits of urban form in relation to walking and health. Boarnet et al used regression analysis on travel survey data from Portland, Oregon, to quantify the impact of built environmental features on distance walked. Walking was translated into lives saved, with each life valued in dollar terms using published estimates of the value of a statistical life ranging from US$2.5 million to US$7.4 million per life saved (US$ 2006). Their analysis suggested that 2 lives would be saved per year for every 1000 people exposed to a more walkable environment. While this finding is promising, missing from the work was any attempt to quantify the cost of the environmental interventions that might help realise these benefits.
While recognising the need to evaluate the complementary effects of each component of a neighbourhood that collectively enhances walkability, this paper begins this important work by focusing on one aspect, namely the presence of sidewalks. Building sidewalks is something that planners could require in all new housing, and which could be retrofitted in established neighbourhoods.
This study considers the cost-effectiveness of spending to extend the length of sidewalks in a neighbourhood to increase levels of walking and improve health. The effect estimates applied in this modelling exercise were adjusted for other built environment features (implicitly holding all other features of the neighbourhood environment constant) and for residential self-selection, which allows for the evaluation of the independent and unbiased effect of increasing sidewalks. Health-adjusted life years (HALYs) were calculated to represent the impact on health of improvements in walking. HALYs are population health measures that combine impacts on morbidity and mortality in a single metric.
SECTION: METHODS
Methods
Overview
This economic evaluation involved four stages: (1) estimate the effect of sidewalks on walking; (2) translate the expected increase in walking into a increase in HALYs gained and healthcare costs; (3) estimate the costs of extending sidewalk length and (4) derive estimate of economic value of investing in sidewalks to increase physical activity in terms of the cost per HALY gained. A health sector perspective was used in which the costs of sidewalks (as a health-promoting intervention) were included. An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values. The 3% rate was chosen following the recommendation by the US Panel on Cost-Effectiveness in Health and Medicine.A health sector perspective was used in which the costs of sidewalks (as a health-promoting intervention) were included. An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values.An intervention of 30 years duration was assumed, a lifetime time horizon was applied and costs and benefits were discounted at 3% (baseline scenario) to 2010 values. The 3% rate was chosen following the recommendation by the US Panel on Cost-Effectiveness in Health and Medicine.
Estimate of effect of sidewalks on walking
RESIDE data
Data for this stage of the evaluation were drawn from the RESIDential Environments Study (RESIDE) in Perth, Western Australia. RESIDE is a longitudinal study examining the relationship between urban design and a number of social outcomes, including physical activity. The opportunity for the RESIDE study arose when, in 1998, the Western Australia state government introduced new planning guidelines (the Liveable Neighbourhood Guidelines) incorporating 'New Urbanist' principles. The RESIDE study followed people relocating to new houses being built in 1 of 74 new housing developments, some of which were designed according to the Liveable Neighbourhoods guidelines. Information on the RESIDE project is detailed elsewhere. The RESIDE data set contains information on 1813 people of whom 59% were women, 81% were married or in de facto relationships, 67% have children living at home, 22% were university educated and 53% were either overweight or obese (average BMI was 26.05).
Model estimates
We took estimates of the relationship between sidewalk length and walking behaviour from the RESIDE cross-sectional baseline survey in this economic evaluation. Data included self-reported neighbourhood-based transportation and recreational walking, socio-demographic characteristics, attitudes towards walking and variables related to residential self-selection (ie, access to services, recreation and schools, pedestrian and cycling friendly streets and housing variety). Neighbourhood-based transportation and recreational walking had been measured using the Neighbourhood Physical Activity Questionnaire, which provides reliable estimates of the proportion of people who walk and the average minutes spent walking in a usual week, within and outside the neighbourhood. This degree of specificity has proved useful in linking walking for different purposes (transport, leisure) with particular neighbourhood attributes. The built environment within 1.6 km around participants' homes had been assessed using Geographical Information Systems and satellite imagery to derive objectively determined measures of neighbourhood walkability (ie, land use mix, residential density and street connectivity) and sidewalk length. A Heckman two-staged regression model had then been used to estimate the association between sidewalk length in the neighbourhood and (1) the proportion of people walking for transport or leisure in the neighbourhood, and (2) the total minutes spent walking in the neighbourhood in a usual week among those who reported any walking. McCormack et al provide a detailed description of the method and results of the Heckman modelling, but in brief, the decision about whether or not to walk was estimated using a multivariate Probit regression followed by a sample selection-bias corrected ordinary least squares regression for minutes spent walking. Estimates of the association between sidewalk length and neighbourhood walking were then adjusted for differences in walkability, attitude towards walking, neighbourhood self-selection, age, gender and education. McCormack et al included neighbourhood preferences in the probit and linear regression models to adjust for the effect of residential self-selection on walking.
Modelling health outcomes and healthcare costs
To translate the Heckman model estimates of walking as a function of sidewalk length into an estimate of gained HALYs and healthcare costs avoided, we used the mathematical model developed for the Assessing Cost-effectiveness in Prevention (ACE-Prevention) project., we used the mathematical model developed for the Assessing Cost-effectiveness in Prevention (ACE-Prevention) project. Baseline health and cost parameters were updated from 2003 to 2010. See online supplementary material for further detail.
Gained HALYs and costs were measured over the lifetime of a 2010 Australian neighbourhood adult population. A macro simulation approach was used to calculate changes in HALYs arising from expected changes in physical activity levels due to walking following a hypothetical increase in sidewalk length. We applied a proportional multistate multicohort life table model in which five physical activity-related diseases were explicitly modelled, comparing the lifetime number of HALYs for a population that is exposed to the intervention with an identical population under status quo conditions. In the proportional multistate life table model, health outcomes are calculated from changes in the incidence of physical activity-related diseases (ischaemic heart disease, stroke, type 2 diabetes, colon cancer and breast cancer in women). Changes in the incidence of diseases lead to corresponding changes in prevalence in later years, and from there to changes in mortality and years lived with disability. Epidemiological data for the diseases were derived from the Global Burden of Disease 2010 study with the help of DISMOD II to obtain parameters not explicitly reported (incidence and case death from prevalence and mortality). The conceptual model for DISMOD II is based on the multistate life table. HALYs are estimated as years of life lived adjusted for health-related quality of life, using Global Burden of Disease disability weights. For more detail, refer to the online supplementary material.
Intervention costs
The intervention was defined as spending to increase the length of sidewalks by 10 km in each 1.6 km road network buffer surrounding a participant's home and maintaining this for 30 years. The cost of installing a standard sidewalk was determined to be A$172 (2012/2013) per square metre based on estimates of actual sidewalk replacement costs obtained from council documents. Previous research used a value of A$70 per linear metre for a sidewalk of 1.8 m in width; however, more recent evidence suggests that the price per square metre is likely to be higher. The initial capital cost and periodic maintenance costs were included, assuming sidewalk replacement after 15 years.
Exposure
More people than just the survey participants will benefit from the investment in sidewalks, and so we also need to take into account residential density to compute the number of people 'exposed' to the intervention. Planning guidelines for Perth from 2003 suggest an average residential density of 9 dwellings/ha in low-density areas. Assuming an average of 2.55 adults per dwelling, this yields an estimate of 19 000 potential beneficiaries within a 1.6 km circular area. We use this figure in our baseline estimate and revisit the assumption in our sensitivity analysis and discussion.
Intervention cost-effectiveness
An incremental cost-effectiveness ratio (ICER) is evaluated for the intervention by comparing model outcomes given current levels of physical activity with those that would be expected following an increase in the length of sidewalks in each neighbourhood. The net costs of the intervention are the costs of installing and maintaining the sidewalks plus the net effect that changes in health have on healthcare costs in future. The reduction in diseases related to physical inactivity lowers treatment cost in the short and medium term, but it also means that new healthcare costs may be incurred by people who now go on to develop unrelated conditions in their added years of life.
Ninety-five per cent uncertainty intervals (UIs) were determined for all outcome measures by Monte Carlo simulation (2000 iterations), using the Excel add-in tool Ersatz (Epigear, V.1.01). Uncertainty distributions around input parameters are described in table 1. The results of the Monte Carlo analysis were then used to determine the probability of intervention cost-effectiveness against a cost-effectiveness threshold of A$60 000 per HALY, which is a commonly used threshold in the Australian context.
SECTION: TABLE
Uncertainty input parameters
Parameter Mean (SD) Distribution Source Proportion doing any walking 62.40% (19.86%) Beta Extra walkers per additional 10 km sidewalk (RESIDE sample) 0.66% (9.68%) Beta Average minutes walked per walker 151.10 (123.15) Lognormal Extra minutes walked per week per 10 km sidewalk 5.26 (2.93) Lognormal Disease cost offset See supplementary table S1 Uniform Australian Institute of Health and Welfare Impacts Study 2001. Maximum/minimum assumed at +-25% of mean value Relative risks of diseases See supplementary table S2 Normal (ln RR) Physical activity and Diabetes risks
SECTION: METHODS
In addition, we vary the cost of sidewalk construction and maintenance, the residential density in the neighbourhood where the new sidewalks are located and the discount rate in a series of one- and two-way sensitivity analyses. We also combine the cost of sidewalks with residential density to find the most cost-effective mix. All scenarios, including the baseline, are presented in table 2.
SECTION: TABLE
Evaluated scenarios
Scenarios Cost sidewalk per square metre (A$2010/m2) Residential density: dwelling per hectare (number of adults*) Discount rate (%) costs/health Other healthcare costs in added life years excluded 1. Baseline 166 9 (19 000) 3 No 2. Low cost sidewalk 136 9 (19 000) 3 No 3. High cost sidewalk 227 9 (19 000) 3 No 4. Low density 166 20 (41 000) 3 No 5. Medium density 166 30 (62 000) 3 No 6. High density 166 60 (123 000) 3 No 7. Low density/low cost sidewalk 136 20 (41 000) 3 No 8. Low density/high cost sidewalk 227 20 (41 000) 3 No 9. Medium density/low cost sidewalk 136 30 (62 000) 3 No 10. Medium density/high cost sidewalk 227 30 (62 000) 3 No 11. High density/low cost sidewalk 136 60 (123 000) 3 No 12. High density/high cost sidewalk 227 60 (123 000) 3 No 13. Discount health 0% and costs 0% 166 9 (19 000) 0 No 14. Discount health 1% and costs 3% 166 9 (19 000) 3/1 No 15. Discount health 5% and costs 5% 166 9 (19 000) 5 No 16. Healthcare costs prolonged life excluded 166 9 (19 000) 3 Yes
*1.6 km road network buffer.
SECTION: RESULTS
Results
Incremental cost-effectiveness
In the baseline scenario, the cost of installing and maintaining an extra 10 km of sidewalks is A$4.1 million per neighbourhood. This investment is expected to gain 24 HALYs over the life span of the neighbourhood adult population (95% UI 20 to 28) (table 3, Scenario 1. Baseline). After taking into account the net effect on healthcare costs, the total cost increases to A$4.2 million. The ICER is A$176 000 per HALY gained (95% UI A$148 000 to A$203 000), which lies well above the A$60 000/HALY threshold (figure 1). Under the baseline scenario assumptions, there was 0% probability of this intervention being under A$60 000 per HALY (table 4 and figure 2).
SECTION: TABLE
Cost-effectiveness results
Scenarios HALYs Intervention cost* (A$) Healthcare cost offsets (A$) Costs prolonged life (A$) Net cost (A$) ICER (A$/HALY) 1. Baseline 24 (20, 28) 4 077 694 -232 232 (-185 343, -288 222) 313 910 (264 636, 374 670) 4 159 373 (4 134 899, 4 186 344) 175 782 (147 983, 203 463) 2. Low cost sidewalk 24 (20, 28) 3 340 761 -232 232 (-185 343, -288 222) 313 910 (264 636, 374 670) 3 422 440 (3 397 967, 3 449 411) 144 635 (121 911, 167 330) 3. High cost sidewalk 24 (20, 28) 5 576 124 -232 232 (-185 343, -288 222) 313 910 (264 636, 374 670) 5 657 802 (5 633 329, 5 684 774) 239 115 (201 101, 276 963) 4. Low density 51 (44, 61) 4 077 694 -501 132 (-399 951, -621 953) 677 386 (571 056, 808 499) 4 253 948 (4 201 137, 4 312 149) 83 303 (70 416, 96 162) 5. Medium density 78 (67, 92) 4 077 694 -757 809 (-604 803, -940 514) 1 024 339 (863 548, 1 222 608) 4 344 224 (4 264 364, 4 432 236) 56 251 (47 635, 64 908) 6. High density 154 (132 182) 4 077 694 -1 503 396 (-1 199 852, -1 865 858) 2 032 157 (1 713 168, 2 425 497) 4 606 455 (4 448 024, 4 781 059) 30 057 (25 527, 34 652) 7. Low density/low cost sidewalk 51 (44, 61) 3 340 761 -501 132 (-399 951, -621 953) 677 386 (571 056, 808 499) 3 517 015 (3 464 205, 3 575 216) 68 869 (58 276, 79 413) 8. Low density/high cost sidewalk 51 (44, 61) 5 576 124 -501 132 (-399 951, -621 953) 677 386 (571 056, 808 499) 5 752 378 (5 699 567, 5 810 579) 112 652 (95 054, 130 236) 9. Medium density/low cost sidewalk 78 (67, 92) 3 340 761 -757 809 (-604 803, -940 514) 1 024 339 (863 548, 1 222 608) 3 607 291 (3 527 432, 3 695 303) 46 706 (39 604, 53 933) 10. Medium density/high cost sidewalk 78 (67, 92) 5 576 124 -757 809 (-604 803, -940 514) 1 024 339 (863 548, 1 222 608) 5 842 654 (5 762 794, 5 930 665) 75 659 (63 987, 87 309) 11. High density/low cost sidewalk 154 (132 182) 3 340 761 -1 503 396 (-1 199 852, -1 865 858) 2 032 157 (1 713 168, 2 425 497) 3 869 523 (3 711 091, 4 044 126) 25 246 (21 468, 29 078) 12. High density/high cost sidewalk 154 (132 182) 5 576 124 -1 503 396 (-1 199 852, -1 865 858) 2 032 157 (1 713 168, 2 425 497) 6 104 885 (5 946 453, 6 279 489) 39 840 (33 798, 45 955) 13. Discount health 0% and costs 0% 57 (49, 67) 4 980 000 -451 438 (-360 947, -559 008) 815 905 (691 928, 969 496) 5 344 467 (5 279 735, 5 422 494) 94 735 (80 509, 108 668) 14. Discount health 1% and costs 3% 42 (36 to 49) 4 077 694 -231 952 (-186 346, -284 915) 580 915 (495 475, 683 747) 4 426 658 (4 373 856, 4 489 457) 106 881 (92 107, 122 033) 15. Discount health 5% and costs 5% 15 (12, 17) 3 666 193 -159 890 (-127 587, -198 580) 182 938 (153 130, 219 227) 3 689 241 (3 673 755, 3 706 601) 254 664 (213 699, 295 717) 16. Healthcare costs prolonged life excluded 24 (20, 28) 4 077 694 -232 232 (-185 343, -288 222) 313 910 (264 636, 374 670) 3 845 462 (3 789 472, 3 892 351) 162 609 (134 756, 190 513)
*No uncertainty for intervention costs was assumed.
Negative costs indicate savings.
Probability of being under A$60 000 per health-adjusted life year threshold
Scenario Probability (%) Baseline 0 Low cost sidewalk 0 High cost sidewalk 0 Low density 0 Medium density 79 High density 100 Low density/low cost sidewalk 5 Low density/high cost sidewalk 0 Medium density/low cost sidewalk 100 Medium density/high cost sidewalk 0 High density/low cost sidewalk 100 High density/high cost sidewalk 100 Discount health 0% and costs 0% 0 Discount health 1% and costs 3% 0 Discount health 5% and costs 5% 0 Healthcare costs prolonged life excluded 0
SECTION: FIG
Cost-effectiveness plane for investing in sidewalks in a neighbourhood, baseline and alternative scenarios compared with the status quo.
Cost-effectiveness acceptability curve for investing in sidewalks in a neighbourhood, baseline and alternative scenarios compared with the status quo.
SECTION: RESULTS
Sensitivity results
The results are extremely sensitive to some of the assumptions made in the analysis, especially with respect to changes in residential density, which materially affects the number of people benefiting from the intervention (table 4). High residential density, or medium density if the cost of installing sidewalks is low, both generate ICERs consistently below the A$60 000 per HALY threshold (table 4 and figure 2). For the medium-density scenario, the probability of being under this threshold was 79%.
SECTION: DISCUSS
Discussion
Principal findings
While sidewalks are important in supporting walking, these results show that investing in increasing the length of sidewalks in a neighbourhood, independent of other modifications to create a more walkable neighbourhood, is unlikely to be a cost-effective method of improving health at the existing (low) levels of residential density in Perth. That is to say, other means of increasing physical activity such as GP 'prescriptions' for physical activity, social marketing campaigns and supported use of pedometers were estimated to generate health benefits at lower net cost.
The analysis is limited to the outcomes associated with the most important diseases related to physical inactivity. Other health benefits, including improved safety for pedestrians, and broader social benefits such as those related to less reliance on motor vehicles, or to any increase in sense of community that results from seeing more of one'sThe analysis is limited to the outcomes associated with the most important diseases related to physical inactivity. Other health benefits, including improved safety for pedestrians, and broader social benefits such as those related to less reliance on motor vehicles, or to any increase in sense of community that results from seeing more of one's neighbours on the street, have not been included because we lack data on the impact on these measures. Thus, one cannot conclude from this work that investing in extending sidewalks is not cost-effective per se. Health gain is, to some extent, an externality or fortunate by-product of decisions that make neighbourhoods more walkable and ultimately more liveable. A more complete evaluation would reflect the value of all outcomes of importance.
The model estimates used for the association between sidewalks and walking also have limitations. The estimates of walking, while specific to the neighbourhood context, were self-reported and therefore prone to recall and memory errors. Further, not all walking trips, either for transportation or recreation, are within the neighbourhood. Our context-specific approach, which matched neighbourhood sidewalks with neighbourhood walking, is a strength of this study. However, this approach may underestimate the total influence of sidewalks on walking, as some walking that originated from within the neighbourhood may have also included some walking outside the neighbourhood. Furthermore, sidewalk provision may also support more vigorous-intensity physical activities such as jogging and running, which can provide health benefits over and above those provided by more moderate-intensity physical activity such as walking. Since this was a sample of mostly younger and middle-aged people who were about to move into new housing developments in suburban Australia, the external validity of our findings is greatest when applied in similar settings. The more the population of interest differs from out study population, the more caution should be applied in the use of our findings. However, in situations where better suited alternative data are not available, our estimates could serve as a 'best available estimate' if the alternative is no estimate at all, with the risk that the health benefits of walking associated with sidewalks are ignored in the decision-making process.
Sidewalk within the broader context
Investment in sidewalks might have a bigger marginal impact on physical activity and produce more health benefits if it were accompanied by complementary efforts to improve other aspects of walkability such as the number and mix of destinations that people can walk to (land use mix), street connectivity and the aesthetic quality of the physical environment. People not only need something to walk on, but also somewhere to walk to. Such a comprehensive approach is likely to have additive and synergistic benefits as each component of walkability complements the others. It might be also necessary to have other health promotion strategies in place, in addition to the built environment changes, to maximise the impact of this investment on physical activity.
Notably, our results show strongly the importance of residential density. In higher density neighbourhoods, the fixed costs of neighbourhood improvements are spread over more people, leading to greater overall benefit, which improves cost-effectiveness. By international standards, density in Australia is very low. While one of the aims of the Western Australian Liveable Neighbourhood Guidelines is to increase density, density remained low, there is still a demand for large houses on large blocks in Australian cities, with little appetite to mandate higher densities. Nevertheless, policies such as the Liveable Neighbourhood Guidelines are influential in changing practice, and average densities of up to 19 houses per hectare are now being observed in green-field developments in Perth. Although that is an improvement over 9 houses per hectare, at 19 houses per hectare, the population density is expected to be ~40 000 people in a neighbourhood, which implies zero probability for the installation of sidewalks to be cost-effective from the perspective of this study (table 2).
Other studies found more favourable cost-effectiveness results for sidewalks. For example, using a sophisticated spatial analysis but what they considered a 'back-of-the-envelope' economic analysis, Guo and Gandavarapu found that increased sidewalk prevalence in Dane County, Wisconsin, USA, would deliver a cost-benefit ratio of 1.87. The contrast with our findings could be due to a range of factors, including the inability in that study to adjust for residential self-selection, the assumption that additional energy spent on active transport directly translate to lower obesity rates (without dietary compensation) where we modelled the impact via physical activity and differences in the built environment such as housing density.
Policy implications
Retro-fitting established neighbourhoods to improve walkability is challenging as it involves changing existing infrastructure and housing stock. Such change is often resisted by residential and government bodies and communities. Infrastructure improvements likely to improve health will require a comprehensive long-term strategy involving integrated planning of infrastructure, housing, transport, land use and urban design. To this end, the development industry has an important role to play in providing leadership in developing new models for homes in green-field sites that meet the need for more compact developments for a healthier and more sustainable future. Similarly, planning regulations relating to shared occupancy, infill development and housing renewal should aim to increase higher density housing supply, resulting in greater use of existing infrastructure such as sidewalks, transportation, public open space and utilities.
The challenges of retro-fitting existing neighbourhoods and our findings here on the significance of walking draw attention to the need to design pedestrian-friendly neighbourhoods from the outset to facilitate active transport and recreational walking.
SECTION: CONCL
Conclusion
This work adds to a growing evidence base examining the cost-effectiveness of intervening in the built environment as a means of increasing physical activity and improving health and social outcomes. It points to the potential offered by neighbourhood redevelopment yet highlights the need for a comprehensive strategy that seeks both to improve all elements of walkability including land use mix and street connectivity. In particular, it highlights the importance of residential density as a mechanism through which the cost-effectiveness of infrastructure is affected because the higher the density, the lower the fixed cost per person who has access to that infrastructure.
Contributors: AS, BG-C, JLV and GRM developed the initial design of the study, oversaw and supervised the empirical work and contributed in drafting the first manuscript. LG and BZ-D revised and amended the first manuscript and all authors revised the final version of the paper. LJC set up the original economic model and BZ-D revised and updated the economic model with demographic, cost and epidemiological data, ran the models and wrote the results. BZ-D drafted the abstract and appendix and JLV revised them. LG, GRM and AS provided the interventions costs. AMMH produced the epidemiological estimates. All authors contributed to and commented on the final version of the manuscript.
Funding: This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data sharing statement: The model to estimate health outcomes and healthcare costs is available on request from the first author of this study.