Annex 4 analytical methods
model description
general description
- acronym
- TFA-POL
- name
- Markov state transition model to estimate the health impacts and related costs to the public of different trans fatty acids (TFA) intake scenarios at the EU level
- main purpose
- Reducing population TFA intakes provides health benefits (i.e., reductions in cardiovascular disease or coronary artery disease (CAD)–related events and deaths) and reduces disease-related health care and other societal costs (e.g., productivity losses, informal care). Many countries in the European Union (EU) and worldwide have implemented different policies to reduce the TFA intake of their populations. However, policy development and implementation also creates costs. The aim of the model is to estimate the health impacts and related costs following from different TFA intake scenarios in the EU population. Based on these estimates, it is possible to evaluate the cost-effectiveness of alternative EU-level policy options aimed at reducing population dietary TFA intake against each other or against a reference situation of no policy action.
- homepage
- —
Developer and its nature
- ownership
- EU ownership (European Commission)
- ownership additional info
- The model was developed by the JRC.
- is the model code open-source?
- NO
Model structure and approach with any key assumptions, limitations and simplifications
- details on model structure and approach
The present model is a computer-simulated, Markov, state-transition model built in Excel (Microsoft Office 2010). Based on a certain industrially-produced trans fatty acids (iTFA) intake as a starting point (“today”), measured as a weighted average of data at MS level collected through existing evidence and a survey, and projected future iTFA intakes, such as resulting from alternative policy scenarios, the model calculates the iTFA-intake affected probabilities of the EU population to transit between health states, as follows:
- probability of keeping well (in this context, staying alive and not having a CAD event);
- probability of experiencing a CAD event for persons without a previous CAD event;
- probability of surviving a CAD event;
- probability of staying alive in the post–acute CAD state;
- probability of experiencing a new CAD event when in the post–acute CAD state;
- probability of death from any cause (except from CAD) for persons without a previous CAD event;
- probability of death from a CAD event; and
- probability of death from any cause except for CAD for individuals with a history of CAD.
The model simulates how people move in yearly cycles between the four health states and accounts for costs (policy- and health status-related) as well as health effects (CAD incidence and disability-adjusted life years, DALYs). These are calculated for each scenario, such as when comparing policy option, and then compared with one another.
In order to better illustrate how the model works in detail in the following a brief summary of a public health economic evaluation study using the TFA-POL model is given. N.b., the described study was not part of the study of the contractor ICF to support the impact assessment nor of the impact assessment itself. The policy scenarios in that study analysed are as follows:
- the reference situation is described by the highest cumulative TFA intake and entails the highest risk of CAD. This scenario assumes a continued decrease in TFA consumption that leads to a removal of iTFAs from the food supply over 10 years due to continuous innovation in the industry and efforts at the national or regional levels. There are no added public costs from implementing this policy option, and therefore all costs result from CAD-associated morbidity and loss of productivity;
- the implementation of a common framework toward reducing TFAs in foods and diets at the EU level is simulated by assuming that public costs are CAD-associated and are also related to food inspection programs to monitor and evaluate the agreements. It is also assumed a faster reduction in TFA consumption than in the reference scenario, leading to a quicker removal of iTFAs from the food supply due to the additional private-public commitments. For this, the model assume the total removal of iTFAs from the food supply after 5 years, half the time needed in reference situation, albeit acknowledging that the rare use of iTFA-containing raw materials by some producers and imports of iTFA-containing foods from countries in which the iTFA issue has not been addressed cannot be excluded;
- mandatory TFA labelling at the EU level is simulated by considering CAD-associated and other non–CAD related public costs. The reduction in population TFA intake is faster than in the reference situation but slightly slower than in scenario 2, because in this case there are only incentives toward reducing TFA content in pre-packaged foods. The assumption in the model is that iTFA removal is faster in pre-packaged foods than in options 1 (reference) and 2, but not in non-prepackaged foods, in which iTFA removal proceeds at the same speed as in the reference option 1. The model assumes population TFA intake reductions for the first 2 years until TFA content labelling is available for all pre-packaged foods, as in the reference situation (option 1), then a faster reduction in iTFA intake from pre-packaged foods, which, based on the available information, is assumed to contribute to 50% of population TFA intake at the start and decrease to 0% in 3 years. The model assumes that reductions in iTFAs from non-pre-packaged foods continue at the same speed as in the reference situation albeit acknowledging that, in reality, some spillover effects in the efforts to remove iTFAs from pre-packaged foods might also be expected for non pre-packaged foods
- a scenario in which there is a legal limit of iTFA content in foods assumes a fast removal of iTFAs in all of the EU food supply and represents therefore the lowest cumulative TFA consumption of all 4 options. The model assumes the total removal of iTFAs in 2 years, and considers CAD-associated public costs as well as other costs not associated with CAD.
As all the costs and effects (obtained from the literature) assume deterministic values, and there are uncertainties related to the current levels of iTFA intakes for the EU population, the model also performs a probabilistic sensitivity analysis by applying probabilistic distributions to all variables. Each of the distributions used in this analysis were chosen following the current trends and literature recommendations.
The point estimates of the mean costs and effects are used to calculate the incremental cost-effectiveness ratios (ICERs), obtained by dividing the difference in costs between a policy option and the reference situation (no EU-level action) by the respective difference in effects (DALYs). The ICER is then interpreted as the cost for each DALY gained.
- model inputs
The below variables (and their respective sources) were used as inputs in the TFA-POL model:
- Probability of death from acute CAD, and probability of death from any cause (from the European Health for All Database);
- Probability of CAD (Hospital discharges by ischemic heart disease; data from European Health for All Database);
- Reduction in RR of CAD in legal limit strategy, Reduction in RR of CAD in voluntary agreements strategy, Reduction in RR of CAD in mandatory labeling strategy (Mozzafarian et al., O’Flaherty et al. );
- RR of second and subsequent CAD events after the first event and RR probability of death from second CAD event compared with death from the first CAD event (assumption);
- Production losses due to mortality, Production losses due to morbidity, Informal care, Primary care, Outpatient care, Accident and emergency, In-patient care, Medication (Nichols et al. );
- School-based intervention, Worksite intervention, Mass media campaigns, Physician counselling, Program of food inspection (from Cecchini et al., Sassi et al. ).
To account for uncertainty, beyond the deterministic analysis (which uses a single value for costs and for effects in the model calculations), different probabilistic distributions to every variable in the model according to the current trends and literature recommendations were assumed. A log-normal distribution was applied to variables (1) to (4), and a gamma distribution were used for variables (5) to (6). Annual discount rate of 3.5% is applied to both costs and effects following best-practice guidelines.
References to input sources:
- Mozaffarian D, Aro A, Willett WC. Health effects of trans-fatty acids: experimental and observational evidence. Eur J Clin Nutr. 2009;63 Suppl 2:S5–21
- O’Flaherty M, Flores-Mateo G, Nnoaham K, Lloyd-Williams F, Capewell S. Potential cardiovascular mortality reductions with stricter food policies in the United Kingdom of Great Britain and Northern Ireland. Bull World Health Organ 2012;90:522–31.
- European Health for All Database (HFA-DB) [Internet]. 2013. [cited 2013 June 10] Available from: http://www.euro.who.int/en/what-wedo/data-and-evidence/databases/european-health-for-all-database-hfa-db2.
- Nichols MTN, Luengo-Fernandez R, Leal J, Gray A, Scarborough P, Rayner M. European Cardiovascular Disease Statistics 2012. Brussels (Belgium): European Heart Network, European Society of Cardiology; 2012
- Cecchini M, Sassi F, Lauer JA, Lee YY, Guajardo-Barron V, Chisholm D. Tackling of unhealthy diets, physical inactivity, and obesity: health effects and cost-effectiveness. Lancet 2010;376:1775–84.
- Sassi F, Cecchini M, Lauer J, Chisholm D. Improving lifestyles, tackling obesity: the health and economic impact of prevention strategies. OECD Health working paper 48. OECD, Paris; 2009.[Internet] [cited 2013 June 10]. Available from: http://www.who.int/choice/publications/d_OECD_prevention_report.pdf
- model outputs
The model presents as outputs:
- the transition probabilities between four health states and the respective number of people who moves in yearly cycles through these states;
- the point estimates of the mean costs and DALYs associated with 4 policy options (3 active policies and the reference situation of no action) to reduce TFA intake in the EU (in euros as of 2011), for men, women and the overall EU population;
- the point estimates of the mean costs and DALYs (in euros as of 2011), for the 3 different EU-level action policy options against the reference situation of not acting at the EU level resulting from deterministic analysis, as well as the ICER (in euros as of 2011);
- the point estimates of the mean costs and DALYs (in euros as of 2011) for the 3 different EU-level action policy options against reference situation of not acting at the EU level resulting from probabilistic sensitivity analysis, as well as the ICER (in euros as of 2011).
- the probabilities of each EU-level action policy option to save costs and DALYs when compared with the reference situation.
Intended field of application
- policy role
The model has been developed in the specific context of preparing a policy decision at EU-level related to the presence of trans fats in foods and diets. Trans fats have been shown to increase the risk for heart disease and some countries had taken measures to reduce their presence in foods and diets at national level leading to a partly fragmented internal market. Therefore, the case to act at EU level in the field of food was based on improving the functioning of the internal market and to achieve a high level of consumer protection and promote public health.
The model took a public spending (deliberately excluding costs to the food industry) and wider social (including not only direct health care costs of heart disease but also indirect societal costs such as productivity losses and informal care) perspective. It was aimed at carrying out a public health economic evaluation to support decision making between pre-defined viable policy options against a reference situation of no EU-level action. The JRC worked closely with a SANTE-led inter-service group for producing a Commission report and an accompanying staff working document on trans fats.
Therefore, the JRC anticipated a highly likely initiative requiring an impact assessment for which the model was pro-actively designed. The JRC communicated clearly the potential to serve as decision analytical tool related to the public health objective of the policy initiative aimed at reducing trans fat intake in the EU population. It was also made clear that other aspects, such as environmental impacts, social impacts on specific population groups or economic impacts on the food industry were not within the scope of the model and would need to be done in addition for an impact assessment.
The model was built to inform the assessment of impacts in the social impact area, category on public health, safety and health systems. The main subcategory concerned is the impact on human health (CAD incidence and disability-adjusted life years) affected by the alternative policy scenarios. As trans fats intake is a dietary determinant of health, also this subcategory (lifestyle-related determinants of health) is concerned. In addition, costs to the public are assessed resulting from the health status of the population related to the policy scenarios as well as from implementing the policies. By calculating the incremental cost-effectiveness ratio (ICER) the model informs not only on the policy option that is projected to achieve the largest gain in public health but also the option that is most cost-effective from a public spending point of view.
Whilst the model was developed specifically for the Commission initiative on trans fats, the approach to assess cost-effectiveness of policy options targeting population intake of nutrients, such as salt, sugars or dietary fibre or food groups, such as fruits, vegetables, sugar-sweetened beverages, that are of public health relevance can be easily transferred from trans fats to these other nutrition and health issues. Therefore, the health economic modelling approach developed here has the potential to be used in the context of the initiatives under the Farm to Fork strategy or the prevention pillar of the Europe’s Beating Cancer Plan.
- policy areas
- Consumers
- Public health
Model transparency and quality assurance
- Are uncertainties accounted for in your simulations?
- YES - As input values of the model assume deterministic values, the model also performs a probabilistic sensitivity analysis by applying probabilistic distributions to all variables. Each of the distributions used in this analysis were chosen following the current trends and literature recommendations. In addition, there are uncertainties related to the current levels of iTFA intakes (starting point of model calculations) for the EU population. Therefore, deterministic and probabilistic sensitivity analyses for 3 alternative initial iTFA intake scenarios in addition to the base case were carried out, as well. Also, for 1000 outcomes in the probabilistic sensitivity analysis, the probabilities for saving costs and DALYs were calculated for each policy option to test the robustness of the overall outcome of comparing the cost-effectiveness of policy options.
- Has the model undergone sensitivity analysis?
- YES - After the paper publication, the model was subjected to a comprehensive sensitivity auditing and uncertainty analysis conducted by an expert group in 2017, which provided suggestions that could improve the development of future similar models.
- Has the model been published in peer review articles?
- YES - An article describing the model and the respective results was published in The American Journal of Clinical Nutrition (2016).
- Has the model formally undergone scientific review by a panel of international experts?
- NO
- Has model validation been done? Have model predictions been confronted with observed data (ex-post)?
- YES - During the impact assessment process, the (SANTE-led) inter-service group (ISG), in which the JRC participated, the JRC model and publication were extensively discussed, in particular the input sources, uncertainties and assumptions made. An external consultant gathered additional data and further ‘validated’ inputs and assumptions used in the JRC model with MS, industry and NGOs. The JRC model was made available to the consultant as it was decided to use the JRC model for the impact assessment and add additional analyses to it, in particular including costs to the food industry (which wasn’t part of the JRC study, which took a public-spending perspective).
- To what extent do input data come from publicly available sources?
- Entirely based on publicly available sources
- Is the full model database as such available to external users?
- NO - The TFA intake, defined as E%, as a starting point for the model (“today”) was calculated as described in the published paper’s Supplemental Tables 1–3. All other data sources are publicly available and referenced in the paper (table 1).
- Have model results been presented in publicly available reports?
- YES
- Have output datasets been made publicly available?
- NO - Results are available in the published paper.
- Is there any user friendly interface presenting model results that is accessible to the public?
- NO
- Has the model been documented in a publicly available dedicated report or a manual?
- NO - Details about data, assumptions, limitations, model structure and results are available in the published paper.
Intellectual property rights
- Licence type
- Non-Free Software licence
application to the impact assessment
Please note that in the annex 4 of the impact assessment report, the general description of the model (available in MIDAS) has to be complemented with the specific information on how the model has been applied in the impact assessment.
See Better Regulation Toolbox, tool #11 Format of the impact assessment report).