European Transport Forecast Model
Quality & Transparency
Quality
Model uncertainties
Models are by definition affected by uncertainties (in input data, input parameters, scenario definitions, etc.). Have the model uncertainties been quantified? Are uncertainties accounted for in your simulations?
- response
- no
- details
- NEAC is used for a wide variety of tasks, often to fill gaps, where no precise data exists. The model is calibrated to available data, but this does not cover the full range of uncertainties in a system of this scale.
- url
Sensitivity analysis
Sensitivity analysis helps identifying the uncertain inputs mostly responsible for the uncertainty in the model responses. Has the model undergone sensitivity analysis?
- response
- yes
- details
- The key area which has been studied is the sensitivity of the mode split function. This has been done by comparing to other models and other functions.
- url
Have model results been published in peer-reviewed articles?
- response
- no
- details
- Not in full, and not by external parties. The model however uses functional forms and parameters which have been published in research studies, e.g. TRANSTOOLS.
- url
Has the model formally undergone scientific review by a panel of international experts?
Please note that this does not refer to the cases when model results were validated by stakeholders.
- response
- no
- details
- url
Model validation
Has model validation been done? Have model predictions been confronted with observed data (ex-post)?
- response
- yes
- details
- NEAC is one of the older European models, and therefore there are many published studies containing forecasts made in the past with projections to the (now) present day. Recently comparisons have been made with the EU Reference Forecasts, so that input assumptions can be aligned, and outputs compared in detail.
- url
Transparency
To what extent do input data come from publicly available sources?
This may include sources accessible upon subscription and/or payment
- response
- Entirely based on publicly available sources
Is the full model database as such available to external users?
Whether or not it implies a specific procedure or a fee
- response
- yes
- details
- NEAC uses the ETIS-PLUS databases, which is openly and freely available.
- url
Have model results been presented in publicly available reports?
Note this excludes IA reports.
- response
- yes
- details
Have output datasets been made publicly available?
Note this could also imply a specific procedure or a fee.
- response
- no
- details
- There are no confidentiality restrictions with the outputs.
- url
Is there any user friendly interface presenting model results that is accessible to the public?
For instance: Dashboard, interactive interfaces...
- response
- no
- details
- url
Has the model been documented in a publicly available dedicated report or a manual?
Note this excludes IA reports.
- response
- yes
- details
- A full description of the model is available on the Panteia website, or alternatively on request.
Is there a dedicated public website where information about the model is provided?
- response
- no
- details
- url
Is the model code open-source?
- response
- no
- details
Can the code be accessed upon request?
- response
- yes
- details