EUROMOD Microsimulation
Quality & Transparency
Quality
Model uncertainties
Models are by definition affected by uncertainties (in input data, input parameters, scenario definitions, etc.). Have the model uncertainties been quantified? Are uncertainties accounted for in your simulations?
- response
- no
- details
- Deterministic model. Users can design uncertainty through simulating various scenarios.
- url
Sensitivity analysis
Sensitivity analysis helps identifying the uncertain inputs mostly responsible for the uncertainty in the model responses. Has the model undergone sensitivity analysis?
- response
- not applicable
- details
- Due to the nature of the model this does not apply.
- url
Have model results been published in peer-reviewed articles?
- response
- yes
- details
- The EUROMOD website has a (regularly updated) database that gathers journal articles, working papers, reports and book chapters in which EUROMOD has been used.
- url
Has the model formally undergone scientific review by a panel of international experts?
Please note that this does not refer to the cases when model results were validated by stakeholders.
- response
- no
- details
- url
Model validation
Has model validation been done? Have model predictions been confronted with observed data (ex-post)?
- response
- yes
- details
- Simulation results are validated against official statistics. The validation process is documented in a series of country reports.
- url
Transparency
To what extent do input data come from publicly available sources?
This may include sources accessible upon subscription and/or payment
- response
- Entirely based on publicly available sources
Is the full model database as such available to external users?
Whether or not it implies a specific procedure or a fee
- response
- no
- details
- Underlying input data are made available by the European Commission (for EU member states) to researchers who have a EUROMOD-related Research Project Proposal (RPP) approved by EUROSTAT. See EUROMOD website for more information. However, the model also runs with hypothetical data created by the user, for which no authorization is needed. Additionally, users can create their own input microdata based on other sources, e.g. administrative registers.
- url
Have model results been presented in publicly available reports?
Note this excludes IA reports.
- response
- yes
- details
- documents
Have output datasets been made publicly available?
Note this could also imply a specific procedure or a fee.
- response
- no
- details
- Output microdata can be only shared among approved researchers. However, aggregate indicators derived from the output microdata can be made publicly available, as long as they respect the confidentiality rules set by the data providers. Selected indicators are made available in the EUROMOD website.
- url
Is there any user friendly interface presenting model results that is accessible to the public?
For instance: Dashboard, interactive interfaces...
- response
- yes
Has the model been documented in a publicly available dedicated report or a manual?
Note this excludes IA reports.
- response
- yes
- details
- The coding of all tax-benefit policies is visible for the users. The model structure is documented in built-in help and user documentation included in the model. Model simulations and content are described in country reports publicly available on the EUROMOD website. The process of data manipulation for the creation of the EUROMOD input dataset is described in the Data Requirement Documents (DRDs), provided together with the EUROMOD input datasets.
Is there a dedicated public website where information about the model is provided?
- response
- yes
Is the model code open-source?
- response
- yes
- details
- The source code is available in GitHub. Detailed Instructions on how to download and install all components of EUROMOD are available from the EUROMOD website.
- url
Can the code be accessed upon request?
- response
- not applicable
- details