SOcial multi CRiteria AssessmenT of European policieS
Quality & Transparency
Quality
Model uncertainties
Models are by definition affected by uncertainties (in input data, input parameters, scenario definitions, etc.). Have the model uncertainties been quantified? Are uncertainties accounted for in your simulations?
- response
- yes
- details
- SMCE can help in dealing with three different types of uncertainties: epistemological (human representation of a given policy problem necessarily reflects perceptions, values and interests of those structuring the problem), scientific (the existence of different levels and scales at which a hierarchical system can be analyzed implies the unavoidable existence of non-equivalent descriptions of it both in space and time) and technical (Compensability versus non-compensability, relevant preference modelling of intensities of preference, mixed information on criterion scores, weights as trade-offs versus weights as importance coefficients, choice of a proper ranking algorithm). SOCRATES helps in dealing with all these uncertainties.
- url
Sensitivity analysis
Sensitivity analysis helps identifying the uncertain inputs mostly responsible for the uncertainty in the model responses. Has the model undergone sensitivity analysis?
- response
- yes
- details
- SOCRATES can deal with both social and technical sensitivity analysis. Sensitivity and robustness analysis looks at the sensitivity of results to the exclusion/inclusion of different criteria, criterion weights and dimensions. While such analysis may look very technical, in reality a social component is always present too. That is, inclusion/exclusion of a given dimension, or set of criteria, normally involves a long story of social, political and scientific controversy, and involves social values and social actors.
- url
Have model results been published in peer-reviewed articles?
- response
- yes
- details
- SMCE is a methodology widely used in many geographical contexts around the world. Many peer reviewed publications on SMCE exist both on the methodological and empirical aspects. SOCRATES is based on in house research developed at JRC, fully published in top international scientific journals.
- url
- documents
Has the model formally undergone scientific review by a panel of international experts?
Please note that this does not refer to the cases when model results were validated by stakeholders.
- response
- no
- details
- url
Model validation
Has model validation been done? Have model predictions been confronted with observed data (ex-post)?
- response
- not applicable
- details
- As a decision model it cannot be validated against observed data.
- url
Transparency
To what extent do input data come from publicly available sources?
This may include sources accessible upon subscription and/or payment
- response
- Based on both publicly available and restricted-access sources
Is the full model database as such available to external users?
Whether or not it implies a specific procedure or a fee
- response
- yes
- details
- The software itself is public. The input data is dependent on the designed decision model and independent from SOCRATES
- url
Have model results been presented in publicly available reports?
Note this excludes IA reports.
- response
- yes
- details
- documents
Have output datasets been made publicly available?
Note this could also imply a specific procedure or a fee.
- response
- yes
- details
- Detailed outputs of the model have been made available in the Impact Assessment that SOCRATES supported.
- url
Is there any user friendly interface presenting model results that is accessible to the public?
For instance: Dashboard, interactive interfaces...
- response
- yes
Has the model been documented in a publicly available dedicated report or a manual?
Note this excludes IA reports.
- response
- yes
- details
- documents
Is there a dedicated public website where information about the model is provided?
- response
- yes
Is the model code open-source?
- response
- no
- details
Can the code be accessed upon request?
- response
- yes
- details