European Commission logo
Joint Research Center (JRC)
METIS

Markets and Energy Technologies Integrated Software

EnergyEnergyenergy system analysisenergy market analysis

Quality & Transparency

Quality

Model uncertainties

Models are by definition affected by uncertainties (in input data, input parameters, scenario definitions, etc.). Have the model uncertainties been quantified? Are uncertainties accounted for in your simulations?

yes
METIS allows stochastic simulations.

    Sensitivity analysis

    Sensitivity analysis helps identifying the uncertain inputs mostly responsible for the uncertainty in the model responses. Has the model undergone sensitivity analysis?

    yes
    Sensitivities runs are included in several METIS studies. These are highly dependent on the context rather than the model.

      Have model results been published in peer-reviewed articles?

      yes

        Has the model formally undergone scientific review by a panel of international experts?

        Please note that this does not refer to the cases when model results were validated by stakeholders.

        yes
        Review by expert panel, led by JRC in 2019.

          Model validation

          Has model validation been done? Have model predictions been confronted with observed data (ex-post)?

          not applicable
          Most of the analysis performed with METIS addresses future time periods.

            Transparency

            To what extent do input data come from publicly available sources?

            This may include sources accessible upon subscription and/or payment

            Entirely based on publicly available sources

            Is the full model database as such available to external users?

            Whether or not it implies a specific procedure or a fee

            no
            Based on Eurostat, ENTSO-E, ENTSO-G

              Have model results been presented in publicly available reports?

              Note this excludes IA reports.

              yes

              Have output datasets been made publicly available?

              Note this could also imply a specific procedure or a fee.

              no
              At request or by re-running publically available scenario files.

                Is there any user friendly interface presenting model results that is accessible to the public?

                For instance: Dashboard, interactive interfaces...

                no

                  Has the model been documented in a publicly available dedicated report or a manual?

                  Note this excludes IA reports.

                  yes
                  Fully documented. All documentation can be found on the METIS website.

                  Is there a dedicated public website where information about the model is provided?

                  yes

                  Is the model code open-source?

                  yes
                  Model scripts are available for download from DG ENER’s website.

                    Can the code be accessed upon request?

                    not applicable