Skip to main content

Retrospective policy evaluation (ex-post evaluation)

Retrospective policy evaluation scenarios are policy evaluation scenarios employed in ex-post assessments. Ex-post assessments are the present evaluations of past efforts to achieve policy goals throughout all stages of the policy cycle and decision-making context (Figure 1).  Ex-post assessments can be based on the straightforward monitoring of variables of interest as well as on a comparison of the achieved change or status with the original targets and the anticipated impacts of the implemented measures.

During the policy review stage of the policy cycle, the outcomes of previously adopted policies can be compared to hypothetical counterfactual or alternative scenarios (Table 1). Scenarios and models can be used to estimate biodiversity or ecosystem service outcomes under hypothetical policy settings alternative to the ones actually implemented. Ex-post assessments can provide valuable information about how to adjust policy settings with the aim to better achieve desired outcomes in the future, or simply as a form of transparent reporting on the performance of policies or programs.

Figure 1: Retrospective policy evaluation illustrated by a graph of changes in nature and nature’s benefits over time. The observed trajectory of a policy implemented in the past (solid black line) is compared to scenarios that would have achieved the intended target (dashed line).

Table 1: Combining scenario approaches and policy objectives (in the context of retrospective policy evaluation).

Approaches for using scenarios

Brief summary

Relevance for policy-making processes

Role of indirect and direct drivers

POLICY EVALUATION using ex-post assessment

Looks backwards to analyse the gap between environmental policy objectives and actual policy results, after using counterfactual scenarios

Reactive Policy Assessment: Post hoc evaluation of policy effectiveness

Identification of drivers explaining discrepancies of outputs

 

Examples of assessments which have used retrospective policy evaluation:

  • Joppa, L., & Pfaff, A. (2010). Reassessing the forest impacts of protection: the challenge of nonrandom location and a corrective method. Annals of the New York Academy of Sciences, 1185(1), 135-149. [Link]