Evaluation of the Integrated Market Enforcement Teams Reserve Fund

Appendix A: Evaluation Matrix

Evaluation Matrix - Evaluation of the IMET Reserve Fund
Issues/Questions Indicators Data Sources Responsibility for Collecting
Relevance (Treasury Board core issues 1-3)
  1. Is there a continued need for the IMET Reserve Fund?
  • IMET/capital market fraud continues to be a federal priority (identified in Throne speeches )
  • Document review
  • Key informant interviews

Policy Implementation Directorate

Department of Justice Evaluation Division

  • Perception of continued need to assist prosecutions in the provinces
  • Key informant interviews
Department of Justice Evaluation Division
  1. To what extent do the goals and objectives of the IMET Reserve Fund align with: 1) Government of Canada priorities 2) Justice Canada’s strategic outcomes?
  • Perception of whether IMET Reserve Fund goals and objectives align with federal priorities
  • Perception of whether IMET Reserve Fund goals and objectives align with the Department of Justice’s strategic outcomes
  • Key informant interviews
  • Document review
Department of Justice Evaluation Division
  1. To what extent are the activities of the IMET Reserve Fund aligned with federal roles and responsibilities?
  • Continued relevance of federal government involvement in supporting the provincial prosecution costs associated with capital market fraud cases
  • Key informant interviews
  • Document review/ departmental files
Department of Justice Evaluation Division
Achievement of Expected Outputs/Outcomes (Treasury Board core issue 4) – The Fund provides assistance to provinces to help ensure an effective prosecution
  1. To what extent has the IMET Reserve Fund achieved its expected outputs/outcomes?
Immediate Outcome: Enhanced prosecution capacity

Enhanced capacity to prosecute serious capital market fraud

  • Enhanced capacity to prosecute serious capital market fraud
  • Extent/ways in which agreements with provinces have enhanced capacity to prosecute capital market fraud
  • Contribution agreements with the provinces (number of signed contribution agreements and nature and value of Reserve Fund agreements by province)
  • Information posted on Justice website
  • Number of inquiries and emails sent to provinces
  • Extent to which the Reserve Fund has been successful in encouraging provincial Crowns to take on serious capital market fraud prosecutions
  • The perceived impact on prosecutions had funding through the Reserve Fund not have been available
  • Key informant interviews
  • Document review
  • Key informant interviews
  • Reserve Fund inquiries and applications/ analysis

Department of Justice Evaluation Division

Department of Justice Evaluation Division

  Intermediate Outcomes: Improved prosecution of serious capital market fraud cases
 

The extent to which the IMET Reserve Fund contributed to the improved or increased effectiveness of prosecutions

  • Nature and extent of funding provided
  • Perception and examples from cases on the extent to which IMET Reserve Fund facilitated provincial prosecutions (i.e. timeliness, completeness of charges, and speed of disposition)
  • Document review
  • Key informant interviews
  • Review of cases
Department of Justice Evaluation Division
 

The extent to which the IMET Reserve Fund contributed to the deterrence and reduced occurrences of serious capital market fraud

  • Perception on the extent to which the Fund contributed to deterrence and reduced occurrence of serious capital market fraud
  • Documents review
  • Key informant interviews
  • Review of cases
Department of Justice Evaluation Division
 

The extent to which the IMET Reserve Fund contributed to an improved integrity of Canada’s capital markets

  • Nature and extent of types of funding provided
  • Perception on the extent to which IMET Reserve Fund assistance contributed to the improved integrity of Canada’s capital markets
  • Document review
  • Key informant interviews
  • Review of cases
Department of Justice Evaluation Division
  Ultimate Outcome and Departmental Strategic Outcomes
 

To what extent has the IMET Reserve Fund contributed to Canadian and international investor confidence in the integrity of Canada’s capital markets

  • Key stakeholders perceptions and examples of how the IMET Reserve Fund contribution
  • Key informant interviews
Department of Justice Evaluation Division
Efficiency and Economy (Treasury Board core issue 5)
  1. To what extent has the IMET Reserve Fund been administered efficiently and economically?
  • Evidence of strategies to achieve outputs and outcomes in the most cost-effective way
  • Measures in place to manage efficiency
  • Suggestions for improvement in efficiency of performance
  • Alternative approaches to service delivery
  • Key informant interviews
  • Document review
Department of Justice Evaluation Division
  1. Are there alternative ways to better achieve the objectives of the Fund?
  • Perceptions of other ways similar objectives and outcomes could be achieved
• Key informant interviews  
  1. Are there any best practices or lessons learned in the administration of the IMET Reserve Fund?
  • Evidence of best practices and lessons learned
  • Key informant interviews
  • Review of cases
  • Document review
Department of Justice Evaluation Division