Evaluation of the Indigenous Courtwork Program

Appendix A: Evaluation Matrix

Evaluation Issues and Questions

Instruments

Justice Officials

Court-workers

KI

Case Studies

Client Survey

Client Interview

Documents, Files, Data

Literature

Issue #1: Continued Need for Program
1. Is there a continued need for the Program?

Level of demand for Indigenous Courtwork Program services

● Yes

● Yes

● Yes

● Yes

 

 

 

● Yes

Number of Indigenous Courtwork Program clients with a charge served by jurisdiction

 

 

 

 

 

 

● Yes

 

Number of Indigenous Courtwork Program clients without a charge served by jurisdiction.

 

 

 

 

 

 

● Yes

 

Number of services provided in court and out of court

 

 

 

 

 

 

● Yes

 
2. To what extent is the Program responsive to the needs of Indigenous persons before the courts?

Evidence that the Indigenous Courtwork Program is addressing the needs of the clients

● Yes

● Yes

● Yes

● Yes

● Yes

 

 

 

Issue #2: Alignment with Government Priorities
3. Are the Program objectives consistent with the priorities of the federal government?

Evidence that the Program objectives are consistent with the priorities of the federal government

 

 

● Yes

 

 

 

● Yes

 
4. Are the Indigenous Courtwork Program objectives consistent with the Department of Justice priorities/core responsibilities?

Evidence that the Program objectives are consistent with the priorities/core responsibilities of the Department of Justice

 

 

● Yes

 

 

 

● Yes

 

Issue #3: Achievement of Expected Outcomes
5. To what extent are the clients aware of their rights and obligations as a result of their interaction with the Courtworkers?

Level of awareness of the clients regarding their rights and obligations as a result if to their interaction with the Courtworkers

● Yes

● Yes

 

● Yes

● Yes

● Yes

 

 
6. To what extent do Courtworkers help their clients make informed decisions with respect to their circumstances before the courts?

Extent to which the clients are able to make informed decisions with respect to their circumstances before the courts

● Yes

● Yes

 

● Yes

● Yes

● Yes

 

 
7. To what extent do Courtworkers advise clients on how to access legal and community/social resources available to them in their community to address their needs?

Extent to which the clients are aware of the legal and community/ social resources available to them

● Yes

● Yes

 

● Yes

● Yes

● Yes

 

 
8. To what extent are the clients able to make informed decisions about pursuing alternative measures/Indigenous therapeutic courts/specialized courts, restorative justice programs and services as a result of the Program?

Extent to which the clients are aware of alternative measures/ restorative justice programs and services

● Yes

● Yes

 

● Yes

● Yes

● Yes

 

 

Extent to which clients are able to make informed decisions about pursuing them in 2017-18

● Yes

● Yes

 

● Yes

● Yes

● Yes

 

 
9. To what extent does the client receive fair, just, timely, and equitable treatment before the Court?

Evidence that clients receive fair, timely and equitable treatment in Court

 

 

 

 

 

 

 

 
10. To what extent do justice officials receive information from the Courtworkers relating to the circumstances of the clients; legal and community/social resources available to the clients in their community; alternative/restorative justice programs and services available to the clients in their community; and cultural traditions and social needs pertaining to the clients?

Level of agreement that justice officials are provided with relevant information on the clients (such as their circumstances, cultural traditions and social issues, legal and community/social resources available to the clients in their community, and alternative/restorative justice

● Yes

● Yes

 

● Yes

 

 

 

 
11. How and to what extent has the information provided by the Courtworkers on the circumstances of the clients been used by the justice officials?

Examples of how information is used by justice officials

● Yes

● Yes

 

● Yes

 

 

 

 

Extent to which information provided to justice officials by the Courtworkers has been used

● Yes

● Yes

 

● Yes

 

 

 

 
12. How and to what extent have the Courtworkers developed partnerships between themselves and the communities they serve?

Nature of linkages that have been developed between the Courtworkers, the communities they serve, and the community- based justice initiatives

 

● Yes

● Yes

● Yes

 

 

 

 

Strength of these linkages

 

● Yes

● Yes

● Yes

 

 

 

 
13. Has the role of the Courtworker changed over the past five years? If yes, what is the nature of these changes? What is driving these changes? Have these changes affected the Courtworkers’ capacity/workload to do their job?

Change in the role of the Courtworkers over the past five years

 

● Yes

● Yes

● Yes

 

 

 

 

Impacts of change on the capacity of the Courtworkers to do their job

 

● Yes

● Yes

● Yes

 

 

 

 
14. What is working well in the Program? What is not working so well in the Program? What needs to be changed?

Strengths and weaknesses of the Program

● Yes

● Yes

● Yes

● Yes

● Yes

● Yes

 

 

Challenges affecting the service delivery of the Program

● Yes

● Yes

● Yes

● Yes

● Yes

● Yes

 

 
15. Are there any changes /impacts that have influenced the Indigenous Courtwork Program? If yes, what are they?

Key factors that are having an influence on the ICW Program

● Yes

● Yes

● Yes

● Yes

 

 

● Yes

● Yes

Implications of changes/impacts on the ICW Program

● Yes

● Yes

● Yes

● Yes

 

 

 

 

Issue #4: Demonstration of Efficiency
16. Are the most appropriate and efficient means being used to achieve the Indigenous Courtwork Program outcomes?

Impact of current Program design on efficiency

 

 

● Yes

● Yes

 

 

 

 

Allocations and expenditures of Program by jurisdiction

 

 

 

 

 

 

● Yes

 

Efforts to improve efficiency

 

 

● Yes

● Yes

 

 

 

 
17. Does the Indigenous Courtwork Program have the resources it needs to achieve its objectives?

Allocations and expenditures of ICW Program

 

 

 

 

 

 

● Yes

 

Level of demand for ICW Program services

● Yes

● Yes

● Yes

 

 

 

 

 
18. Have all the resources that were allocated for the Indigenous Courtwork Program been used? If no, why not?

Allocations and expenditures of ICW Program by jurisdiction

 

 

● Yes

 

 

 

● Yes

 

Program Design
19. Are there any differences in Indigenous Courtwork services needed by Indigenous men and women before the courts?

Nature of service needs of Indigenous men and women before the courts

 

● Yes

 

 

● Yes

● Yes

 

 
20. To what extent are the performance indicators clearly and consistently reported upon by each jurisdiction?

Performance measures in place

 

 

● Yes

 

 

 

● Yes

 

Data being collected by jurisdictions

 

 

 

 

 

 

● Yes

 

Performance information analyzed and reported

 

 

 

 

 

 

● Yes

 
21. To what extent has the Tripartite Working Group had input into the development of the Program and policy, performance indicators and services?

Level of Tripartite Working Group involvement in the development of the Program indicators

 

 

● Yes

 

 

 

● Yes

 
22. What are the challenges associated with collecting and reporting standardized performance measures across all jurisdictions?

Extent to which standardized measures are in place and are being reported

 

 

● Yes

 

 

 

● Yes

 
23. To what extent has the Project Fund impacted the Program?

Nature of changes to the ICW Program brought about by the Fund

 

 

● Yes

● Yes

 

 

● Yes

 
24. To what extent is the Tripartite Working Group working collaboratively/effectively? If not, what needs to be modified/changed?

Evidence of the Tripartite Working Group collaboration on program, policy, communication and governance issues

 

 

● Yes

 

 

 

● Yes