Aboriginal Courtwork Program, Formative Evaluation

Appendix C: Evaluation Issues and Questions

Evaluation Issues

Implementation and Delivery – To what extent has the ACW Program been implemented as intended?

  1. How is the ACW program being delivered in each jurisdiction?  What are the differences/commonalities between jurisdictions?
  2. Are the federal contribution agreements flexible enough to meet the jurisdictions' objectives and priorities? If not, why not?
  3. Do federal resources flow in a timely fashion to the provinces / territories? If not, why? What are the challenges?
  4. Are the reporting requirements defined in the federal contribution agreements completed on time? If not, why?  What are the challenges?
  5. Did the TWG meet its mandate? How effective is the TWG in meeting its mandate? What could its role be in the future? How could it be improved?
  6. Did the TWG Steering Committee meet its mandate? How effective is the TWG Steering Committee in meeting its mandate? What could its role be in the future? How could be improved?
  7. Are the objectives of the ACW program clear among key parties involved in the program? (TWG, Steering Committee, SDAs, DOJ, provinces / territories, courtworkers)
  8. Are the roles and responsibilities clear to all parties involved in the program? (TWG, Steering Committee, SDAs, DOJ, provinces / territories, courtworkers)
  9. Has the recent increase in federal funding helped alleviate immediate pressures on Courtwork Program? If so, how? If not, why not?
  10. What are the strengths and weaknesses of the way in which ACW program is delivered? What aspects of the ACW program delivery should be improved?

Data Collection – How effective is the ongoing performance measurement strategy?

  1. To what extent have the performance reporting requirements outlined in the program's RMAF been implemented?
  2. Are the right tools and resources available to meet the program's performance reporting requirements?  If not, what additional tools or resources are required?
  3. What factors have facilitated or impeded the data collection and reporting of the performance measurement guide?  What are the solutions to these barriers? What improvements can be made?

Support / Advice / Linkages

  1. To what extent have Aboriginal courtworkers reached their client groups?
  2. Was the Aboriginal courtworker successful in facilitating links between established and evolving community justice programs and the formal justice system on behalf of the accused?
  3. To what extent have courtworkers developed linkages between the formal and community justice systems and the Aboriginal community?
  4. To what extent have the courtworkers been provided with the training they require to do their job?  What could be improved?
  5. Were accused aware of their rights, obligations as a result of their interaction with the courtworker?
  6. How satisfied are Aboriginal Clients with the quality of services provided?
  7. How could the ACW service be improved?
  8. Were those within the formal justice system (court officials, duty counsel, legal aid lawyers, judges, etc.) advised of relevant issues relating to the circumstances of the accused?
  9. How satisfied are Court Officials and the Judiciary with the quality of services provided?