Accountability and Coordination Framework of the Roadmap for Canada’s Linguistic Duality - Justice Canada Component Evaluation

Appendix A: Evaluation Framework

Table 3: Evaluation Framework
Criteria Questions Indicators Sources / Methods
a) Relevance 1. Do the duties assigned to the OLLS under the Accountability and Coordination Framework align with the official language priorities of the federal government and the Department of Justice? Degree of alignment of the OLLS’s duties under the Framework with the official language priorities set out by the federal government and Justice Canada and perceptions of Framework stakeholders on this Literature review / Interviews
2. Is the OLLS’s involvement in implementing the Framework still necessary? Change in official language coaching at the federal level

Perceptions of Framework stakeholders on the relevance of the OLLS’s duties		 Literature review / Interviews
b) Performance - effectiveness 3. Is the OLLS recognized as playing an important overall (horizontal) role in facilitating the implementation of the Official Languages Act in its entirety? Perceptions of Framework stakeholders on the overall (horizontal) role played by the OLLS. Interviews
4. Have the OLLS’s duties contributed to better horizontal coordination among the federal institutions in implementing the Official Languages Program? Evidence of the OLLS’s contribution to coordination of the federal institutions in terms of official languages and perceptions of Framework stakeholders on this Literature review / Interviews
5. Have the instruments and resources provided by the OLLS been useful to the federal institutions for fulfilling their responsibilities under the Official Languages Act? Description of the instruments and resources produced, type and frequency of the offering, level of increase in demand and evidence of their use and perceptions of Framework stakeholders regarding their usefulness Literature review / Interviews
6. To what extent have the OLLS’s duties contributed to better knowledge of the spirit and intent of the Official Languages Act within the federal institutions? Evidence of the dissemination of knowledge about the spirit and intent of the OLA in the federal institutions.

Perceptions of Framework stakeholders on this		 Literature review / Interviews
7. Have the duties carried out by the OLLS had any unintended positive or negative impacts? Evidence of unintended positive or negative impacts from the OLLS carrying out its duties and perceptions of Framework stakeholders on this Literature review / Interviews
c) Performance - efficiency and economy 8. Do the benefits resulting from the OLLS performing its duties outweigh the costs? Comparison between changes in costs and changes in resulting impacts

Evidence of duplication of initiatives and perceptions of Framework stakeholders on these topics		 Literature review / Interviews
9. Are there other more cost-effective ways of achieving the intended objectives? Evidence of more cost-effective ways and perceptions of Framework stakeholders on this Literature review / Interviews
10. Are there any emerging realities with official languages and its governance structure that have required the OLLS’s activities to change? Evidence of unanticipated changes that have affected the OLLS’s activities and perceptions of Framework stakeholders on this Literature review / Interviews