Justice Partnership and Innovation Program Evaluation, Final Report

Appendix D: Survey Questionnaire

Survey Questionnaire (Generic - Applicants)

Introduction

Hello, may I speak with …?

Hi, my name is and I am calling from Goss Gilroy Incorporated, on behalf of the Department of Justice Canada. Justice Canada is currently undertaking an evaluation of the Justice Partnership and Innovation Program which I will refer to by its acronym JPIP throughout the interview. This evaluation is being conducted to provide the Department with an assessment of the need for JPIP, its effectiveness and efficiency.

The Department launched the evaluation in March 2011 and contracted the independent consulting firm Goss Gilroy Incorporated to conduct this evaluation on their behalf. As part of the evaluation, the consulting firm will be conducting interviews with randomly selected JPIP applicants, including both those awarded grants/contributions and those not awarded.

Your participation is completely voluntary and your acceptance or refusal to participate will not affect your relationship with the Department of Justice, nor will it affect current or future funding decisions of the Department. The information you provide will be collected under the authority of the Department of Justice Act and will be administered in accordance with the Privacy Act and other applicable privacy laws. The information you provide is for the purpose of the evaluation only, and no administrative decision about individuals or organizations will be made as a result of this study.

All responses will be pooled for analysis. Depending on your answers, the survey should take between 30 and 40 minutes to complete. Do you have time to complete the survey now?

  • Name of Respondent
  • Organization
  • Project(s)

Section 1: About You

To begin with, we would like to ask you a few questions about you. Your answers to these questions will provide us with a context within which to interpret your answers.

  • 1.  Which of the following field of law or justice, which is a focus of JPIP, does your organization operate in? <Several options may apply. Read list.>

    1. Human rights
    2. Women’s rights
    3. Nunavut law
    4. Aboriginal issues
    5. Missing or murdered Aboriginal women
    6. Official languages
    7. International law (justice-related issues in the international fora)
    8. Access to justice
    9. Racism
    10. Anti-terrorism
    11. Sentencing
    12. Other (Please specify)

    <Only ask if none of the options in Q1. applies> 1a. Which of the following best describes your organization?

    1. Non-profit organization
    2. Government
    3. Canadian institution/board of education
    4. International organization
    5. Band, tribal council, self-governing First Nation and Inuit
    6. Other (Please specify)

  • 2. How many full-time employees usually work in your organization? <Read the list>

    1. Less than 10 employees
    2. Between 10 and 50 employees
    3. Between 50 and 100 employees
    4. Over 100 employees
    5. I don’t know

  • 3. (6.1.1) How did you learn about the JPIP program? <Several options may apply. Do not read the list. Prompt only if necessary>

    1. Department of Justice Canada website
    2. Department of Justice Canada - Other method (please specify:)
    3. I heard about the program on the news (e.g., Minister’s announcement)
    4. I heard about the program from other organizations in my field
    5. I heard about the program from organizations outside my field
    6. Other (Please specify)
    7. I don’t know

  • 4. (6.1.1) How familiar are you with the JPIP program? <Read the scale>

    1. Not at all familiar
    2. Slightly familiar
    3. Somewhat familiar
    4. Very familiar
    5. I don’t know

  • 5. (6.1.1) Other organizations in your field could benefit from funding from JPIP. How familiar do you think these organizations are with the program? <Read the scale>

    1. Not at all familiar
    2. Slightly familiar
    3. Somewhat familiar
    4. Very familiar
    5. I don’t know

Section 2: Program Relevance and Continued Need

<Ask successful and unsuccessful applicants>

  • 6. (1.1.2) Based on your knowledge and experience, could you describe the needs of the population your organization serves which could be addressed through support provided by Justice (through a program like the JPIP)? <Open-ended question>

  • 7. (1.1.2) I will list several types of JPIP objectives and activities. I would like you to tell me the extent to which your organization needs or would benefit from support to achieve these objectives and/or conduct these activities. Would you say that your organization needs support or would benefit from support to… <Read one option at a time and read the scale: “would you say not needed, slight need, etc.”>

    JPIP Objectives Not needed Slight need Moderate need Great need Don’t know
    a) Promote and encourage involvement in the identification of emerging trends, issues and/or gaps and possible responses with respect to the justice system? 1 2 3 4 5
    b) Promote innovations in the justice system to ensure greater access to the justice system? 1 2 3 4 5
    c) Build knowledge, awareness, understanding and informed dialogue among justice stakeholders on justice issues including:
    • Access to justice
    • Racism
    • Official languages
    • Anti-terrorism
    • Sentencing
    • Justice issues in the international fora
    		 1 2 3 4 5
    d) Build knowledge, awareness, understanding and informed dialogue among the public on justice issues including:
    • Access to justice
    • Racism
    • Official languages
    • Anti-terrorism
    • Sentencing
    • Justice issues in the international fora
    		 1 2 3 4 5
    e) Inform Canadians about access to justice issues and the justice system in order to contribute to increased public understanding, participation, confidence and trust in the justice system? 1 2 3 4 5
    Now we will talk about need for support or benefitting from support for particular activities. Would you say that your organization needs support or would benefit from support to…
    JPIP Objectives Not needed Slight need Moderate need Great need Don’t know
    a) Offer workshops, conferences, symposiums? 1 2 3 4 5
    b) Offer training sessions? 1 2 3 4 5
    c) Pilot, demonstration and research projects? 1 2 3 4 5
    d) Public legal education and information projects? 1 2 3 4 5
    e) Other (please specify) 1 2 3 4 5

  • 8. (1.1.1) How well are JPIP objectives and activities aligned with the justice needs of the general public? Would you say… <Ask the respondent to explain his answer>

    1. Not at all aligned
    2. Slightly aligned
    3. Somewhat aligned
    4. Very much aligned
    5. Completely aligned
    6. I don’t know

  • 9. (1.1.4) How well are JPIP objectives and activities aligned with the needs of the legal community in general? Would you say… <Ask the respondent to explain his answer>

    1. Not at all
    2. Slightly aligned
    3. Somewhat aligned
    4. Very much aligned
    5. Completely aligned
    6. I don’t know

  • 10 (1.1) Do you plan to re-apply to JPIP in the future? <Ask the respondent to explain his answer>

    1. Yes
    2. No
    3. I don’t know

Section 3: Results of Funded Projects

<Ask successful applicants only>

The following section concerns the results of your JPIP funded project(s) or activity(ies).

  • 11. (4.1.2) Would you say that your JPIP funded activities resulted in… <Several options may apply. Read the list>

    1. The identification of emerging trends in the justice system (4.1.2)
    2. The identification of emerging issues in the justice system (4.1.2)
    3. The identification of gaps in the justice system (4.1.2)
    4. The generation of best practices or responses to emerging trends/issues or gaps in the justice system (4.1.3)
    5. Knowledge sharing (4.1.2)
    6. Other (please specify:)
    7. I don’t know [go to Q16]

  • 12. (4.1.2) <If identified trends> Could you please describe the number and types of emerging trends in the justice system that you identified?

  • 13. (4.1.2) <If identified issues> Could you please describe the number and types of emerging issues in the justice system that you identified.

  • 14. (4.1.2)<If identified gaps> Could you please describe the number and types of gaps in the justice system you identified?

  • 15. (4.1.3) <If generated best practices/responses> Could you please describe the number and nature of best practices or responses this project generated?

  • 16. (4.1.2) <If resulted in knowledge sharing> Could you please describe these knowledge sharing activities and their result?

  • 17. To what extent would you say that JPIP funded activities (in your organization and other funded organizations) led to…

    1. (4.2.2) Increased knowledge, awareness, understanding, confidence, trust, and informed dialogue on justice issues (prompt: access to justice, racism, official languages, anti-terrorism, sentencing, and justice-related issues in the international fora) among the general public?

      1. Not at all
      2. To a little extent
      3. To some extent
      4. To a great extent
      5. To a very great extent
      6. I don’t know

    2. (4.2.2) Increased knowledge, awareness, understanding, confidence, trust, and informed dialogue on justice issues among organizations and individuals connected to your organizations affected by your organization’s work (stakeholders)?

      1. Not at all
      2. To a little extent
      3. To some extent
      4. To a great extent
      5. To a very great extent
      6. I don’t know

    3. (4.2.2) Mobilization of partnerships and networks (among stakeholders) on justice-related issues (prompt: access to justice, racism, official languages, anti-terrorism, sentencing, and justice-related issues in the international fora)?

      1. Not at all
      2. To a little extent
      3. To some extent
      4. To a great extent
      5. To a very great extent
      6. I don’t know

    4. (4.6.1) Promotion of emerging ideas, processes or ways of doing in the justice system to ensure better access to it?
      1. Not at all
      2. To a little extent
      3. To some extent
      4. To a great extent
      5. To a very great extent
      6. Don’t know

  • 18. Are you familiar with PLEI materials and activities?

    1. Yes
    2. No [go to Q19]

  • 19. 4.5.1) <Ask only if familiar with PLEI materials and activities> To what extent would you say the general public finds PLEI materials/activities useful in addressing their legal needs and concerns? Please explain your answer and, if possible, provide examples. <Read the scale: “would you say not at all, slightly etc.”>

    1. Not at all
    2. To a little extent
    3. To some extent
    4. To a great extent
    5. To a very great extent
    6. I don’t know [go to next questions]

  • 20. (5.2.2) Could you please describe how participants in JPIP funded activities, recipients of materials/activities and, if relevant, the general public benefited from these (financial and non-financial)?

    1. I don’t know

  • 21. Can you provide an estimate of the dollar value of these benefits? (5.2.1)

    1. I don’t know

Section 4: Design and Delivery

<Ask successful and unsuccessful applicants>

  • 22. How satisfied are you with… <Read one option at a time. Read the scale “would you say very dissatisfied, dissatisfied etc.”>

    Characteristic of the JPIP Program Very dissatisfied Dissatisfied Neither Satisfied or Dissatisfied Satisfied Very satisfied I don’t know
    a) The ease of the application process?(6.2.4) 1 2 3 4 5 6
    b) The clarity of the application process? (6.2.2) 1 2 3 4 5 6
    c) The type of information required in the application form? (6.2.1) 1 2 3 4 5 6
    d) The ease of interactions between applicants and JC? (6.2.3) 1 2 3 4 5 6
    e) The timeliness of responses to your queries or communications with Justice Canada? (6.3.2) 1 2 3 4 5 6
    f) The appropriateness of selection criteria? (6.2.2) 1 2 3 4 5 6
    g) The timeliness of communication about status of your application (approval decisions)? (6.3.1) 1 2 3 4 5 6
    h) <Successful applicants only> The size of the amount awarded if applications are successful? (5.1.1) 1 2 3 4 5 6
    i) <Successful applicants only> The time period of funding awarded (can vary from 1 to more than 3 years)? (5.1.1) 1 2 3 4 5 6
    j) <Successful applicants only> The timeliness of payments? (6.3.3) 1 2 3 4 5 6
    k) <Successful applicants only> The funding reporting requirements (6.4) 1 2 3 4 5 6
    l) Other (please specify) 1 2 3 4 5 6

  • 23. (6.2.1) Do the current application forms and processes allow your organization to provide enough information to allow Justice Canada to make good decisions about whether or not to provide funding to your organization?

    1. Yes
    2. No – Could you please specify the issues? (e.g., not enough room to provide information, not asking for the right types of information, not clear how to meet evaluation criteria, etc.)

  • 24. [For each item in Q21 for which the respondent answered “very dissatisfied” or “dissatisfied”] Please tell me how you think ‘X’ could be improved.

    Probe successful applicants: Direct bank deposits could speed up payment processing time, although there may be some additional administrative burden associated with direct deposit. Would you prefer direct deposit?

  • 25. (6.3.4) Do you have any comments about the timeliness of the JPIP application process?

    1. Yes – please specify
    2. No

  • 26. (7) Do you have any other comments you would like to share about the JPIP program?

    1. Yes – please specify
    2. No

Those are all the questions we have for you. Thank you very much for taking the time to complete this survey.

END

Date modified: