Federal Victims Strategy Evaluation, Final Report


The methodology used to evaluate the FVS included a document review, review of six sub-studies, interviews with key stakeholders, a file review, and case studies of projects funded under the Victims Fund. This section provides further details on each research method.

3.1 Data Collection Methods

3.1.1 Document Review

A wide variety of relevant documents were identified and reviewed. These documents can be grouped under the following categories:

3.1.2 Sub-studies

A number of evaluation activities and sub-studies were undertaken by the Department of Justice Evaluation Division to help inform the evaluation. The results of these sub-studies contributed significantly to this evaluation. The following describes these studies:

3.1.3 Interviews with 46 Key Informants

Interviews were conducted with PCVI staff, federal, provincial and territorial members of the Working Group on Victims of Crime, members of the Advisory Committee and federal stakeholders who are not members of the FPT Working Group on Victims of Crime. The distribution of the 46 key informants by group is shown in Table 5. The interviews were designed to address evaluation questions related to the relevance and performance (i.e. effectiveness, efficiency and economy) of the Strategy. Two interviews were conducted in person and the remaining by telephone.

Table 5 Interviews of Key Informants and PCVI Staff
Respondent Type Number Interviewed
PCVI Directors, Managers, Staff 11
Federal Members of FPT Working Group on Victims of Crime 7
Provincial Members of FPT Working Group on Victims of Crime 13
Territorial Members of FPT Working Group on Victims of Crime 3
Advisory Committee Members 10
Federal Stakeholders (not members of FPT Working Group on Victims) 2
Total 46

3.1.4 File Reviews of 57 Victims Fund Projects

The file review of 57 Victims Fund funded projects encompassed 44 projects from the Projects and Activities Component and 13 projects from the Provincial/Territorial Component. The sample represented 62% of the projects funded under the Provincial/Territorial Component and 40% of the projects funded under the Projects and Activities Component.[9]

Funded projects from across the country were selected for this review. Projects were selected based on the availability of information on file regarding project outcomes and impacts. The sample included a cross section of projects by type and size (i.e. the amount of funding and/or duration). All four types of projects funded under the Provincial/Territorial Component (i.e. Implementation, Sentencing, Underserved, and Emergency Fund) were included in the review. For the Projects and Activities Component, the sample was drawn from PLEI, enhancements to victim services, training, and research and evaluation projects. Bill C-2, An Act to protect children and other vulnerable persons (2006) projects,[10] hereafter referred to as testimonial aid projects, and NVCAW projects were excluded from the review as these types of projects have been previously examined in the sub-studies conducted by the Department of Justice. Conference attendance funding was also excluded.

3.1.5 Case Studies of 11 Victims Fund Projects

Eleven projects were selected for the case studies based on the results of the file review and in consultation with the Department of Justice Evaluation Advisory Committee. The sample was selected from the reviewed projects which had adequate outcome data, project results, and products available for review. The location, budget, objectives and target population of the projects were also considered.

Ten case studies were conducted in English and one in French. The case studies included interviews with project representatives, sponsors and partners/stakeholders, when possible. A total of 18 case study interviews were conducted, including 11 with project sponsors, 5 with project staff and 2 with project partners.

In addition to project summary reports, which funded recipients are asked to complete and provide to the PCVI at the conclusion of their project, other project products such as publications, presentations and websites were reviewed as part of the case studies.

3.2 Evaluation Strengths and Limitations

Several methods and mechanisms were used to enrich the data collection process and increase confidence in the overall results. The strengths of the evaluation methodology included:

There were also some limitations associated with the implementation of the methodology. The limitations were mitigated as much as possible through the use of multiple lines of evidence and validation of findings through other primary and secondary sources of data. The limitations include: