Access to Justice in Both Official Languages Support Fund

3. Methodology

3. Methodology

Four main research methods were used in evaluating the Support Fund: a literature review, an analysis of project files, interviews with key stakeholders, and surveys of members of the legal profession (English speaking - and French-speaking) and recipients of funding under the Support Fund. Each of these activities is described in greater detail in the subsections that follow.

3.1. Literature Review

The literature review met two main objectives. First, the review made it possible to prepare a clear definition of the Support Fund, revise the logic model included in the Results-based Management and Accountability Framework (RMAF), and develop the evaluation framework and research tools. Second, it provided the answers to some evaluation questions. The text below provides a complete list of the documents reviewed.

Documents Reviewed

3.2. Analysis of Project Files

Files on projects funded by the Support Fund were reviewed to obtain information about the funding application process, how project files are kept, recipient organizations, the type and size of projects funded, the compatibility of the projects with the selection criteria and the extent to which the projects help to meet the needs identified in relation to access to justice in both official languages, and the existing data collection methods.

All files closed as of February 2007(n=106) were reviewed and analyzed.

3.3. Interviews with Key Stakeholders

The objective of interviewing key stakeholders was to obtain information and informed perceptions concerning the relevance, design and implementation, effectiveness of and alternatives to the Support Fund.

Between December 2006 and February 2007, 30 interviews were conducted by telephone and in person with 32 stakeholders. The stakeholders interviewed fell into four categories:

The interview guides are attached as Appendix B.

3.4. Surveys of Jurists and Recipients

Three surveys were done in the course of this evaluation: a survey of French-speaking jurists outside Quebec, a survey of English-speaking jurists in Quebec, and a survey of recipients of funding under the Support Fund.

Table 3 sets out the objective, sample and distribution methods, and response rate for each of the three surveys. The survey questionnaires are attached in Appendix B.

Table 3: Surveys of Jurists and Funding Recipients
  French-speaking Jurists English-speaking Jurists Funding Recipients
Objective To obtain information about the benefits of membership in an AJEF, ongoing needs for professional development, resources and tools, problems relating to the practice of law in the minority language and progress associated with activities funded by the Support Fund. To obtain information about ongoing needs for professional development, resources and tools, problems relating to the practice of law in the minority language and progress associated with activities funded by the Support Fund. To obtain information about the funding application process, needs relating to the delivery of legal and/or judicial services in the minority language, the ability of the Support Fund to respond to those needs and the performance measurement systems in place.
Sample The questionnaire was sent to 612 French-speaking jurists outside Quebec whose contact information is given on the AJEF Web site. The questionnaire was sent to 250 English-speaking jurists in Quebec, chosen randomly from a list of members of the Barreau du Québec who had requested correspondence from the Barreau in English. The questionnaire was sent to all organizations that had submitted a funding application to the Support Fund, a total of 25 recipients.
Distribution The questionnaire was sent by electronic mail or, if an electronic address was not available, by facsimile.

After the initial questionnaire was sent, two reminders were sent to jurists who had not yet responded to the survey.		 The questionnaire was sent by electronic mail.

After the initial questionnaire was sent, two reminders were sent to jurists who had not yet responded to the survey.		 The questionnaire was sent by electronic mail.

After the initial questionnaire was sent, two reminders were sent to recipients who had not yet responded to the survey.
Response Rate In total, 160 French-speaking jurists completed the survey questionnaire, a response rate of 26%. In total, 27 English-speaking jurists completed the survey questionnaire, a response rate of 11%. In total, 14 recipients completed the questionnaire, a response rate of 56%.