Contraventions Act Fund for Implementation of Language Obligations Evaluation

3. METHODOLOGY

The methodology used for this evaluation was based on two main sources of information: a literature review and a series of interviews.

3.1. Literature Review

The literature review provided information on the activities conducted in the context of the Implementation Fund, specifically since 2008. This work also helped build a solid information base for preparing the interviews with key stakeholders. All the documentation pertaining to the Implementation Fund was therefore analyzed for this purpose. The list of documents consulted includes:

3.2. Interviews with Key Stakeholders

The main goal of the interviews with key stakeholders was to obtain informed opinions and perceptions on the relevance, effectiveness, and efficiency and economy of the Implementation Fund. Therefore, a series of interviews were conducted with stakeholders involved in administration of the Implementation Fund. Thirteen individuals from the following groups were consulted:

The interviews were conducted in person or by phone, in the official language chosen by the respondents. Before each interview, the respondents received the interview guide including the list of issues that were to be addressed. The data derived from these interviews are incorporated into this report in aggregate form.

3.3. Methodological Challenges

Two main methodological challenges arose in connection with this evaluation: the incomplete data submitted to the Department by the funding recipients  and a limited pool of key stakeholders.

Incomplete data submitted to the Department

The funding recipients of the Implementation Fund are required to submit an annual activity report that covers a set of indicators set out in the funding agreements. Although the submitted reports are complete, incomplete data were submitted to the Department regarding the 2010-11 report. In addition, since the year 2011-12 is not over, the reports for this year were not available. To minimize the impact of this situation on this evaluation, the interview guides were designed to cover the activities undertaken during those fiscal years.

Limited pool of key stakeholders

The number of stakeholders with sufficient knowledge of the Contraventions Act and the Implementation Fund is very limited because this is a highly specialized field. However, it was possible to identify about 15 various stakeholders working in this field who were able to make a significant contribution to this evaluation.