The Action Plan for Official Languages Coordination Program Summative Evaluation
3. Methodology
-
3.2. Document Review
3. Methodology
The methodology used to evaluate the Coordination Program covered both activities initiated by the Department of Canadian Heritage (formally the Privy Council) and those initiated by the Department of Justice Canada. It included key informant interviews, a document review, and a review of similar initiatives. This section provides further details on each research method.
3.1. Key informant interviews
Interviews were conducted with key informants involved with the Privy Council, Canadian Heritage, and Justice Canada, as well as other federal departments. More specifically, the following key informants were interviewed:
- key personnel of the Official Languages Secretariat (Canadian Heritage), former team members of the Official Languages Branch (Privy Council Office), and key personnel of the Official Languages Law Group (Justice Canada) (3)
- departmental official languages champions and senior management (6)
- key personnel in other federal departments and agencies with responsibilities under the Official Language Action Plan Coordination Framework (12)
- legal counsel (employees of Justice Canada assigned to various departments and agencies) (6)
- community organizations (6).
A total of 28 interviews were conducted involving 33 individuals. Interviews were conducted by telephone or in person, as appropriate.
3.2. Document Review
In consultation with Canadian Heritage and Justice Canada, a series of relevant documents were identified and reviewed. These documents can be grouped under the following categories:
- official documentation relating to the Coordination Program (Action Plan for Official Languages, Treasury Board Submission, Results-based Management and Accountability Framework for the Coordination Program, Mid-term Report on the implementation of the Action Plan for Official Languages)
- documents relating to the formative evaluation of the Coordination Program
- strategic planning information prepared for managers of the Coordination Program
- financial information
- presentations made by the Coordination Program group
- information relating to the post-censal survey
- information relating to the Horizontal Results-based Management and Accountability Framework prepared for the Official Languages Program (both the long and abridged versions) and the performance measurement strategy (Official Languages Program Information Management System)
- documents relating to the work of the Committee of Deputy Ministers on Official Languages (CDMOL) and the Committee of Assistant Deputy Ministers on Official Languages (CADMOL)
- documents relating to consultations (both internal to the federal government and with external stakeholders)
- information relating to the advisory function of the Official Languages Law Group within the Department of Justice
- other relevant information (information on Bill S-3, Annual Reports from the Commissioner of Official Languages, documents from Official Languages Champions, etc.).
3.3. Review of similar initiatives
Two suitable coordination initiatives were identified in collaboration with Canadian Heritage for this review on the basis of their similarity in terms of scale and coordination function. For this review, appropriate documents from each initiative were gathered and reviewed, and interviews were conducted with key informants.
Key documents pertaining to the mandate, structure, processes, and expected outcomes of each initiative were reviewed, which included the following.
- Multiparty Agreement for the 2010 Winter Olympic and Paralympic Games (November 14, 2002)
- Integrated Results-based Management and Accountability Framework and Risk-based Audit Framework for 2010 Winter Olympic and Paralympic Games (draft as of March 31, 2007)
- 2010 Olympic and Paralympic Winter Games RMAF/RBAF Implementation Team: Terms of Reference (August 18, 2006)
- The 2010 Olympic and Paralympic Winter Games Federal Secretariat: 2006/2007 Annual Progress Report – Delivering on our Commitments (March 2007 version)
- A Canada for All: Canada's Action Plan Against Racism – Annex C: Horizontal and Integrated Results-based Management and Accountability Framework/Risk-based Audit Framework (August 31, 2005)
- Terms of Reference for the Action Plan Against Racism Interdepartmental Working Group
- Evaluation Assessment of Canada's Action Plan Against Racism: Final Report. PRA (June 16, 2006)
- Baseline Information for Canada's Action Plan Against Racism: Final Report. PRA (May 25, 2007)
Key informant interviews were conducted to assess both the extent to which processes have been implemented as expected and in a cost-effective manner, and the results of these coordination initiatives to date. Three interviews, including a total of four key informants, were conducted in person or over the telephone, as appropriate.
- Date modified: