3. Evaluation methodology
The evaluation was guided by an evaluation matrix (evaluation questions, indicators, and data sources) that was developed through the evaluation scoping and design phase. The evaluation issues and questions are presented in Appendix A. The evaluation included multiple lines of evidence and employed the data collection methods described below.
3.1 Document and File Review
The document review provided descriptive information on the SHW Initiative’s activities as well as information responding to evaluation questions. The review was ongoing throughout the evaluation and included the following types of documents:
- Administrative and internal documents for the SHW Initiative including project documentation and reports.
- Publicly available departmental and other government documents such as federal Budget Speeches and Minister’s mandate letters.
- Financial budget information.
3.2 Academic Literature Review
The academic literature review provided descriptive information on the needs of target populations with respect to legal information and education, and access to legal advice. This review was limited to countries with cultures similar to Canada’s and focused on interventions at the federal level.
3.3 Key Informant Interviews
A total of 17 interviews were conducted with 20 individuals representing the following groups:
- Justice Canada representatives (n=3)
- PLEI project representatives (n=10)
- Legal Aid project representatives (n=4) and
- Subject matter experts/advisors (n=3)
Subject matter experts included members of an advisory committee that was consulted during the development of the SHW Initiative.
3.4 Case Studies
Five case studies were conducted to provide an in-depth exploration of project activities and identify delivery challenges and best practices. Five themes were selected in discussions with the EWG. Case study themes, the associated projects that were selected and a description of each are presented in Table 3 below. Summaries of the case studies are included in Appendix B.
| Theme | Case Study Projects | Context |
|---|---|---|
| Networking | The Atlantic Region Network | The Atlantic Region Network is made up of five projects from four Atlantic provinces that received Initiative funding to provide PLEI or a mix of PLEI and legal advice. The five organizations were: the Community Legal Information of Prince Edward Island (CLI), the Legal Information Society of Nova Scotia (LISNS), the Public Legal Information Association of Newfoundland and Labrador (PLIAN), the PEI Human Rights Commission; and the Public Legal Education and Information Service of New Brunswick (PLEIS NB). The five projects met regularly to share information and resources and to support collaboration. |
| Information sharing/ outreach | The Public Legal Education Association of Canada (PLEAC) | PLEAC’s project had a unique focus on collaboration and knowledge transfer between funded projects. It supported opportunities for partnerships, professional development, and for hosting conferences to bring the project delivery organisations together. Additional knowledge dissemination activities included a website for access to information on projects and initiatives across Canada related to workplace sexual harassment. |
| Transition from PLEI to PLEI and legal advice | The Public Legal Education and Information Service (PLEIS) of New Brunswick | This project was initially intended to focus on PLEI; however, it was later changed to add a legal advice component. In terms of PLEI, the project aimed to create education and training resources that explain the law, policies, practices, and procedures for dealing with SHW, both from an employment law and a human rights perspective. The project focused on multiple vulnerable populations including newcomers, women, and members of the 2SLGBTQI+ community. Regarding legal advice, the intent was to develop a workplace sexual harassment legal advice delivery model that included a roster of trained legal professionals and access to a hotline/referral service for anyone experiencing SHW. |
| Cross-sectoral collaboration | The White Ribbon Project | White Ribbon received project funding for cross-sectoral activities that bridged both hospitality and male-dominated sectors. White Ribbon collaborated with Canada Steamship Lines Group and Sunwing Travel Group to implement sexual harassment responses within their workplaces. White Ribbon adapted, developed and disseminated PLEI resources, promoted awareness of workplace sexual harassment, and built capacity of industry professionals through training on workplace sexual harassment. |
| Legal advice and information | The Help and Legal Centre of Northumberland | There are 20 legal clinics across Ontario, including rural and remote areas that are collaborating and taking a coordinated approach to provide services. These 20 clinics used SHW resources to produce legal education materials, hire staff to deliver the legal advice and services to clients, and organize and present various educational sessions. |
3.5 Limitations and Mitigation Strategies
As this is a relatively new initiative, there was limited information available regarding projects’ achievement of outcomes. Most projects are still delivering activities and have not yet entered the phase where they would be reporting on outcomes. Consequently, outcome information was only available for a minority of projects. Therefore, the evidence pertaining to the achievement of outcomes relies heavily on interviews with project funding recipients.
Securing participation in the evaluation from funding recipients posed a challenge, resulting in a lower number of interviewees. Efforts were made to be flexible regarding timing of interviews, which were booked over a three-month timeframe to maximize the available times to meet with available interview respondents.
- Date modified: