Project Managers' Guide to Performance Measurement and Evaluation

APPENDIX 3: Tools for Project Managers - Case Scenarios & Logic Models

Case Scenarios & Logic Models – Road Maps to Results

Here are four case scenarios and related results-oriented logic models. Think of the logic model as a road map that leads to results. Use these as examples in developing other models.

Steps in Developing an Outcome Logic Model:
  1. Define your goals and objectives
  2. Add your activities (overall activity and specific activities)
  3. Identify your “target” or “client” groups
  4. Identify the outputs of your activities
  5. Add the immediate outcomes (within 1 year) that will result from your objectives, activities and outputs
  6. Add your intermediate outcomes that your objectives will lead to within a year
  7. Add the long-term outcomes that your objectives will lead to down the road 2+ years
  8. Check the overall logic of your model
  9. Refine your logic model as your project develops.

See the W.K. Kellogg Foundation Evaluation Handbook for further information on developing different types of logic models.

Case Scenario 1: Special Edition of a Provincial Newsletter on “Abuse of People with Disabilities”

Purpose
  • Newsletter will contain six legal information articles on issues related to the abuse of people with disabilities.
  • Six articles (total of 8 pages) strike the right balance of a manageable amount of information for the reader.
  • Involves provincial consultation to determine most important issues.
Goals
  • Produce a newsletter to educate provincial citizens on the abuse of people with disabilities
  • Partner and consult with BC service to identify the most important issues and the best way to address them in print
  • Distribute the Newsletter throughout BC with emphasis on distribution to service providers
  • Evaluate the Newsletter and report on findings.
Workplan
  • A. Consultation Process
    • Purpose:

      To generate guidance and feedback on content and contacts [not a full-scale research project and should not be held to such a standard].

    • Extent:

      A minimum of 25 organizations provincially/regionally distributed.

    • Process:

      • Two-week provincial consultation tour through key regions.
      • Consultation with service providers and advocates (community mental health workers, mental health associations, women’s, seniors, youth centres, multi-cultural and aboriginal organizations, individuals with disabilities) and with partners
      • Consultation with legal community (Crown Prosecutors, lawyers, advocates).
    • Consultation Questions:

      • How do you identify disabled people who may be abused? What warning signs do you look for?
      • Is there any one group that is at higher risk than the others? (Women? Youth? People with physical disabilities? Mental disabilities? Multi-cultural communities? What services exist to help people who are disabled and are being abused?
      • What are the biggest hurdles these people have to face when it comes to receiving help?
      • Do you think the public is aware of this issue? What more do you think the public needs to know?
      • If you were writing a booklet to educate around this issue, what would you include? (This is the key question and the main purpose of the consultation).
    • Consultation Report:

      Consultation report to inform newsletter.

  • B. Newsletter Production
    • draft the Newsletter
    • departmental review
    • prepare it for printing
    • print
  • C. Newsletter Distribution
    • Update mailing list and distribute to: non-profit sector, and associations and organizations associated with physical and mental disabilities, as well as various multi-cultural and aboriginal groups that are not included under another heading.
    • 10,000 Newsletters
    • Evaluation Forms
    • Self Addressed Stamped Envelopes
Evaluation
  • Plan:

    • Of the 10,000 newsletters, 1000 packages will include an Evaluation and Self Addressed Stamped Envelope (10% of total mail-out). This distribution process will ensure appropriate and relevant contact lists, and will facilitate the prompt return of evaluations.
    • These evaluations will be tabulated and will be incorporated into the reporting process.
  • Data to be tracked:

    • The number and percentage of returned evaluations
    • What our audience liked and disliked about the publication
    • Suggestions for improving our publications
    • Suggestions for future topics and services
    • Suggestions for other distribution targets
    • Previous knowledge of services mentioned
    • People’s Law School
    • Other organizations listed
  • Evaluation Resources:

    • Evaluation is a deliverable of this Newsletter, but is not funded by DOJ.
    • Organization says that DOJ funds the preliminary work that goes into creating an evaluation framework.
    • Due to timing, the actual compilation of the data received takes place in the fiscal year post funding. This, therefore, represents the project sponsors contribution to the project.
Reporting
  • Report #1 (March 31st): Distribution of the Newsletter and 1st draft of the final report. This will include a first look at evaluation but, as with past practice, evaluation cannot be accurately reported on until six months past the distribution.
  • Report # 2 (September 30) A report on the Evaluation will be provided for the department 6 months after the completion date of March 31st.
National Sharing

Consultation report, newsletter and evaluation to be shared with community partners and national colleagues, including PLEAC and consultation participants.

Expected Outcomes
  • Increased awareness of the issues surrounding abuse of people with disabilities.
  • Increased awareness of provincial resources and services available to address this issue.
Budget

$24,500.00 for salaries and benefits, contract consulting and writing fees, printing, distribution, consultation travel and hosting.

Road Map for Newsletter Project

Case Scenario 2: Child Victims and the Criminal Justice System – Legislative Review

Purpose

Consultation on, and review of criminal legislation to examine the need for criminal law reform related to specific offences against children, facilitating child victim/witness testimony, sentencing, age of consent to sexual activity.

Workplan
  • Establish & carry out FPT consultation process.
  • Establish & carry out public consultation process.
  • Determine/coordinate related research activities.
  • Report on consultation and research results.
  • Coordinate/develop follow-up options at FPT level.
  • Legislative amendments and implementation as appropriate.
Expected Outcomes
  • Criminal law reform.
  • Strengthened, coordinated criminal justice response to child victim issues.

Road Map for Legislative Review

Case Scenario 3: Expert Consultation on Key Research Issues

Purpose

Consultation with key experts in the field of family violence, to identify priorities in family violence research from a justice perspective.

Goals
  • Seek information & advice from key experts.
  • Exchange ideas & information on research needs.
  • Consider results in research planning.
Workplan
  • A. Identify & Invite Experts
    • Include A Range Of Experts In Fields Of Violence Against Women And Children.
    • Include Those With Expertise In Specific Population Groups Or Living Contexts (e.g. Rural, Remote, Aboriginal, Cultural Diversity).
  • B. Plan Meeting
    • Prepare Agenda, Consultation Questions, Consultation Package.
    • Arrange For Presentations & Logistics.
    • Evaluation Form!
  • C. Hold Meeting
    • Conduct meeting.
    • Record proceedings.
  • D. Meeting Report
    • Draft meeting report & evaluation results.
    • Disseminate report.
  • E. Planning Implications

    Consider results in research planning including opportunities for collaboration.

Evaluation
  • Evaluation questionnaire will be administered at the meeting.
  • Information will be considered in research evaluation planning
Budget

$40,000 for meeting, travel for participants, facilitation, reporting, evaluation.

Road Map for Expert Consultation Project

Case Scenario 4: Child Witnesses of Family Violence: Training/Research Project

Purpose
  • Develop resource for Casework Staff and Program volunteers.
  • To utilize existing resources to develop a training program for volunteers that can be incorporated into current orientation and training material delivered within a national child and youth-serving organization (volunteer based).
  • Resource will be flexible and will provide an overview and assist volunteers who are dealing with child witnesses to gain more detailed information to help them support the child.
Goals
  • Develop a user friendly, comprehensive training package to assist volunteers and caseworkers in supporting children and youth who witness family violence in the home.
  • Increase awareness around the need to support child witnesses of family violence.
  • Provide BBBSC member agencies, along with all other child and youth serving organizations with a resource that will increase their capacity to serve children living in violent homes (transferable and sustainable product).
Workplan
  • A. Establish Advisory Committee
    • Role to identify materials, provide insights.
    • Includes experts in fields of Violence Against Women and Children.
  • B. Research & Design
    • Research existing material & assess for appropriateness for project.
    • Design resource to increase caseworkers understanding of child witness issues, allow for incorporation into existing training, explain caseworker role as mentors
  • C. Pilot
    • 5 agencies to pilot and evaluate materials.
    • Further evaluation by Program Volunteers matched with child witnesses.
  • D. Revise & Finalize

    Revise based on evaluation feedback from pilot.

  • E. Share
    • Share training with other organizations.
    • Post on web site.
    • Sustained dissemination.
Evaluation

Plan:

  • Questionnaire will be administered at the pilot.
  • Information will be used to revise the program.
  • Results of evaluation will be made available to pilot agencies.
Budget
Research $4000
Writing Training Program $4000
Pilot Agencies $2500 (5 agencies @ $500)
Printing $2000
Translation $3500
Promotion and Distribution of Material $500
Administration $1500
Project Management $2000
Total $20,000
Sustainability
  • The training program will be posted on BBBSC’s on-line library in downloadable form, and will be accessible by all organizations who wish to use it.
  • The program may be transformed into an on-line interactive training module that is available through BBBSC’s on-line library.
  • Promotion of the material through regular announcements to other organizations (by e-mail, quarterly newsletters, other publications etc).
  • Promoting the program to other organizations through BBBSC’s 181 local member agencies.
  • Partnering with other organizations that reach a wider group of children and youth, to provide this training on a more extensive basis.

Road Map for Training Research Project

Road Map—Template

Date modified: