Photo of people gathered around a computer monitor

Why Evaluate?

Evaluating progress is essential for accountability and making adjustments along the way. This involves monitoring activities and accomplishments, assessing the impact and merit, and using the information to improve the effort.

 

Key Questions to Consider

  • What is the framework (logic model, or pathway) by which our activities will lead to improvement in desired outcomes?
  • What questions do we hope to answer with the evaluation?
  • What methods will we use to answer the evaluation questions, and to monitor and evaluate the effort?
  • How will we make sense of the data? How will stakeholders, including those most affected, be involved in reviewing the data and contributing to what it means?
  • How will we use the evaluation information for celebration, accountability, and improvement?
  • How will we use an equity lens to see whether the effects of the effort benefit all people, including vulnerable groups that have had worse outcomes?

 

Some Recommended Actions

  1. __ Describe the program or initiative’s framework or logic model (i.e., pathway by which our activities will lead to intended outcomes). Include information about:
    • Purpose or mission (i.e., the problem or goal to which the program, effort, or initiative is addressed).
    • Context or conditions (i.e., the situation in which the effort will take place; factors that may affect outcomes)
    • Inputs: Resources and barriers (i.e., Resources may include time, talent, equipment, information, money, etc.; Barriers may include history of conflict, environmental factors, economic conditions, etc.)
    • Activities or interventions (i.e., what the initiative will do to effect change and improvement) (e.g., provide information and enhancing skills; enhance services and support; modify access, barriers and opportunities; change the consequences; modify policies and broader systems)
    • Outputs (i.e., direct evidence of having performed the activities) (e.g., targeted actions to those most affected; number of services provided)
    • Intended effects or outcomes
      • Short-term (e.g., community and systems changes)
      • Intermediate (e.g., changes in behavior)
      • Longer-term (e.g., improvement in outcomes; reduced inequities)
  2. __ Focus the evaluation questions and methods. Include:
    • Evaluation questions – What information about the effort is important to stakeholders? (e.g., How well has the program met its stated objectives?; How much/what kind of difference has the program or initiative made in the community as a whole? For those groups experiencing poorer outcomes?)
    • Methods – What methods will be used to evaluate the effects of the program or initiative? (e.g., Behavioral surveys; Interviews with key participants; Archival records; Observations; Monitoring and evaluation system)
    • Indicators of success – What indicators will be used to judge the success of the program or initiative? Match the indicators to the evaluation questions. Potential indicators include:
      • Program outputs
      • Participation rates
      • Levels of satisfaction
      • Changes in behavior
      • Community or system changes
      • Improvements in indicators of outcomes and inequities
  3. __ Outline and implement the evaluation plan. Indicate:
    • How you will involve all stakeholders (i.e., including those most affected) in identifying indicators of success, documenting evidence of progress, and sense making about the overall initiative and how it can be improved.
    • How you will track implementation of the intervention.
    • How you will assess ongoing changes in specific objectives (e.g., changes in behavior).
    • How you will assess ongoing changes in specific outcomes (e.g., indicators; inequities).
    • Ethical implications of the initiative.
  4. __ Make sense of the data and justify conclusions. This includes engaging stakeholders (including those most affected) in:
    • Sensemaking and interpretation – How will we engage those responsible, and those most affected, in making sense of the data (i.e., what we are seeing, what it means)? How will we use the information to help answer the evaluation questions?
    • Judgments – statements of worth or merit of the initiative. How will we communicate what the findings suggest about the value added by the effort?
    • Recommendations – How will we identify recommendations based on the results of the evaluation?
  5. __ Use the information from the evaluation, including to:
    • Celebrate accomplishments
    • Make adjustments in activities and interventions
    • Communicate lessons learned to stakeholders and relevant audiences

 

Example of Evaluation

 

Resources for Evaluation

Tools from the Community Tool Box

Toolkit: Evaluating the Initiative

Introduction to Evaluation

Some Methods for Evaluating Comprehensive Community Initiatives

Tools from WHO and Other Sources

WHO Evaluation Practice Handbook (Comprehensive)