Evaluation Tools
Evaluation Tools:Evaluation GuidelinesEvaluation PlanningSample GoalsSample Measures
Rationale
The Meadows Foundation considers evaluation to be an important part of its grant making process. The Foundation regularly summarizes evaluation results provided by grantees on their projects. This helps in evaluating the accomplishments of Foundation-funded organizations.
Evaluation of Individual Grants
At its best, evaluation should provide useful information for program development and improvement. Approaches to evaluation vary depending upon the nature and scope of the project. Successful evaluation begins with a clear description of the program and its activities, and sets specific, measurable goals to be accomplished during a particular time period. The Foundation recognizes that grant recipients themselves are best qualified to assess the results of their own work. However, to assist applicants in developing an evaluation plan for their projects, planning tools, sample goals and measures are included in this document.
Organizations receiving funds from The Meadows Foundation are asked to provide interim and final reports to the Foundation. These reports should document the extent to which the project goals have been met. The Foundation will review reports to assess progress in achieving goals within the funding period.
Evaluation Studies on Foundation Areas of Interest
In addition to evaluations carried out by individual grantees, the Foundation may identify specific areas of interest requiring more extensive evaluation research to answer broader questions. Grantees may be asked to participate in these evaluation studies.
Building Evaluation Capacity At The Local Level
As the Foundation builds its capacity to conduct and use evaluation information to improve its grant making, it hopes to encourage grantees to conduct meaningful evaluation of their programs to improve program development, implementation and outcomes. In addition to the following evaluation tools, the Foundation is available to provide limited technical support to grantees in developing goals and measures.
Issues to consider when designing an evaluation:
- Intended Outcome: Who or what is expected to change because of this project?
- Activities to Achieve Outcome: What activities or set of activities are planned to achieve this outcome?
- Information Needed (Measures): What baseline information do we have? What new information will be collected and reported to demonstrate progress toward and achievement of these outcomes and activities?
- Target Goals and Dates: What is the numerical target goal and date for each measure?
- Data Collection Methods: What methods will be used to gather the information and who will be responsible for gathering it?
- Resources Needed: What resources (human and financial) are needed to conduct the evaluation and what is available?
- Results: How will evaluation results be used? Who will receive them?
Here are some sample goal statements to assist you in setting your own goals. When available
please include baseline data (i.e., the current or starting level) and a date for the goal to be accomplished when writing your goals.
Goals Without Baseline Data
|
To serve |
|
1,800
goal |
|
people per year
measure |
|
by |
|
Dec. 31, (insert year)
date |
|
To raise |
|
$150,000.
goal |
|
in |
|
additional funding
measure |
|
by |
|
Dec. 31, (insert year)
date |
|
To recruit and train |
|
15 volunteers
goal & measure |
|
by |
|
Dec. 31, (insert year)
date |
Note: For new programs, it may be helpful to use data from comparable programs to help you set goals.
Goals With Baseline Data (Current data)
|
|
To |
increase
direction +/- |
the |
number of people served per year
measure |
from |
1,500
baseline |
to |
1,875
goal |
| |
by |
Dec 31, (insert year)
date |
|
(25% increase) |
|
|
|
To |
increase
direction +/- |
|
hospital bed capacity
measure |
from |
150
baseline |
to |
200
goal |
| |
by |
Dec 31, (insert year)
date |
|
(33% increase) |
|
|
|
To |
increase
direction +/- |
the |
number of courses offered
measure |
per year from |
4
baseline |
to |
10
goal |
| |
by |
Dec 31, (insert year)
date |
|
(150% increase) |
|
Note: To calculate percent increase (or decrease) over a specific time period, divide the goal (or actual number reached) by the baseline, subtract one and multiply by 100.
These
sample measures are provided to assist you in finding appropriate ways to measure progress toward your program goals. You are
not required to use these in any way. You may find other measures that are more appropriate to your program. This list is not exhaustive, and includes only a sample of appropriate measures.
Arts/Cultural Programs
- Number of productions or exhibits produced
- Number of attendees, percentage of target population(s)
- Percentage of income from ticket sales, subscribers, advertising, donors
- Number of awards received
- Audience/patron satisfaction - number/percentage expressing satisfaction with program/service
Civic and Public Programs
Training/Economic Development
- Number of jobs created
- Number of people trained
Educational Programs
- Number of students served per year
- Number of students graduating high school
- Percentage of reduction in high school dropouts
- Number of school administrators/teachers/superintendents/school board members receiving training
- Percentate of students improving performance
- Percentage increase in students going on to college
- Number of highly qualified teachers recruited
Environmental Programs
- Number of species ready for delisting as threatened or endangered
- Acres of habitat restored
- Acres of land/watershed protected
- Number of people, including landowners, provided educational materials or programs
- Number of public awareness campaigns
- Percentage of reduction in energy use for buildings
- Percentage of reduction in indoor potable water use
Health/Mental Health Programs
Health
- Number of individuals treated/served (duplicated or unduplicated)
- Total number of visits
- Average daily occupancy
- Number of people screened or calls received
- Average waiting time to receipt of care/average response time
- Decrease in incidence/prevalence/mortality of selected conditions
- Client satisfaction - number/percent of patients expressing satisfaction with service
- Number/percentage of clients successfully completing program
Mental Health
- Number of individuals served; number/percentage of clients in priority population (Note: priority population includes individuals with a diagnosis of major depression, schizophrenia, or bipolar disorder.)
- Number of individuals with mental illness employed
- Number/percentage of clients successfully completing program
- Number of families served
- Number of mental health professionals hired; number/percentage of employees who are culturally diverse
- Number of new mental health professionals practicing in rural areas
Human Services Programs
- Number of people served (duplicated or unduplicated), percentage of target population served
- Number/percentage of individuals served achieving/maintaining specified criteria within specified time after program completion
- Client satisfaction - number/percentage of clients expressing satisfaction with program/service
- Number of affordable housing units created
- Percentage of decrease in recidivism rate
Nonprofit Management Programs
- Number of dollars raised
- Number of volunteers/board members/staff trained
Building/Capital Campaigns
- Facility construction/renovation -- start/completion date, completed on time, completed within budget/percentage of budget spent
- Number of additional people served -- start/completion date, completed on time, completed within budget/percentage of budget spent
- Number of additional staff trained
- Number of additional volunteers recruited, trained
- Number of additional programs developed/implemented because of the new, renovated, or expanded building
