Preparing the Groundwork
for
Evaluation
1.3 Develop realistic expectations
Constraints on Evaluation
Be realistic about the time and help you will need, the available resources, costs and limitations of the evaluation process. Plan carefully to make the evaluation as efficient and meaningful as possible.
- levels of knowledge and expertise available
- priorities for resources for program delivery
- program size and numbers
- sources and types of data
- time and funding available
- attitudes and perceptions within and outside
the program
Time Demands
Program managers sometimes underestimate the
time required for evaluation—and to decide how
to explain, report and use findings for program improvement.
The analytical stage may also require more time than
allotted.
Need an example?
Sorting and analysis
of data:
-
Quantitative
data (coded or numerical) may need to be analyzed
by subgroups to answer questions, for
example, about whether girls and boys fared differently
or whether
the program was finding and keeping the target group.
- Qualitative data, e.g., from interviews,
focus groups
- may actually take longer to work through
than quantitative results
- need repeated review by
independent readers to discern patterns and intensity
of comments
How to reduce limitations?
Weigh the pros and cons of having an external evaluation
or outside help to conduct the evaluation, particularly if objectivity
is an important consideration. A transparent process and well-designed
data collection methods can increase objectivity.
- involvement of partners, external evaluators
or outside assistance to increase expertise
and resources
- restricting the evaluation to key questions
- planning evaluation in stages over time
- sampling multi-site programs
- use of existing or readily available
data
- use of ready-made data collection tools
and instruments
- adequate preparation and careful timing
to collect sufficient data with minimal call backs
(See Step 5)
Start with key issues and
feasible questions. It is possible to adapt to changing circumstances,
learn from experience and amend your evaluation methods as
needed over time
Remember that evaluation is likely to be an ongoing
or at least repeated process in your program, a series
of steps toward continued program improvement.
|
