Planning
a Meaningful Evaluation
2.6
Determine methods for monitoring program results
A number of factors influence the choice of evaluation
methodology. e.g.,
- evaluation purpose,
- time and resources available
- level of expertise
Evaluation approaches
Evaluation approaches include experimental, quasi-experimental
or non-experimental, longitudinal or single-time, formative
and/or summative, comparative or non-comparative (See
Glossary.) They can use quantitative methods, qualitative
methods or a combination of both. Some methods provide
what is considered more reliable information in scientific
terms, but even this depends on numbers and quality of
evaluation.
There is a perception that some evaluation methods
are intrusive and incompatible with program philosophy,
e.g.,
-
a program for disaffected teenagers fears that using
questionnaires, typically associated with authority,
could jeopardize their developing relationships with
the program.
Test your assumptions. e.g.,
-
involve participants in discussions about evaluation
and how it can improve programming to gain their
interest and cooperation
CAUTION: Detailed knowledge about what programmers
are assessing and what results they hope to find could
influence participants’ responses and bias results.
Meet this challenge by using:
- a variety of evaluation techniques
- concrete indicators that measure behaviour and attitudes
as well as qualitative assessments of attitude
and satisfaction
- careful question design. (See
Step 4)
|