SEARCH
 
< previous section

Planning a Meaningful Evaluation

2.6 Determine methods for monitoring program results

A number of factors influence the choice of evaluation methodology. e.g.,

  • evaluation purpose,
  • time and resources available
  • level of expertise

Evaluation approaches

Evaluation approaches include experimental, quasi-experimental or non-experimental, longitudinal or single-time, formative and/or summative, comparative or non-comparative (See Glossary.) They can use quantitative methods, qualitative methods or a combination of both. Some methods provide what is considered more reliable information in scientific terms, but even this depends on numbers and quality of evaluation.

There is a perception that some evaluation methods are intrusive and incompatible with program philosophy, e.g.,

  • a program for disaffected teenagers fears that using questionnaires, typically associated with authority, could jeopardize their developing relationships with the program.

Test your assumptions. e.g.,

  • involve participants in discussions about evaluation and how it can improve programming to gain their interest and cooperation

CAUTION: Detailed knowledge about what programmers are assessing and what results they hope to find could influence participants’ responses and bias results.

Meet this challenge by using:

  • a variety of evaluation techniques
  • concrete indicators that measure behaviour and attitudes as well as qualitative assessments of attitude and satisfaction
  • careful question design. (See Step 4)

 

 

< previous section
Last updated: July 2004
© 2004