 Developing
New Data Collection Tools
7.1 Review results with staff and volunteers
The sequence of planning and conducting a self-evaluation
is an opportunity for program managers to either set
the agenda of discovery or play a major role in doing
so. It is natural for managers, staff and stakeholders
to expect that evaluation results will be immediately
relevant to their work, since the framework of topics
and questions was built upon fundamental program concerns.
At first glance, however, some results may seem puzzling,
ambiguous or counter-intuitive, while other results
may seem obvious and trite.
Unfortunately, research teaches us that,
- thinking
something is not the same as having data to support
it,
- results may engender alternative possibilities
of interpretation,
- sometimes results provide
only partial answers and raise additional questions.
To gain additional value from evaluation, program
managers share analyzed data with staff and volunteers
familiar with day-to-day program operations—utilizing
their knowledge and experience to help interpret patterns
in the data and what they say about programming. Such
consultation may vary from informal one-on-one meetings
to group workshops or presentations, depending on the
size and structure of the program.
An in-house review of results prior to any public
disclosure:
- allows staff and volunteers to see the culmination
of the evaluation process
- how their input can influence decision-making
and program direction
- how their roles may influence program effectiveness
- provides an in-house opportunity to air all viewpoints
- ensures that staff know how results are being
interpreted by peers and supervisors
- helps staff/volunteers understand what effort
is expected of them and why it is important
- helps build an in-house culture receptive to
follow-up evaluation
- helps to make program leadership responsive to
concerns and accountable for taking action
- provides an opportunity to explain factors allowing
or preventing program change
|