The "Keeping Score" on Kids in Hamilton Reporting Project

Abstract

Kate Feightner, Stakeholder Use of the Keeping Score on Kids in Hamilton-Wentworth Report: A Descriptive and Exploratory Mixed Model Research Protocol (McMaster University, Hamilton, Ontario: 2002).

This thesis proposes a sequential, two-phased mixed model study to describe the use of the Keeping Score on Kids report and explore the determinants of report utilization among report recipients in Hamilton.

Phase One consists of a descriptive and analytic, structured face-to-face survey. Respondents will be selected using a stratified simple random sampling strategy (n=114) followed by purposeful selection of information rich cases (n@20). A multi-dimensional and process-focused definition of use is proposed. Data will also be collected on a range of factors thought to facilitate or hinder report use including characteristics of the report and its dissemination; the individual recipient and the organization they represent; recipient-researcher interaction; and the political/community environment. Univariate and bivariate (parametric and non-parametric) statistics and thematic coding will be used to analyze survey data.

Phase Two consists of qualitative in-person interviews used to verify and elaborate upon Phase One findings. Phase One results will be used to develop the semi-structured interview guide and select the purposeful sampling strategies. Interview data will be analyzed using a template analysis technique combined with a quasi-statistical approach to summarize the data specific to report uses. Methods of verification will include clarifying researcher bias, member checks, triangulation, data analysis audit trial and rich, thick description. Phase One and Phase Two findings will be compared and contrasted to gain further insight.

Limitations of this protocol include the complex nature of utilization, questionable validity of the utilization index, and threat of recall bias. Protocol strengths include the mixed methods design, integrated organizing framework and multi-dimensional definition of information use.

Implementation of this protocol will help to identify realistic expectations with respect to use and impact of a social report on local decision-making. Specific strategies to improve the utilization of future social reports will also be identified.