Deliverable 5 - Cross-Site Analysis

August 2003

Introduction to Cross-Site Analysis

This document presents the results of the cross-site analysis carried out as part of the campaign assessment process of TAPESTRY. We first give an overview of the data collection method, before presenting the results and conclusions of the analyses. Full descriptions of the individual case studies are also available.

Data Collection, Entry and Checking

Each case study followed the guidelines set out in the Common Assessment Framework (CAF) [original Deliverable 3] where common questions were suggested for each case study to use in its 'before' and 'after' evaluation of their campaigns. After case studies had used the CAF, feedback from case study managers, TTR and the University of Westminster was used to formulate an updated framework: the "Campaign Assessment Guidance" [revised Deliverable 3]. Annex B, however, presents an analysis of the data collected as based on the original CAF, developed near the beginning of the project.

As each campaign proceeded, the University of Westminster and TTR maintained close contact with the case study managers to be sure that the questionnaires being used on site for each evaluation conformed as well as possible with the CAF, to enable the best possible cross-site analysis to be undertaken. This was a key part of the added value delivered by the project, in that we would be making a concerted effort to compare quantitative findings from one site to another, based on a common data collection framework (set out in the CAF). As might be expected, exceptions had to be made here and there, but every effort was made to ensure that the commonality of core questions was kept at a maximum.

For the purposes of centralised data collection, the University of Westminster developed a data template (in Excel) for case studies to enter their 'before and 'after' data into. The template was distributed to each case study, after instructions on use had been given during a demonstration at one of the consortium meetings. Figure 1 shows the introductory screen, and Figure 2 the CAF-based interactive index, the contents and functionality of which changed according to context.

back to downloads