The evaluation strategy for the MIXER application is in two distinct strands. The first is a longitudinal study which focuses on the learning outcomes of the MIXER application, the second is a one day intervention called Show Time which focuses on the evaluation of the more ‘difficult to evaluate’ aspects of the projects R&D themes. These involve an element of Transmedia Evaluation.
Transmedia Evaluation is an approach designed to remove this unnecessary evaluation encumbrance from the participant, whilst still gaining quality evaluation results and findings. With Transmedia Evaluation the user’s role and activities remain intact and consistent with their interaction reality, whether the user be player, social networker or commentator.
For further information on the Transmedia Evaluation approach please visit: http://ecute.eu/aaei/
Longitudinal Study Overview
In our evaluation of MIXER we had three conditions, with 20-30 children participating in each:
- Single Interaction: children engage once with MIXER
- Double Interaction: children engage twice with MIXER
- Passive MIXER: children watch an interaction with MIXER
- Control: children watch a video on camping (Control Group Activity Plan).
All conditions completed the pre-test and post-test which were provided as in the form of activity books with each child completing a series of activities, including selected factors from 3 questionnaires: Matson Evaluation of Social Skills with Youngsters (Matson, Rotatori, & Helsel, 1983), Bryant’s Empathy Index for Children (Bryant, 1982; Lasa Aristu, Holgado Tello, Carrasco Ortiz, & Del Barrio Gándara, 2008), the Cultural Intelligence Scale (Ang et al., 2007) After the children have interacted with MIXER they complete an Engagement Questionnaire, based on the Agent Evaluation Questionnaire (Hall, Woods & Aylett, 2006).
Evaluation Activity Books