Development of Instruments

To create questionnaires that matched the Transmedia Evaluation approach several studies were conducted to transform the instruments to match the narrative of the application (MIXER) under development. This approach was seen to be flexible as an underlying theme was identified, allowing adjustments to aspects of the narrative found in MIXER, such as the game played within it.

Study 1: Questionnaires as an Activity Book

This study examined to what extent the aesthetic look of a questionnaire had on a participants engagement in answering questionnaires. Three conditions were set, in which they were provided with either:

  • A set of questionnaires printed on white A4 paper in a standard font,
  • A comic book demonstrating an early version of MIXER, followed by a set of questionnaires printed on white A4 paper in a standard font,
  • A colourful activity book that contained an early version of MIXER (as above), erroneous activities, such as a word search, and the questionnaires printed on colour paper deploying in a more colourful and extravagant typeface.

Through observation and examination of completed material it was shown that the activity books allowed for a more engaging experience for the participant. This was shown through a 100% completion of questions in the activity books, along with a more settled atmosphere; in which minor disruptive behaviour was not observed.

 

Study 2: Questionnaire Comprehension 1

In order to gain an understanding the children’s understanding of the instruments in Table 1, children were provided with the full version of each of the questionnaires. The children were provided with the recommended time to complete each questionnaire and asked to answer the questions and ask if they needed help understanding a question. If they children asked help they were asked what they thought the question meant, to which most replied with a ‘do not know’ type response. A discussion was held after in which the children circled questions they did not understand or just words they found difficult.

 

Study 3: Questionnaire Comprehension 2

This study followed on from the previous study in which the parallel class was asked to examine versions of the questionnaires modified based upon the responses received from the previous study. The children were asked to answer the questions, but underline any word they could not understand and place a cross to next to those they could not answer.

They were then asked to provide definitions or alternatives to the underlined words through research on iPads using a thesaurus and the Internet and feed back in a group discussion, in which it was seen if every understood the alternative words.

 

Study 4: Prototype Activity Book

This study took the chosen factors for each questionnaire and the slightly adapted questions and presented them in the form of a simple activity/work book. They were place on a variety of backgrounds based on the theme of going camping. They had some simple activities inserted into it, such as a maze and word search.

There were some know issues, such as font size, but when presented to a class of children the response was positive and all the questions were answered. It did seem, however, that there was still some tendency to always answer the questions in the positive.

 

Study 5: Five Degrees of Happiness

Coming Soon

 

 

 

 

 

The Final Instruments