The last participant's final questionnaire was submitted today, which means we'll be in the thick of evaluation over the next few weeks. Of the 24 participants signed up to the trial we've actually got rich and usable data sets for 11 – not quite as many as we'd hoped for, but more than enough to occupy us in analysing and evaluating the implications.
In addition to 6 experience-related questionnaires submitted by each of the participants, we're also analysing the system logs to draw out patterns of usage: over time, acitvity (whether browsing or authoring etc), and possibly even location.
We'll correlate this with the participants experiences, as well as the actual content they created on the system to build up a picture of how they used UT. An interesting suggestion from Nicholas Nova has prompted us to plan a series of short interviews with the participants presenting them with what they said about the experience, as well as what they did and when they did it, to see what additional observations or insights into their use and behaviour this might trigger.
From our point of view its been a great success – generating a wealth of data about how people can actually use mobile spatial annotation/public authoring platforms with current technologies, and points to some of the key issues that manufacturers and telcos are going to have to address in the near future. We'll be posting snippets from the evaluation as we proceed and make sense of it all, with a final report planned for September.
Posted by Giles Lane at July 16, 2004 01:04 AM