Statistics, Lies and Video Tapes in Usability Testing - Part 2

Now something about the statistics part. Its great to show some graphs and charts as a part of the results in the usability testing report. But the best part is the selective use of statistics to prove a point. Sometimes it can be tricky. Its important to know how much data is important and in how many different ways it can be analyzed.

The timing of the task is only important when the task itself is time bound. Otherwise its just good to show the success rate of the task. I hardly use a stop watch during usability tests. Yeah... there was this one UT where we had to test ATM's and it was critical to time the tasks.

Well, the important part is that use statistics to make a valid argument . Use statistics when it’s statistically significant.