Statistics, Lies and Video Tapes in Usability Testing - Part 1

I dont know why organizations need tons of video taping for their usability evaluation sessions. They end up paying a lot of money and I wonder what happens to all those tapes a week down the line. Sometime back we were all having a good laugh when I suggested the idea that we should all make a reality TV show with all the funny, strange, and surreal comments we get during user testing.

I dont know if the reality show will solve this issue, but the reality is that NOT all user testing sessions need to be taped religiously. Unless of course the video equipment is free, the manager is gone on a vacation while you were testing and you need to convince him/her when they are back.

Simple usability tests give the best results. And all the more better when one starts early in the process of design. I know , i know.. that only happens in a utopian world, but thats what we all strive for.

So, best is to make quick notes, have a tight moderator protocol so that you know what to ask. And analyze the results as soon as possible so that all the comments are fresh in the memory and you have time to tear apart the design you have tested. And Make sure you annotate the findings with the screen shots with those cute little call outs. That will take the mind off of your managers from that infamous video tapes.