Ran into a situation when I was looking at usability testing quantitative data, which by the numbers showed the users were able to complete their tasks easily and quickly. However, when I reviewed each video to get some qualitative data they seemed to be complete opposites. Watching the users struggle in one of the tasks and hearing their frustrations was more informative vs. just looking at the numbers. If I had only looked at the numbers, I would not have been able to make the better UX design recommendations for the stakeholders. Hearing the users points of frustrations and identifying them will give us opportunities that will have a direct impact on the business’s financial bottom line. So my takeaway from this study is never solely to rely on the data numbers given to you and always ask to watch some usability testing in person or the videos.
