How to choose a UX research method

We can also use a 2x2 diagram to decide what kind of research method we should carry out. Diagram 5 shows a 2x2 diagram with "Type of research method" plotted against "Type of data". With "Type of research method" we can classify research methods into behaviour-based methods, and intention (or opinion) based methods. With "Type of data" we can classify research methods into quantitative ("What is happening?") and qualitative ("Why is it happening?").

Diagram 5: A 2x2 plot with the axes,"Type of research method" and "Type of data".

In this example, I've placed specific research methods in each quadrant, but these aren't the only methods you can use. Consider these as examples only.

How to choose a usability evaluation method

Burrowing down further, here's how we can use a 2x2 to choose a specific kind of usability evaluation method. One of the axes in Diagram 6 is "Our knowledge of users". Although not an ideal situation, it's common for product teams to not have a great deal of knowledge about users yet still have a product that they need to evaluate. In that case their knowledge of users is low. In contrast, another product team may have spent time doing field visits to users and so the team knows a thing or two about its users. The other axis is "Urgency". Sometimes we need an answer in a day or so and other times we have the luxury of a 2-week sprint to find the answer.

This diagram helps us choose between different types of usability test and usability inspection methods.

Diagram 6: A 2x2 plot with the axes,"Our knowledge of users" and "Urgency".

The four quadrants are:

• Lab-based usability test: If our knowledge of users is low, a lab-based test is a good choice, especially when the test is of low urgency. By having users in the lab, we can expose the design team to users and increase their overall awareness of users and their capabilities.
• Remote usability test: When our knowledge of users is high and we have more than a few days to work on the issue, then a remote usability test is a good choice.
• Cognitive walkthrough: This inspection method makes sense when we have a good knowledge of users and it's important to get the results urgently. This is because a cognitive walkthrough can be completed in a few hours but it does require a good knowledge of users and their tasks.
• Heuristic evaluation: This inspection method offers value when we need quick answers but don't know a great deal about our users. Instead, we can use standardised usability principles to provide the team with a quick answer.