Top 3 UX Metrics For Testing Product Usability

What are UX Metrics?

Metrics help support design changes while also allowing UX teams to choose the most critical problems in their product usability. Usually, this framework is used to measure the enterprise user experience so that we can talk with the users and gather vital information from them.

Types of Metrics

Consider UX metrics as your key performance indicators (KPIs). The KPIs for UX/UI design are of different types, each of which focuses on a distinct area:

  • Usability Metrics
  • Engagement Metrics
  • Conversion Metrics

Three UX Metrics For Usability Testing

You might be familiar with some common usability testing metrics and the frameworks that use them.

  1. Are both time and cost-efficient and
  2. were found to be the most effective at providing accurate results — without needing a large sample size of participants!

1- Single Ease Question or SEQ (Post Task Questionnaire)

The Single Ease Question (SEQ) is a UX performance metric that uses a seven-point scale to rate how difficult users are finding a task. Here’s an example of what this scale may look like:

Collecting Responses of SEQ through Google Form

Post-task questionnaires should be short — ideally one to three questions — in order to allow minimum interference with the user flow during a testing session.

Interpreting SEQ Scores

Once user responses are collected, you can track the answers using this UX Metrics Scorecard.

Benefits of Using SEQ

The SEQ method is very useful for two reasons:

  1. Since it is conducted right after task completion, the SEQ method gathers users’ immediate thoughts and impressions, as the experience is still fresh in their minds. Hence, the participants can clearly assess how they felt during the experience without any other tasks or thoughts hindering their memory.
  2. With the data being collected right after every task, the SEQ method allows easy comparison of the most problematic issues in your workflows for every task.

2- System Usability Scale or SUS (Post Test Questionnaire)

A post-test questionnaire, the System Usability Scale contains ten different questions. Each of these questions has five responses — from strongly agree to strongly disagree — to gauge the usability and learnability of the system.

Conducting Usability Session by SUS through Google Form

To conduct the usability session by SUS, here’s the Google Form Survey you can use.

  • For odd items: subtract 1 from the user response.
  • For even items: subtract user responses from 5.
  • This will scale all values from 0 to 4 (with 4 indicating the most positive response).
  • Add up all of the converted responses from each user and multiply the total by 2.5. This will convert the range of all possible values from 0 to 100 instead of from 0 to 40.

Formula:

Interpreting SUS Scores

Just as we did in SEQ, a UX Metrics Scorecard is used here as well, which looks like this.

Benefits of Using SUS

With references in more than 1300 publications and articles, the SUS method has made its mark as an industry standard.

  • It is relatively a very easy scale to apply to participants
  • It provides reliable results even when administered on small sample sizes
  • It is very valid in that it effectively differentiates between usable and unusable systems.

3- Usability Metric for User Experience (UMUX)

A result of research at the Intel Corporation in 2010, the UMUX method came about as a replacement for the SUS to create a tool that was not just shorter than the SUS but also conformed to the ISO 9241–11 definition of usability (i.e., effectiveness, efficiency, satisfaction).

Interpreting UMUX Scores

The UMUX is best used after a usability test in the following way:

  • Determine what method you will use to distribute the questionnaire. A pen and paper will suffice for in-person testing, but you can use an online survey tool for remote testing.
  • While scoring UMUX, odd items are scored as [score — 1], while even items as [7 — score]. The scores are summed up, and the total is then divided by 24 and multiplied by 100.

UX Metrics Test Plan Template

Here is a sample usability test plan template to use before conducting Usability Testing.

Takeaway

There are many factors that come into play when deciding what metrics will work best for you; the ones discussed in this article were shortlisted because they were found to be the most time-effective and easily compatible with smaller sample sizes of participants.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
mobileLIVE

mobileLIVE

One of Canada’s fastest-growing technology companies, helping brands accelerate their #DigitalTransformation.