What types of usability testing are used in Conversion Rate Optimisation?

There’s three types of usability testing in conversion rate optimisation: Laboratory, Remote unmoderated and Remote moderated. Here we have a look at each in a bit more detail.


Laboratory usability testing

Laboratory usability testing is the most expensive method, as it requires special premises and equipment and the testers need to make a special journey to get to the lab, rather than being in their own home.

In qualitative laboratory testing, users are studied interacting with the website in person. In-lab usability testing usually works with small and specific sample sizes to better obtain qualitative data.

Typically, the user sits in front of a PC, mobile or tablet alongside a facilitator who gives the user tasks to perform. A one-way mirror is often used, so that a number of observers can watch the interaction, make notes, and ensure the activity is recorded. Sessions are usually filmed and the software used logs interaction details. This enables a number of stakeholders to observe how a customer interacts with the site first-hand.

The kind of tasks might be ‘Please buy a gift of a teddy bear, to be delivered to your niece in Gloucester on her birthday next Wednesday’.

The observers can see for themselves if participants are able to complete specified tasks successfully and any stumbling blocks they encounter along the way. It also gives a flavour of how long it takes to complete specified tasks and helps generate ideas for the changes required to improve user performance and satisfaction.

In laboratory usability tests, a facilitator gives the user tasks to perform whilst other team members observe.


Remote unmoderated usability testing 

This inexpensive usability testing method is deep as opposed to broad because it’s designed to look at small, specific areas. It is ideal if the scope of the testing is limited to a specific feature, your participants are dispersed, or you need results fast.

For unmoderated user testing, you’ll need a software application package, such as whatusersdo or UserTesting, to administer the tasks and questions. This plays the role of a session facilitator to guide the participants through the session and record what happens.

In an unmoderated remote session, the participant can complete the study in his or her own time, on their own PC, mobile or tablet whilst recording the session for later review by the usability expert.

Although there is no real-time interaction with the participant, some remote testing tools allow pre-defined follow-up questions to be built into the study, to be shown after each task or at the end of the session.

An example video you would get from UserTesting with annotations added.


Remote moderated usability testing

By contrast, remote moderated usability testing is broad as opposed to deep. It’s a way of observing users throughout the entire customer journey, although, when appropriate, it can also be used to look at specific issues in more detail.

In moderated remote testing, users and facilitators operate in the same ‘virtual’ space at the same time. The facilitator watches the usability test remotely as it happens and communicates directly with the participant via the telephone, email, chat, or a combination of methods.

To carry out remote usability testing, you need to recruit website visitors willing to take part. We use a simple software tool called Ethnio, although you can also email a subset of your database to find willing participants. In order to carry out the usability testing, you also need screen sharing and recording software such as GoToMeeting or join.me. One of the great strengths of this method is that you are speaking to real users, while the experience of using the website is fresh in their minds.

Moderated sessions allow for interaction between the participant and facilitator, enabling the facilitator to ask questions for clarification or dive deeper into issues that crop up during the session.

However, the success of this method lies in the skill of the moderator. That person should, ideally, be the same person who is analysing the website using quantitative tools such as heat maps and analytics, so that they already have a good understanding of where the problems are. In addition, the moderator needs to be a good listener, and open to genuinely finding out what the issues are, rather than leading the tester towards a conclusion.


Case Study – Bettys 

Bettys is a prestigious and popular chain of tea shops in the North of England, with a loyal and devoted following. It is famous for its cakes, which it also sells online.

During one usability session the facilitator overheard the tester’s friend in the background saying “I didn’t know Bettys sold cakes”. This was strange, as the website clearly showed a basket symbol at the top and a large banner offering free delivery.

Rather than ignoring this chance remark, the researcher explored it in more depth. As a result, a new web page was developed which just added ten words to the home page. “Shop online now – direct from our bakery to your door.” This was tested and led to a double-digit improvement in sales.

To find out more about usability testing, read our full usability testing ebook.


Discover how businesses have made the shift from CRO to experimentation – and you can too

Download your copy today >

Posted in: Usability Testing

If you enjoyed reading this, you might also like

Request an Initial Strategic Review

If you’re serious about initiating change within your business, we’d like to offer you a 60-minute Initial Strategic Review.

“We’ll share what we’ve learned from decades of experience working with businesses using CRO, innovation and experimentation to achieve business goals like yours”

Johann Van Tonder, COO, AWA digital.

This is an opportunity for ambitious online businesses who are already generating significant revenue… and know they can bring in more… but are not sure exactly how.


We partner with the leading CRO technologies