Review of Easy and Inexpensive Tools for Usability Testing

There is a perception about usability testing that it is both time consuming and expensive. While it can be time consuming, good usability testing certainly can be inexpensive. You will find out with the examples below and the good thing is that there are a number of different online tools that don’t all do the same thing so you can test different aspects of a site in multiple ways.

The following is a look at five of the most well known tools to help you get the most out of user testing without the need for a large budget.

Userfly is a browser based usability tool. Once signed up it is very easy to get up and running by including a few lines of Javascript in the head section of your code. Once users have visited your site, you are able to view exactly what they clicked on and where they browse to in your site. All this is done in your browser, so there is no software to install and you can access it from anywhere.

In my experience of using it however, the data was unreliable as users appeared to be clicking in the middle of nowhere and following through to a different area of the site. A little investigation reveals this is due to the way that Userfly displays the recording in your browser as it places your site in an iFrame and shows users’ interactions. The problem with this is the inconsistencies between browser engines and the only way to make sure what you’re seeing is what the user saw, is to view the test in the browser that the tester used.

Advantages

Free test recordings.

Easy to setup.

Very cheap.

Immediate results.

Disadvantages

UserTesting.com takes a unique approach to usability testing as they pay users to perform tests for them and pass the results on to you. What you get is the ability to give the user a scenario and define what you them to do, such as order a holiday in Rome with a set budget or buy a book. You even have the ability to select your target audience by selecting the gender, age, country, yearly household income and expertise with computers and the web.

Within an hour or so of a completed test, you receive a full video of the user’s screen along with an audio recording. Testers are instructed to provide running commentary as they perform the test which is great as it basically is them thinking out loud allowing you to hear what they think. You can make comments directly in the timeline of the video when you need to flag something and you also get access to a written summary of what the user thought of the experience.

Advantages

Disadvantages

Open Hallway is similar to UserTesting.com as feedback comes in the form of video and audio recordings. The biggest difference is that you have to source testers yourself. Once you create a test you receive a link to send who will then be given instructions of what you require from them.

When someone fulfills a test, you’ll see a video of their full screen (with audio recording), not just the browser.

Advantages

Can be used to test any website, not just your own.

Records user’s full screen and voice.

Can be used to test desktop applications as well as websites.

Disadvantages

Silverback is the odd one out as it isn’t an online app. Rather, it is Mac OS X software that takes advantage of the iSight camera that comes included on most Mac computers. While the user is performing your given task(s), the camera records their reactions and audio records their commentary should you wish. You can even mark points in the recording with the Apple remote when you see something that you want to flag for later study.

The only downside to Silverback is that you have to source your own testers and possibly even invite them to your location for testing. You may well need to pay them and their travel expenses which can add up to a considerable amount. Given that web guru Jakob Nielsen has advised that testing with just 5 users will find more than three quarters of a site’s usability, this is still a valuable option to consider.

Advantages

Free 30-day trial.

Can test on sites locally before they go live.

See people’s facial reactions.

Disadvantages

More expensive than other options when paying for users is taken in to consideration.

Mac OS X only.

Mix & Match

Don’t just settle for one option, try them all and see what works the best for what you need. For example, Userfly is great for quick and cheap testing to get a rough idea of how users use your site while UserTesting.com is more comprehensive, ideal for testing complex websites.

What tools or methods do you use for usability testing?

Improve your design knowledge in just a minute or two a day, for free

with...

Great Design Details

You'll get a free email every Monday to Friday with actionable design details that will increase the effectiveness of your designs. Each one only takes about a minute or two to read.

Success! Now check your email to confirm your subscription.

There was an error submitting your subscription. Please try again.

Email Address

I'd like to receive the free email course.

Free. No spam. Unsubscribe anytime.

by Tom Kenny

I’m a freelance web designer and front-end developer with 9 years of experience designing for the web. Follow me on Twitter here.

Make More Informed Design Decisions

Learn why the best designers make the decisions they do to design successful websites people love in this FREE eBook with three in-depth case studies. I’ve spent hours studying what makes these websites amazing, so you can use what works and focus on your design work.