A website usability test observes real users attempting tasks on your site to identify navigation problems, confusing interfaces and conversion barriers that analytics alone cannot reveal. You give participants specific tasks, watch them interact with your site in real time and document where they struggle, succeed or abandon the process entirely.
Why Usability Testing Beats Guessing
Your team is too familiar with your website to see its problems. You know where everything is because you built it. Your customers do not have that advantage. Usability testing exposes the gap between how you think users navigate your site and how they actually do.
A 30-minute usability test with five participants reveals more actionable insights than weeks of analyzing heatmaps or debating design decisions in meetings. Watching a real person struggle to find your pricing page or abandon your checkout process makes problems undeniable and creates immediate urgency to fix them.
Professional website UX audits combine usability testing with heuristic evaluation for comprehensive coverage of user experience issues.
Step 1: Define Your Testing Goals
Choose What to Test
Focus each usability test on a specific area of your site or a specific user journey. Testing everything at once produces scattered findings. Effective test goals include:
- Can users find and complete the contact form?
- Can users navigate from the homepage to a specific product and add it to cart?
- Is the checkout process clear and free of friction?
- Can users find the information they need on the services page?
Write a Test Plan
Document your test plan with these elements: research questions (what you want to learn), participant criteria (who should test), task list (what participants will do), success metrics (how you measure outcomes) and timeline (when testing happens).
Step 2: Recruit Participants
Find the Right People
Your test participants should match your actual target audience. A usability test with random college students tells you nothing about how your B2B software customers experience your site. Recruit participants who match your buyer persona demographics, technical proficiency and familiarity with your industry.
Recruitment Sources
- Your customer base: Email existing customers and offer an incentive for 30 minutes of their time
- Social media: Post recruitment calls on LinkedIn, Twitter or Facebook targeting your audience
- Testing platforms: UserTesting.com, Maze and Lookback provide pre-screened participant panels
- Local networks: For local businesses, recruit through community groups and business associations
Incentives
Offer $50-$100 gift cards for 30-60 minute sessions. Product discounts, free services or charitable donations in the participant’s name also work. Fair compensation attracts quality participants who take the test seriously.
Step 3: Design Your Test Tasks
Write Scenario-Based Tasks
Frame tasks as realistic scenarios rather than instructions. Do not say “Click the Services link in the navigation.” Instead say “You need a new website for your business. Find out what Vancouver web design services this company offers and how much they cost.”
Scenario-based tasks reveal natural user behavior. Instructional tasks only test whether users can follow directions.
Task Design Rules
- Use language your customers would use, not your internal terminology
- Do not hint at the answer in the task description
- Order tasks from simple to complex to build participant confidence
- Include 5-8 tasks per session to keep sessions under 45 minutes
- End with an open question: “Is there anything on this site that confused or frustrated you?”
Step 4: Run the Test
Moderated Testing
Sit with the participant (in person or via video call) and observe as they complete each task. Ask them to think aloud, narrating their thought process as they navigate. Your role is to observe, not guide. Resist the urge to help when they struggle. The struggle is the data.
Unmoderated Testing
Use platforms like Maze or UserTesting to run tests asynchronously. Participants complete tasks on their own time while screen recording captures their interaction. Unmoderated testing is faster and cheaper but provides less depth than moderated sessions.
What to Record
- Screen recording of the participant’s browser/device
- Audio of their think-aloud narration
- Task completion (success, partial success, failure)
- Time to complete each task
- Points of confusion, hesitation or error
- Emotional reactions (frustration, satisfaction, surprise)
Pair usability findings with A/B testing to validate that your proposed fixes actually improve performance.
Step 5: Analyze Your Findings
Review Each Session
Watch every recording and note each usability issue. Document the issue, which task it occurred during, how many participants experienced it and its severity (critical, major, minor).
Identify Patterns
A problem that one participant encounters might be an individual quirk. A problem that three or more participants encounter is a genuine usability issue. Focus your fix list on issues that multiple participants experienced.
Severity Classification
- Critical: Users cannot complete the task at all. This blocks conversions. Fix immediately.
- Major: Users complete the task but with significant difficulty or frustration. Fix within 30 days.
- Minor: Users notice the issue but work around it easily. Schedule for the next design update.
Create a Findings Report
For each issue, document: description of the problem, video clip showing the problem, severity rating, number of participants affected and recommended fix. This report becomes your UX improvement roadmap.
Step 6: Implement and Retest
Fix Critical Issues First
Address critical usability issues immediately. These are blocking conversions right now. Deploy fixes as soon as they are developed and tested.
Validate With Follow-Up Testing
After implementing fixes, run a smaller follow-up test with three to five new participants. Verify the issues are resolved and that your fixes did not create new problems. This validation step prevents shipping solutions that create different problems.
Make Usability Testing Ongoing
Run usability tests quarterly, before major redesigns and before launching new features. Regular testing catches issues early when they are cheaper and faster to fix.
Want expert eyes on your website’s usability? Request a free audit and we will identify the biggest usability issues costing you conversions and recommend specific improvements.
Frequently Asked Questions
How many participants do you need for usability testing?
Five participants uncover approximately 85% of usability issues according to research by Jakob Nielsen. For most businesses, testing with five to eight users provides enough data to identify critical problems. Increase to 10-15 participants for quantitative studies where you need statistical significance.
How much does usability testing cost?
DIY usability testing using free screen recording tools and recruiting participants from your customer base costs $0-$200. Remote testing platforms like UserTesting.com or Maze charge $50-$100 per participant. Full-service usability studies from UX agencies cost $5,000-$25,000 depending on scope.
What is the difference between usability testing and A/B testing?
Usability testing observes how users interact with your site to identify problems and understand behavior. A/B testing compares two versions of a page to determine which performs better statistically. Usability testing tells you why something fails. A/B testing tells you which option wins. Use both for complete optimization.
Related: marketing strategy guide
Need help with this?
Quake Media helps businesses across Vancouver and Canada with SEO, PPC and custom web development. Get a free audit and see where your site stands.


