Skip to main content

Assistive Technology User Testing for a National Museum — Beyond Automated Scanning

Automated tools said the site was largely conformant. Real users told us something different. The barriers that matter most are often the ones no scanner can find.

Accessibility Partners Canada facilitating accessibility strategy discussions for a National Museum to improve inclusive visitor experiences and accessible cultural programs.

Project Overview

A national museum engaged Accessibility Partners to conduct accessibility user testing on its digital properties. The museum had run automated scans and wanted to go further to understand what it actually feels like to navigate their platforms using the assistive technologies their visitors depend on.

  • The Limits of Automated Accessibility Testing

    Automated scanning tools are useful. They catch missing alt text, colour contrast failures, and certain structural issues efficiently. What they cannot do is tell you whether a screen reader user can complete a task, whether a keyboard-only user can reach every interactive element, or whether a person using voice control can navigate a complex gallery interface. The museum’s automated results presented one conformance picture. They wanted the real one.

  • Our Assistive Technology User Testing Approach

    We recruited, coordinated, and managed testing sessions with real assistive technology users — people who use these tools as part of their daily lives, not researchers operating unfamiliar software. Testing covered NVDA, VoiceOver, iOS Voice Control, Windows Magnifier, and keyboard-only navigation. We conducted both moderated sessions, where a facilitator was present to observe and probe, and unmoderated sessions, which surfaced the experience without the influence of a facilitator.

    Every barrier identified was mapped to the specific WCAG success criterion it violated. We delivered a prioritised remediation report with screen captures, session transcripts, and clear developer guidance. We followed the report with a developer workshop to ensure findings translated into action.

Project Snapshot

Industry
National Museum
Location
Canada
Compliance Standard
Accessible Canada Act
Key Result
5 assistive technologies · WCAG-mapped findings

User Testing Results

  • Testing conducted with real users of NVDA, VoiceOver, iOS Voice Control, Windows Magnifier, and keyboard-only navigation

  • Moderated and unmoderated sessions both conducted

  • Every finding mapped to a specific WCAG success criterion

  • Barriers surfaced that automated tools had not detected

  • Prioritised remediation report with screen captures and session transcripts delivered

  • Developer workshop held to translate findings into implementation

Services Used

Talk to Us About User Testing

Every engagement we take on is led by a credentialed senior consultant — not delegated to junior staff after the proposal is signed. We hold Government of Canada Standing Offer #1 national ranking, $5M errors and omissions insurance, and twelve years of experience across federal, provincial, municipal, and private-sector clients.

If your organisation has automated scan results but wants to know what your users actually experience, we would welcome the conversation.

Contact Us

Frequently Asked Questions

What assistive technologies do you use in accessibility user testing?

Testing commonly includes NVDA, VoiceOver, keyboard-only navigation, Voice Control, and screen magnifiers.

What is the difference between moderated and unmoderated accessibility user testing?

Moderated sessions include a facilitator, while unmoderated sessions allow users to complete tasks independently in real-world conditions.

Why can’t automated scanning replace real user testing?

Automated tools cannot fully evaluate real user experiences or confirm whether important tasks can actually be completed successfully.

How are user testing findings turned into actionable developer guidance?

Each issue is mapped to WCAG requirements and documented with screenshots, explanations, and remediation recommendations.