Expand / Testing and learning

Prototype Testing Toolkit

A practical framework for planning, conducting and analysing prototype tests across a wide range of innovation contexts.

Before you begin

Turning Prototypes into Learning Opportunities

01

Introduction

Building a prototype is only the beginning. The real value of prototyping emerges when people interact with an idea and generate feedback, observations and evidence that can inform future decisions.

Many teams invest considerable effort in creating prototypes but far less effort in designing effective tests. As a result, opportunities for learning are missed, assumptions remain unchallenged and decisions continue to rely on intuition rather than evidence.

Prototype testing is the bridge between making and learning.

It transforms prototypes from objects into opportunities for discovery.

Whether testing a sketch, a digital interface, a service concept, an educational experience or a business model, effective testing helps innovators understand how people respond, where friction occurs and what should happen next.

This toolkit provides a practical framework for planning, conducting and analysing prototype tests across a wide range of innovation contexts.

02

Why Prototype Testing Matters

Many organisations spend significant resources developing solutions before understanding whether people actually want, need or understand them.

Prototype testing helps reduce this uncertainty.

Rather than asking:

"Do you like this idea?"

Prototype testing explores questions such as:

  • Can people use it?
  • Do they understand it?
  • Does it solve a meaningful problem?
  • What assumptions are being challenged?
  • Where does confusion occur?
  • What should be improved?

Testing transforms opinions into evidence.

The goal is not to prove that a solution is correct.

The goal is to learn.

03

What Makes a Good Prototype Test?

Effective tests share several characteristics.

Clear Learning Objectives

Every test should answer a specific question.

Examples:

  • Can users complete a task?
  • Do participants understand the value proposition?
  • Does the workflow make sense?
  • What assumptions remain uncertain?

Without a clear objective, feedback can become unfocused and difficult to interpret.

Realistic Context

Testing should reflect authentic situations as closely as possible.

People often behave differently when evaluating hypothetical concepts compared with interacting with realistic experiences.

The more relevant the context, the more meaningful the insights.

Representative Participants

Testing with the wrong audience can generate misleading conclusions.

Whenever possible, recruit participants who resemble the intended users, customers, students, employees or stakeholders.

Open-Minded Inquiry

Great testing seeks understanding rather than confirmation.

Teams must remain willing to discover that their assumptions were incorrect.

Unexpected findings often produce the most valuable learning.

04

Before You Test: Define Your Learning Goal

The first step in any testing activity is identifying exactly what needs to be learned.

Ask:

What assumption are we testing?

Example:

"Users will understand the dashboard."

What uncertainty exists?

Example:

"We are unsure whether users can find key information."

What outcome would indicate success?

Example:

"Most users can complete the task without assistance."

What evidence will help us decide?

Example:

Observation, interviews, task completion rates or satisfaction scores.

05

Types of Prototype Tests

Different prototypes require different testing approaches.

Concept Testing

Used during early idea exploration.

Typically involves:

  • Concept sketches
  • Storyboards
  • Idea posters
  • Experience sketches

Participants evaluate the idea rather than the implementation.

Questions may include:

  • Does this concept make sense?
  • What value might it create?
  • What concerns arise?

Usability Testing

Focuses on how people interact with a solution.

Commonly used with:

  • Websites
  • Mobile apps
  • Digital platforms
  • Educational technologies

The focus is behaviour rather than opinion.

Experience Testing

Used for:

  • Service design
  • Learning experiences
  • Events
  • Customer journeys

Participants engage with the experience and provide feedback.

Functionality Testing

Explores whether a solution performs as expected.

Particularly useful for:

  • Software systems
  • Physical products
  • Interactive technologies

Pilot Testing

A larger-scale test conducted before implementation.

Pilot tests help evaluate:

  • Feasibility
  • Scalability
  • Adoption
  • Operational challenges
06

Recruiting Participants

A prototype test is only as valuable as the participants involved.

Identify Your Audience

Ask:

Who will use the solution?

Examples:

  • Students
  • Educators
  • Customers
  • Staff
  • Community members
  • Patients
  • Citizens

The more closely participants reflect the intended audience, the more valuable the learning.

Determine Sample Size

For qualitative testing, smaller groups are often sufficient.

Five to ten participants can reveal many usability and experience issues.

Larger samples become valuable when seeking quantitative validation.

Avoid Selection Bias

Participants should not all share the same characteristics or perspectives.

Diverse perspectives often reveal different challenges and opportunities.

Recruit Early

Testing typically takes longer to organise than expected.

Recruitment should begin before prototypes are completed.

07

Preparing for Testing

Good preparation increases the quality of insights generated.

Create a Test Plan

Every test should document:

Objectives

What is being learned?

Audience

Who will participate?

Activities

What will participants do?

Data Collection

What information will be gathered?

Success Criteria

How will results be evaluated?

Prepare Materials

Examples include:

  • Prototypes
  • Instructions
  • Observation sheets
  • Consent forms
  • Question guides
  • Recording tools

Preparation allows facilitators to focus on learning rather than logistics.

08

Facilitating a Prototype Test

Facilitation plays a critical role in obtaining useful insights.

Welcome Participants

Create a relaxed and supportive environment.

Explain:

  • Why the session is occurring
  • What participants will be doing
  • How information will be used

Most importantly:

Tell participants they are not being tested.

The prototype is.

Encourage Natural Behaviour

Avoid directing or correcting participants.

Allow people to interact naturally with the prototype.

If confusion occurs, observe it.

That confusion may be exactly what the team needs to learn from.

Ask Open Questions

Instead of asking:

"Do you like this?"

Try:

  • What stands out?
  • How would you describe this experience?
  • What would you expect to happen next?
  • What was confusing?
  • What worked well?

Open questions produce richer insights.

09

Observation Techniques

Observation is often more valuable than direct feedback.

People may struggle to explain their behaviour accurately.

Watching behaviour provides powerful evidence.

Observe Actions

Pay attention to:

  • Hesitation
  • Navigation patterns
  • Workarounds
  • Errors
  • Questions
  • Emotional reactions

Behaviour often reveals patterns participants themselves may not notice.

Record Key Moments

Look for moments where participants:

  • Become confused
  • Make mistakes
  • Express delight
  • Change strategy
  • Seek assistance

These moments often reveal design opportunities.

Capture Quotes

Direct quotes provide valuable insight and can help communicate findings to stakeholders.

Example:

"I wasn't sure where to click next."

Simple comments often reveal significant usability challenges.

10

Interviewing After Testing

Interviews help explain behaviours observed during testing.

Start Broad

Examples:

  • How did the experience feel?
  • What stood out to you?

Explore Specific Moments

For example:

  • I noticed you paused here. What were you thinking?
  • What made that step difficult?

Focus on Experiences

Avoid asking participants to design the solution.

Instead focus on understanding their needs and experiences.

11

Capturing Evidence

Good testing generates evidence that can be revisited and analysed.

Observation Notes

Document:

  • Actions
  • Behaviours
  • Challenges
  • Quotes

Video Recording

When appropriate, recordings preserve details that might otherwise be missed.

Screenshots

Useful for digital testing.

Photographs

Helpful for physical and service prototypes.

Quantitative Data

Examples include:

  • Task completion rates
  • Time on task
  • Error rates
  • Satisfaction ratings
12

Analysing Results

Testing is only valuable if findings are interpreted effectively.

Identify Patterns

Look for recurring issues.

If multiple participants experienced similar challenges, the issue may require attention.

Group Insights

Common categories include:

  • Usability
  • Understanding
  • Value
  • Navigation
  • Communication
  • Accessibility

Patterns are often easier to identify when grouped visually.

Prioritise Findings

Not every issue requires action.

Consider:

Frequency

How often did the issue occur?

Severity

How serious was the impact?

Strategic Importance

Does it affect critical objectives?

13

Avoiding Common Testing Mistakes

Testing Without Objectives

Testing should answer questions.

Leading Participants

Avoid influencing behaviour or responses.

Explaining Too Much

If users require extensive explanation, this may reveal a design problem.

Falling in Love with the Prototype

Be willing to change direction.

Ignoring Contradictory Evidence

Unexpected findings often provide the greatest learning opportunities.

14

Turning Insights into Action

Prototype testing should lead to decisions.

After analysing findings, ask:

  • What worked well?
  • What needs improvement?
  • What assumptions were validated?
  • What assumptions were challenged?
  • What should happen next?

Every testing activity should produce clear actions.

15

Prototype Testing Checklist

Before Testing

  • ✅ Define objectives
  • ✅ Recruit appropriate participants
  • ✅ Prepare materials
  • ✅ Plan data collection
  • ✅ Establish success criteria

During Testing

  • ✅ Observe behaviour
  • ✅ Ask open questions
  • ✅ Capture evidence
  • ✅ Avoid leading participants
  • ✅ Create a supportive environment

After Testing

  • ✅ Analyse patterns
  • ✅ Prioritise findings
  • ✅ Identify improvements
  • ✅ Plan next iterations
  • ✅ Share insights with stakeholders
16

Reflection Questions

  • What assumptions are you currently making?
  • What evidence would help reduce uncertainty?
  • Are you observing behaviour or relying on opinions?
  • Which findings surprised you?
  • What should be tested next?
17

Key Takeaways

Great prototypes generate opportunities for learning.

Great prototype tests turn those opportunities into evidence.

The most successful innovators do not simply create prototypes.

They create structured learning experiences that reveal what people need, how they behave and what should happen next.

Effective testing replaces assumptions with insight, intuition with evidence and uncertainty with understanding.