Results may be presented as a text report, a PowerPoint presentation, a highlights
video, or whatever format works best for you and your client. Your goal is to
help improve the interface and to help developers and decision-makers to visualize
the users as real people.
Here is an outline of major sections we like to include:
- Executive summary (major positive and negative results from the test, with
a focus on implications for site owner business and branding goals)
- Description of test methodology and test circumstances, participant list,
and task list
- Results
- Appendices (test script and other test materials)
Executive Summary
- Your executive summary should cover the major positive and negative results
of your test.
- It also needs to speak effectively to executives. In other words, it needs
to focus on the probably priorities and concerns of your audience. Focus on
the implications of the problems you observed for site owner business and
branding goals. Think about your audience's preconceptions and priorities—know
in advance how persuasive you need to be.
- Use headings and white space to organize your main points. Use what you've
learned about creating visual hierarchies to help support your message.
- Be clear on what your goals are (delay release date, pay for changes, agree
to more testing after revision)
- Help your audience understand usability testing
Here is an example of an executive
summary (PDF) for the testing on a cosmetics site.
Description of Test Circumstances, Methodology Including information about test circumstances, methodology and test participants
helps to build your credibility.
Include
- the physical location of the test
- the number of test participants
- equipment used
- connection speed
- the version of the interface tested
- a description of the test team
- a summary of demographic information about participants (to show that they
were representative of the target market).
Results
Use a clear, consistent format for findings. We have settled on a format that
resembles bug-tracking forms, because we find that this format makes sense to
developers and coders and makes it easy to implement our recommendations.
Here is an example of a complete
usability report (PDF) for testing on a wireless phone service site.
Put your findings in the order of their importance. Don't exaggerate or minimize
the importance of your findings.
Clearly identify the areas of the interface that need attention. Screenshots
are usually helpful.
Make sure your observations are thorough and objective, and that your recommendations
are persuasive and courteous. Address feasibility issues in your recommendations.
Sort your observations into logical categories that accurately reflect the
patterns you saw in your testing and that relate logically to the concerns of
the site owners and stakeholders.
Making a Highlights Video Advantages of a Highlights Video
- Images and sound have higher impact, are more memorable
- You can show the video in a meeting, to make sure management see it
What to Include in the Video
- Focus on 5-6 global and severe problems
- Start with something positive
- Provide context for your clips with subtitles and voice narration
- Try to find clear, dramatic clips (not all from same test participant)
Potential Problems:
- Clips may be unclear w/o context
- Clips may be too long
- Clips may be "messy"
Producing the Video
- Choose clips
- Name clips (categorization)
- Choose order for clips
- Add titles, subtitles, and narration
- Add transitions, nail down sound clips, and add small voice fades as necessary.