U.S. flag

An official website of the United States government

Government Website

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Safely connect using HTTPS

Secure .gov websites use HTTPS
A lock () or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Reporting on Usability Testing

Usability Testing Lesson | 10 Minutes

You’ve conducted usability testing and collected powerful user feedback about your service or product. What’s next?  

Your next and final step in the usability testing process is the creation of a report that clearly identifies the ways a service can be improved. 

What Should I Include in My Usability Testing Report? 

Image
Outlining a Usability Testing Report (graphic). The usability testing report is an organized presentation of the testing process, feedback collected, and findings. The report should include: Executive Summary, Background, Recommendations, Test Results, and Methodology. Each part helps define your purpose for the usability test before starting the actual testing.

Your usability testing report is a culmination of all the feedback you received during your testing session. You should include the following information in your report: 

  • Executive Summary: Show top insights and highlighted recommendations.
  • Background: Briefly summarize why you completed the study. This should include context as to why it's important to your work.
  • Recommendations: List the items that need to be updated and the positive findings. This should include user feedback rated on a prioritization scale. 
  • Test Results: Record user feedback and describe the task related to the data, such as presenting qualitative and/or quantitative data from the test session in an easily digestible format.
  • Methodology: Explain the approach you used to test the service, such as a comparative usability test to determine user preferences between two approaches to solving a specific issue.

When you put together your report, consider using visual aids like charts and graphs to help readers understand your data and your findings. 

What Kind of Information Should I Share?  

Depending on your usability testing approach, you may have collected qualitative and/or quantitative data from your testing participants. You should include all forms of data in your report, including the positive and negative feedback you may have received.  

Qualitative Versus Quantitative Data. What Is the Difference? 

Qualitative data is any insight, finding, or anecdote shared (or observed) by a participant during a usability testing session. This can include: 

  • Observations about pathways participants took while exploring the service
  • Issues observed with the service's functionality
  • Responses from the participant when probed/questioned by moderator
  • Comments/recommendations made by the participants throughout the testing process  

When you record qualitative data points, be sure to identify the task the participant is trying to complete and be as exact as possible with your participants' remarks. Direct quotes from a user can add powerful context to the key findings you describe in your report. 

Quantitative data is any metric that describes the user's experience during a usability testing session. This can include:

  • Success rate of task completion; such as tracking if a user can navigate to a particular page on a website
  • Error rate for each task; such as tracking if a user can or cannot complete the assigned tasks while testing the service/product
  • Time to complete a task
  • Satisfaction of service rating; such as a Net Promoter Score (NPS) or Customer Satisfaction Score (CSAT)
  • Participants demographic information (if it impacts the participant data within the report) 

To keep your quantitative data organized and accurate, be sure to align each new data point to the specific task that is being completed as you record your findings. 

How Should I Organize My Data?

When you build your report, you should work to present your data in a way that makes it easy for readers to understand how you came to your conclusions about what should be done to improve your service.  One way to do this is by using a feedback prioritization scale.  

Image
Feedback Prioritization Scale (graphic). As you compile data for the report, you can use a simple rating scale to help readers understand what’s the most important feedback to address. Priorities: Critical (must fix or users cannot use/complete a task), Serious (frustrates users and they may not use the service in the future), and Minor (not a smooth process but task can be completed).

By using the feedback prioritization scale, you can make direct connections from your key data points to your recommendations for iteration. 

  • Critical: If we do not fix the issue, users will not be able to use/complete a task in the service.
  • Serious: Users are frustrated and if we do not fix the issue, they may not use the service in the future. 
  • Minor: Users can use/complete a task in the service, but it is not a smooth process or easy to use. 

Your prioritization will help make it easier for readers to understand and organize what iterations will lead to the most significant improvement to the service. 

In Summary 

A usability testing report that is built correctly with detailed information is a tool you can use to clearly communicate with your leadership team. Whether you are seeking support/funding for iterations or seeking a straightforward and quick approval for your service/product to be published, your testing report will be key in providing the evidence you need to support your work. 

The final stage of usability testing is to report your testing session findings and iterate your service to better meet the customer’s needs. This is a vital step in the process of usability testing as we strive to improve our customers’ experiences across each DHS Component.

  • What Did You Learn?

    Take our short knowledge check to find out how much you know about reporting on usability testing.  

    Disclaimer: Responses and results are anonymous and may be used to improve the course offerings. 

    Check Your Knowledge

 

  • Moderating Usability Testing

    15 Minutes

    Learn about the roles of a moderator and how to create a step-by-step process to ensure you gain meaningful feedback during usability testing.

Last Updated: 01/24/2023
Was this page helpful?
This page was not helpful because the content