Summary (Defects) report

Overview

The Summary (Defects) report shows an overview of all of the defects you’ve discovered and linked to tests you’ve recorded in TestRail. This report provides insight and metrics related to the overall status of testing efforts and the quality of a particular release. It includes a graphical representation of the summary data, as well as detailed lists of the test runs and defects found using the search criteria specified in the report options.

Creating a Summary (Defects) report

Prerequisites

Please make sure you have the following permissions enabled for your user role.

For more details, please check out the managing user roles and permissions guide

Steps to create a Summary (Defects) report

To generate the Summary (Defects) report in TestRail, you need to put a few configuration settings in place.

Navigate to the project for which you would like to create a test report. Then, navigate to the Report tab.

On the right side, you will see a pane titled Create a Report. Click on Summary under the Defects section. 

On Add Report page, you will find 3 main sections: 

• Name and Description
• Report Options
• Access & Scheduling

Follow the below steps to configure each section

1. Name and Description

   Enter the report's name and description in their respective fields.

2. Report Options

   On the Add Report page, scroll down to Report Options. Here, you will see three tabs, DEFECTS, SECTIONS & TEST RUNS, and TESTS.

   DEFECTS

   On the DEFECTS tab, you can choose to include all defects found in the report, or include only specific defects by identifier.  In most use cases, you will select All defects as shown below.

   

   SECTIONS & TEST RUNS

   You can do the following under the SECTIONS & TEST RUNS tab: 

   

   1. Choose to include all sections of test cases or specific sections only. This allows you to show the results for specific sections of the test case that you would like to display in your report. If you would like to make specific selections, make sure to click the radio button “The following sections only:”. You can also hold down the ctrl/cmd key and click to select multiple sections or sub-sections.

       

      
   2. Choose the test runs for which you would like to view test results. This can be done in two ways. The first option is to apply one or more filters to select the test runs that match the applied filter(s). You can filter the test runs using parameters like Assigned To, Completed On, Created By, Milestone, etc. This can be helpful if you want to compare results for tests across multiple test runs that fit certain criteria, e.g. all the test runs in a given test plan or across a milestone that you are using to track testing for a specific release.
      
      
      

       

      Afterwards, click Add Test Runs; then, click Apply Filters.
      
      
      
      

      The second option is to make individual selections of the test runs, one by one. Click the radio button next to Only the following test runs, then click Add Test Runs and check the boxes for each test run you would like to include in your report.

      
      
      
   3. Select the maximum number of test runs to include. The maximum number can be five, 10, 25, 50, or 100. 

   TESTS

   You can do the following under the TESTS tab:

   1. Choose the column(s) to include in the tables displaying tests' information in the report. The default columns include ID and Title. Depending on the information you want to display, you can add additional columns such as Type (of the test), Priority, etc. 

       

      
   2. Set the maximum number of tests to display per group. The maximum number can be 10, 25, 50, 100, 250, 500, or 1000.

    

3. Access & Scheduling

   This section enables users to set access and scheduling options. For more details, please refer to the General configurations guide.

Finally, scroll down and click Add Report to generate the report.

Reading a Summary (Defects) report

It may take minutes to generate your report depending on the data included. However, once the report is fully generated, the next thing is to view and interpret it. To view the report, go to your Reports tab and click on the appropriate report under the list. The first chart on the report page is a bar graph that illustrates the number of defects found during applicable test runs. The test runs with defects are categorized based on the current test status (passed, failed, etc.). An example of this graph is shown below.

Next, you will see a list of test runs that have defects and meet the criteria provided in the report options. This list includes high-level information about each test run including the corresponding test section and milestone. An example is shown below. The note at the bottom indicates the number of test runs that met the search criteria but did not have any defects.

Afterwards, you will see a list of the defects and information about the test run where the defect was identified. Each defect includes a link to the corresponding entry in the integrated defect tracking system. The current status of the test run is shown in the far right column.