Plan (Summary) report

Overview

The Plan (Summary) report provides a high-level overview and summary of all progress and activity for a specific test plan in your TestRail project.
It also gives a detailed breakdown of the status of the test plan being executed within the project.

Creating a Plan (Summary) report

Prerequisites

Please make sure you have the following permissions enabled for your user role.

For more details, please check out the managing user roles and permissions guide

Steps to create a Plan (Summary) report

To generate the Plan (Summary) report in TestRail, you need to put a few configuration settings in place.

Navigate to the project for which you would like to create a test report. Then, navigate to Reports.

On the right side, you will see a pane titled Create a Report. Click on the Plan report under the Summary section. 

On Add Report page, you will find 3 main sections: 

• Name and Description
• Report Options
• Access & Scheduling

Follow the below steps to configure each section

1. Name and Description

   Enter the report's name and description in their respective fields.

2. Report Options

   On the Add Report page, scroll down to Report Options. Here, you will see three tabs, TEST PLAN & DETAILS, ACTIVITY, and TESTS.

   TEST PLAN & DETAILS

   On the TEST PLAN & DETAILS tab, you can select the test plan you want to use for the report from the dropdown menu.

   You can also select the general sections to include in the report: Status and test statistics, Activity (results over time), Progress and remaining estimate/forecast, Tests, and test results.

   

   ACTIVITY

   You can select the time frame for the report. You can select between today and past dates.

   

   1. You can select the time frame for the report. You can select between today and past dates.
      
   2. By default, all test cases are included. To show only test cases with specific statuses, hold ctrl + click one or more: Passed, Blocked, Untested, Retest, Failed, In Progress.
   3. Select the maximum number of activities to display on the report, (from newest to oldest). 10, 25, 50, 100, 250, 500, or 1000 (maximum).

   TESTS

   You can do the following under the TESTS tab:

   1. Filter the tests to be displayed in the report by any case field—including custom case fields—except text fields, like Assigned to, Estimate, Priority, etc. 
      
      
      
   2. Choose the column(s) to include in the tables displaying tests' information in the report. The default columns include ID and Title. Depending on the information you want to display, you can add additional columns such as Type (of the test), Priority, etc.
   3. Set the maximum number of tests to display per group. The maximum number can be 10, 25, 50, 100, 250, 500, or 1000.

    

3. Access & Scheduling

   This section enables users to set access and scheduling options. For more details, please refer to the General configurations guide.

Finally, scroll down and click Add Report to generate the report.

Reading a Plan (Summary) report

It may take minutes to generate your report depending on the data included. However, once the report is fully generated, the next thing is to view and interpret it. To view the report, go to Reports and click on the appropriate report under the list.

Test Plan & Details

Status and test statistics – A quick view into whether the test plan is complete, how many test cases are marked as Passed, and how many have not yet run. Typically, a test plan is completed when there are no more untested items.

If you hover over a section of the pie chart, you can see an overview of the number of test cases and the percentage of all test cases on the report.

Underneath the chart is a table that lists the milestone that this test plan is associated with, along with the creation date and completed status. 

Users can see a list of test runs that are attached to the plan. Each of the rows shows a test run with its percentage of test cases marked Passed on the right column. To the right of the titles are labels that indicate which device the test run was created for. Users can click the titles to open a details page for each.

Activity

Activity (results over time) – A snapshot of statuses for all test cases that ran during the time frame you selected on the Activity tab during configuration. The overview of the test case activity is shown as a graph.  Users can see details about test status per day, by hovering over the peaks of each line.

If there is any activity available during the timeline, a list of all test cases that ran for the plan shows underneath the graph. 

To the right, each row will list the name of the user who triggered the test run or manually marked the status as retest or blocked. 

Progress and remaining estimate/forecast – A view of remaining tests to complete and remaining effort needed, against ideal progress. The high-accuracy forecast further breaks down the projected completion date based on current activity and forecast, giving team leaders a side-by-side hours estimate of progress.

The high-accuracy forecast further breaks down the projected completion date based on current activity and forecast, giving team leaders a side-by-side hours estimate of progress.

Underneath Forecasts & Estimates is a list of test runs. The device type is listed to the right of the titles, and the titles link to more details.

Tests

Tests and test results – List of tests organized by test run. Each line includes test ID, name, status, and any other columns the user added when configuring the report. Clicking the ID or Title will open a details page for that test case. Each row lists details in the Type column based on what was selected when each test case was created.