Projects (Test Execution) Summary

Overview

This report - available for Enterprise license plans only - provides a global view of quality status across all projects, with a side-by-side comparison of individual project statuses, helping identify which projects need more attention, which are closer to completion, and supporting go/no-go decisions for each project.

Creating a report

Prerequisites

To enable Cross-Project Reports, go to Administration Users & Roles Edit Role or contact your Administrator, and ensure appropriate permissions are granted:

Steps

To generate this report, you need to select a few filtering and other viewing options. Navigate to Cross-Project Reports under the Dashboard.

On the left side pane titled Create Cross-Project Reports, click Project Summary under the Test Execution section. 

On the Add Report page, you will find three main sections: 

• Name and Description;
• Report Options: as described below;
• Access & Scheduling: as described below.

Report Options

Scroll down to Report Options. You will see three tabs: Test Details, Project and Milestones and Activity.

Details

On this tab, you can filter which type of milestones and test runs and plans to include, based on their characteristics.

Projects and Milestones

Here, you can:

a) Select specific projects, while making use of the Search and Filter (Active/Completed) options:

b) In case you selected Select specific milestones on the previous tab, click the arrow to expand and see the selected project's milestones. Here too, you can make use of the same Search and Filter options and select the milestones you wish to include in the report.

Activity

1. Select the time frame, between today and past dates, including the entire project duration.
2. Select one or more test statuses.

Finally, you can choose whether or not to include links to project data accessible in TestRail and move to the next section...

ACCESS & SCHEDULING

In this section at the bottom of the page, select publishing and sharing preferences.

1. Choose whether to share broader than the admin group.
2.  Select one or more options for when to create the report: Right now, On demand via the API (read API referencce), Schedule this report.

   Option	Description
   Right now	The report will load and send notifications as soon as the user publishes.
   On demand via the API	The report will be triggered to publish based on the API call.
   Schedule this report	The report will be published at a specific time and date. The user can set the report to publish on recurrence.

   
   

3. Finally, select who and how you want to share the report with. Please note that:
   1. Users who do not have access to all selected projects will not be able to access the report via link;
   2. To share outside your organization, insert external email addresses and select whether they receive PDF or HTML copy;
   3. While sending the reports as an HTML attachment allows for interaction (hover-over graphs and expand/collapse tables), some email providers block them.  In that case you can use PDF attachments, which work best for small reports where not much scroll is needed.

Ok! Your Cross-Project Report is all set up now! Scroll down and click Add Report to generate it.

Reading the report

It may take a few minutes to generate your report depending on the data included. However, once the report is fully generated, the next thing is to view and interpret it. To view the report, go to Cross-Project Reports and click on the appropriate report under the list.

Header

Here you can find information about when and by whom the report was created, as well as which filters were used.

Projects included in the report

This section highlights the number of projects in the report. Administrators can configure which statuses are to account for as executed or unexecuted.

Test Execution(s)

Here, you can see the distribution of test statuses for the aggregation of the projects.

Top Testing Insights

This section highlights the top five projects which have the highest passed and failed percentages, as well as executed and unexecuted tests percentages.

Status Breakdown (Active)

The Status Breakdown covers the active projects, while the completed projects are covered in the next section. Here you can see detailed status information for each project, as well as figures relating to the number of selected milestones and related test plans, test runs and tests. You can hover over the graph to see more details, and expand the table below to see milestone data.

Completed Projects

This section shows the same information as the previous one, but only for completed projects.

Expand and Collapse

Since the tables in this report can get quite long when expanded, you can use the Expand and Collapse buttons on the top header of the report to ease your navigation and choose between a more compacted or more detailed view of the report.