Reporting Use Cases

Overview

TestRail provides numerous reporting capabilities with centralized reporting found with the Reports module. This article will focus on specific use cases that TestRail reporting can be leveraged to enhance your team's visibility and monitoring of testing activities throughout the software development lifecycle (SDLC).

Monitoring Testing Traceability

A critical aspect during software testing is ensuring that defined requirements that have been implemented are adequately validated by functional and/or non-functional tests. The below provides a breakdown on how to generate requirements and defect traceability reports using TestRail.

Test Cases With Linked Requirements

Purpose: Shows all test cases that have one or multiple linked requirements (references field)

Report/Template To Use: Coverage for References Report

Setup Steps:

      1. Navigate to the TestRail reporting module

      2. Select the report template "Coverage for References"

      3. Update the report name and description to "Test Cases With Linked Requirements"

      4. In the "Test Cases" section, select only the "Test cases with references" option

      5. Select the desired accessibility and report creation settings

      6. Generate the report by clicking "Add Report"

Test Cases Without Linked Requirements

Purpose: Show all test cases that have NO requirements/traceability linked (empty references test case field)

Report/Template To Use: Coverage for References Report

Setup Steps:

      1. Navigate to the TestRail reporting module

      2. Select the report template "Coverage for References"

      3. Update the report name and description to "Test Cases Without Linked Requirements"

      4. In the "Test Cases" section, select only the "Test cases without references" option

      5. Select the desired accessibility and report creation settings

      6. Generate the report by clicking "Add Report"

Test Executions With Linked Defects

Purpose: Show test cases and corresponding test runs that have failed validation and are associated with a linked defect

Report/Template To Use: Summary for References (Defects) report

Setup Steps:

      1. Navigate to the TestRail reporting module

      2.  Select the report template "Summary for References" in the "Defects" section

      3. Update the report name and description to "Test Executions With Linked Defects"

      4. In the "Test Cases" section, click the "Add Test Runs" link to add desired test runs to report on

      5. Select the desired accessibility and report creation settings

      6. Generate the report by clicking "Add Report"

Viewing Release Testing Activities 

Leveraged commonly by teams for release end summary of all testing activities and/or to facilitate stakeholder approvals, release summary reports provide an overall view of all testing activities associated to a release (milestone) event. These insights are restricted to milestones that are configurable/user defined within TestRail.

Release Test Execution Summary

Purpose: Shows all test executions associated to a given release (milestone)

Report/Template To Use: Milestone Summary Report

Setup Steps:

      1. Navigate to the TestRail reporting module

      2. Select the report template "Milestone" in the "Summary" report section

      3. Update the report name and description to "Release <version here> Test Execution Summary"

      4. In the "Milestones & Details" section, select only the desired release milestone

      5. Select the desired accessibility and report creation settings

      6. Generate the report by clicking "Add Report"

Managing Release Testing Workload 

With the demands of software teams always increasing, engineering and testing leadership routinely manage and assess workload and status of testing assignments for a given release (milestone). The below reporting will help facilitate tracking and workload summary of testing assignments within TestRail.

Purpose: Show a breakdown of workload and testing assignments for a given release (milestone)

Report/Template To Use: Workload Summary Report

Setup Steps:

      1. Navigate to the TestRail reporting module

      2. Select the report template "Workload Summary" in the "Users" report section

      3. Update the report name and description to "Release <version> Testing Workload Report"

      4. In the "Users & Details" section, select only the desired team members or include all users in TestRail.

      5. In the "Tests" section, select criterion to filter the report. In the example below a date range is being used to filter user workload within the last month

      6. In the "Sections & Tests" section, select one or multiple test runs 

      7. Select the desired accessibility and report creation settings

      8. Generate the report by clicking "Add Report"

Was this article helpful?
0 out of 2 found this helpful