For teams that use Azure DevOps Cloud, TestRail comes with a Azure DevOps app that you can install in your Azure DevOps instance for free. Once you install the app, you can enable the Azure DevOps board add-on to view TestRail data relating to test results, cases, runs, milestones, and plans right within Azure DevOps issues that you’ve linked as References or Defects in TestRail.
Please note that each Azure DevOps user who wishes to use the free Azure DevOps app will need to be logged into a valid TestRail account.
You can also add new test cases, kick off new test runs from Azure DevOps, and review the overall progress of your testing by viewing dashboards for individual projects and overall activity in your TestRail instance.
To install the Azure DevOps app, go to the Marketplace, search for the TestRail Azure DevOps app add-on and click Install.
As of TestRail 10.3.1, the app is available only for Azure Devops Cloud and can connect to TestRail Cloud and Server. The Azure DevOps Server version will be released in a later date to be announced.
TestRail Azure DevOps Panel
Once you have successfully installed the TestRail Azure DevOps add-on, and once you enter your instance, the "TestRail: Results" panel is located by default on one of the narrow panels of the Azure DevOps' work item details area.
We recommend you to move the "TestRail: Results" panel to the wider (main) panel of Azure DevOps work item view. This way you have a better view and control of it:
- Go to Organization settings.
- Under Boards, click Process.
- Select where the TestRail app will be used (e.g. Basic, Agile, etc).
- Click the (...) button and click Create inherited process.
- Inside the new window, enter the new process name (e.g. "TestRail View") and click Create Process.
- Once the child process is created, select it.
- Click the Work Item name you wish to customize (e.g. "Epic").
- Drag and drop the "TestRail Results" panel to the wider area under Description.
You can now view the "TestRail Results" panel in a more comfortable and familiar way.
TestRail Results section in the Azure DevOps issue view
To open TestRail: Results in your customized Azure DevOps panel, click Show to expand the section and see the test information.
The new section show tabs with the information referenced in TestRail in each entity type, as you can see in the blue buttons panel in the image below.
Clicking each tab should show you all the results you link from Azure DevOps to TestRail that you specifically want to see. All the information you see will be any result linked to that specific Azure DevOps issue as a Reference and/or Defect from your TestRail instance.
For example, you could link a test case to a Azure DevOps issue. Under the Cases tab, you will see all the times that test case was tested and access them directly from the Work Item while also getting all the information you need with a drop-down option (highlighted in the below screenshot) for each element to see extra details.
Similarly, you can see results under any of the other tab options once you've linked them in TestRail.
This information can be seen in a very similar way as you see it in your TestRail instance, making it easier to interpret and access.
Test cases and test runs in the issue view
To quickly link new Cases and Runs in Azure DevOps, you can do it directly from the right side menu in each issue, clicking Add Test Case and Add Run buttons.
Once you click either one, a small section should appear underneath the Add Test Case / Add Run button where you can choose from a small dropdown a TestRail project in which you can quickly create the new case or run.
This action will take you to the Add Test Case or Add Test Run page in your TestRail instance, where you can configure a case or a run. You should notice that the Azure DevOps issue ID has already been added to the References field, thus creating traceability between the Azure DevOps issue and TestRail entity.
You can check if the reference was successfully linked to the issue by refreshing the Azure DevOps page and rechecking the corresponding tab under TestRail: Results to see the reference details.
That way, the case or run can be linked to the Azure DevOps issue and be verified for easy access from your instance directly.
To link existing test cases or runs (from TestRail) to a Azure DevOps issue, you need to access the case or run from your TestRail instance and click Edit. After editing the References field in TestRail, simply click on Save and refresh the Azure DevOps issue page. The newly added details will appear in the corresponding tab, the same way as explained above.