TestRail is a powerful test management tool that helps teams organize, track, and analyze their testing efforts. But to truly optimize your testing workflow, you need efficient test automation. That’s where Ranorex comes in.
By integrating Ranorex with TestRail, you can automate UI tests and push results directly into TestRail, ensuring a seamless connection between test execution and reporting. This article walks you through the integration process, so you can enhance test coverage, improve efficiency, and streamline reporting.
What is Ranorex?
Ranorex is an all-in-one UI test automation tool for desktop, web, and mobile applications. It offers a full IDE with open APIs, intelligent code completion, refactoring, and debugging for automation experts.
Users can leverage its capture-and-replay tools and built-in methodology to create reliable, maintainable tests while learning automation. Ranorex also enables cross-functional team collaboration through shared object repositories and test automation modules. Additionally, it is backed by a dedicated support team to ensure user success.
Key benefits:
- Maximize resources: Expand test coverage and support fast-paced release cycles while controlling costs.
- Empower every skill level: Build sophisticated tests with easy-to-use tools for codeless automation; plus a full IDE.
- All-in-one solution: Automate desktop, web and mobile tests on legacy platforms or the latest technologies.
- Simple integration: Synchronize test cases with Ranorex Studio and get real-time testing feedback in TestRail.
Why integrate Ranorex with TestRail?
As a TestRail user, you already know the importance of efficient test case management in delivering high-quality software. But to truly accelerate your testing cycles and increase test coverage, you need powerful UI test automation—and that's where Ranorex Studio comes in.
By integrating TestRail’s structured test management with Ranorex’s robust automation, you can:
- Eliminate repetitive manual testing – Use data-driven automation to cover corner, edge, and boundary cases without repeating the same test steps for different data values.
- Speed up release cycles – Run automated regression tests overnight and in parallel, ensuring that you get rapid feedback on application quality.
- Enhance test stability – Ranorex’s reliable object recognition and built-in best practices keep your tests stable, even as your application evolves.
- Free up your QA team – With less time spent on routine test execution, your testers can focus on exploratory, UX, and high-value test scenarios.
- Seamlessly integrate into your workflow – Ranorex supports a wide range of technologies, making it easy to automate tests across desktop, web, and mobile applications, all while managing everything in TestRail.
By combining TestRail with Ranorex Studio, you’re not just automating tests—you’re maximizing efficiency, improving software quality, and delivering high-velocity feedback essential for DevOps success.
- Save time: Automate repetitive UI tests and focus on more critical tasks.
- Improve accuracy: Reduce human error by running consistent automated tests.
- Seamless reporting: Automatically send test results to TestRail for better tracking and analysis.
- Better collaboration: Centralize manual and automated test results in one place for better team insights.
Step-by-Step guide to Integrate Ranorex result with TestRail
Step 1: Set Up Your TestRail API
To enable communication between Ranorex and TestRail, you’ll need to use the TestRail API. Log in to TestRail and go to Administration Site Settings API. Enable the API if it’s not already active.
Note your TestRail instance URL, username, and API key (found in your user settings).
Step 2: Set Up Permissions
Depending on how you use the integration, the TestRail user account must have certain permissions.
To set them, go to Administration > Users & Roles and create a role with the appropriate permissions or change the permissions of an existing role.
- Import into Ranorex Studio: No permissions are required.
- Export to existing projects: Add/Edit Cases & Sections, Suites.
- Export to new projects: You need to be an admin on TestRail.
- Report results to an existing TestRail run: Add/Edit Test Results, Add/Edit Attachments.
- Report results to a new TestRail run: Add/Edit Runs & Plans, Add/Edit Test Results, Add/Edit Attachments.
Step 3: Setup Automation Type field
Ranorex Studio imports and synchronizes only TestRail cases that are marked as automated for Ranorex.
- TestRail 5.5 and later: The Automation Type drop-down field is already present by default. Simply set it to Ranorex.
- TestRail 5.4 and earlier: You will need to add a custom field to the user interface for importing and exporting to work correctly.
- Go to Administration > Customizations > Case Fields
- Add a field with the following values:
- Label: Automation Type
- System Name: automation_type
- Type: Dropdown
- Click Add Projects & Options and specify Ranorex as Option 1. Click the Selected Projects tab and apply the field to your projects.
Step 4: Required custom fields
If your TestRail project uses required custom fields, ensure required fields have default values. Otherwise, export/sync can fail because Ranorex Studio cannot infer which value to populate.
Fixing this error is explained in Importing, exporting, synchronizing.
Step 5: Configure Your Ranorex Instance using the TestRail Wizard
- In Ranorex Studio, open the solution you want to work with.
- Go to Tools > TestRail integration > Start TestRail wizard.
- In Connect to TestRail, enter:
- Server address
- Credentials
- Click Sign in.
Tip: The server address applies to both TestRail on-premises and TestRail Cloud. You can copy it from your browser’s address bar.
After signing in, the wizard takes you to Import/Export, where you can import, export, and set up the connection. See Importing, exporting, synchronizing.
Next steps
- Import/export and configure mapping: Importing, exporting, synchronizing.
- Run tests and report results (including evidence uploads): Running tests and reporting to TestRail.
- Team workflows and source control: Collaboration.
-
TestRail YAML Connection Credentials.