Hello,

based on the feedback we've received so far on this forum, by email and from customers we visited on-site, we are looking into introducing a new feature (set) that we originally planned to add in a later version, namely configuration and test plan support. Please note that we are also looking at other new features, but we want to get more feedback about this particular feature in this thread.

This feature would basically allow you to easily start multiple test runs at once and group the resulting runs in a test plan. We would also add support for configurations, while a configuration can be any variation a project needs to be tested against (different operating systems, browser versions, databases etc).

When you select to test a suite against specific configurations, TestRail would automatically create a run for each configuration combination you specified. To make it easier to have a standard test plan for your projects, we would also add a feature to easily save and load test plan templates. From our view, adding test plan and configuration support would help with the following issues:

• Making it really easy to start multiple related test runs at once

• Specify configurations to start multiple test runs for configuration combinations. We expect this to be a very common task/situation

• Providing a way to save/load complex test plans from templates. If you regularly want to start runs for multiple suites (e.g., your full project release test), having a way to do this with just a few clicks is important

• Because we expect users to have many test runs active at the same time for bigger projects, the resulting runs of a test plan would be grouped together on the overview pages to make them easier to comprehend

Before we consider implementing this feature, we want to gather a bit more feedback about this and ask for your comments and ideas. To make it easier for you to understand how we would implement such a feature, we've created the following detailed mockups.

One of our design goals of this feature is that it's completely optional. If you just want to start single test runs, you can ignore this feature and don't have to create any test plans. If, however, you have some more complex requirements, you can benefit from this in addition to the existing functionality.

Mockups
The following mockup shows the modified Test Run overview page. In addition to listing single test runs, this page would also include all active test plans and provide a way to add new ones:

Click here for full version

And the following page shows the Add Test Plan page, where you can create a new test plan and start multiple test runs. You can add test suites to your test plan, configure all run settings (assignment, name, cases to include) and assign configurations:

Click here for full version

We welcome any ideas, comments and questions about the mockups and feature idea. It would also be great if you could tell us if and how this feature would help you. Thanks!

Regards,
Dennis