This is a migrated thread and some comments may be shown as answers.

Test order when using test lists

3 Answers 72 Views
General Discussions
This is a migrated thread and some comments may be shown as answers.
Josh
Top achievements
Rank 1
Josh asked on 24 Sep 2013, 03:02 AM
Before the major updates, when running multiple test lists, tests would run first in order of test lists, then in order of tests.

Now they run in order of tests alone, disregarding test lists.

What is the reason for this change? Do we have / can we get the option to run them either way?

I'm aware that tests are meant to be scoped so they can be run entirely individually but due to the way we use a custom-made DLL to monitor performance in coded steps, our tests are meant to be run in the order we specify. This is largely because of differentiating cold/warm/hot caching tests (so the cold cache tests have to be run first).

If you can't change this back or at least give us the option, we'll have to stick with your earlier version which is obviously not ideal.

3 Answers, 1 is accepted

Sort by
0
Ivaylo
Telerik team
answered on 27 Sep 2013, 08:10 AM
Hello Josh,

Please excuse me for the delayed reply. I have logged a bug on your behalf and opened a feedback item which you can review using this public URL.
Unfortunately the only workaround on this we can offer is to put all your tests in a single test list and do the order the way you would like your tests to be executed.

Thank you for your understanding regarding this matter.

Regards,
Ivaylo
Telerik
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
Josh
Top achievements
Rank 1
answered on 29 Sep 2013, 08:57 PM
Thanks Ivaylo, I really hope that this gets fixed soon as it's a major issue for us.
0
Ivaylo
Telerik team
answered on 01 Oct 2013, 01:26 PM
Hello Josh,

The priority of the bug has been raised, however I'm not able to commit with exact time frame on when this will be fixed.

Thank you for your understanding and patience regarding this matter.

Regards,
Ivaylo
Telerik
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
Tags
General Discussions
Asked by
Josh
Top achievements
Rank 1
Answers by
Ivaylo
Telerik team
Josh
Top achievements
Rank 1
Share this question
or