Test order when using test lists

[Josh]

Before the major updates, when running multiple test lists, tests would run first in order of test lists, then in order of tests.

Now they run in order of tests alone, disregarding test lists.

What is the reason for this change? Do we have / can we get the option to run them either way?

I'm aware that tests are meant to be scoped so they can be run entirely individually but due to the way we use a custom-made DLL to monitor performance in coded steps, our tests are meant to be run in the order we specify. This is largely because of differentiating cold/warm/hot caching tests (so the cold cache tests have to be run first).

If you can't change this back or at least give us the option, we'll have to stick with your earlier version which is obviously not ideal.

[Ivaylo]

Hello Josh,

Please excuse me for the delayed reply. I have logged a bug on your behalf and opened a feedback item which you can review using this public URL.
Unfortunately the only workaround on this we can offer is to put all your tests in a single test list and do the order the way you would like your tests to be executed.

Thank you for your understanding regarding this matter.

Regards,
Ivaylo
Telerik

[Josh]

Thanks Ivaylo, I really hope that this gets fixed soon as it's a major issue for us.

[Ivaylo]

Hello Josh,

The priority of the bug has been raised, however I'm not able to commit with exact time frame on when this will be fixed.

Thank you for your understanding and patience regarding this matter.

Regards,
Ivaylo
Telerik