This question is locked. New answers and comments are not allowed.
After spending several months in automation I have now a suite of tests (each one <10 min.) that take some 24h in total to execute. This is too long. I need to split the execution across several machines to cut down the execution time.
Is there any tool that would deal with deployment & execution of tests on distributed environment so that tests run in parallel?
I heard about Selenium Grid, but it seems to work with selenium tests only (it doesn't deploy tests to test machine).
Is there any tool that would deal with deployment & execution of tests on distributed environment so that tests run in parallel?
I heard about Selenium Grid, but it seems to work with selenium tests only (it doesn't deploy tests to test machine).
3 Answers, 1 is accepted
0
Hello Wit,
The first obstacle to watch out for is you can't have multiple tests running in parallel on the same machine at the same time. You'll get conflicts anytime some sort of desktop interaction needs to happen in a test.
Do you have any sort of build infrastructure in place now? One idea would be to split up your tests into multiple Visual Studio test lists, setup multiple test agents, and have your TFS server (assuming you have one) order different test lists to be executed by the different test agents. This would achieve the parallel execution you seek.
Sincerely yours,
Cody
the Telerik team
The first obstacle to watch out for is you can't have multiple tests running in parallel on the same machine at the same time. You'll get conflicts anytime some sort of desktop interaction needs to happen in a test.
Do you have any sort of build infrastructure in place now? One idea would be to split up your tests into multiple Visual Studio test lists, setup multiple test agents, and have your TFS server (assuming you have one) order different test lists to be executed by the different test agents. This would achieve the parallel execution you seek.
Sincerely yours,
Cody
the Telerik team
Do you want to have your say when we set our development plans?
Do you want to know when a feature you care about is added or when a bug fixed?
Explore the
Telerik Public Issue Tracking
system and vote to affect the priority of the items
0
Wit
Top achievements
Rank 1
Rank 1
answered on 18 Sep 2010, 01:55 PM
That's only a half satisfactory solution. When one test agent breaks or script hangs then all tests of that batch are stalled.
Ideal solution would allocate tests one by one to available machines. This way only some tests that caused a crash/hang etc. would not be completed.
Proper solution would also restart such test agent.
I used to work once with such tool but it was internal solution of one corporation.
Ideal solution would allocate tests one by one to available machines. This way only some tests that caused a crash/hang etc. would not be completed.
Proper solution would also restart such test agent.
I used to work once with such tool but it was internal solution of one corporation.
0
Hello Wit,
I understand your goal and will log this as a feature request. We are working on an advanced scheduler for our QA edition but it's going to take us a while to finish it's implementation... maybe later this year or early next year.
Our WebAii tests work just like Microsoft coded Unit Tests. If you can find a way of dividing up Unit Tests across multiple test agents using Microsoft's tools, then you should be able to do the same thing with Webaii tests. I am sorry bug I am not aware of how to do it the way you want at this time.
Regards,
Cody
the Telerik team
I understand your goal and will log this as a feature request. We are working on an advanced scheduler for our QA edition but it's going to take us a while to finish it's implementation... maybe later this year or early next year.
Our WebAii tests work just like Microsoft coded Unit Tests. If you can find a way of dividing up Unit Tests across multiple test agents using Microsoft's tools, then you should be able to do the same thing with Webaii tests. I am sorry bug I am not aware of how to do it the way you want at this time.
Regards,
Cody
the Telerik team
Do you want to have your say when we set our development plans?
Do you want to know when a feature you care about is added or when a bug fixed?
Explore the
Telerik Public Issue Tracking
system and vote to affect the priority of the items