Parallel execution of tests

4 posts, 0 answers
  1. Wit
    Wit avatar
    24 posts
    Member since:
    Jul 2010

    Posted 16 Sep 2010 Link to this post

    After spending several months in automation I have now a suite of tests (each one <10 min.) that take some 24h in total to execute. This is too long. I need to split the execution across several machines to cut down the execution time.
    Is there any tool that would deal with deployment & execution of tests on distributed environment so that tests run in parallel?
    I heard about Selenium Grid, but it seems to work with selenium tests only (it doesn't deploy tests to test machine).
     
  2. Cody
    Admin
    Cody avatar
    3354 posts

    Posted 17 Sep 2010 Link to this post

    Hello Wit,

    The first obstacle to watch out for is you can't have multiple tests running in parallel on the same machine at the same time. You'll get conflicts anytime some sort of desktop interaction needs to happen in a test.

    Do you have any sort of build infrastructure in place now? One idea would be to split up your tests into multiple Visual Studio test lists, setup multiple test agents, and have your TFS server (assuming you have one) order different test lists to be executed by the different test agents. This would achieve the parallel execution you seek.

    Sincerely yours,
    Cody
    the Telerik team
    Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items
  3. Wit
    Wit avatar
    24 posts
    Member since:
    Jul 2010

    Posted 18 Sep 2010 Link to this post

    That's only a half satisfactory solution. When one test agent breaks or script hangs then all tests of that batch are stalled.
    Ideal solution would allocate tests one by one to available machines. This way only some tests that caused a crash/hang etc. would not be completed.
    Proper solution would also restart such test agent.
    I used to work once with such tool but it was internal solution of one corporation.
  4. Cody
    Admin
    Cody avatar
    3354 posts

    Posted 22 Sep 2010 Link to this post

    Hello Wit,

    I understand your goal and will log this as a feature request. We are working on an advanced scheduler for our QA edition but it's going to take us a while to finish it's implementation... maybe later this year or early next year.

    Our WebAii tests work just like Microsoft coded Unit Tests. If you can find a way of dividing up Unit Tests across multiple test agents using Microsoft's tools, then you should be able to do the same thing with Webaii tests. I am sorry bug I am not aware of how to do it the way you want at this time.

    Regards,
    Cody
    the Telerik team
    Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items
Back to Top