Distributed Remote Execution using ArtOfTest.Runner

6 posts, 0 answers
  1. David
    David avatar
    44 posts
    Member since:
    Jun 2019

    Posted 20 Jan Link to this post

    Hello

    I'm trying to find documentation around  how to use ArtOfTest.Runner to execute tests remotely distributed across machines.

    We're planning to use Azure Devops which I've setup the agents. 

    I've been unable though to find using CLI how to have tests execute distributed in a remote fashion.

    We have 4 remote servers (1 controller, 3 runtimes)

    I'm hoping to be able to distribute execution of a test list across those machines using ArtOfTest.Runner.

  2. Plamen Mitrev
    Admin
    Plamen Mitrev avatar
    214 posts

    Posted 21 Jan Link to this post

    Hello David,

    Thank you for contacting us and sharing details about the setup that you want to create. 

    You can find more details and guidelines on how to setup Azure DevOps for continuous integration here. Each agent should be configured to execute a specific test list and it uses the ArtOfTest.Runner.exe to do that. You can adjust other options options and test list settings for the test list execution.

    The above way to configure your environment should allow you to distribute the test lists across different execution machines. Please do not hesitate to contact us again, if you need further assistance, or any questions arise. 

    Regards,
    Plamen Mitrev
    Progress Telerik

     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. David
    David avatar
    44 posts
    Member since:
    Jun 2019

    Posted 21 Jan in reply to Plamen Mitrev Link to this post

    Thanks Plamen.

    I did go through the two documents you referenced above.  
    Unless I missed something I don't believe either of those specifically describe how to execute tests across a distribution of servers in a similar fashion to the functionality "remote execution" that's built into Test Studio.

    Is there a setup you can suggest that would allow for this functionality?

  4. Plamen Mitrev
    Admin
    Plamen Mitrev avatar
    214 posts

    Posted 21 Jan Link to this post

    Hi David,

    The remote execution functionality in Test Studio works with the scheduling service and that takes care of the test list execution. When you take the route of continuous integration with Azure DevOps or other build server, you need to configure the build agents yourself. To do that, you need to follow the steps below.

    1. Add the agent on the execution machine.
    2. Add new "Command line" task for each test list that you want to execute on that agent.
    3. Configure the task to use the ArtOfTest.Runner.exe and specify the test list's path and additional options.

    You can add multiple task for that agent and create other agents to utilize all execution machines in your setup. That is how you can distribute test lists in Azure DevOps across your setup with ArtOfTest.Runner.exe.

    I hope the above details will help you get things on the way. If you encounter any troubles, please get back to me with more details about the configurations and environment on your end and I will do my best to advise you further.

    Thank you for your understanding and cooperation.

    Regards,
    Plamen Mitrev
    Progress Telerik

     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. David
    David avatar
    44 posts
    Member since:
    Jun 2019

    Posted 23 Jan Link to this post

    Got it! Thanks Plamen as always for your thorough responses :)
  6. Plamen Mitrev
    Admin
    Plamen Mitrev avatar
    214 posts

    Posted 27 Jan Link to this post

    Hi David,

    I am happy to help you with anything related to Test Studio.

    Please do not hesitate to contact us again, if you have follow up questions.

    Regards,
    Plamen Mitrev
    Progress Telerik

     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top