This is a migrated thread and some comments may be shown as answers.

Distributed Remote Execution using ArtOfTest.Runner

5 Answers 81 Views
General Discussions
This is a migrated thread and some comments may be shown as answers.
David
Top achievements
Rank 1
David asked on 20 Jan 2020, 03:12 PM

Hello

I'm trying to find documentation around  how to use ArtOfTest.Runner to execute tests remotely distributed across machines.

We're planning to use Azure Devops which I've setup the agents. 

I've been unable though to find using CLI how to have tests execute distributed in a remote fashion.

We have 4 remote servers (1 controller, 3 runtimes)

I'm hoping to be able to distribute execution of a test list across those machines using ArtOfTest.Runner.

5 Answers, 1 is accepted

Sort by
0
Plamen Mitrev
Telerik team
answered on 21 Jan 2020, 01:05 PM

Hello David,

Thank you for contacting us and sharing details about the setup that you want to create. 

You can find more details and guidelines on how to setup Azure DevOps for continuous integration here. Each agent should be configured to execute a specific test list and it uses the ArtOfTest.Runner.exe to do that. You can adjust other options options and test list settings for the test list execution.

The above way to configure your environment should allow you to distribute the test lists across different execution machines. Please do not hesitate to contact us again, if you need further assistance, or any questions arise. 

Regards,
Plamen Mitrev
Progress Telerik

 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
David
Top achievements
Rank 1
answered on 21 Jan 2020, 01:58 PM

Thanks Plamen.

I did go through the two documents you referenced above.  
Unless I missed something I don't believe either of those specifically describe how to execute tests across a distribution of servers in a similar fashion to the functionality "remote execution" that's built into Test Studio.

Is there a setup you can suggest that would allow for this functionality?

0
Plamen Mitrev
Telerik team
answered on 21 Jan 2020, 02:29 PM

Hi David,

The remote execution functionality in Test Studio works with the scheduling service and that takes care of the test list execution. When you take the route of continuous integration with Azure DevOps or other build server, you need to configure the build agents yourself. To do that, you need to follow the steps below.

  1. Add the agent on the execution machine.
  2. Add new "Command line" task for each test list that you want to execute on that agent.
  3. Configure the task to use the ArtOfTest.Runner.exe and specify the test list's path and additional options.

You can add multiple task for that agent and create other agents to utilize all execution machines in your setup. That is how you can distribute test lists in Azure DevOps across your setup with ArtOfTest.Runner.exe.

I hope the above details will help you get things on the way. If you encounter any troubles, please get back to me with more details about the configurations and environment on your end and I will do my best to advise you further.

Thank you for your understanding and cooperation.

Regards,
Plamen Mitrev
Progress Telerik

 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
David
Top achievements
Rank 1
answered on 23 Jan 2020, 04:39 PM
Got it! Thanks Plamen as always for your thorough responses :)
0
Plamen Mitrev
Telerik team
answered on 27 Jan 2020, 01:17 PM

Hi David,

I am happy to help you with anything related to Test Studio.

Please do not hesitate to contact us again, if you have follow up questions.

Regards,
Plamen Mitrev
Progress Telerik

 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
Tags
General Discussions
Asked by
David
Top achievements
Rank 1
Answers by
Plamen Mitrev
Telerik team
David
Top achievements
Rank 1
Share this question
or