Scheduling Server and Test Runner problem

10 posts, 0 answers
  1. Jin Khai
    Jin Khai avatar
    11 posts
    Member since:
    Mar 2018

    Posted 25 Mar Link to this post

    Currently I am using my own machine to write test case using Telerik Test Studio,

    and I setup 2 Virtual machine at within the same network subnet IP address, in order to test the "Run test remotely" functionality.

    So I have machine: TestRunner1 and TestRunner2

    The scheduling server and data services i Setup on TestRunner1 as well.

    I wrote 4 test cases, and put them into 2 test lists, eg: TestList1 = 2 test cases, TestList2 = 2 test cases

    Sometimes when i run certain test cases on either one of the TestRunner machines, the test cases hangs and then TestRunner machine stays at "Busy" state, but I see that nothing is running on the machine using remote desktop. But sometimes the test lists pass successfully.

    The "distribute test lists" also never works well, none of the test lists being executed, and both TestRunner machines stays at "Busy" state.

    Need some help, my company is evaluating this product and we need to run on probably 200-300 Test Runner machine at same time.

  2. Nikolay Petrov
    Admin
    Nikolay Petrov avatar
    308 posts

    Posted 29 Mar Link to this post

    Hi Jin,

    Thank you for your interest in Test Studio.

    The scheduling setup depends on an open network communication between machines in the configuration. Please, verify that there are no firewall or other restrictive software available on any of the machines.
    Further on, you have to keep the remote session active during the test execution in order to have any of the recorded desktop actions executed on the execution agents.
    These are the most common problems when using remote execution configuration. There could be more specific problems related to the current application under testing as well.

    Additional information related to the test execution and problems in the setup could be present in each machine application log. To get the information in the log - it has to be enabled and cleared before reproducing the problem.

    Some part of our customers have CI configuration and use only the command line ArtOfTest.Runner to execute tests in scheduled builds. It's up to the specific needs of your company automation policy to choose which approach will suit best.

    Please, let us know if you need additional directions or assistance.

    Best Regards,
    Nikolay Petrov
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Jin Khai
    Jin Khai avatar
    11 posts
    Member since:
    Mar 2018

    Posted 05 Apr in reply to Nikolay Petrov Link to this post

    Thanks, sorry it took me more times to reply because I am a little bit busy with other stuffs.

    I have tried the https://docs.telerik.com/teststudio/knowledge-base/scheduling-kb/keep-active-session method. so far it looks stable. the only bad thing is it didn't work again if i minimize the RDC. I have try https://docs.telerik.com/teststudio/knowledge-base/test-execution-kb/minimized-rdc but unfortunately it didn't work on Windows Server 2016.

    But resizing the RDC and keep it open did not break any tests.
    But anyhow your solution solved my the other problem too https://www.telerik.com/forums/upload-file-in-chrome-not-working-when-user-inactive

    I disagree with you that this only happened to Windows OS limitation, I personally have tried on Selenium framework. they don't have this issue. It seems like limitation on Telerik instead.

     

    Any how i can extend my trial? because i left 14 days and i need to try a few more complicated test cases like scrolling on web pages and etc JavaScript responsive web page.

     

    I do noticed that if I restart the scheduling services at the other VM, my currently local Test Studio that connected to it will crashed.

     

    Can console ArtOfTest run "distribute test cases"?

     

     

  4. Ivaylo
    Admin
    Ivaylo avatar
    775 posts

    Posted 10 Apr Link to this post

    Hello Jin,

    Please note that in Selenium all the tests are running on locked machine because most test steps don't use the mouse or keyboard. Instead they are able to inject events (like a Click or Select) directly into the DOM structure of the page while in Test Studio we are simulating system-wide mouse moves and mouse clicks instead. This is where we hit the Windows OS limitation. If you are using our Testing Framework for example you'll get the same experience as in Selenium, however you will not be able to use the full feature set that Test Studio offers.

    Regarding extending trial please contact our sales department as we from the engineering are not allowed to extend trials. 

    We are sorry to hear the Test Studio instance is crashing, please submit a separate ticket with the detailed repro steps and include all the logs so we can investigate this behavior. Please note that you need only one scheduling service installed.

    You can distribute test runs using the scheduling feature as shown in this article, unfortunately you cannot use the console.

    Should you have any additional questions let us know.

    Regards,
    Ivaylo
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. Jin Khai
    Jin Khai avatar
    11 posts
    Member since:
    Mar 2018

    Posted 11 Apr in reply to Ivaylo Link to this post

    It seems like not true.

    From this documentation:
    https://docs.telerik.com/teststudio/features/scheduling-test-runs/tts-command-line-client

    It seems like i can run the ArtOfTest console and setup parameter as "-d" to distribute the test case

    Please double confirm.

  6. Ivaylo
    Admin
    Ivaylo avatar
    775 posts

    Posted 13 Apr Link to this post

    Hello Jin,

    Please note that using the command-line client you cannot specify to which execution machines to distribute the tests on. That is why I have not provided this option. However if you would like give it a try and see whether this suits your needs.

    Otherwise use the scheduled approach I've already advised.

    Regards,
    Ivaylo
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  7. Jin Khai
    Jin Khai avatar
    11 posts
    Member since:
    Mar 2018

    Posted 13 Apr in reply to Ivaylo Link to this post

    Ok, i just tried.

    it can run multiple test cases remotely via scheduling server,

    but it can't select which test runner, and it can't schedule a time.

    So means I need to use jenkins or task scheduler to handle that.

  8. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    934 posts

    Posted 18 Apr Link to this post

    Hello Jin,

    All of these features you describe, as my colleague advised, are available in the Test Studio UI in the Test Lists tab - you could choose a machine to run a test list on, to select appropriate time, etc. 

    Please let me know more about the use case you would like to accomplish and what your concerns of using directly the UI are. Please note that if you would like to implement Test Studio in a CI environment we recommend using the ArtOfTest.Runner - please find an example how to setup Jenkins to run Test Studio tests

    I will appreciate any additional detailed notes if you will need further assistance. 

    Thank you in advance! 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  9. Jin Khai
    Jin Khai avatar
    11 posts
    Member since:
    Mar 2018

    Posted 18 Apr in reply to Elena Tsvetkova Link to this post

    Yes understood. but I might use jenkins to execute those tests after the build has completed.
    So i have to use command client.
  10. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    934 posts

    Posted 20 Apr Link to this post

    Hello Jin,

    Thank you for getting back to me. Since you might need to use Jenkins then you could rely on the features a Jenkins CI provides for executing tasks in multiple machines environment. I guess here you could find what you need. 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top