Load test will only run locally

46 posts, 0 answers
  1. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 27 Oct 2015 Link to this post

    I have a scheduling server set up which also serves as the storage server.  There are 5 execution servers (including my local computer) all connected to the scheduling server and I am able to run test lists remotely on them.  The question comes when trying to run load tests.  If I do not include my local machine on the "Manage Users" screen, then the "Run this test" button is not enabled and I cannot run a load test, no matter what other computers and VU's have been set up on the "Manage Users" screen.  If I do add my local computer to that list, then the "Run this test" button is enabled, but when I click it, I get a message "sending the test to the scheduling server" but the load test never runs and the "Run this test" button remains disabled until I restart the test studio application.  Below is the error log in that scenario.  Keep in mind that my local machine does have its test runner scheduling connection configured to the proper scheduling server (not localhost or my computername):

    10/27 19:06:44,Telerik.TestStudio.Scheduling.Client.exe(8624:14)] First trace message from pool unnamed thread (managed ID = 14, native ID = 7100).
    [10/27 19:06:44,Telerik.TestStudio.Scheduling.Client.exe(8624:14),Execution] JobValidator.EnsureServiceIsReady() : No drones have been registered- reject job
    [10/27 19:06:44,Telerik.TestStudio.Desktop.exe(2216:42)] First trace message from pool unnamed thread (managed ID = 42, native ID = 8248).
    [10/27 19:06:44,Telerik.TestStudio.Desktop.exe(2216:42),Error] SchedulingTestListRunner.BeginTest() : EXCEPTION! (see below)
         Situation: Error scheduling test list job on local server!
         Outer Exception Type: Telerik.TestStudio.Shared.Communication.Exceptions.NoDronesRegisteredException
         Message: No Drones have been registered with this scheduler
         HRESULT: 0x80131500 (Official ID (if app.) = COR_E_EXCEPTION, Error Bit = FAILED, Facility = FACILITY_URT, Code = 5376)
         Call Stack:
              Server stack trace:
              at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<CheckForKnownResponseCode>d__66.MoveNext()
              Exception rethrown at [0]:
              at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
              at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task)
              at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__5f.MoveNext()
              Exception rethrown at [1]:
              at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
              at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task)
              at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__62`1.MoveNext()
              Exception rethrown at [2]:
              at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
              at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task)
              at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<Post>d__46`2.MoveNext()
              Exception rethrown at [3]:
              at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
              at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task)
              at Telerik.TestStudio.Shared.Communication.ExecutionManagerCommunicationLayer.<QueueJobRun>d__26.MoveNext()
              Exception rethrown at [4]:
              at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
              at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccess(Task task)
              at ArtOfTest.WebAii.Design.Execution.LocalExecution.SchedulingTestListRunner.<BeginTest>d__c.MoveNext()

    [10/27 19:06:44,Telerik.TestStudio.Desktop.exe(2216:42),Error] SchedulingTestListRunner.BeginTest() : Error scheduling test list job on local server!

    If I change my local test runner to use the local computer as its scheduling connection and change the project scheduling server settings to run locally, only then will the load test work, but it only runs from my machine and not the execution machines.  How do I get a load test to run on multiple execution machines?  Can this only be done through a test list?

     

    Thanks!

    Chad

     

     

  2. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 28 Oct 2015 Link to this post

    Hi Chad,

    How do I get a load test to run on multiple execution machines?  Can this only be done through a test list?

    In short, that is correct. The "Run this test" button, as shown at the bottom of this page, will only run it locally. To run it remotely on all of your execution servers requires you to use a test list along with either "Run List Remotely" or "Schedule Test List".

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 29 Oct 2015 in reply to Cody Link to this post

    Thank you Cody.  That answers my question and that was what I was afraid of :|
  4. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 29 Oct 2015 Link to this post

    Unfortunately, my test list will not run the one sample load test that is in the list.  When I try to run it I am almost immediately taken to the Results tab.  Viewing the failed results of the test yield the below error (screen shot attached).

     Unable to load test 635fcb30-a212-477d-80da-bf125e7ee7e6 LoadTest\Sample\LoadTest.tstest

     

     

  5. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 29 Oct 2015 Link to this post

    Hi Chad,

    Why is there a GUID in the path name? I'm referring to the part "635fcb30-a212-477d-80da-bf125e7ee7e6". It's possible this is causing a path length error. Windows has a limit of 260 characters total for the path plus filename e.g. "c:\users\user A\my documents\test studio\test studio projects\635fcb30-a212-477d-80da-bf125e7ee7e6 LoadTest\Sample\LoadTest.tstest". That total cannot exceed 260 characters.

    Try shortening the path length then tell me what happens.

    Thanks and I look forward to hearing back from you.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  6. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 29 Oct 2015 in reply to Cody Link to this post

    Hi Cody,

    The GUID that is displayed is not anything that we have done.  It is displayed automatically as per the screen shot.  The physical path to that particular test is D:\ConnectedToTFS\360 View CRM\QA\Automation\TestStudio\2015SR1-RP1\LoadTests\Sample\LoadTest.tstest.

  7. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 29 Oct 2015 in reply to Chad Link to this post

    BTW just to be clear, that GUIID is the "UniqueID" that is assigned to the test by Test studio which displays in the properties of that test (screen shot attached).

     

    Thanks!

    Chad

  8. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 29 Oct 2015 Link to this post

    Hi Chad,

    Thank you for the clarification. I guess the GUID is not actually part of the path. I'm just not used to seeing it displayed like that and incorrectly assumed it was part of the path. I see your total path length is only 100 characters, so we're actually fine there.

    We need to create and look at the log. Please clear and enable the Test Studio application log. Then recreate the problem then view the log. Put the log into a .zip file and attach that file for analysis.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  9. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 30 Oct 2015 in reply to Cody Link to this post

    Hi Cody,

     After disconnecting my project from source control (TFS) and re-saving the load test, I have been able to run the sample load test remotely without the original error message.  I'm not sure how it's going to react to larger tests but will cross that bridge when it comes.  I appreciate your help and will open a new thread for that if need be.

     

    Thanks!

    Chad

  10. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 30 Oct 2015 Link to this post

    Hello Chad,

    Ok, that's partially good news. It should not be necessary to disconnect the project from source control. One possible explanation is that it caused a change to the test file forcing it to be re-uploaded to the storage server and now it runs successfully. If that theory is correct, reconnecting your project to source control will not break it.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  11. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 30 Oct 2015 in reply to Cody Link to this post

    Unfortunately it is happening again.  I created a new project containing a total of 7 tests, 2 of which are load tests.  One of the load tests is perfectly happy when run remotely in a list and the other simply will not run in a test list. 

    I tried using my local machine as the scheduling server and running the list remotely, choosing my machine and that fails as well.  The load test run perfectly fine when I choose the "Run this test" option when editing the test, so I don't think it's a problem with the test itself.  I also don't think it is any kind of firewall or network issue as the other load test performs flawlessly.  Zipped logs and screen shots are attached.  "Icdt" indicates the failing load test and "Ref" indicates the working load test.

    IcdtSuccessLocalRun - running the test using the "Run this test" button when editing the load test (not using a test list).

    IcdtRemoteToLocal - running the test list with test runner configured to use my machine as the scheduler.  Ran the test list remotely selecting my machine as the target.

    IcdtFailRemoteExecMachine - running the test list while pointed to a remote scheduling server and choosing a remote execution machine.

    RefSuccessRemoteExecMachine - running the other load test successfully in a list to a remote execution machine.

     

    Please let me know if there is further information I can provide.

     

    Thanks!

    Chad

  12. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 02 Nov 2015 Link to this post

    Hello Chad,

    I also don't think it is any kind of firewall or network issue as the other load test performs flawlessly.

    I agree with you. While I do see some errors in the log files, I can't identify a specific problem in the logs that is an obvious sign of the cause of the problem. Let's do some additional diagnostics:

    What happens if you put the problem test into a test list by itself? Does that work when run remotely? Is it possible it's always the second (or first) test in the list that doesn't work as expected? I saw this once before months ago, but don't clearly remember the cause of the problem. I haven't seen this for many months. I think we found and fixed the problem... but we're dealing with a new DB technology now.

    If the above tests doesn't reveal anything useful, it may be time to crack open the contents of the MongoDB and see what's in it. Download and install Mongo Management Studio (free Community Edition) on the machine acting as your storage server. See the first attached screen shot for connection settings to connect to your MongoDB from Mongo Management Studio. Now drill down and look to see if you can find a test having the ID 09a0a5d3-8396-47d8-8362-1592c2d36597. See second attached screen shot for an example where to look.

    If you cannot find such a test in the DB, the next step is to capture a Fiddler trace as Test Studio is trying to schedule the test list to run remotely. We need to see if the problem test is being pushed up into storage.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  13. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 02 Nov 2015 in reply to Cody Link to this post

    When I first ran these two load tests, they both were contained in the same test list.  The "ref" test ran and the "icdt" test did not.  Unfortunately I don't recall the ordering of the tests in the list and I have since updated that original list.

    I was able to find the test with the ID of 09a0a5d3-8396-47d8-8362-1592c2d36597 in the database (attached).

    I did manage to get the failing list to run remotely (which may be why I can find it in the DB now).  I don't ​know though if it was simply a result of updating the test and saving it or if the changes that were made are what fixed the test.  The "Icdt" test was set to monitor 3 performance counters on 2 remote servers (same 3 counters per server), whereas the "Ref" test did not have any counters set up.  As soon as I removed the counters and saved the test, it would run remotely.  I added the same counters back in for the same servers one by one, testing in between, and each time the test was successful.  So I ​know it's not an issue with counters being used per se​, but maybe something didn't save correctly ​with the load test the first time (although it would run successfully locally before the counter changes).  I ​do still need to find the root cause of the problem though, as it is kind of disheartening considering how quick and simple these tests are and how little traffic they record.  When I start recording and configuring larger tests, I would like to be confident that the tests will work in and of themselves (realizing they still may fail due to errors on my end of course).  I am seeing similar failures with ​some web tests as well (in the original project), where a list ​will ​not run all of the tests contained in the list remotely, but again works fine locally​.

    I do still happen to have a copy of the original test files in their failing state, if that might be helpful in troubleshooting.  Otherwise just let me know what ​I need to do next in order to figure out what might be happening.

  14. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 02 Nov 2015 in reply to Chad Link to this post

    Forgot to answer: What happens if you put the problem test into a test list by itself?

    I tried that after the initial failure and the test would not run by itself either.  The previous failure screen shots are from just such a scenario.

    So the same test failed when the list included another successful test, as well as when it was the only test in the list.  Failures only apply to the list when run on a remote execution machine, all local tests would run successfully.

  15. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 03 Nov 2015 Link to this post

    Hi,

    I do still happen to have a copy of the original test files in their failing state...

    I'm willing to take a copy of them and see if I can reproduce your symptoms. Unfortunately since you're no longer experiencing the problem (and we don't really know what triggered the "fix") we don't have anything more to try and diagnose it on your end. We need it in the broken state so we can continue working on isolating why it isn't working as expected.

    So how large is the broken project after being put into a .zip file? You can leave out the folders Backup and Results.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  16. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 05 Nov 2015 in reply to Cody Link to this post

    Hi Cody,

     

    There is a password in the test that I will have to remove and will unfortunately require me to update and re-save the test, which may fix things just due to act of re-saving.  Guess we will see.  I'll update that test a bit later on today (hopefully) and either let you know that it's passing after the save or zip it up and send it on along if it's still failing.

     

    Thanks!

    Chad

  17. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 05 Nov 2015 Link to this post

    Hi Chad,

    No problem. I'll standby for your results.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  18. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 09 Nov 2015 Link to this post

    Hi Cody,

     

    Unfortunately re-saving the test seemed to correct the issue for this test.  Good for the test, but not so useful in troubleshooting.  Oh well, I'll consider this closed and will create a new post if anything starts to fail again.

     

    Thanks again!

    Chad

  19. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 09 Nov 2015 Link to this post

    Hi,

    Ok sounds good. Thank you for the update.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  20. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 11 Nov 2015 Link to this post

    And of course now it is happening again with my new larger test that I just created ^&##@#!!!!  I am sooo sick of this, I need to get to the cause of this problem.  Why will load tests not run in a list!  I don't have time to troubleshoot this freaking software every time I create something new.  Once again when I try to run the load test locally, it works.  When I include that test as the only test in a list and try to execute it remotely, I get taken immediately to the test results screen with a failure "unable to load test..."  

    There are errors in the log about SourceControlMediator.GetProject(), but this project is not connected to source control.  Please help!!

     

     

     

  21. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 11 Nov 2015 Link to this post

    Hi Chad,

    I managed to reproduce this exact problem yesterday on my local machine. I've passed it on to our development team for analysis. I'm waiting to hear back from what is causing this and how to overcome it. I will update you when I hear back from them.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  22. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 11 Nov 2015 in reply to Cody Link to this post

    Thanks Cody.  I look forward to hearing from you and getting this resolved.
  23. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 16 Nov 2015 Link to this post

    Hi Chad,

    Thank you for your patience. Our development team is still trying to determine the root cause of this problem.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  24. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 16 Nov 2015 in reply to Cody Link to this post

    Thank you for the update Cody.  I look forward to hearing their findings.

     

    Chad

  25. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 17 Nov 2015 Link to this post

    Hi Chad,

    Good news. It appears we have fixed this particular problem in our latest internal build, 2015.3.1112. I encourage you to upgrade all machines to this version and try again please.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  26. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 17 Nov 2015 in reply to Cody Link to this post

    Awesome!  Does this update only apply to the remote run time execution machines (i.e. no update to the stand alone Test Studio app)?
  27. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 17 Nov 2015 Link to this post

    Hello,

    Sorry no, it applies to both Test Studio IDE and the Runtime. Version notes can be viewed here.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  28. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 17 Nov 2015 in reply to Cody Link to this post

    Good deal.  I'll get those installed tonight and try out some load tests that were failing.

     

    Thanks so much!

    Chad

  29. Chad
    Chad avatar
    24 posts
    Member since:
    Mar 2015

    Posted 17 Nov 2015 Link to this post

    Is the message in the attached screen shot anything I need to worry about?  The installation went ok but I got the attached message on the Configure Scheduling Server screen.  I already had the scheduling service and MongoDB set up, but when I clicked apply anyway the message appeared at the bottom.

     

    -Chad

  30. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 17 Nov 2015 Link to this post

    Hello Chad,

    To be honest I'm not sure if we need to worry about that error message or not. I'll admit it is worrisome. I can see it's truncated. It's trying to point us to an assembly that cannot be found, but I can't tell which one due to the truncated text. Is there any way to get the whole message?

    Otherwise go ahead and give things a try. Generally it's not necessary to rerun Configure as Scheduling Server when you simply upgrade Test Studio. Are things working as expected now?


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top