Unable to load test

[Ondrej]

Hi Telerik team
I am having really serious problem with TTS. When I want to run remote test list some test will execute OK but some test give an error message (I can see that error in the "results"): Unable to load test xxxxx NameOfTest - I've made some screenshot attached to this message
I am using TTS version 2014.2.6018.0 and I have tried some methods how to fix it:
-I have made new TTS Project, created blank tests and I've copied all steps into new created test... but this method doesent work
-I've alo tried to restore TTS Database but Im still getting that message -still no success
-BUT when I create new Project which includes only 8 test (max 130 steps each) its working OK.... -but its very unpleasant to work with dozens of projects- so its not solution for me

I have no other ideas what to do now.

[Ivaylo]

Hello Ondrej,

How did you managed to recreate the database? Please note that db recreation works 100% of the cases and you should not experience this behavior if you recreated or change the database correctly. Please follow the instructions below:

One way to change the database is to Programs and Features in your Control Panel, select Telerik Test Studio and hit Change, this will go through the installation procedure where you are configuring the storage, shown in this article and you can specify a new Database name.

The other way to proceed is to edit the connection string in CloudStorageSelfHost.exe config file located in the following folder (see the screenshot attached):

C:\Program Files (x86)\Telerik\Test Studio\StorageService

You need only to change the database name with the new name and save the changes. Test Studio will create the new database for you automatically. Please note that you should change only the highlighted part.

Regards,
Ivaylo
Telerik

 

[Ondrej]

Thank you for your reply. I recreated DB exactly in the same way
how you described in email before I asked you for your help... Then I've saved
the new database for further restore.

But Im still getting the message: "Unable to load
test" from cca 5% of my tests...  Tests which are not running are
still the same tests.

Is it possible that update TTS to newest version will help me?

[Ivaylo]

Hello Ondrej,

You can give it a try with updating the Test Studio but I cannot guarantee that would help.

One question, did you restart the scheduling and the storage server? If not, please proceed. Also if you are using an antivirus program please try to temporarily disable it.

As a last resort you may recreate the failing tests, you can simply create a new test and copy/paste the steps from the problematic tests in it.

Regards,
Ivaylo
Telerik

 

[Ondrej]

Yes, I have tried to restart scheduling and the storage server many times and I dont use any antivirus program on execution machine. And as I wrote in the first post- I also tried to create new test and copy all steps from the old test to the new one. - But it doesent work...
Now Im trying to reinstall Windows on execution machine(Windows server 2008 -> Windows server 2012) + newest updates.
My question is: Is it possible to have different versions of TTS on execution machine (Test Runner) and another version on machine where I am creating the new tests?
Another thing what I detected is that files in MSSQL\DATA are quite big
TestStudio.mdf 3,6GB
TestStudio_log.Idf 4,4GB
TestStudioStorage_log.Idf 351MB
I have made about 90tests - each test contains cca 150 steps.

[Ivaylo]

Hello Ondrej,

On the following

My question is: Is it possible to have different versions of TTS on execution machine (Test Runner) and another version on machine where I am creating the new tests?

The simple answer is No, you cannot use different versions on the scheduling and on the execution machine.

When setting up the scheduling you can also give it a try with setting a brand new database as well.

Regards,
Ivaylo
Telerik

 

[Ondrej]

Hello Ivaylo,

well... I have already solved the problem with the "Unable to load test" error:

I have noticed that problem were only with files bigger than cca 60MB (*.resx files) - where the .png screens are saved.

So I have tried to delete that file (TTS will create a new one) and the problem is gone.... I dont see an "expected state" prinstcreen now but test are running correctly now

= Problem solved, thanks for help

[Ivaylo]

Hello Ondrej,

Thank you for the update, and I am glad to hear you got it working.

I am closing this case now.

Regards,
Ivaylo
Telerik

 

[Dennis]

We see the "Unable to load test" issue frequently, so I'm just curious if it's a test-execution issue (in other words, the test was never executed because it was unable to load) or if it's an issue with the results loading (in other words, the test was executed, but the results for the test are unable to load). The error messages aren't clear.

[Elena]

Hello Dennis,

Thank you for your feedback - it is really beneficial and I will share it with the development team! Hopefully there will be improvement in the messages soon! 

Apart from that I would like to provide some insights on the topic. I guess you are also seeing the error in the Results tab when a test list result is opened. The message starts with "X tests were executed out of Y on 'test' machine" so the assumption is that the tests listed as unable to load were not executed at all. Though you are correct it is not clear what the reason for that is. 

The truth is there could be different reasons for that which needs to be investigated for each specific case. What we request in such cases are the log files of the execution machine and the one which hosts the scheduling service. Both can be accessed in the Execution Status View and I would like to mention it is recommended to clear the logs before starting the faulty execution. 

Please let me know if you will need to further investigate the errors you have encountered. In case you would like to find out what might be causing the errors I will appreciate if you generate and send the mentioned above log files zipped via this thread. 

Thanks once again for the valuable feedback - it will certainly help us enhance the user experience with Test Studio. 

Regards,
Elena Tsvetkova
Progress Telerik

 

[Dennis]

Hi Dennis,

Thanks for all additional notes. These certainly describe the whole picture. 

I have deleted the previously attaches log file as per your request - please let me know if you still see it or there is anything else you would like to remove from the public post. 

Based on your request for a secure channel of communication I would recommend you submit a support ticket through your Telerik account and refer the current forum post as a reference for the discussion led so far. 

Please let me know in case you have any concerns. 

Regards,
Elena Tsvetkova
Progress Telerik

 

[Elena]

Hi Dennis,

Thank you for the additional information. 

I will need some further details to have the whole picture of remote executions you perform. You mentioned there are 9 execution machines in the setup. Please let me know how the test lists are scheduled - are there multiple jobs starting in the same time on different machines? Are the scheduled jobs distributed among the execution machines? Is there anything else specific for the runs you see the message 'Unable to Load test'? 

Do you use the same version of Test Studio and Run-time edition on the execution machines? 

Please generate the log files of some of the execution machines - depending on the above details - if a job is distributed collect the logs for the machines which will run the tests. If there are multiple jobs starting in the same time collect the files from the machines which results are 'Unable to Load test'. 

Thank you for your cooperation! 

Regards,
Elena Tsvetkova
Progress Telerik

 

[Dennis]

Hi Elena.

Here's some more info about our scheduled test-list runs:

1. We have about 30-35 test lists that run three times a day (once for the Prod environment, once for Test and once for Stage).
2. The agents are rebooted before each of the three sets of runs (before the Prod run, before the Test run, etc.).
3. The test lists are staggered in their start times by about 3 minutes (e.g., Test List A starts at 4 a.m., Test List B starts at 4:03 a.m., Test List C starts at 4:06 a.m., etc.).
4. The test lists range in the number of tests they include from 1-17 tests (we have seen the failure to load issue when the list contains as few as three tests and as many as 17).
5. The test lists are distributed among the nine agents.
6. We only have Test Studio Test Runner installed on the agents (version 2018.2.606.0 is on each agent).
7. We have Test Studio and Test Runner both installed on the controller (version 2018.2.606.0 for each).
8. The Controller has 8 GB of RAM and 8 vCPUs, while the agents have 6 GB of RAM and 4 vCPUs.

Also, can you delete the attachment from my previous post and give me a secure method for sending you the log files?

Thanks,

Dennis

[Elena]

Hello Dennis,

I have deleted the previously attached log files but also modified that reply - please excuse me for the misunderstanding and any confusion this may led to. 

Please find my additional comments below: 

I have deleted the previously attaches log file as per your request - please let me know if you still see it or there is anything else you would like to remove from the public post.

Based on your request for a secure channel of communication I would recommend you submit a support ticket through your Telerik account and refer the current forum post as a reference for the discussion led so far.

Please let me know in case you have any concerns.

Regards,
Elena Tsvetkova
Progress Telerik