Hi,
I recently upgraded from your custom build (1527) to (2013.1.806) and when i am trying to run the lists. They doesn't run.
Here is the video of it. http://screencast.com/t/jEpFuQmo
I have also attached the log file and the list along with the associated test.
Regards,
Kiran
I recently upgraded from your custom build (1527) to (2013.1.806) and when i am trying to run the lists. They doesn't run.
Here is the video of it. http://screencast.com/t/jEpFuQmo
I have also attached the log file and the list along with the associated test.
Regards,
Kiran
45 Answers, 1 is accepted
0
Hello Kiranjeet,
I am sorry to hear you are running into this problem.
I was not able to reproduce your issue with the test list that you sent us. I have recorded a short video as demonstration.
Do you experience the same issue if you try to run this test using quick execution?
Can you also try to run this test list from the ArtOfTest.Runner?
Hope to hear from you soon.
Regards,
Velin Koychev
Telerik
I am sorry to hear you are running into this problem.
I was not able to reproduce your issue with the test list that you sent us. I have recorded a short video as demonstration.
Do you experience the same issue if you try to run this test using quick execution?
Can you also try to run this test list from the ArtOfTest.Runner?
Hope to hear from you soon.
Regards,
Velin Koychev
Telerik
0
Mike
Top achievements
Rank 1
Rank 1
answered on 08 Aug 2013, 03:24 PM
What we have found after updating is that the lists do run, but they take a long time to get started. They also take a long time between tests within a list.
Was something implemented that causes a significant delay between tests and before beginning the first test of a list?
Was something implemented that causes a significant delay between tests and before beginning the first test of a list?
0
Bob
Top achievements
Rank 1
Rank 1
answered on 08 Aug 2013, 04:39 PM
You're not alone. My test lists have over doubled in execution and won't complete. It's saving results after each test on the list, but the next process isn't spinning up until that is completed.
I've been able to get around this for now by creating a "master test" that execute every single test on your list within a single test, with "continue on failure" marked for each test. This reproduces the 2012 functionality / speed... at least for me.
I've been able to get around this for now by creating a "master test" that execute every single test on your list within a single test, with "continue on failure" marked for each test. This reproduces the 2012 functionality / speed... at least for me.
0
Chris
Top achievements
Rank 2
Rank 2
answered on 08 Aug 2013, 06:39 PM
Same thing is happening for me. I had to revert back to previous version, too much to do to try to troubleshoot these issues.
-Chris
-Chris
0
Mike
Top achievements
Rank 1
Rank 1
answered on 08 Aug 2013, 11:58 PM
We may have to do the same thing. Another killer issue I'm having with the new release is that I can't data bind a test or even select a data table internal to an individual test.
Has anyone else been able to get data binding and data driven testing to work in the new build? If so, please let me know how you did it.
Has anyone else been able to get data binding and data driven testing to work in the new build? If so, please let me know how you did it.
0
Nadezhda
Top achievements
Rank 1
Rank 1
answered on 09 Aug 2013, 03:37 AM
I have problem with the lists too. I checked RecycleBrowser but my tests are running in a separate IE window so the second test fails. How can I revert to the previous version? Where I can download it from? I can see only the last release. Also I don't think that the files created in the new version can be opened from the older one, do you have some problems with that? I need to solve this immediately since I need those tests today, so could someone provide me more information as soon as possible?
0
Faris
Top achievements
Rank 1
Rank 1
answered on 09 Aug 2013, 07:14 AM
Hi guys -
We have discovered a performance degradation in TestLists execution that we are actively working on! This is the #1 priority issue for the dev team and we should have a fix out by next week at the latest! We will update this thread as soon as the hotfix is available.
Thanks,
Faris
We have discovered a performance degradation in TestLists execution that we are actively working on! This is the #1 priority issue for the dev team and we should have a fix out by next week at the latest! We will update this thread as soon as the hotfix is available.
Thanks,
Faris
0
Hello guys,
@Faris - Thank you for your input!
@Mike - Since data driven testing is different issue, you can open new forum thread to discuss it there. Otherwise, it should work as expected. You can follow the steps from our documentation how to create an external data driven test and let us know in the new forum thread what issues do you experience.
Regards,
Velin Koychev
Telerik
@Faris - Thank you for your input!
@Mike - Since data driven testing is different issue, you can open new forum thread to discuss it there. Otherwise, it should work as expected. You can follow the steps from our documentation how to create an external data driven test and let us know in the new forum thread what issues do you experience.
Regards,
Velin Koychev
Telerik
0
Kiranjeet
Top achievements
Rank 1
Rank 1
answered on 20 Aug 2013, 12:37 PM
Hi,
I have tried uniinstalling and installing test studio from scratch. The problem still exists.
First of all, When i try to run the test list i got compliation error messages in many tests. Then I tried excluding those tests which has compilation errors and try running test list, it didn't run.
I also tried through the Test Studio Test Runner, test list didn't run. I have attached the log files and some of the compliation error messages.
Thanks,
Kiran
I have tried uniinstalling and installing test studio from scratch. The problem still exists.
First of all, When i try to run the test list i got compliation error messages in many tests. Then I tried excluding those tests which has compilation errors and try running test list, it didn't run.
I also tried through the Test Studio Test Runner, test list didn't run. I have attached the log files and some of the compliation error messages.
Thanks,
Kiran
0
Girish
Top achievements
Rank 1
Rank 1
answered on 21 Aug 2013, 04:17 AM
Hi Telerik,
are we trying to fix this issue as an emergency fix, as it is affecting whole lot of users who are using the new telerik version.
in fact , our project deliverables are greatly affecting and at times it is irritating to see test lists not run.
are we trying to fix this issue as an emergency fix, as it is affecting whole lot of users who are using the new telerik version.
in fact , our project deliverables are greatly affecting and at times it is irritating to see test lists not run.
0
Hello,
@ Kiran - Can you try to add an assembly reference for Telerik.TestStudio.Interfaces.dll
You can find it in the following folder - C:\Program Files (x86)\Telerik\Test Studio\Bin
This should solve the compilation errors.
@ Girish - Note that at the end of this week or early next week, we will release an internal build which includes many bug fixes in test list execution.
Thank you for your understanding.
Regards,
Velin Koychev
Telerik
@ Kiran - Can you try to add an assembly reference for Telerik.TestStudio.Interfaces.dll
You can find it in the following folder - C:\Program Files (x86)\Telerik\Test Studio\Bin
This should solve the compilation errors.
@ Girish - Note that at the end of this week or early next week, we will release an internal build which includes many bug fixes in test list execution.
Thank you for your understanding.
Regards,
Velin Koychev
Telerik
0
M
Top achievements
Rank 1
Rank 1
answered on 27 Aug 2013, 11:24 PM
Hi,
We are experiencing the same issue. A simple test list with one test (goes to Google and types text in) takes about 15 minutes to execute. Telerik sits there not doing anything (Task Manager shows idle) for about quarter of an hour then test is run in seconds.
M
We are experiencing the same issue. A simple test list with one test (goes to Google and types text in) takes about 15 minutes to execute. Telerik sits there not doing anything (Task Manager shows idle) for about quarter of an hour then test is run in seconds.
M
0
Hello,
Ivaylo
Telerik
Please download and install the internal build from yesterday where the performance of the test lists is significantly improved. It's is nearly back to the old version timing but more work needs to be done. You can download the internal release using this link.
Thank you all for your understanding and patience.
Ivaylo
Telerik
0
Kiranjeet
Top achievements
Rank 1
Rank 1
answered on 29 Aug 2013, 09:45 AM
Hi Ivalyo,
The test list run seems to be working fine. But it couldn't able to load the results after the test list run is being aborted. The results are in the results folder though and can be checked by openning them individually, which is not viable. I tried clicking on the "Reload" Results. But got an error message. I have attached the log file and the test results aswell.
We still not able to record the tests though which is already logged as another issue.
Regards,
Kiran
The test list run seems to be working fine. But it couldn't able to load the results after the test list run is being aborted. The results are in the results folder though and can be checked by openning them individually, which is not viable. I tried clicking on the "Reload" Results. But got an error message. I have attached the log file and the test results aswell.
We still not able to record the tests though which is already logged as another issue.
Regards,
Kiran
0
Hello Kiran,
Ivaylo
Telerik
How the test list execution got aborted, is that manually abortion? Furthermore are you talking about local runs or scheduled ones. If it is remote does the scheduling service running, it should have some misconfiguration which we need to narrow down. Please provide more information as logs so we can review further.
Regards,Ivaylo
Telerik
0
Kiranjeet
Top achievements
Rank 1
Rank 1
answered on 30 Aug 2013, 10:39 AM
Hi Ivalyo,
I aborted it manually because I just wanted to test if the test list run problem is being fixed or not. I waited for few tests to run and It seemed to me working fine and so i aborted the list run.
This was a local test list run which i triggered it manually. Please find attached the log file.
Thanks & Regards,
Kiran
I aborted it manually because I just wanted to test if the test list run problem is being fixed or not. I waited for few tests to run and It seemed to me working fine and so i aborted the list run.
This was a local test list run which i triggered it manually. Please find attached the log file.
Thanks & Regards,
Kiran
0
Girish
Top achievements
Rank 1
Rank 1
answered on 02 Sep 2013, 08:20 AM
hi
is the test list issue resolved. we are not able to run the test list for more than 15 tests in a list. still facing the same issue.
is the test list issue resolved. we are not able to run the test list for more than 15 tests in a list. still facing the same issue.
0
Hello Kiran,
Ivaylo
Telerik
When the test list is manually aborted it is expected behavior to do not have results. In your case when you press reload results it seems you have mixed results from remote and local executions, since it seems there is a misconfiguration with your scheduling setup you are getting the message in question. Please try resetting the scheduling setup, or creating a brand new database. That should solve the problems you are getting. Please follow this article in order to proceed.
Regards,Ivaylo
Telerik
0
Hello Girish,
Ivaylo
Telerik
Did you install the latest internal build? The issue with the test lists should now be solved.
Regards,Ivaylo
Telerik
0
James
Top achievements
Rank 1
Rank 1
answered on 19 Sep 2013, 01:52 PM
I'm seeing the same issue reported by other users above with the latest version... I select a list with 2 test, click run List, and then nothing ever happens. The run list button is disabled, but the list never executes.
0
Hello James,
Ivaylo
Telerik
I am sorry to hear you are experiencing this issues. In order to assist you further I will need more detailed information about your setup.
Please provide me with the following:
1. Screenshot of the Scheduling settings (refer to the screenshot).
2. Screenshot of the Test Studio Runner (refer to the screenshot).
3. Please clear the logs, reproduce the issue and then attach the log here.
A short video demonstrating the problem is more than welcome in this case, you can use Jing in order to record your video.
Looking forward to hearing from you.
Ivaylo
Telerik
0
James
Top achievements
Rank 1
Rank 1
answered on 19 Sep 2013, 03:07 PM
Hello Ivaylo,
*Edit* - I found the Runner settings and was able to find/fix the issue as well based on a startup error message there. For some reason Tomcat6 is running on my machine at startup and it is using the same port the scheduling server was trying to use, so the scheduling server could never start. I killed Tomcat6 and everything worked fine. Thanks for pointing me in the right direction!
James
*Edit* - I found the Runner settings and was able to find/fix the issue as well based on a startup error message there. For some reason Tomcat6 is running on my machine at startup and it is using the same port the scheduling server was trying to use, so the scheduling server could never start. I killed Tomcat6 and everything worked fine. Thanks for pointing me in the right direction!
James
0
Hello James,
Ivaylo
Telerik
I happy to hear you were able to find and fix the issue you are experiencing.
Regards,Ivaylo
Telerik
0
Chris
Top achievements
Rank 2
Rank 2
answered on 20 Sep 2013, 03:45 PM
0
Sneha
Top achievements
Rank 1
Rank 1
answered on 27 Sep 2013, 04:56 AM
Hi,
I am experiencing the same issue that my test list is not running. I have the latest TestStudio edition and it says that there are no more updates available for it.The individual tests ran successfully and problem is while running the test list.I don't remember changing any of the settings in particular and I am trying to run a test list locally. Please advice.
I am experiencing the same issue that my test list is not running. I have the latest TestStudio edition and it says that there are no more updates available for it.The individual tests ran successfully and problem is while running the test list.I don't remember changing any of the settings in particular and I am trying to run a test list locally. Please advice.
0
Hello Sneha,
Ivaylo
Telerik
I am sorry to hear you are experiencing this issues. In order to assist you further I will need more detailed information about your setup.
Please provide me with the following:
1. Screenshot of the Scheduling settings (refer to the screenshot).
2. Screenshot of the Test Studio Runner (refer to the screenshot).
3. Please clear the logs, reproduce the issue and then attach the log here.
A short video demonstrating the problem is more than welcome in this case, you can use Jing in order to record your video.
Looking forward to hearing from you.
Ivaylo
Telerik
0
Sneha
Top achievements
Rank 1
Rank 1
answered on 27 Sep 2013, 04:24 PM
HI Ivaylo,
I have attached the scheduling setup screenshot. I could not figure out how to get the Screenshot of the Test Studio Runner. I also could not find any log files for this. The tests won't run and after a while I abort the execution. I looked at C:\WebAiiLog and did not find any log for this. Please let me know if I should be looking elsewhere.
I have attached the scheduling setup screenshot. I could not figure out how to get the Screenshot of the Test Studio Runner. I also could not find any log files for this. The tests won't run and after a while I abort the execution. I looked at C:\WebAiiLog and did not find any log for this. Please let me know if I should be looking elsewhere.
0
Hello Sneha,
Ivaylo
Telerik
You pull out the Test Studio Runner from the sistray. Please refer to the screenshot attached. Regarding the Test Studio log please refer to this article and Standalone section.
I would like you also to try something else. In the Scheduling server settings, please choose Run Remotely, then replace "sneha" with localhost, and then switch back to Run locally.
Does this help?
Ivaylo
Telerik
0
Sneha
Top achievements
Rank 1
Rank 1
answered on 30 Sep 2013, 04:28 PM
Hi,
My TestRunner came up blank as seen in the screenshot. Unfortunately replacing 'localhost' did not help.
The log file had the following info -
[09/30 10:56:14,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:19,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:20,Telerik.TestStudio.exe(5256:1),Error] LocalSchedulingServer.ConnectToSchedulingServerAsync() : Initial schedule server ping failed
[09/30 10:56:24,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:29,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
Please let me know if you have everything to look at.
My TestRunner came up blank as seen in the screenshot. Unfortunately replacing 'localhost' did not help.
The log file had the following info -
[09/30 10:56:14,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:19,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:20,Telerik.TestStudio.exe(5256:1),Error] LocalSchedulingServer.ConnectToSchedulingServerAsync() : Initial schedule server ping failed
[09/30 10:56:24,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
[09/30 10:56:29,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
Please let me know if you have everything to look at.
0
Hello Sneha,
Could you please restart the Test Runner and give it a try again?
Regards,
Ivaylo
Telerik
Could you please restart the Test Runner and give it a try again?
Regards,
Ivaylo
Telerik
0
Sneha
Top achievements
Rank 1
Rank 1
answered on 02 Oct 2013, 04:50 PM
That worked.. Thanks a lot
0
Hello Sneha,
Ivaylo
Telerik
I am glad to hear this worked.
Regards,Ivaylo
Telerik
0
Madhu
Top achievements
Rank 1
Rank 1
answered on 08 Jan 2014, 05:20 PM
Hi,
I'm facing TestLists doesn't run problem on latest version, using 2013.2.1219.0 standalone version. I've re-installed test studio couple of times and restarted system/test runner but no luck. Trying to execute locally not on scheduling server. Attached a video clip for more details.
Any suggestions please?
Thanks,
Madhu.
I'm facing TestLists doesn't run problem on latest version, using 2013.2.1219.0 standalone version. I've re-installed test studio couple of times and restarted system/test runner but no luck. Trying to execute locally not on scheduling server. Attached a video clip for more details.
Any suggestions please?
Thanks,
Madhu.
0
Hello Kiran,
You still need to be connected to the scheduling even for a local run. Please refer to the screenshots attached, one is yours the correct one is from my machine, how this is supposed to be setup.
Please connect to the scheduling and make sure it is installed when you upgraded.
Regards,
Ivaylo
Telerik
You still need to be connected to the scheduling even for a local run. Please refer to the screenshots attached, one is yours the correct one is from my machine, how this is supposed to be setup.
Please connect to the scheduling and make sure it is installed when you upgraded.
Regards,
Ivaylo
Telerik
0
Madhu
Top achievements
Rank 1
Rank 1
answered on 13 Jan 2014, 02:14 PM
I agree, when installing I selected full installation (storage server and scheduling server in it) but don't see any errors/warnings it went smoothly. Is there any other areas I need to verify that why scheduling is not connecting?
Attached couple of screenshots from event viewer.
Thanks,
Madhu
Attached couple of screenshots from event viewer.
Thanks,
Madhu
0
Hello Madhu,
Please make sure the Test Studio Runner is running and give it a try.
Your test lists should run locally without any issues.
Regards,
Ivaylo
Telerik
Please make sure the Test Studio Runner is running and give it a try.
Your test lists should run locally without any issues.
Regards,
Ivaylo
Telerik
0
Luke
Top achievements
Rank 1
Rank 1
answered on 31 Mar 2014, 09:02 PM
Demoing this software right now and I'm having this same issue. Initial demo install test lists would not run. Nothing happened when you click Run List and the application shows no activity.
After reading this thread I installed the latest build and was able to run my proof of concept test list several times last week.
This week, nothing happens when you click Run List and the application shows no activity. I've included the log, but there's not much information in there.
How often does the scheduling feature break down in this way? Judging by this thread it's a relatively persistent issue. Do most users tend to use their own scheduling and avoid this issue? It will be difficult to recommend this testing solution if basic functionality is so brittle.
After reading this thread I installed the latest build and was able to run my proof of concept test list several times last week.
This week, nothing happens when you click Run List and the application shows no activity. I've included the log, but there's not much information in there.
How often does the scheduling feature break down in this way? Judging by this thread it's a relatively persistent issue. Do most users tend to use their own scheduling and avoid this issue? It will be difficult to recommend this testing solution if basic functionality is so brittle.
0
Girish
Top achievements
Rank 1
Rank 1
answered on 01 Apr 2014, 03:27 AM
Same thing hapens in our team too.. test studio has been inconsistent in running the scripts through test list. the ones which will be running, will not run the next week for no reason, neither we have permanent solution to this over the past few months.
Quite annoying when you are in a timeboxed release..
Quite annoying when you are in a timeboxed release..
0
Hello Girish,
Could you please submit a separate support ticket/forum thread providing more detailed information instead of updating existing thread with about 40 posts. By stating that you are experiencing the same issue you are not providing enough information, especially when in the thread are observed multiple issues.
Thank you for your understanding.
Regards,
Ivaylo
Telerik
Could you please submit a separate support ticket/forum thread providing more detailed information instead of updating existing thread with about 40 posts. By stating that you are experiencing the same issue you are not providing enough information, especially when in the thread are observed multiple issues.
Thank you for your understanding.
Regards,
Ivaylo
Telerik
0
Luke
Top achievements
Rank 1
Rank 1
answered on 01 Apr 2014, 03:10 PM
Thanks, this answers my question. Telerik Test Studio can not be recommended because of inconsistent performance and surly customer support. We may have to go with the less expensive Sahi instead.
0
Hello Luke,
It should be a reason why the test list is not running, maybe some change in the configuration or something, if you provide more detailed information on how the things are set up on your end I will be happy to take a look and assist further.
Regards,
Ivaylo
Telerik
It should be a reason why the test list is not running, maybe some change in the configuration or something, if you provide more detailed information on how the things are set up on your end I will be happy to take a look and assist further.
Regards,
Ivaylo
Telerik
0
Luke
Top achievements
Rank 1
Rank 1
answered on 02 Apr 2014, 11:50 PM
Don't trouble yourself. You've already disqualified Telerik from consideration.
0
Hello Luke,
I am sorry to hear about your decision.
Wish you all the best.
Regards,
Ivaylo
Telerik
I am sorry to hear about your decision.
Wish you all the best.
Regards,
Ivaylo
Telerik
0
IT Procurement
Top achievements
Rank 1
Rank 1
answered on 05 Feb 2015, 09:03 PM
I was running into these same issues.
Ensure that your machine has Administrative Privileges Set.
This fixed the issue I was having with the Test Lists.
Hope that helps.
Ensure that your machine has Administrative Privileges Set.
This fixed the issue I was having with the Test Lists.
Hope that helps.
0
Hello Rowan,
Thank you for your input.
Regards,
Ivaylo
Telerik
Thank you for your input.
Regards,
Ivaylo
Telerik