Test List doesn't run

46 posts, 0 answers
  1. Kiranjeet
    Kiranjeet avatar
    11 posts
    Member since:
    Jan 2012

    Posted 07 Aug 2013 Link to this post

    Hi,

    I recently upgraded from your custom build (1527) to (2013.1.806) and when i am trying to run the lists. They doesn't run.
    Here is the video of it. http://screencast.com/t/jEpFuQmo

    I have also attached the log file and the list along with the associated test.

    Regards,
    Kiran
  2. Velin Koychev
    Admin
    Velin Koychev avatar
    88 posts

    Posted 08 Aug 2013 Link to this post

    Hello Kiranjeet,

    I am sorry to hear you are running into this problem.

    I was not able to reproduce your issue with the test list that you sent us. I have recorded a short video as demonstration. 

    Do you experience the same issue if you try to run this test using quick execution?
    Can you also try to run this test list from the ArtOfTest.Runner

    Hope to hear from you soon.

    Regards,
    Velin Koychev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Mike
    Mike avatar
    8 posts
    Member since:
    Aug 2012

    Posted 08 Aug 2013 Link to this post

    What we have found after updating is that the lists do run, but they take a long time to get started.  They also take a long time between tests within a list.

    Was something implemented that causes a significant delay between tests and before beginning the first test of a list?
  4. Bob
    Bob avatar
    39 posts
    Member since:
    Apr 2013

    Posted 08 Aug 2013 Link to this post

    You're not alone. My test lists have over doubled in execution and won't complete. It's saving results after each test on the list, but the next process isn't spinning up until that is completed.

    I've been able to get around this for now by creating a "master test" that execute every single test on your list within a single test, with "continue on failure" marked for each test. This reproduces the 2012 functionality / speed... at least for me.
  5. Chris
    Chris avatar
    17 posts
    Member since:
    Sep 2011

    Posted 08 Aug 2013 Link to this post

    Same thing is happening for me. I had to revert back to previous version, too much to do to try to troubleshoot these issues.
    -Chris
  6. Mike
    Mike avatar
    8 posts
    Member since:
    Aug 2012

    Posted 08 Aug 2013 Link to this post

    We may have to do the same thing.  Another killer issue I'm having with the new release is that I can't data bind a test or even select a data table internal to an individual test.

    Has anyone else been able to get data binding and data driven testing to work in the new build?  If so, please let me know how you did it.
  7. Nadezhda
    Nadezhda avatar
    2 posts
    Member since:
    Aug 2013

    Posted 08 Aug 2013 Link to this post

    I have problem with the lists too. I checked RecycleBrowser but my tests are running in a separate IE window so the second test fails. How can I revert to the previous version? Where I can download it from? I can see only the last release. Also I don't think that the files created in the new version can be opened from the older one, do you have some problems with that? I need to solve this immediately since I need those tests today, so could someone provide me more information as soon as possible?
  8. Faris
    Faris avatar
    4 posts
    Member since:
    Jun 2008

    Posted 09 Aug 2013 Link to this post

    Hi guys -

    We have discovered a performance degradation in TestLists execution that we are actively working on! This is the #1 priority issue for the dev team and we should have a fix out by next week at the latest! We will update this thread as soon as the hotfix is available. 

    Thanks,
    Faris
  9. Velin Koychev
    Admin
    Velin Koychev avatar
    88 posts

    Posted 09 Aug 2013 Link to this post

    Hello guys,

    @Faris - Thank you for your input!

    @Mike - Since data driven testing is different issue, you can open new forum thread to discuss it there. Otherwise, it should work as expected. You can follow the steps from our documentation how to create an external data driven test and let us know in the new forum thread what issues do you experience.

    Regards,
    Velin Koychev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  10. Kiranjeet
    Kiranjeet avatar
    11 posts
    Member since:
    Jan 2012

    Posted 20 Aug 2013 Link to this post

    Hi,

    I have tried uniinstalling and installing test studio from scratch. The problem still exists.

    First of all, When i try to run the test list i got compliation error messages in many tests. Then I tried excluding those tests which has compilation errors and try running test list, it didn't run.

    I also tried through the Test Studio Test Runner, test list didn't run. I have attached the log files and some of the compliation error messages.

    Thanks,
    Kiran
  11. Girish
    Girish avatar
    16 posts
    Member since:
    Jan 2013

    Posted 20 Aug 2013 Link to this post

    Hi Telerik, 

    are we trying to fix this issue as an emergency fix, as it is affecting whole lot of users who are using the new telerik version. 

    in fact , our project deliverables are greatly affecting and at times it is irritating to see test lists not run.
  12. Velin Koychev
    Admin
    Velin Koychev avatar
    88 posts

    Posted 21 Aug 2013 Link to this post

    Hello,

    @ Kiran - Can you try to add an assembly reference for Telerik.TestStudio.Interfaces.dll
    You can find it in the following folder -  C:\Program Files (x86)\Telerik\Test Studio\Bin  
    This should solve the compilation errors. 

    @ Girish - Note that at the end of this week or early next week, we will release an internal build which includes many bug fixes in test list execution.

    Thank you for your understanding.

    Regards,
    Velin Koychev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  13. M
    M avatar
    1 posts
    Member since:
    Aug 2013

    Posted 27 Aug 2013 Link to this post

    Hi,

    We are experiencing the same issue.  A simple test list with one test (goes to Google and types text in) takes about 15 minutes to execute.  Telerik sits there not doing anything (Task Manager shows idle) for about quarter of an hour then test is run in seconds.

    M
  14. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 28 Aug 2013 Link to this post

    Hello,

    Please download and install the internal build from yesterday where the performance of the test lists is significantly improved. It's is nearly back to the old version timing but more work needs to be done. You can download the internal release using this link.

    Thank you all for your understanding and patience.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  15. Kiranjeet
    Kiranjeet avatar
    11 posts
    Member since:
    Jan 2012

    Posted 29 Aug 2013 Link to this post

    Hi Ivalyo,

    The test list run seems to be working fine. But it couldn't able to load the results after the test list run is being aborted. The results are in the results folder though and can be checked by openning them individually, which is not viable. I tried clicking on the "Reload" Results. But got an error message. I have attached the log file and the test results aswell.

    We still not able to record the tests though which is already logged as another issue.

    Regards,
    Kiran
  16. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 30 Aug 2013 Link to this post

    Hello Kiran,

    How the test list execution got aborted, is that manually abortion? Furthermore are you talking about local runs or scheduled ones. If it is remote does the scheduling service running, it should have some misconfiguration which we need to narrow down. Please provide more information as logs so we can review further.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  17. Kiranjeet
    Kiranjeet avatar
    11 posts
    Member since:
    Jan 2012

    Posted 30 Aug 2013 Link to this post

    Hi Ivalyo,

    I aborted it manually because I just wanted to test if the test list run problem is being fixed or not. I waited for few tests to run and It seemed to me working fine and so i aborted the list run.

    This was a local test list run which i triggered it manually. Please find attached the log file.

    Thanks & Regards,
    Kiran
  18. Girish
    Girish avatar
    16 posts
    Member since:
    Jan 2013

    Posted 02 Sep 2013 Link to this post

    hi

    is the test list issue resolved. we are not able to run the test list for more than 15 tests in a list. still facing the same issue. 
  19. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 02 Sep 2013 Link to this post

    Hello Kiran,

    When the test list is manually aborted it is expected behavior to do not have results. In your case when you press reload results it seems you have mixed results from remote and local executions, since it seems there is a misconfiguration with your scheduling setup you are getting the message in question. Please try resetting the scheduling setup, or creating a brand new database. That should solve the problems you are getting. Please follow this article in order to proceed.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  20. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 02 Sep 2013 Link to this post

    Hello Girish,

    Did you install the latest internal build? The issue with the test lists should now be solved.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  21. James
    James avatar
    7 posts
    Member since:
    Aug 2011

    Posted 19 Sep 2013 Link to this post

    I'm seeing the same issue reported by other users above with the latest version... I select a list with 2 test, click run List, and then nothing ever happens.  The run list button is disabled, but the list never executes.
  22. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 19 Sep 2013 Link to this post

    Hello James,

    I am sorry to hear you are experiencing this issues. In order to assist you further I will need more detailed information about your setup.
    Please provide me with the following:

    1. Screenshot of the Scheduling settings (refer to the screenshot).
    2. Screenshot of the Test Studio Runner (refer to the screenshot).
    3. Please clear the logs, reproduce the issue and then attach the log here.

    A short video demonstrating the problem is more than welcome in this case, you can use Jing in order to record your video.

    Looking forward to hearing from you.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  23. James
    James avatar
    7 posts
    Member since:
    Aug 2011

    Posted 19 Sep 2013 Link to this post

    Hello Ivaylo,

    *Edit* - I found the Runner settings and was able to find/fix the issue as well based on a startup error message there.  For some reason Tomcat6 is running on my machine at startup and it is using the same port the scheduling server was trying to use, so the scheduling server could never start.  I killed Tomcat6 and everything worked fine.  Thanks for pointing me in the right direction!

    James
  24. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 20 Sep 2013 Link to this post

    Hello James,

    I happy to hear you were able to find and fix the issue you are experiencing.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  25. Chris
    Chris avatar
    17 posts
    Member since:
    Sep 2011

    Posted 20 Sep 2013 Link to this post

     
  26. Sneha
    Sneha avatar
    4 posts
    Member since:
    Sep 2013

    Posted 26 Sep 2013 Link to this post

    Hi,
    I am experiencing the same issue that my test list is not running. I have the latest TestStudio edition and it says that there are no more updates available for it.The individual tests ran successfully and problem is while running the test list.I don't remember changing any of the settings in particular and I am trying to run a test list locally. Please advice.
  27. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 27 Sep 2013 Link to this post

    Hello Sneha,

    I am sorry to hear you are experiencing this issues. In order to assist you further I will need more detailed information about your setup.
    Please provide me with the following:

    1. Screenshot of the Scheduling settings (refer to the screenshot).
    2. Screenshot of the Test Studio Runner (refer to the screenshot).
    3. Please clear the logs, reproduce the issue and then attach the log here.

    A short video demonstrating the problem is more than welcome in this case, you can use Jing in order to record your video.

    Looking forward to hearing from you.

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  28. Sneha
    Sneha avatar
    4 posts
    Member since:
    Sep 2013

    Posted 27 Sep 2013 Link to this post

    HI Ivaylo,
    I have attached the scheduling setup screenshot. I could not figure out how to get the Screenshot of the Test Studio Runner. I also could not find any log files for this. The tests won't run and after a while I abort the execution. I looked at C:\WebAiiLog and did not find any log for this. Please let me know if I should be looking elsewhere. 
  29. Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 30 Sep 2013 Link to this post

    Hello Sneha,

    You pull out the Test Studio Runner from the sistray. Please refer to the screenshot attached. Regarding the Test Studio log please refer to this article and Standalone section.
    I would like you also to try something else. In the Scheduling server settings, please choose Run Remotely, then replace "sneha" with localhost, and then switch back to Run locally. 
    Does this help?

    Regards,
    Ivaylo
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  30. Sneha
    Sneha avatar
    4 posts
    Member since:
    Sep 2013

    Posted 30 Sep 2013 Link to this post

    Hi,
    My TestRunner came up blank as seen in the screenshot. Unfortunately replacing 'localhost' did not help.
    The log file had the following info -
    [09/30 10:56:14,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
    [09/30 10:56:19,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
    [09/30 10:56:20,Telerik.TestStudio.exe(5256:1),Error] LocalSchedulingServer.ConnectToSchedulingServerAsync() : Initial schedule server ping failed
    [09/30 10:56:24,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
    [09/30 10:56:29,iexplore.exe(4232:21),Recording] TranslatorsCache.BuildTranslatorMatchLookup() : Cache State is current for 'Page (Appraisal Edit)'. Skipping...
    Please let me know if you have everything to look at.
Back to Top