All test cases do not run from test list

14 posts, 0 answers
  1. Prashant
    Prashant avatar
    20 posts
    Member since:
    Nov 2010

    Posted 03 Oct 2013 Link to this post

    Hello,

    we have created 100+ test cases in Test Studio. Now we want to automate them to run daily. So I think Tests List feature from Telerik Test Studio does what we are looking for. In last few days I am giving a try to run test cases from Test Lists. But I am facing few issues in it.

    We have added test cases from Visual Studio plug-in, since test cases also need some coded steps. While executing Test List, sometimes it runs only first test cases and does not execute remaining test cases in the list. I am trying to run about 10 test cases in a Test List. My list is static. Sometimes it executes about half of those test cases and does not work to execute remaining cases. Sometimes it executes all of them. It doesn't matter whethe test case execution was successful or not, execution haults in between.

    I am using Test Sudio version 2013.1.806.0. Let me know if you need other info to resolve the issue.
  2. Boyan Boev
    Admin
    Boyan Boev avatar
    1072 posts

    Posted 04 Oct 2013 Link to this post

    Hello Prashant,

    Thank you for contacting us.

    Please download and install our latest internal build which contains many bug fixes and improvements in test list execution.

    You can download it from here.

    Let me know if this helps. 

    Regards,
    Boyan Boev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Prashant
    Prashant avatar
    20 posts
    Member since:
    Nov 2010

    Posted 24 Oct 2013 Link to this post

    Hello,

    I have downloaded latest internal version given in the link. With this version I was able to execute few more test cases.But I am still not able to excute all the tests given in the list. Test List execution fails at some point or other irrespective of tests executed successfully or not.

    Let me know what kind of data you will need to resolve this issue. As of now, we have created 100s of tests. But since we are not able to execute them in a Test List, we are not able to make use of investment done so far.

    I would appreciate if you could resolve this issue as soon as possible.
  4. Boyan Boev
    Admin
    Boyan Boev avatar
    1072 posts

    Posted 28 Oct 2013 Link to this post

    Hello Prashant,

    How the test list execution fails? What's happening on the execution machine?

    In order to help you best please provide us some more detailed information:

    1. Please send us also application log. Here is an article how to pull the application log. Please make sure you clear the log before reproducing this.

    2. Send us the execution log from the execution machine. Please check out the bottom of the same article.

    3. A short video demonstrating the issue also might be useful, you can use Jing in order to record the video.

    If the issue persists please:

    1. Please provide us with a copy of your test and if it is possible grant us access to your application so we can reproduce the issue on our end and give you a solution. 


    2. If direct access is not possible, capture a Fiddler trace and attach it to this support ticket in a zip file. If you are unfamiliar with how to do so, this link will provide you with step-by-step instructions for download and use. Please make sure to enable 'Decrypt HTTPS traffic' and 'Store binaries' options (see attached image) before starting capture.

    Hope to hear from you soon.

    Regards,
    Boyan Boev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. Prashant
    Prashant avatar
    20 posts
    Member since:
    Nov 2010

    Posted 07 Nov 2013 Link to this post

    Hello Boyan,

    We were able to figure out the issue and issue was not from Telerik's end.

    We were using VNCViewer to login to the machine from which test lists were being executed. But at some point this execution used to get stop. When we logged in directly onto machine, instead of VNCViewer, test cases worked properly. So VNCViewer was playing some trick in between because of which test cases were not getting executed.

    Thanks.
  6. Boyan Boev
    Admin
    Boyan Boev avatar
    1072 posts

    Posted 08 Nov 2013 Link to this post

    Hello Prashant,

    I am very glad to hear that.

    If you need additional assistance, please do not hesitate to contact us again. 

    Regards,
    Boyan Boev
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  7. Pavan
    Pavan avatar
    8 posts
    Member since:
    Feb 2014

    Posted 24 Oct 2017 Link to this post

    Hi Guys,

    I did face the same issue – Out of 5 scripts from my Test List, only 2 scripts are running and then Test List got stuck. I did follow one of the blog from Telerik (https://www.telerik.com/forums/test-list-returns-12-28---project-is-offline-or-uncontrolled-making-files-writeable#RDwWaa4HwkKQcfxS1KmFWg) which did not work for me. My Test List settings, Browser settings, Got the latest Telerik version (2017.2.615.0) too.  You can find my comments in my name - Pavan.

    I’m thinking this discussion is more relates to my issue so I’m responding here. Please let me know how I can fix the issue which I’m facing. 

    Attached is the latest log which I have generated today, please find it. Please let me know if you need more info. 

    Appreciated if you can respond as soon as possible. Thanks in advance. 

  8. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    971 posts

    Posted 26 Oct 2017 Link to this post

    Hello Pavan,

    Thank you for reaching us out. 

    Please note that the threads you are referring to dates back in more than 3-4 years and probably the current issue you are facing is not related to the previous here. In case you are not able to find more recent topic about the faced issue I would recommend to submit a new thread.

    Anyways, let us get back to the issue you experience. I suspect that the test where the execution stuck contains a verification step in an if..else statement which does not find the target element to verify. For example this could be a popup which may or may not appear. In the case when it does not appear the verification could not return either true or false as it fails internally. 

    To overwhelm such a scenario you should implement a try..catch block instead of the if..else. This could be implemented in a coded step and here is a sample article to refer to. 

    Please let me know if my assumption was correct or you would need further assistance. Thanks! 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  9. Pavan
    Pavan avatar
    8 posts
    Member since:
    Feb 2014

    Posted 27 Oct 2017 in reply to Elena Tsvetkova Link to this post

    Hey Elena,

    Thank you so much for responding.

    I'm not using the verification step inside the If & Else statement. Also, If & else statement is not part of the scripts only. So please advise. I even tried the Dynamic Test List and that also did not work for me. Please let me know if you need any other addition information. 

    Best, Pavan.

  10. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    971 posts

    Posted 31 Oct 2017 Link to this post

    Hi Pavan,

    Thanks for the clarification. 

    Please let me know if this happens each time when the test is executed despite if it is in a test list or a quick execution. 

    Next thing I would like to kindly ask for would be if you could provide the test in question? If you could grant access to the application as well I would be able to test it on my end. This would be the easiest way to investigate what might be causing the misbehavior. 

    Thank for your understanding! 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  11. Pavan
    Pavan avatar
    8 posts
    Member since:
    Feb 2014

    Posted 06 Nov 2017 in reply to Elena Tsvetkova Link to this post

    Hi Elena,

    Thanks for responding back!

    Having said that, I can run the scripts individually but not in Test List. If I want to run the scripts in Test List, then I should have only 2 scripts in it. If it's more than 2 scripts, Test List will not be executed the 3 rd scripts where it will get stuck. I have given the logs for the same too.

    Regarding the giving the access to the application, I may need some more time to get it done. Till that, please consider the above information and advise.

    will be waiting for your solution! Thanks for your time :)

  12. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    971 posts

    Posted 09 Nov 2017 Link to this post

    Hello Pavan,

    Thanks for getting back. 

    Could you please elaborate more on the tests included in the test list
    - what would be executed if you rearrange their order? 
    - do you observe the misbehavior with particular tests and order or it happens with any tests in your project? 

    it is important to identify if there is a particular test that causes the test lists to abort or it is random behavior. If it turns out this a particular test I would like to inspect that even if I am not able to execute it. You could provide a sample project with the faulty tests for the investigation. 

    I am looking forward to hearing from you! 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  13. Pavan
    Pavan avatar
    8 posts
    Member since:
    Feb 2014

    Posted 09 Nov 2017 in reply to Elena Tsvetkova Link to this post

    Elena, 

    I'm glad that you're helping me. 

    However, having said that the scripts which I'm running in the Test List is clear and can be executed individually. There is no issue with the scripts which may effect the Test List execution. It is only failing in Test List no mater what scripts you have in it. I've given all the possible best information in my previous posts. I would request you to revisit those which may help you. Due to some limitation, I cannot share my scripts with you. So please let me know if any other information you required. 

    Thanks a lot for doing this for me. Hope I hear back soon! 

    -Pavan

  14. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    971 posts

    Posted 14 Nov 2017 Link to this post

    Hi Pavan,

    Thank you for getting back to me. 

    I understood that you might have some concerns sharing your tests or any further information in a public thread. But since the scripts are running fine one by one probably there are some configuration settings which might prevent the successful test list execution. This is the reason I would like to inspect the project itself. 

    Also I would like to point out you are referring old forum posts related to outdated versions of Test Studio which behavior might have been dramatically changed with the time. Please also note that we do not recommend duplicating discussions for the same issue. 

    I would like to kindly ask you to choose one of the addressed threads and if required continue the communication in it. Please find some possible reasons why a project could be running locally and not remotely. 

    Please note that you could submit a support ticket if you would like to continue the investigation in private and share confidential details. 

    Thanks in advance for your time and cooperation! 

    Regards,
    Elena Tsvetkova
    Progress Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top