automatic bug submission on tfs

6 posts, 1 answers
  1. Doga Ercan
    Doga Ercan avatar
    21 posts
    Member since:
    Jul 2011

    Posted 02 Nov 2012 Link to this post

    Hi,

    I can set auto-submit on advanced setting of tfs bug tracking. 

    In case of failure, a different bug has been submitted for each test step and its sub step and so on.

    For example in a test execution like;

    Step1

    Step2
    Step2.1
    Step2.2
    Step2.2.1
    Step2.2.2
    Step2.2.3
    Step2.3

    Step3

    If Step2.2.3 fails, tool seperately creates three bug on tfs for Step2.2.3, Step 2.2 and Step2.

    And it says, it is Standalone test list execution feature only! Does it mean that this feature doesnt work for test scheduling and execution server?

    Thanks

    Ercan
  2. Byron
    Admin
    Byron avatar
    184 posts

    Posted 06 Nov 2012 Link to this post

    Hello Ercan,

    The automatic bug submission feature functions for scheduled test list executions, even if they are executed on a separate machine. However, it is not available for Test Studio Runtime Edition or the Visual Studio plugin.

    Regards,
    Byron
    the Telerik team
    Are you enjoying Test Studio? We’d appreciate your vote in the ATI automation awards.
    Vote now
  3. Doga Ercan
    Doga Ercan avatar
    21 posts
    Member since:
    Jul 2011

    Posted 07 Nov 2012 Link to this post

    Hi Byron,

    Thanks for your reply.

    I have updated my post later and added a new question but I guess you havent seen it.

    Do you have any idea about it? I am posting below again.

    In case of failure, a different bug has been submitted for each test step and its sub step and so on.

    For example in a test execution like;

    Step1

    Step2
    Step2.1
    Step2.2
    Step2.2.1
    Step2.2.2
    Step2.2.3
    Step2.3

    Step3

    If Step2.2.3 fails, tool seperately creates three bug on tfs for Step2.2.3, Step 2.2 and Step2.

    Thanks

    Ercan


  4. Byron
    Admin
    Byron avatar
    184 posts

    Posted 08 Nov 2012 Link to this post

    Hello Ercan,

    So far, I have not been able to reproduce this behavior: test lists with automatic bug reporting to TFS submit only one bug when the last step of a multi-step subtest fails during list execution. Are you using TeamPulse bug reporting or TFS? Can you provide the version of your source control server? If possible, please provide us with a copy of your test and access to your application. Also, please provide your failure log. You can export this to file from the failure tab for your test and add them to a .zip archive. If it is not possible to grant us access to your application, please take a Fiddler trace and attach it to a support ticket in a zip file. You can capture a Fiddler trace using FiddlerCap. A Jing video of the behavior may also help us diagnose your issue. Thanks for helping us diagnose this behavior.

    Kind regards,
    Byron
    the Telerik team
    Are you enjoying Test Studio? We’d appreciate your vote in the ATI automation awards.
    Vote now
  5. Carsten Wagner
    Carsten Wagner avatar
    1 posts
    Member since:
    Mar 2010

    Posted 09 Nov 2012 Link to this post

    Hi again,

    I have submitted the ticket #628083.

    We are using TFS 2010. 

    By the way, problematic sub-steps are tests as sub-steps. This may be the reason of the problem?

    Thanks

    Ercan


  6. Answer
    Byron
    Admin
    Byron avatar
    184 posts

    Posted 09 Nov 2012 Link to this post

    Hello Ercan,

    Based on your support ticket, it appears that a logical step is calling a subtest containing a coded step as part of its if branch. In this scenario, Test Studio generates a bug report for the step in the subtest that fails, and a bug report for the conditional step that failed as a result, in that order.

    I have created a bug report for this behavior, which you can follow in our Public Issue Tracking System (PITS). Thanks for your input, which we rely upon to improve our product. 

    Kind regards,
    Byron
    the Telerik team
    Are you enjoying Test Studio? We’d appreciate your vote in the ATI automation awards.
    Vote now
Back to Top