Auto Generate Bug through Command Prompt to TFS

14 posts, 0 answers
  1. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 23 Nov 2015 Link to this post

    Is it possible to run Telerik.TestStudio.CommandLineClient.exe or ArtOfTest.Runner.exe on the command prompt and if the test or test list fails then to automatically generate a bug on TFS?
  2. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 24 Nov 2015 Link to this post

    Hello Chelsea,

    If you enable Auto-submit, as shown in the attached screen shot, it should work.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 24 Nov 2015 in reply to Cody Link to this post

    Hi Cody,

    In the screenshot, your Team Foundation Server has a green checkmark beside it. Mine has the

    black circle with the line through it like the icon beside your TeamPulse Server.

    Do you know why that is?

    Thanks.

  4. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 24 Nov 2015 Link to this post

    Hi Chelsea,

    Yes, the green checkmark means that particular bug tracker has been configured and the configuration saved. The black circle with the line through it means it hasn't been configured for a connection yet.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 30 Nov 2015 in reply to Cody Link to this post

    Hi Cody,

     I followed your instructions from the screenshot, but the bug was not generated. What is an arbitrary example of what I should be putting into the command prompt? Do I need to specify there the location ect?

  6. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 30 Nov 2015 Link to this post

    Hi Chelsea,

    What method are you using to run the tests? Which command line tool? Are you running a single test or a test list? I'm not sure but I think auto submit only works for a test list.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  7. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 30 Nov 2015 in reply to Cody Link to this post

    Hi Cody,

    I am using the ArtOfTest.Runner.exe on the Command Prompt. I was running a test, not a test list. In the Command Prompt, should I be including the server, build, project, ect as shown under the Result publishing options in the line where I call the test/test list to create the bug?

  8. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 30 Nov 2015 Link to this post

    Hi Chelsea,

    It is not necessary to specify server, build, project, platform, flavor when using ArtOfTest.Runner. These only apply when you are pushing your results into a TFS server. They do not apply to submitting a bug.

    Please try specifying a test list instead of just a single test. Let me know your results.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  9. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 01 Dec 2015 in reply to Cody Link to this post

    Hi Cody,

    If not pushed to TFS, where would the bug be submitted to?

    I ran the test and it failed as expected, but where do I find the

    bug?

  10. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 01 Dec 2015 Link to this post

    Hi Chelsea,

    Where the bug gets automatically submitted depends on the default you have selected when you configured the bug tracker. See the attached screenshot for one am referring to. My development team confirmed that auto submit only works when running a test list. It does not work when running a single test.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  11. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 02 Dec 2015 in reply to Cody Link to this post

    Hi Cody,

    I am trying to push the tests to TFS and it asks for the Platform and Flavor on the TFS Publishing part of ArtOfTest.Runner.exe. Where can I find these values? Additionally, when checking in results and tests into TFS while directly in Test Studio, how am I able to specify where they go (tests tab etc) rather than both under code?
  12. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 02 Dec 2015 Link to this post

    Hi Chelsea,

    I am trying to push the tests to TFS and it asks for the Platform and Flavor on the TFS Publishing part of ArtOfTest.Runner.exe.

    Did you mean you're trying to push the test results to TFS? Pushing tests to TFS means you're trying to put them into source control and source control doesn't have the concept of platform or flavor.

    When you push results to TFS they are associated with a specific TFS build. So you have to look up a build in TFS in which to connect the results too. If there is no TFS build to associate the results with then you cannot do a push. Usually you're trying to associate the results with a specific build of your product. I suggest you get in touch with your developers and see how your product is being built and if there is a TFS build in which you can associate test results with. They can help you in identifying the platform and flavor of the build.

    Regarding putting tests into source control in TFS when you connect a Test Studio project to TFS you choose which folder in the TFS source control tree where you want your test project to be added to. This is documented on our page Connect Project to TFS.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  13. Chelsea
    Chelsea avatar
    34 posts
    Member since:
    Nov 2015

    Posted 03 Dec 2015 in reply to Cody Link to this post

    Hi Cody,

    I don't mean under the folders in source control. In the TFS web portal at the top the tabs are Home, Code, Work, Build and Test. I'm want to know how I can put the tests that I create on Test Studio (not using the Visual Studio Plugin) under the Test tab (where the Test Plan is) when I check it in rather than having them dumped under the Code tab.

    As a side note, I ran the ArtOfTest.Runner.exe with the TFS publishing criteria filled out and associated with the appropriate build but I am unable to find where the results have been posted to.
  14. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 03 Dec 2015 Link to this post

    Hi Chelsea,

    Ah, I was actually unaware of the Test tab in the TFS web portal. The short answer is you can't. The technical reason is that Test Studio tests are a different kind of object compared to TFS tests. TFS tests actually have no code within them. You can link a TFS test to an automated test, either a Microsoft coded unit test, or a Test Studio test. But as far as TFS is concerned both (coded unit tests and Test Studio tests) are in fact a type of code file and must appear on the code tab.

    I don't have access to TFS 2015. Hopefully this link helps you figure out how to view the test results.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top