Test results in TFS Build vNext

10 posts, 0 answers
  1. Shaun
    Shaun avatar
    3 posts
    Member since:
    Jul 2012

    Posted 09 Feb Link to this post

    Is there any way to publish automated test results into TFS 2015 with the new build system? 

    I have tried with both ArtOfTest.Runner and Mstest but neither will publish the trx file into the build.

    Thanks
    Shaun

  2. Boyan Boev
    Admin
    Boyan Boev avatar
    1039 posts

    Posted 12 Feb Link to this post

    Hello Shaun,

    Thank you for contacting us.

    Please elaborate a bit more what exactly do you want to achieve? What do you mean by "the new build system"? 

    Test Studio works correctly with TFS 2015.

    Hope to hear from you soon.

    Regards,
    Boyan Boev
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. Shaun
    Shaun avatar
    3 posts
    Member since:
    Jul 2012

    Posted 12 Feb in reply to Boyan Boev Link to this post

    In TFS 2015 they have created a new build system:
     https://msdn.microsoft.com/en-us/library/vs/alm/build/feature-overview

    I have setup a new build and I am trying to run automated tests then publish the results back into TFS using one of the runners:

    MSTest is known not to work with the new build system as it can't find the build to publish
    ArtOfTest appears to have a similar problem where i can publish to an XAML Build but not to a "vNext" Build

    The same problem occurs if you run 

    ArtOfTest.Runner.exe /test=test.tstest /root=D:\Tests /server=tfs /build=vNextBuildName /Project=Default /platform=Release /flavor=x86

    Thanks

    Shaun

  4. Boyan Boev
    Admin
    Boyan Boev avatar
    1039 posts

    Posted 17 Feb Link to this post

    Hi Shaun,

    According to the link you have provided about the new build MSTEST should work correctly.

    My guess here is that you have some incorrect configuration, especially that you can publish results to one build and you are not able to another.

    Are there any differences between the two builds (i.e. in configuration)? 

    Looking forward to hearing from you.

    Regards,
    Boyan Boev
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. Shaun
    Shaun avatar
    3 posts
    Member since:
    Jul 2012

    Posted 17 Feb in reply to Boyan Boev Link to this post

    One build is XAML based - This one is ok to publish to

    The other is using the new build system - Can't publish using ArtOfTest or MSTest

     Here is the reason i can't use MSTest:
    https://social.msdn.microsoft.com/Forums/vstudio/en-US/1baafce1-8d11-424f-9d6f-64baa92d23be/how-to-publish-trx-file-to-tfs-2015-linking-with-vnext-build?forum=tfsbuild

     Is there a similar reason for ArtOfTest?

  6. Boyan Boev
    Admin
    Boyan Boev avatar
    1039 posts

    Posted 22 Feb Link to this post

    Hi Shaun,

    Yes, that's maybe the reason. To be honest we have tested this new build system with ArtOfTest.

    However if MSTEST is not able to publish with this build system maybe it is the same reason for ArtOfTest.

    Is there a way for you to use the old one?

    Thank you for your cooperation.

    Regards,
    Boyan Boev
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  7. Jeff
    Jeff avatar
    21 posts
    Member since:
    Dec 2012

    Posted 24 Aug in reply to Boyan Boev Link to this post

    Hi Boyan,

    To be honest we have tested this new build system with ArtOfTest.

    I am very interested in seeing how you achieved this.  Could you please show me the details and different parameters you entered for each step in the definition?  I am curious how you were able to have the ArtOfTest runner to execute tests on an agent within a vnext build.

    Thanks,

    Jeff

     

  8. Boyan Boev
    Admin
    Boyan Boev avatar
    1039 posts

    Posted 26 Aug Link to this post

    Hi Jeff,

    I am sorry for the typo. I wanted to say that we have NOT tested this new build system with ArtOfTest runner.

    Excuse me again for the misunderstandings.

    Regards,
    Boyan Boev
    Telerik by Progress
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  9. Jeff
    Jeff avatar
    21 posts
    Member since:
    Dec 2012

    Posted 26 Aug in reply to Boyan Boev Link to this post

    Hi Boyan,

    Thanks for clarifying.  Are there any working examples of running a tstest file with TFS vNext?  If not, is this something Telerik will be addressing in the near future?

    Thanks,

    Jeff

  10. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    251 posts

    Posted 31 Aug Link to this post

    Hello Jeff,

    Let me interfere into this thread since my colleague is out of office this week. I am sorry to admit currently there are no plans to test this on our side and create possibly a working example. However I will submit a feature request into our public feedback portal on your behalf and your proposal will be taken into consideration. Here you could follow its progress and vote for your request. 

    Thanks for your understanding! 

    Regards,
    Elena Tsvetkova
    Telerik by Progress
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top