This is a migrated thread and some comments may be shown as answers.

Test results in TFS Build vNext

9 Answers 105 Views
General Discussions
This is a migrated thread and some comments may be shown as answers.
Shaun
Top achievements
Rank 1
Shaun asked on 09 Feb 2016, 02:24 PM

Is there any way to publish automated test results into TFS 2015 with the new build system? 

I have tried with both ArtOfTest.Runner and Mstest but neither will publish the trx file into the build.

Thanks
Shaun

9 Answers, 1 is accepted

Sort by
0
Boyan Boev
Telerik team
answered on 12 Feb 2016, 11:38 AM
Hello Shaun,

Thank you for contacting us.

Please elaborate a bit more what exactly do you want to achieve? What do you mean by "the new build system"? 

Test Studio works correctly with TFS 2015.

Hope to hear from you soon.

Regards,
Boyan Boev
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
Shaun
Top achievements
Rank 1
answered on 12 Feb 2016, 03:50 PM

In TFS 2015 they have created a new build system:
 https://msdn.microsoft.com/en-us/library/vs/alm/build/feature-overview

I have setup a new build and I am trying to run automated tests then publish the results back into TFS using one of the runners:

MSTest is known not to work with the new build system as it can't find the build to publish
ArtOfTest appears to have a similar problem where i can publish to an XAML Build but not to a "vNext" Build

The same problem occurs if you run 

ArtOfTest.Runner.exe /test=test.tstest /root=D:\Tests /server=tfs /build=vNextBuildName /Project=Default /platform=Release /flavor=x86

Thanks

Shaun

0
Boyan Boev
Telerik team
answered on 17 Feb 2016, 11:53 AM
Hi Shaun,

According to the link you have provided about the new build MSTEST should work correctly.

My guess here is that you have some incorrect configuration, especially that you can publish results to one build and you are not able to another.

Are there any differences between the two builds (i.e. in configuration)? 

Looking forward to hearing from you.

Regards,
Boyan Boev
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
Shaun
Top achievements
Rank 1
answered on 17 Feb 2016, 12:19 PM

One build is XAML based - This one is ok to publish to

The other is using the new build system - Can't publish using ArtOfTest or MSTest

 Here is the reason i can't use MSTest:
https://social.msdn.microsoft.com/Forums/vstudio/en-US/1baafce1-8d11-424f-9d6f-64baa92d23be/how-to-publish-trx-file-to-tfs-2015-linking-with-vnext-build?forum=tfsbuild

 Is there a similar reason for ArtOfTest?

0
Boyan Boev
Telerik team
answered on 22 Feb 2016, 08:00 AM
Hi Shaun,

Yes, that's maybe the reason. To be honest we have tested this new build system with ArtOfTest.

However if MSTEST is not able to publish with this build system maybe it is the same reason for ArtOfTest.

Is there a way for you to use the old one?

Thank you for your cooperation.

Regards,
Boyan Boev
Telerik
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
Jeff
Top achievements
Rank 1
answered on 24 Aug 2016, 06:00 PM

Hi Boyan,

[quote]To be honest we have tested this new build system with ArtOfTest.[/quote]

I am very interested in seeing how you achieved this.  Could you please show me the details and different parameters you entered for each step in the definition?  I am curious how you were able to have the ArtOfTest runner to execute tests on an agent within a vnext build.

Thanks,

Jeff

 

0
Boyan Boev
Telerik team
answered on 26 Aug 2016, 01:15 PM
Hi Jeff,

I am sorry for the typo. I wanted to say that we have NOT tested this new build system with ArtOfTest runner.

Excuse me again for the misunderstandings.

Regards,
Boyan Boev
Telerik by Progress
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
0
Jeff
Top achievements
Rank 1
answered on 26 Aug 2016, 01:18 PM

Hi Boyan,

Thanks for clarifying.  Are there any working examples of running a tstest file with TFS vNext?  If not, is this something Telerik will be addressing in the near future?

Thanks,

Jeff

0
Elena
Telerik team
answered on 31 Aug 2016, 07:22 AM
Hello Jeff,

Let me interfere into this thread since my colleague is out of office this week. I am sorry to admit currently there are no plans to test this on our side and create possibly a working example. However I will submit a feature request into our public feedback portal on your behalf and your proposal will be taken into consideration. Here you could follow its progress and vote for your request. 

Thanks for your understanding! 

Regards,
Elena Tsvetkova
Telerik by Progress
 
The New Release of Telerik Test Studio Is Here! Download, install,
and send us your feedback!
Tags
General Discussions
Asked by
Shaun
Top achievements
Rank 1
Answers by
Boyan Boev
Telerik team
Shaun
Top achievements
Rank 1
Jeff
Top achievements
Rank 1
Elena
Telerik team
Share this question
or