Running UI tests on TFS Build

[Harrison]

Hi I'm trying out a trial of test studio (along with the VS plugin) and I'm currently trying to get a test to run on a TFS build server.  I've attached a screenshot of the settings for the step in my build.  I'm going off a tutorial I read for running tests on TFS with MSBuild.  Given the what the logs output after running the test step in the build, it looks like the test isn't actually running.  Here is the command that TFS is running: 

Executing C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow\vstest.console.exe "C:\BuildAgent4\_work\9\s\src\IBS.Cloud\IBS.Cloud.Automation.UI\Login.tstest" /Settings:"C:\BuildAgent4\_work\9\s\src\IBS.Cloud\TelerikSettings.testsettings" /logger:trx /TestAdapterPath:"C:\BuildAgent4\_work\9\s"

If you look at the second screenshot I've attached, the logs say "No results found to publish".  My hunch is that I need a test adapter, given the "TestAdapterPath" argument in the command, but I don't know which test adapter I should use.  Any thoughts?

Just FYI I'm pretty new to setting something like this up, so bear with me.

 

Thanks,

Harrison

[Elena]

Hi Harrison,

Please be informed that using vstest.console.exe is not fully implemented since there are quite many difficulties and it was postponed. My recommendation is to use MSTest to execute your tests on the TFS build. Please give it a try and get back to me in case you would need any further assistance. Thanks! 

Regards,
Elena Tsvetkova
Telerik by Progress

 

 

[Harrison]

Ok so I have a few questions.  First off, I'm trying to run tests at the command line with mstest but it's not recognizing the testlist I created.  However, I created this test list in test studio, not in visual studio, so it's an .aiilist file not a .vsmdi file.  Is this potentially the issue?  Also, if possible I'd like to use the test list from test studio because you can create a dynamic test list, whereas (from looking at your tutorial for using test lists) it looks like a test list created in visual studio is static.

[Harrison]

I attached a screenshot of my command line.  When I added a publish result argument it still complained about specifying which tests to run.

[Andy]

The Test Studio trial does not include the Scheduling and Storage services, nor the Runtime licenses by default and this is typically something that is deployed after purchasing the product.  Many times our customers do this on their own, but we do have a very talented Services team that will implement it for you, for an additional fee.  Since each environment is unique our documentation should be taken as a guided example, but is still subject to be different in each environment.  Rest assured that our Services team does have the expertise to configure this for many different environments, and it is well worth the cost to ensure you get the most out of Test Studio.

[Elena]

Hi Harrison,

Thank you for getting back to me. The MSTest Runner could execute only Visual Studio test lists. If you need to run Test Studio test lists through the command prompt you could use the ArtOfTest.Runner. 

Regards,
Elena Tsvetkova
Telerik by Progress