Running UI tests on TFS Build

6 posts, 0 answers
  1. Harrison
    Harrison avatar
    4 posts
    Member since:
    Nov 2016

    Posted 14 Nov 2016 Link to this post

    Hi I'm trying out a trial of test studio (along with the VS plugin) and I'm currently trying to get a test to run on a TFS build server.  I've attached a screenshot of the settings for the step in my build.  I'm going off a tutorial I read for running tests on TFS with MSBuild.  Given the what the logs output after running the test step in the build, it looks like the test isn't actually running.  Here is the command that TFS is running: 

    Executing C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow\vstest.console.exe "C:\BuildAgent4\_work\9\s\src\IBS.Cloud\IBS.Cloud.Automation.UI\Login.tstest" /Settings:"C:\BuildAgent4\_work\9\s\src\IBS.Cloud\TelerikSettings.testsettings" /logger:trx /TestAdapterPath:"C:\BuildAgent4\_work\9\s"

    If you look at the second screenshot I've attached, the logs say "No results found to publish".  My hunch is that I need a test adapter, given the "TestAdapterPath" argument in the command, but I don't know which test adapter I should use.  Any thoughts?

    Just FYI I'm pretty new to setting something like this up, so bear with me.

     

    Thanks,

    Harrison

  2. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    938 posts

    Posted 17 Nov 2016 Link to this post

    Hi Harrison,

    Please be informed that using vstest.console.exe is not fully implemented since there are quite many difficulties and it was postponed. My recommendation is to use MSTest to execute your tests on the TFS build. Please give it a try and get back to me in case you would need any further assistance. Thanks! 

    Regards,
    Elena Tsvetkova
    Telerik by Progress
     
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
     
  3. Harrison
    Harrison avatar
    4 posts
    Member since:
    Nov 2016

    Posted 17 Nov 2016 in reply to Elena Tsvetkova Link to this post

    Ok so I have a few questions.  First off, I'm trying to run tests at the command line with mstest but it's not recognizing the testlist I created.  However, I created this test list in test studio, not in visual studio, so it's an .aiilist file not a .vsmdi file.  Is this potentially the issue?  Also, if possible I'd like to use the test list from test studio because you can create a dynamic test list, whereas (from looking at your tutorial for using test lists) it looks like a test list created in visual studio is static.
  4. Harrison
    Harrison avatar
    4 posts
    Member since:
    Nov 2016

    Posted 17 Nov 2016 in reply to Harrison Link to this post

    I attached a screenshot of my command line.  When I added a publish result argument it still complained about specifying which tests to run.
  5. Andy
    Andy avatar
    13 posts
    Member since:
    Mar 2012

    Posted 18 Nov 2016 Link to this post

    The Test Studio trial does not include the Scheduling and Storage services, nor the Runtime licenses by default and this is typically something that is deployed after purchasing the product.  Many times our customers do this on their own, but we do have a very talented Services team that will implement it for you, for an additional fee.  Since each environment is unique our documentation should be taken as a guided example, but is still subject to be different in each environment.  Rest assured that our Services team does have the expertise to configure this for many different environments, and it is well worth the cost to ensure you get the most out of Test Studio.
  6. Elena Tsvetkova
    Admin
    Elena Tsvetkova avatar
    938 posts

    Posted 22 Nov 2016 Link to this post

    Hi Harrison,

    Thank you for getting back to me. The MSTest Runner could execute only Visual Studio test lists. If you need to run Test Studio test lists through the command prompt you could use the ArtOfTest.Runner

    Regards,
    Elena Tsvetkova
    Telerik by Progress
     
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
     
Back to Top