Test Studio integration with CI (TeamCity)

9 posts, 1 answers
  1. Josh
    Josh avatar
    3 posts
    Member since:
    Apr 2012

    Posted 25 Feb 2013 Link to this post

    I have been trying to explore the integrating Test Studio with our current CI (Team City 7.x).

    I have been reviewing the existing documentation here.

    The type of testing we are wanting to perform would be automated testing of a WPF application.

    My question is, is there a way I can set this up to run headless. i.e. Not have a user logged in/remoted in to the machine with the build runner on it?

    Thanks in advance for any help.

    Josh
  2. Answer
    Byron
    Admin
    Byron avatar
    184 posts

    Posted 25 Feb 2013 Link to this post

    Hi Josh,

    Unfortunately, it will not be possible to automate against a WPF application on a remote machine with no active session. WPF automation is desktop automation, and desktop automation requires an active session. 

    Greetings,
    Byron
    the Telerik team
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
  3. Josh
    Josh avatar
    3 posts
    Member since:
    Apr 2012

    Posted 25 Feb 2013 Link to this post

    Byron,

    Thanks for the fast reply. I have just one more question. Apparently we have a Scheduling Server installed on our network. Would it be possible for me to schedule tests to be run from our CI on that server? 

    The reason I ask is that while I have control over the CI, the Scheduling Server is being maintained by someone else. If I could just schedule the jobs, then they could work out the active session issue.

    Thanks again,
    Josh
  4. Byron
    Admin
    Byron avatar
    184 posts

    Posted 26 Feb 2013 Link to this post

    Hello Josh,

    Unfortunately not. CI servers have two options for executing Test Studio tests: tests can be run with ArtOfTest.Runner on the command line, or with MSTest. Either of these runners can execute tests and test lists and publish results, and ArtOfTest.Runner even has an option to publish test run results to a scheduling server results database. But neither has an option to schedule a test with a scheduling server; this requires a Full Test Studio license and access to the Test Studio client. That being said, you could schedule your test using the Test Studio scheduling server, but this would not be triggered by your CI server triggers, such as check-ins. Of course, these distinctions are largely academic: regardless of how you schedule or trigger a Test Studio test execution, the execution machine will require an active session to perform desktop automation.

    Kind regards,
    Byron
    the Telerik team
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
  5. Josh
    Josh avatar
    3 posts
    Member since:
    Apr 2012

    Posted 26 Feb 2013 Link to this post

    Byron,

    Got it. Thanks again for all your help and clarifications.

    Josh
  6. Moss
    Moss avatar
    1 posts
    Member since:
    Nov 2013

    Posted 04 Dec 2013 Link to this post

    Hi Byron,

    Could you please give a sample MSTest command line to execute Test Studio Test lists on TeamCity build?
    I assume this is achievable as you mentioned in the previous post.

    Many Thanks,
    Moss
  7. Rodney
    Admin
    Rodney avatar
    6 posts

    Posted 09 Dec 2013 Link to this post

    Hello Moss,

    Byron is unavailable so allow me to interject. You can't execute Test Studio test lists with MSTest. If you need to execute Test Studio test lists, then you should use ArtofTest.Runner.

    MSTest will let you run lists created in Visual Studio Test List Editor. Here’s a knowledge base article that outlines some of the more common execution scenarios: Executing Tests with MSTest.

    For additional MSTest commands, I recommend having a look at MSTest.exe Command Line Options.


    Regards,
    Rodney
    Telerik
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  8. Arnar
    Arnar avatar
    2 posts
    Member since:
    Nov 2015

    Posted 03 Dec 2015 in reply to Byron Link to this post

    How is it possible to run UI tests with ArtOfTest.Runner on the command line using TeamCity? I am currently having problem with running the tests in the CI build, the following error is ArtOfTest.InternetExplorer assembly missing.. Do you know any possible solution?

     

  9. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 07 Dec 2015 Link to this post

    Hello Arnar,

    I answered this question in your private support ticket. Did you find that information useful? I haven't heard back from you yet.


    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top