Publish Test Results With ArtOfTest.Runner

4 posts, 2 answers
  1. Aaron
    Aaron avatar
    28 posts
    Member since:
    May 2012

    Posted 04 Mar 2013 Link to this post

    We are using the command line tool ArtOfTest.Runner within Jenkins CI to run our tests. It would be great to have the results published to scheduling server and/or by mail. The ArtOfTest.Runner holds the arguments for this scenario:

    ArtOfTest.Runner list=Tests\TestLists\BasicTestList.aiilist out=Results serverPublish=true notifyOption=1 mails="mytestresults@mail.com"

    But after executing the test we get the error "Unable to find TFS server info". Since we do not specify a TFS server in the project but a scheduling server, this error came unexpected.

    The following output from test execution shows our problem:
    C:\Temp\test>ArtOfTest.Runner list=Tests\TestLists\BasicTestList.aiilist out=Results serverPublish=true notifyOption=1 mails="mytestresults@mail.com"
    Executing test: 'BasicTest'
    Navigate to : 'http://www.google.de/'
    Enter text 'google' in 'GbqfqText'
    Keyboard (KeyPress) - Eingabetaste (1 times) on 'GsrBodyTag'
    Verify 'TextContent' 'Contains' 'translate..de/' on 'TranslateDeCiteTag'
    Wait for '250' msec.
    Result saved with path: 'Results\BasicTestList 130068607503594562.aiiresult'.
    PublishRunResult: Unable to find TFS server info


    How can we publish the results via command line?
  2. Answer
    Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 06 Mar 2013 Link to this post

    Hello Aaron,

    I am sorry to hear you are experiencing this issue. Could you please try with executing the following command:

    ArtOfTest.Runner.exe list="Tests\TestLists\BasicTestList.aiilist"  serverPublish=true notifyOption=1 mails=mytestresults@mail.com

    I have double checked on my side and everything works as expected, Here is what I am executing:

    C:\Users\ittodorov>ArtOfTest.Runner.exe list="C:\Users\ittodorov\Documents\Test Studio Projects\March2013\TestLists\google.aiilist" serverPublish=true notifyOption=1 mails=myemailaddress@telerik.com
    Executing test: 'google.com'
    Navigate to : 'http://google.com/'
    Click 'HplogoDiv'
    Result saved with path: 'C:\Users\ittodorov\Documents\Test Studio Projects\March2013\Results\google 130069604665124672.aiiresult'.
    Publishing to Schedule Server successful!

    Before proceed please make sure your SMTP server in Scheduling Server is configured correctly (please refer to the screenshot attached). You can also make sure your Scheduling Service is up and running before you execute. 
    If you are still experiencing the issue could you please run a scheduled test list via the Test Studio UI and see if you are getting the emails and the results published?

    Hope this helps.

    Kind regards,
    Ivaylo
    the Telerik team
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
  3. Aaron
    Aaron avatar
    28 posts
    Member since:
    May 2012

    Posted 11 Mar 2013 Link to this post

    Thanks for your response. We identified the firewall/proxy to be the problem. Now all works as expected.

    But now I have a new question: is it possible to get a more detailed mail by command-line publishing as described in my first post? Like when you plan or schedule a test-list for remote execution.

    Thanks in advance!
  4. Answer
    Ivaylo
    Admin
    Ivaylo avatar
    782 posts

    Posted 13 Mar 2013 Link to this post

    Hello Aaron,

    I am glad you have been able to identify the reason of the issue you were experiencing.
    Unfortunately in order to get more detailed email you will have to execute your tests through the UI of Test Studio.

    Thank you for your understanding.

    Regards,
    Ivaylo
    the Telerik team
    Quickly become an expert in Test Studio, check out our new training sessions!
    Test Studio Trainings
Back to Top