Running Test List remotely with Jenkins

13 posts, 0 answers
  1. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 11 Dec 2015 Link to this post

    so what i'm trying to do is have a test list created and run it remotely on another machine with Jenkins. i am also using a custom DLL for creating data in a DB.

    i can run the test list just fine on my local machine and not have any issues but when i bring it to Jenkins to run on another machine using ArtOfTest list runner , then it starts to have issues locating my DLLs.

    i have looked through your forums and i found one that talked about having to put them in the root so i did but i ended up being able to put it in the bin folder and it worked, but now it complaining again (in Jenkins, in test studio it still works fine) and i have triple checked the reference and everything else i can think of.

    it feels like one day it work and the next its broken again, its become very tedious and i would really appreciate some help to save my self the frustration.

    i would attach my project but its over 2MB

  2. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 11 Dec 2015 Link to this post

    Hi John,

    First it's okay to attach a 2 MB file to our support ticket system. We have a limit of 20 MB for file attachments. To better understand where the process is breaking can you share with me either the Jenkins build log showing the error or our test runner test log showing where it's failing with the error message?

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  3. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 14 Dec 2015 Link to this post

    Hi cody 

    i tried up loading my project with you attach files but it wasnt working, i also trying using 7zips split feature to make separate 2MB files but that didnt work for me either so i used our organizations eLink: you can download it with this link https://apps.ivey.ca/FileUpload/eLink/73bddf59-8717-4d85-8505-acae3621f8c0_eZone%20UI%20Tests%20Revamp.zip

    Thanks :)
    John

  4. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 14 Dec 2015 Link to this post

    Hi John,

    Thank you for all the additional information plus the project. I now see what the problem is. You are referencing a custom DLL and have placed it into the projects bin folder. See the attached screenshot for what I'm referring to. Unfortunately Test Studio does not upload any files from our bin folder to our storage service for execution on the remote execution machine. This means at compile time Test Studio is unable to link to your custom DLL because it doesn't exist on the remote machine.

    Instead your custom DLL should be placed in the projects root folder and taken out of the bin folder.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  5. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 17 Dec 2015 Link to this post

    I've been trying to get that working but i still cant get it to work on Jenkins. Still complaining about references. Here's the new version of my project

    https://apps.ivey.ca/FileUpload/eLink/b683e8cf-7718-4674-a7cf-fb32c0e8aaa3_eZone%20UI%20Tests%20Revamp.zip

    thanks

  6. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 17 Dec 2015 Link to this post

    Hi John,

    I see nothing wrong with the configuration of your test project. In fact I even tried running it using the Telerik remote scheduling service. It was able to compile and try to run a test the corset failed trying to connect to your server. What exactly is the command line you're using to run the tests using the ArtOfTest runner?

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  7. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 18 Dec 2015 Link to this post

    "C:\Program Files (x86)\Telerik\Test Studio\Bin\ArtOfTest.Runner.exe" list="C:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\TestLists\MasterTestList.aiilist"

    and these are the compile errors

     

    ProjectCompile: Compile failed: c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-DBCleanUp.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-DeleteCommunities.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-DeleteCommunities.tstest.cs(20,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-HBA1\DM-CourseSections-HBA1.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-HBA1\DM-CourseSections-HBA1.tstest.cs(20,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-HBA1\DM-Create-HBA1.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-HBA1\DM-Create-HBA1.tstest.cs(20,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-HBA1\DM-Register-HBA1.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-Staff\DM-Create-Staff.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Data Manipulation\DM-Staff\DM-Create-Staff.tstest.cs(20,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\Common\Logins\LI-HBA1.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\TestRunner\My Courses\My Courses.tstest.cs(19,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?) c:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\TestRunner\My Courses\My Courses.tstest.cs(20,7) : error CS0246: The type or namespace name 'eZoneUITestingORM' could not be found (are you missing a using directive or an assembly reference?)

  8. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 18 Dec 2015 in reply to Cody Link to this post

    "C:\Program Files (x86)\Telerik\Test Studio\Bin\ArtOfTest.Runner.exe" list="C:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\TestLists\MasterTestList.aiilist"

     

  9. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 18 Dec 2015 Link to this post

    Hi John,

    Please try adding the root= parameter like this:

    "C:\Program Files (x86)\Telerik\Test Studio\Bin\ArtOfTest.Runner.exe" list="C:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests\TestLists\MasterTestList.aiilist" root="C:\Program Files (x86)\Jenkins\jobs\Sample.UITest\workspace\eZoneUITests"

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  10. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 18 Dec 2015 in reply to Cody Link to this post

    it didn't help, i still get the same error
  11. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 18 Dec 2015 Link to this post

    Hi John,

    I must admit I have no idea why it's not working as expected. The only way for you to be getting compile errors is if the DLL eZoneUITestingORM.dll is not in the root folder for the project when Test Studio is trying to run the test. Looking at the build output log that folder should be c:\Program Files (x86)\Jenkins\jobs\Ivey.eZone.MasterTest.UITest\workspace\eZoneUITests. Can you have a look on your build machine and verify your DLL is being placed in this folder?

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
  12. John
    John avatar
    12 posts
    Member since:
    Oct 2015

    Posted 21 Dec 2015 Link to this post

    yes in test studio it works fine but when we try and use the test runner on our Jenkins box it dosent work and those DLL's are definitely there.

    thanks

  13. Cody
    Admin
    Cody avatar
    3360 posts

    Posted 21 Dec 2015 Link to this post

    Hello John,

    I have to admit this is a real stumper. At this point my only suggestion is to use Fusion Log Viewer to diagnose what what is causing the DLL buying failures.

    Regards,
    Cody
    Telerik
     
    The New Release of Telerik Test Studio Is Here! Download, install,
    and send us your feedback!
Back to Top