Unable to play steps in silverlight on build machines

[Ko-Lin]

Hi,

  I have some Silverlight UI Automation tests running correctly on my local machine, however, on the build machine, I keep run into "ArtOfTest.WebAii.Silverlight.ApplicationNotReadyException" as it navigates to the url properly but failed to execute any steps within Silverlight.

  I have attached the .trx file.

  Any ideas?  

[Cody]

Hi Ko-Lin,

Sorry you have run into this problem. I need to start and ask what may seem like an obvious step, did you install the WebAii framework on your build server? Just copying the dll's onto the server is not sufficient to get it to work right. Our installer registers libraries that the framework makes use of.

Greetings,
Cody
the Telerik team

[Ko-Lin]

Hi,

  Yes, WebAii framework has been installed on the build server. I do have some dlls checked-in with the project that is under Telerik\WebUI Test Studio 2010.2\Bin and Telerik\WebUI Test Studio 2010.2\Bin\Translators.

[Cody]

Hello Ko-Lin,

Thank you for confirming that. This error happens when we the framework is attempting to make it's first connection to the Silverlight application. Is it possible that Silverlight is not installed on the build server, or that it doesn't work properly, or is the wrong version (e.g. your app is a Silverlight 4 app and you only have Silverlight 3 installed)?

Kind regards,
Cody

the Telerik team

[Ko-Lin]

Hi,

  I can confirm that both of my machines - the working and non-working ones - both installed the same version of silverlight 4.0.50917.0 runtime.  The silverlight application on the server can be visually interacted and is loading properly.

  
Regards,
Ko-Lin

[Cody]

Hi Ko-Lin,

Thank you for the additional information. How have you configured your build server, more specifically:

• What tool is performing your build (TFS, TeamCity, etc.)?
• What action do you take to initiate a build and a test run?
• When the WebAii test runs as part of your build, are you able to see try to execute (and fail) it in the console window?
• Is the build & testing agent running under a real user account or is it using something like LocalSystem or some other special account?

All the best,
Cody

the Telerik team

[Ko-Lin]

Hi Cody,

  I got a feeling we might be onto some good stuff here; here is to answer your questions:

1. We are using TeamCity for builds
2. I have a msbuild project to perform all the actions for build, deployment and initiate tests.  Builds are done via MSBuild commands and tests are kicked off like "MSTest.exe -testmetadata:$(Prototype)\MyProject.Prototype.vsmdi" />"
3. I can see the test try to execute as it opens up the browser and navigates to the Url. I can also see the execution failed in my console window.
4. The build agent is ran under Local System and is allow to interact with desktop.

  Finally, I have been playing the test via command line by executing msbuild on the server under Administrator rights and am not able to be get it to work.

  Thank you for your patient response.


Regards,
Ko

[Cody]

Hi Ko-Lin,

We have some documentation describing how to run WebAii tests on a TeamCity server. Try following those directions and let me know if that solves this problem for you.

Regards,
Cody

the Telerik team

[Ko-Lin]

Hi,

  Thank you for your reference on Team City, I found my answers misleading to you.  My Team City integration has not come into play yet as I am stuck getting the tests to play via MSTest on a different machine.  All I have been doing is to use MSTest to play my vsmdi that contains silverlight web aii tests.  

  I believe I have two machine setup the same way but one failed to interact with silverlight test.  Looks like we are having no luck on narrowing down the issue that might have cause my tests from timing out.  

Regards,
Ko

[Cody]

Hello Ko-Lin,

I am sorry we haven't figured this one out yet. Let's go into diagnostic mode:

1. You already said the Silverlight application works just fine on your server when you manually launch a browser and manually exercise the application, correct? This is the first step.
2. What happens if you manually try to launch the test from the command line by running the same MStest command line you are using in the build definition? If this works go to step 3. If not we need to dig deeper to try and figure out why not.
3. Can you reconfigure the build agent to run in command line mode instead of as a service? This is documented in the online documentation I already pointed you to. Does this solve the problem? If yes, this is probably the only way it will work. There are subtle important difference (permissions) when executing under a real user account versus running under a service account. If this does not work we need to dig deeper to figure out why not.

If you still cannot get it working I suggest we setup a GoToMeeting where I can see this problem first hand on your build server. Unfortunately this will have to wait until next week because it is Thanksgiving holiday for the rest of this week. I won't be in the office until Monday.

Regards,
Cody

the Telerik team

[Ko-Lin]

Hi Cody,

  I figure if I could get one machine to work, it must be some of the silly things I have missed on the 2nd machine.  As I ran out of options a couple of days ago, I re-installed the same version of silverlight and it is now working as it should.  

  Thank you very much for you help.  

Regards
Ko-Lin

[Cody]

Hello Ko-Lin,

I am very glad to hear you were able to resolve this problem. Thank you for the update!

Best wishes,
Cody
the Telerik team