Chrome on teambuild (64 bit) does not work

[Henry]

In our setup we use tfs, teambuild 2010 and Webaii testframework together with nunit.
We can test in safari without problems, but our baseline browser is chrome.
Also we want to be able to test using safari and chrome in one test.

When we run nunit manually to drive our tests, everything works fine in Chrome.
But when we run the same tests in our build Chrome hangs. Chrome opens the url: http://localhost:<random number>/webui?<random number>.
30 Chrome windows are open like this until we stop the build, in our test we only open 2 browser instances.

We really can use some help, because we are tryining to fix this issue for a long time now, without any luck.

Thanks in advance,
Henry

By the way, the WebUi extension is installed.

[Daniel Djambov]

Hi Henry,

This is really strange and unexpected behavior. I'm working on reproducing the issue locally and try to find some solution/workaround. In the mean time - can you provide a little bit more details about your environment and tests? Like OS, what team build process template you use, are you trying to test Silverlight application or regular html, what version of NUnit are you using, .net framework, build specifics - anything will be of a help. I suppose Chrome is latest version, as it is updated automatically, is setup and does not have any specific plugins/localizations that might prevent it from running properly?

Also as using NUnit framework with TFS is not such a common scenario, can you confirm that tests with active browser Safari run with the build, but only problem is with Chrome when unit test dll is run from the build? And both run fine with NUnit console when run manually?

Did you try to use MSTest Unit test to run with the build and Chrome - just to see if it works there?

So far I have tests that are running with NUnit, that open Chrome browser, then close it and open Safari, also tests with all browsers (IE9, FF, etc) for execution with NUnit 2.5.8 and it works well. Now I need to associate the nunit process template for teambuild 2010 in order to reproduce the issue.

Greetings,
Daniel Djambov
the Telerik team

[Henry]

Hi Daniel,

First of all, thanks for taking the time to try to help us.
On the buildserver we run on a 64 bit Windows Server 2008 R2 OS.
We test an MVC 2.0 webapplication, that uses a lot of jQuery, Ajax and we use websockets for what we call our 'real-time' communication.
We run on the .NET Framework 4.0
In TFS we use the Scrum template.
We use NUnit 2.5.7.10213
In our UI tests we use StoryQ (2.0.4.)  in combination with your WebAii framework (v 2010.3.1109.0)
Chrome indeed is the latest version, we run the build under a service account that we gave admin rights on the buildserver.
We use http://nunit4teambuild.codeplex.com/ to run the NUnit test from our builds.

Indeed, your assumption that on the buildserver we can run automated builds against Safari (latest version) is valid.
We can manually run the tests on the buildserver logged in under the service account also, only when we run the tests automated through teambuild the tests do not run against Chrome.
 
We did not try using MS Test, we will try in our next sprint.

I hope i am clear, if not I wuill monitor this thread, so feel free to ask questions.

Regards,
Henry

[Daniel Djambov]

Hi Henry,

Thanks for the detailed info - this is what I need for now. I'll work to reproduce the exact problem and find a solution for it. Will let you know asap when we have the workaround.

Best wishes,
Daniel Djambov
the Telerik team

[Henry]

Hi Daniel,

Did you manage to find a solution or workaround?
We ourselves are still working on this problem and keep hitting walls, we are really hoping that you can help us, by sharing your findings.

Regards,
Henry

[Daniel Djambov]

Hi Henry,

I'm sorry for the late response. I haven't yet setup the exact environment you have and reproduced the issue. Until I do so, can you please check if it is still present in our latest release - R1.2011, which is out for couple of weeks: http://www.telerik.com/automated-testing-tools/webaii-framework-features.aspx

We implemented multiple fixes and improvements, so it is possible your problem no longer exists.

Please tell me if it works for you.

Best wishes,
Daniel Djambov
the Telerik team

[Henry]

We installed the latest version, but the behavior does not change.

[Daniel Djambov]

Hi Henry,

We had to give it a try with latest build, but now I'm concerned the problem is somewhere else.

What you describe, that test is running properly in Chrome when executed with NUnit and only fails, and opens multiple instances of browser when running through Team Build 2010 with nunit4teambuild, makes me think it is likely to be a build configuration issue.

Another thing that I observed is that you say you invoke in one test  2 browser instances - is it correct? If so - can you explain the use case you achieve with this scenario - probably a workaround is changing the test itself. Can you provide some simple sample test that you have the problem visible with?

In the mean time did you manage to run the test using MSTest and see if the issue is present there also?

Greetings,
Daniel Djambov
the Telerik team