We are currently running into a issue using safari where we are unable to run more than a few test cases in one run. This even happens with the Sample code that ships with WebAii.
Here is what I did in the sample code.
- In app.confg change configuration\WebAii.Settings\defaultBrowser="Safari"
- Build
- Open Test List Editor
- Run the first 5 test cases
Here is the output from the run:
Passed QuickStarts_VSTS_CS.UsingAspNetDevSrv.UseAspNetDevServer
Failed QuickStarts_VSTS_CS.AjaxSupport.WaitingForMultiplePageChanges Initialization method QuickStarts_VSTS_CS.AjaxSupport.MyTestInitialize threw exception. System.TimeoutException: System.TimeoutException: Wait for condition has timed out.
Failed QuickStarts_VSTS_CS.TestRegions.AccessingTestRegions Assert.IsTrue failed.
Failed QuickStarts_VSTS_CS.TestRegions.AccessingElementsUsingTestRegions Test method
QuickStarts_VSTS_CS.TestRegions.AccessingElementsUsingTestRegions threw exception:
...
Failed QuickStarts_VSTS_CS.TestRegions.UsingFindParamAttributeWithTestRegions Test method QuickStarts_VSTS_CS.TestRegions.UsingFindParamAttributeWithTestRegions threw exception:
...
Error QuickStarts_VSTS_CS.AjaxSupport.WaitingForSinglePageChange The agent process was stopped while the test was running.
The first one always passes for me. After that however is seems the environment gets in a bad state and nothing will pass from that point onwards.
Is this a known issue with Safari?
Does anyone know of any workarounds?
We are currently blocked by this and I need to find a workaround as soon as possible.
Thanks,
Chris
4 Answers, 1 is accepted
Rank 1
Here are the 4 browsers I used
- Internet Explorer 9.0.8080.16413
- FireFox 3.6.13
- Safari 5.0.3
- Chrome 9.0.597.107
I took 5 test cases from QuickStarts_VSTS_CS project that ships with the Telerik binaries. None of the test cases I picked specify a specific browser and pull the value from the app.config.
- QuickStarts_VSTS_CS.WebAii2Samples.JavascriptReturnsObject
- QuickStarts_VSTS_CS.WebAii2Samples.JavascriptEventNotifications
- QuickStarts_VSTS_CS.WebAii2Samples.ChainedFindExpressions
- QuickStarts_VSTS_CS.WebAii2Samples.MouseEvents
- QuickStarts_VSTS_CS.WebAii2Samples.JavascriptReturnsJson
Here are the results I recieved:
Internet Explorer: 5/5 PASSED
FireFox: 5/5 PASSED
Safari: 0/5 PASSED
Chrome: 0/5 PASSED
When I debug into the failures the following call to the active browser never seems able to suceed.
ActiveBrowser.NavigateTo(Path.Combine(TestContext.TestDeploymentDir, "WebAii2Pages/JavascriptFunctions.html"));This leaves me with the following questions.
- Is a browser i am currently running against not supported?
- If all of these browsers are supported does anyone have any ideas I can try to make these test cases pass for all browsers?
Thanks,
Chris
Rank 1
Thanks,
Chris
Rank 1
We also had the same issue its issue with WebAii library that thinks it killed the Safari instance before spawning a new one but there is some delay before the process is actually killed. Long story short put Thread.Sleep() delays between tests of order of 2 - 5 seconds to make it work reliably. I have seen it show the same issue for Firefox too.
Thanks,
Kashy
Rank 1
Thanks,
Chris