WebUI Test Studio Test Lists

[Carlos]

Hi all,

When I use quick execution my tests work fine but I use the test lists option and list them together and then execute them together I get random failures and I can understand why as when I investigate the test and then replay it using quick execution it works perfectly. Has anyone else experienced this problem?

Many thanks

[Cody]

Hello Carlos,

Can you give us an example of the failure you get most often? What is the error message? Is it always the same error message (e.g. can't find element) or does it always seem to be different? Which step is failing? Is it always step 1 of a test or a step in the middle?

Greetings,
Cody
the Telerik team

[Carlos]

The most common failure message I received is as follows:

ArtOfTest.Common.Design.Exceptions.ElementFindException: Unable to locate element. Details: Attempting to find [Html] element using
Find logic
 (Html): [id 'Exact' ctl00_MainContent_tbCompanyName] AND [tagname 'Exact' input]

Unable to locate element. Search failed!

It happens in quite a few tests which is quite frustrating and it's a number of different elements.

Many thanks for your help

[Konstantin Petkov]

Hello Carlos,

Is this a dynamically loaded user control? This error typically appears when you attempt to perform some action over an element/control which is not yet available to access. The resolution in general is to record some verification like "Wait for element exist" before performing that action. We also expose an WaitOnElementsTimeout property you can set with bigger timeout (the default value is 5 seconds) in case of some slow operation.

Please let us if you need further assistance in resolving this type of error or if you experience other troubles and need help with.

All the best,
Konstantin Petkov
the Telerik team

[Konstantin Petkov]

Hi Carlos,

Did you get this problem resolved? Just if you still need help with that and to help you resolve similar problems in future, please watch the video we uploaded on that same topic.

Getting Started on Recording Tests (Best Practices)

I hope you find it helpful.

Greetings,
Konstantin Petkov
the Telerik team

[Carlos]

Just ran the test list again and not i'm getting the following:

ArtOfTest.Common.Design.Exceptions.ExecutionException: Wait for condition has timed out

Is this also related to the same feature?

[Konstantin Petkov]

Hi Carlos,

Yes, this is probably related too. The wait for condition timeout failure most times can be easily resolved by adding the necessary WaitFor or just Verify at the right place in the test. Let us know if the video helps you get this resolved also.

Greetings,
Konstantin Petkov
the Telerik team

[Carlos]

I have increased the timeout on the WaitOnElementsTimeout field and things appeared to have improved but now I'm getting an error when dealing with pop-up browsers

ArtOfTest.Common.Design.Exceptions.ExecutionException: Exception occured waiting for the new browser to connect. ---> System.OperationCanceledException: Exception occured waiting for the new browser to connect. ---> System.TimeoutException: Wait for condition has timed out
   at ArtOfTest.Common.WaitSync.CheckResult(WaitSync wait, String extraExceptionInfo)
   at ArtOfTest.Common.WaitSync.For[T](Predicate`1 predicate, T target, Boolean invertCondition, Int32 timeout)
   at ArtOfTest.WebAii.Core.Manager.WaitForNewBrowserConnect(String url, Boolean isPartial, Int32 timeout)
   --- End of inner exception stack trace ---
   at ArtOfTest.WebAii.Core.Manager.WaitForNewBrowserConnect(String url, Boolean isPartial, Int32 timeout)
   at ArtOfTest.WebAii.Design.IntrinsicTranslators.Descriptors.HtmlDialogHandlerDescriptor.Execute(Browser browser)
   at ArtOfTest.WebAii.Design.Extensibility.HtmlActionDescriptor.Execute(IAutomationHost autoHost)
   at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep()
   --- End of inner exception stack trace ---

[Konstantin Petkov]

Hello Carlos,

We will need further details to be able to track down this error.

Does it occur running a test list only again or do you get the problem with the Quick Execution too? Also can you share the test log so that we can get a better picture of the test scenario? You can also check the Step Failure Details (double click on the failed step in the TestResults (Result View) or the TestExplorer. You should get a failure info dialog with more info and resolution suggestion for a live (running) page.

Thanks for any additional info you can share!

Greetings,
Konstantin Petkov
the Telerik team

[Carlos]

It happens on both the quick execution and test list

Failure summary:
Exception occured waiting for the new browser to connect.


Test Log
Overall Result: Fail
--------------------------------------------------
'16/08/2010 12:57:29' - 'Pass' : 1. Navigate to : 'http://www1.creditsafeuk.com/?sid=1729'
'16/08/2010 12:57:29' - 'Pass' : 2. Set 'TxtUserNameText' text to 'AutotestUK'
'16/08/2010 12:57:30' - 'Pass' : 3. Keyboard (KeyPress) - Tab (1 times) on 'TxtUserNameText'
'16/08/2010 12:57:30' - 'Pass' : 4. Set 'TxtPasswordPassword' text to '******'
'16/08/2010 12:57:32' - 'Pass' : 5. Keyboard (KeyPress) - Enter (1 times) on 'TxtPasswordPassword'
'16/08/2010 12:57:33' - 'Pass' : 6. Click 'MainContentBelgiumAreaTag'
'16/08/2010 12:57:43' - 'Fail' : 7. Connect to pop-up window : 'http://app.creditsafe.be/CSBELive/loginv2.aspx?uname=AutotestUK&pword=Quality&language=EN&origincountry=GB'
--------------------------------------------------
Failure Information:
~~~~~~~~~~~~~~~
Exception occured waiting for the new browser to connect.
InnerException:
System.OperationCanceledException: Exception occured waiting for the new browser to connect. ---> System.TimeoutException: Wait for condition has timed out
   at ArtOfTest.Common.WaitSync.CheckResult(WaitSync wait, String extraExceptionInfo)
   at ArtOfTest.Common.WaitSync.For[T](Predicate`1 predicate, T target, Boolean invertCondition, Int32 timeout)
   at ArtOfTest.WebAii.Core.Manager.WaitForNewBrowserConnect(String url, Boolean isPartial, Int32 timeout)
   --- End of inner exception stack trace ---
   at ArtOfTest.WebAii.Core.Manager.WaitForNewBrowserConnect(String url, Boolean isPartial, Int32 timeout)
   at ArtOfTest.WebAii.Design.IntrinsicTranslators.Descriptors.HtmlDialogHandlerDescriptor.Execute(Browser browser)
   at ArtOfTest.WebAii.Design.Extensibility.HtmlActionDescriptor.Execute(IAutomationHost autoHost)
   at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.ExecuteStep()
--------------------------------------------------
'16/08/2010 12:57:43' - Detected a failure. Step is marked 'ContinueOnFailure=False' aborting test execution.
--------------------------------------------------
'16/08/2010 12:57:45' - Overall Result: Fail
--------------------------------------------------

[Konstantin Petkov]

Hello Carlos,

You can try changing the default properties to connect to the page this popup holds. Follow the next steps:
- Find and select the page element in the ElementsExplorer
- Look at its properties. By default we look for all attributes of the page including the full path and query.
- Change the CompareMode property to FullPath. This should ignore the query.

Once you change that please save the project and re-run your test.

If that doesn't help, can you please submit a private support ticket and send the credentials to login to that site? I'd like to play with it and get back to you with resolution, thank you!

Kind regards,
Konstantin Petkov
the Telerik team

[John]

I see the following when I click on this link... 

Sorry for the trouble.

The page you were looking for could not be found.

thanks,
John

[Cody]

Hi John,

Are you referring to the vide Getting Started on Recording Tests (Best Practices)? This video was removed because we weren't completely happy with some of its content (we didn't explain ourselves thoroughly on some of the stuff we were doing and it was causing confusion). It's on our TO DO list to re-record it with better explanation and more details.

We have a couple of videos with related content to that one which you may enjoy:
http://tv.telerik.com/watch/automated-testing-tools/testing-kendoui-grid-with-test-studio
http://tv.telerik.com/watch/automated-testing-tools/silverlight-testing-best-practices
http://tv.telerik.com/watch/automated-testing-tools/webui-developer-webaii-best-practices-

Regards,
Cody
the Telerik team

[John]

Thank you, that is Great!  If you need, I could record snippets or or send you some of my own. 

John

[Cody]

Hi John,

We appreciate the offer. However we need to create the videos ourselves so it has the Telerik intro and polish on it (and to avoid any possible copyright/legal issues). We do welcome additions to our code library as samples.

All the best,
Cody
the Telerik team

[Dave]

I too am having similar problems running 4 tests in a test list, which all run fine in the Quick Test!

ArtOfTest.Common.Design.Exceptions.ExecutionException: Exception occurred waiting for the new browser to connect.

Exception occurred waiting for the new browser to connect.

Both the tests which are failing everytime contain a pop up new browser window step.

[Cody]

Hello David,

The key question to get answered is what was the URL of the popup window? Test Studio was looking for a browser window that has this exact URL:

https://qa-gms.thebigword.com/SingleSignOn/

Since I don't have a screen shot of what windows were opened at the time of failure, I have no idea if a window with this URL was present. Can you run the test again and carefully watch for this?

Regards,
Cody
Telerik