Step Failure Details dialog

[Dave Clarke]

Hi There

We have recently upgraded from v1.1 of WebAii design canvas to Telerik's WebUI Test Studio Dev ed (2010.1). It has some nice new features (thanks for that!) but we are still left wanting for what we consider to be a key feature.

We need (we logged this last year with WebAii support) an improved "step failure dialog", that clearly shows the expected and actual html captured, side by side, with formatting and any differences clearly highlighted. We often have tables of figures that we "verify InnerMarkup" at the whole table level. When one of these verify steps fail, it is impossible to see the differences between actual and expected text, until we copy and paste into a third party tool (eg WinMerge). What we really need is a "side by side" html formatted view of expected versus actual so we can quickly identify table cells or other parts of an html block that have different values, with differences clearly highlighted.

Have you any thoughts on:

a) when/if this feature will become available? 

b) what workaround you would recommend in the short term?

Also (and this we think is a bug)  we often find that the screen shot captured (image tab of step failure dialog) at time of failure has a  "black square" obscuring part of the screenshot that was captured at the time the verification step failed.

thanks

Dave Clarke

Visualize Systems

on behalf of Unilever PLC, UK

[Missing User]

Hello Dave,

Thanks for your compliments of the new features in WebUI Test Studio. I do remember this feature request and logging it. I was able to find the work item and need to confer with my boss on the status of the request.

Unfortunately, I do not now of another work around to do the compare for you, unless you wanted to use WebUI to automate uploading the .trx files on a site like this. But I'm not sure that would be of any more help to you.

The black screen with snap shots is a known issue and may involve the Windows implementation we use to take the snap shot. Is this happening for every Failure Resolution screen (see attached screenshot) or the image saved to the TestResults folder?

Regards,
Nelson Sin
the Telerik team

Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items.

[Matthew Roberts]

OK thanks, a comparer tool would be really useful!

re: screenshot blackout.

It happens when you view it in the dialog, as per your screenshot. We are on XP SP3.

cheers
Dave

[Missing User]

Hello again Matthew,

Thanks for the response back. Are any of the Storyboard screenshots also blacked out for any of your test steps?

Sincerely,
Nelson
the Telerik team

Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items.

[Dave Clarke]

Hi There

No all the storyboard screenshots look fine.

thanks

Dave

[Missing User]

Hi again Dave,

Thanks for the update. We are still looking into a WinMerge feature as far as what would be required to have something like this implemented in WebUI.

Also, is the blackscreen snapshot issue occurring on local test runs or in continious integration type server test runs?

Kind regards,
Nelson
the Telerik team

Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items.

[Dave Clarke]

Hi

Yes it happens on local test runs too.

thanks

Dave

[Missing User]

Hello again Dave,

Thanks for the extra info. Unfortunately, this is a know issue we are tracking and possibly due to the .NET Framework calls we use to capture the screen at the point of failure for the test.

We'll look to address the issue as soon as we can. You could try in a code behind file something similar to this thread, but in the cleanup instead of  Log.WriteLine("Failed Step: " + this.ExecutionContext.CurrentStep.Description);

you can try taking several screenshots using the equivalent number of calls with the following line: Log.CaptureBrowser(ActiveBrowser, "FileNamePrefix"); 

Regards,
Nelson
the Telerik team

Do you want to have your say when we set our development plans? Do you want to know when a feature you care about is added or when a bug fixed? Explore the Telerik Public Issue Tracking system and vote to affect the priority of the items.