Silverlight 5

[kiley]

Hello,

It appears that WebAii (even the latest internal build that is available) does not work with Silverlight 5 beta.  It errors out with a timeout exception that reads, "Timeout trying to connect to Silverlight App". I'm very eager to find out if there is a way for me to get WebAii to work with Silverlight 5 beta.  And if not, when will Silverlight 5 be supported?  Will it be after the Silverlight 5 RTW happens?

Thanks!

Kiley

[Stoich]

Hello Kiley,
    I tried to reproduce this issue but I wasn't able to do so. Currently Silverlight 5 beta seems to be integrated with the Framework.

You're probably missing one key line of code:

Settings.Current.Web.EnableSilverlight = true;

This should be the very first line of code in your test method.

Check out the section on this in our docs:
http://www.telerik.com/automated-testing-tools/support/documentation/user-guide/telerik-testing-framework/silverlight-test-automation/introduction.aspx

All the best,
Stoich
the Telerik team

[kiley]

Hello Stoich, thank you for your prompt reply.

That's great to hear that WebAii should work with Silverlight 5 beta, however, I'm still unable to get it to work.  I have the latest WebAii installed and to ensure that things are setup correctly, I am using the 'QuickStarts_NUnit_CS' solution that was included with the WebAii installer.  I've also converted the solution to Visual Studio 2010.  

To verify that my Silverlight 5 test is correct and that it *should* work, I have created a Silverlight 4 test and verified that it passes.  My Silverlight 5 test is nearly identical to it.

Here are the two tests that I'm trying to run.  As stated above, the Silverlight 4 test succeeds, but the the Silverlight 5 test fails with the message from my original post.

[Test]
public void Silverlight4Test()
{
    Manager.LaunchNewBrowser( BrowserType.InternetExplorer );
    ActiveBrowser.NavigateTo( "http://www.silverlight.net/content/samples/sl4/toolkitcontrolsamples/run/default.html" );
    SilverlightApp app = ActiveBrowser.SilverlightApps()[ 0 ];

    Assert.IsNotNull( app.Find.ByName( "InstallApplicationPanel" ) );
}

[Test]
public void Silverlight5Test()
{
    Manager.LaunchNewBrowser( BrowserType.InternetExplorer );
    ActiveBrowser.NavigateTo( "http://some-silverlight-5-site.com/hosting-page.html" );
    SilverlightApp app = ActiveBrowser.SilverlightApps()[ 0 ];  // This is where it times out...

    Assert.IsNotNull( app.Find.ByName( "userLogOnOffControl" ) );
}

If you have any other suggestions, I would be very appreciative of your help.

Thanks,
Kiley

[kiley]

Hi Stoich (or anyone who is testing against Silverlight 5 beta),

What exact version of the Telerik Testing Framework were you using to successfully test against Silverlight 5?  I'm still unable get this working and could really use some help.

Thanks,
Kiley

[Stoich]

Hi Kiley,
    I just discussed this with our developers. Apparently we do have some issue with SL 5 beta (curiously I wasn't able to him them initially). The good news is that we've already developed a fix for the issue which will be made available with our next internal build. The build should be uploaded in the next few days.

I'll let you know when it becomes available.

Kind regards,
Stoich
the Telerik team

[kiley]

Hi Stoich,

This is great news -- I'm very anxious to get my hands on the next build.  Do you anticipate it this week?

Thanks,
Kiley

[Stoich]

Hello Kiley,

    as of a few hours ago the new internal build is available for downloading. You can download it from your Telerik account. Let me know whether you still encounter problems with Silverlight 5 beta automation after upgrading.

Greetings,
Stoich
the Telerik team

[kiley]

Hi Stoich,

Thanks for letting me know about the new build.  However, I'm still unable to use the testing framework with any Silverlight 5 site.  I have tried Internet Explorer, Firefox and Chrome as well.

Please let me know if you or your Silverlight developers have other suggestions.  Also -- are you able to successfully test against a Silverlight 5 site?  Could you attach a working sample?

Thanks for your help,

Kiley

[kiley]

Hi Stoich,

I'm including some error details for your reference:

Error Message:

Test method QuickStarts_VSTS_CS.SilverlightHealthcareSample.Silverlight5Test threw exception:
System.TimeoutException: Timeout trying to connect to Silverlight App.

Error Stack Trace

ArtOfTest.WebAii.Silverlight.SilverlightApp.WaitUntilExtensionCreated(String extensionCall)
ArtOfTest.WebAii.Silverlight.SilverlightApp.Connect(Int32 timeout)
ArtOfTest.WebAii.Silverlight.SilverlightApp.Connect()
ArtOfTest.WebAii.Silverlight.SilverlightAppsList.get_Item(Int32 index)
QuickStarts_VSTS_CS.SilverlightHealthcareSample.Silverlight5Test() in D:\Program Files (x86)\Telerik\Testing Framework 2011.1\Samples\Testing Framework\QuickStarts_VSTS_CS\Tests\SilverlightHealthcareSample.cs: line 358

Debug Trace

Uncategorized: DialogMonitor.Start() : Using: ArtOfTest.WebAii, Version=2011.1.825.0, Culture=neutral, PublicKeyToken=4fd5f65be123776c
Uncategorized: DialogMonitor.Start() : OS: Microsoft Windows NT 6.1.7601 Service Pack 1
DialogPlayback: DialogMonitor.Start() : Beginning monitoring for dialogs from the set {}.
UIAutomation: AutomationExtensions.AddAutomationEventHandler() : Added a(n) WindowPatternIdentifiers.WindowOpenedProperty handler on element System.Windows.Automation.AutomationElement scope Descendants.
Framework: Manager.get_ActiveBrowser() : The current ActiveBrowser is either invisible or disconnected.
Framework: InternetExplorerActions.LaunchNewBrowserInstance() : Process launched (ID=2996, Path="C:\Program Files (x86)\Internet Explorer\iexplore.exe", Arguments="-nomerge about:blank").
Framework: InternetExplorerActions.LaunchNewBrowserInstance() : Attempting to attach on IE frame (HWND=328512)...
Framework: Connector.Start() : Process launched (ID=3440, Path="C:\Windows\SysWOW64\rundll32.exe", Arguments="ArtOfTest.Connector.dll,AttachToWindowEntryPoint 328460").
Framework: Connector.Start() : Process exited (ID=3440, ExitCode=0, Path="C:\Windows\SysWOW64\rundll32.exe", Arguments="ArtOfTest.Connector.dll,AttachToWindowEntryPoint 328460").
Framework: InternetExplorerActions.LaunchNewBrowserInstance() : Process "QTAgent32" (ID=1268) is assumed to host the controller.
Uncategorized: Connector.InjectCode() : ------- Function Start  -------
Framework: Connector.InjectCode() : Connection string: C:\Windows\assembly\GAC_MSIL\ArtOfTest.InternetExplorer\2011.1.825.0__5339893a7cefe4d6\ArtOfTest.InternetExplorer.dll?ArtOfTest.InternetExplorer.ArtOfTestPluginEntryPoint?1268
Framework: InternetExplorerActions.WaitForDocument() : Attempting to get IHTMLDocument2 from Internet Explorer HWND 328460 on another thread...
Framework: <>c__DisplayClasse.<WaitForDocument>b__7() : Attempting to get document from window handle
DialogPlayback: DialogMonitor.AutomationEvent_OnWindowOpened() : New window detected, but not considered a dialog (Text = "Blank Page - Windows Internet Explorer", ClassName = "IEFrame").
Framework: InternetExplorerActions.WaitForDocument() : IHTMLDocument2 successfully retrieved.
Framework: Connector.InjectCode() : Sending WM_COPYDATA to HWND 328460 (lpData = "C:\Windows\assembly\GAC_MSIL\ArtOfTest.InternetExplorer\2011.1.825.0__5339893a7cefe4d6\ArtOfTest.InternetExplorer.dll?ArtOfTest.InternetExplorer.ArtOfTestPluginEntryPoint?1268")...
Framework: BrowserProvisioner.ServiceThread() : A new client has connected to the provisioning pipe.
Framework: BrowserRemoted.AsyncListenerThreadEntry() : Not connected; this will now wait indefinitely for a pipe client connection...
Framework: BrowserRemoted.AsyncListenerThreadEntry() : A new client has connected to the pipe.
Framework: BrowserRemoted.AsyncListenerThreadEntry() : Now waiting indefinitely for a command from the pipe client...
Framework: Connector.InjectCode() : Returned from sending WM_COPYDATA (LRESULT=0, GetLastError()=DS_S_SUCCESS).
Uncategorized: Connector.InjectCode() : ------- Function End -------
Framework: Manager.AddNewBrowser() : Added client ID "Client_953810ae-8f55-4ea8-8fa9-bfe4e1cdb116" (now there is/are 1 total).
Framework: BrowserProvisioner.EndService() : Connecting to the provisioning pipe "Pipe.ArtOfTest.WebAii.BrowserProvisioner" in order to unblock and eventually terminate it...
Framework: BrowserProvisioner.EndService() : Provisioning pipe connected.
Framework: BrowserProvisioner.ServiceThread() : A new client has connected to the provisioning pipe but this will be treated as a termination cue.
Framework: BrowserProvisioner.EndService() : Provisioning thread terminated.
DialogPlayback: DialogMonitor.AddDialog() : Added {OnBeforeUnloadDialog(Dismiss=OK)} for monitoring.
Framework: Manager.RemoveBrowser() : Removed client ID "Client_953810ae-8f55-4ea8-8fa9-bfe4e1cdb116" (0 remaining).
Framework: Manager.SetActiveBrowser() : Active browser is now null.
Framework: BrowserRemoted.End() : Now aborting the listener thread (TID = 20).
Error: PipeCommunication.AsyncPipeRead() : EXCEPTION ("Pipe Null State: False")
     Type: System.Threading.ThreadAbortException
     Message: Thread was being aborted.
     Call Stack:
          at System.Threading.WaitHandle.WaitOneNative(SafeHandle waitableSafeHandle, UInt32 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext)
          at System.Threading.WaitHandle.InternalWaitOne(SafeHandle waitableSafeHandle, Int64 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext)
          at System.Threading.WaitHandle.WaitOne(Int32 millisecondsTimeout, Boolean exitContext)
          at System.Threading.WaitHandle.WaitOne()
          at ArtOfTest.WebAii.Messaging.Process.PipeCommunication.AsyncPipeRead(PipeStream pipe, Byte[] bytes, Int32 offset, Int32 count)

DialogPlayback: DialogMonitor.Stop() : Dialog monitoring is being halted.

I look forward to hearing from you.

Thanks,
Kiley

[Stoich]

Hello Kiley,
    I will try to explain the situation.
Currently we're integrated with the latest "internal" build of SL5 Beta but the integration has been lost with the officially available SL5 Beta. I apologize for mistakenly informing you that the new Testing Framework build will resolve the issue.

 Telerik is a certified Microsoft partner. As such we have access to newer SL 5 Beta builds that are not yet publicly available. Since our end goal is flawless integration with the upcoming SL 5 official release, naturally we always work with the latest SL5 Beta available to us.

As already mentioned once SL5 is officially release we should fully support it. Is this issue a show stopper for your company? It might be possible to come up with a custom build in order to resolve the issue if you feel it's necessary.

All the best,
Stoich
the Telerik team

[kiley]

Stoich, thank you very much for the clarification.

Currently, our company is in the process of rewriting a very large-scale web application using Silverlight 5. The existing HTML product has a large suite of UI automation tests around it to ensure constant quality of the product.  We will not release our new Silverlight 5 application without this same UI automation test suite around it -- so, I guess you could say that this is a show stopper in a way.

You mentioned that it may be possible to come up with some sort of a custom build to resolve the issue for us.  Can we explore that option a bit further?

Thanks,
Kiley

[Stoich]

Hello Kiley,
  I'm sorry to hear that this is a problem for you. I discussed this with our developers and we came to the conclusion that preparing such a build would require a susbantial amount of effort. Flawless integration with the official SL5 release is top prority for us.

The SL5 Beta will be discarded once the offical SL5 becomes available. We're currently nearing a major release and we have our hands full, we don't see enough value in spending effort on integration with a product that will be discarded in the near future. 

Best wishes,

Stoich
the Telerik team

[kiley]

Stoich,

Thank you for looking into the option of a custom build of the WebAii framework for us -- your time is greatly appreciated. That said, would you be willing to share the Silverlight build/revision number that your developers are using to develop against?  The reason I ask is because we are also a Certified Microsoft Partner and have several contacts at Microsoft who could assist us in obtaining the same build (or a later one) that you have, which I'm guessing should work with your latest published WebAii build.

Thanks,
Kiley

[Stoich]

Hi Kiley,
    I've sent you the build number for the SL5 runtime in an e-mail. However, you will have to obtain the actual SL runtime your self. Since you're a Microsoft partner I hope this will not be a problem. Once you've managed to obtain the build let me know and I'll send you the necessary Testing Framework build.

Kind regards,
Stoich
the Telerik team

Check out Telerik Trainer, the state of the art learning tool for Telerik products.