Build in TFS succeeds with failed webaii test

[Tien Loong]

Hello,

Currently I am testing a trial version of WebUI Test Studio Developer Edition for our company and hereby I am using Team Foundation Server (TFS). I have created a test project with a webaii test in it (using the built-in recorder) and created a new build definition file. But when I try to start the build process and let it perform on a remote server (which has the same version of Visual Studio and WebUI Test Studio Developer Edition installed), the build process succeeds but the test fails. The following error message is returned:

Overall Result: Fail
--------------------------------------------------
'20-9-2010 14:44:07' - Unexpected exception during execution.
'20-9-2010 14:44:07' - System.NullReferenceException: Object reference not set to an instance of an object.
   at ArtOfTest.WebAii.Core.Manager.SetupDialogMonitoring()
   at ArtOfTest.WebAii.Core.Manager.LaunchNewBrowser(BrowserType browserToLaunch, Boolean waitForBrowserToConnect, ProcessWindowStyle windowStyle, String arguments)
   at ArtOfTest.WebAii.Core.Manager.LaunchNewBrowser(BrowserType browserToLaunch)
   at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.Initialize(Settings settings, String deploymentDirectory, ExecutionType exeType, Int32 lastStepIndex, IntPtr& hwnd, BrowserType browserType)
   at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.Initialize(Settings settings, String deploymentDirectory, ExecutionType exeType, BrowserType browserType)
   at ArtOfTest.WebAii.Design.Execution.TestExecuteProxy.ExecuteTest(Test test, Settings settings, String deploymentFolder, ExecutionType exeType, Int32 lastStepIndex, IntPtr& hwnd)
--------------------------------------------------
'20-9-2010 14:44:07' - Overall Result: Fail
--------------------------------------------------

Because I am new to using TFS, I do not know where the problem actually lies. There seems to be something wrong with launching the web browser, but the remote server has Internet Explorer 7 installed.

Here is some information about the computer and remote server:

PC:
- Windows 7 Home Premium
- Microsoft Visual Studio 2008, Version 9.0.30729.1 SP
- Internet Explorer 8

Server:
- Windows Server Standard without Hyper-V (2007, SP1)
- Microsoft Visual Studio 2008, Version 9.0.30729.1 SP
- Internet Explorer 7

Kind regards,

T.L. Siaw

[Nikolai]

Hello Tien Loong,

By looking at the exception it seem that you are trying to invoke a dialog handler for some dialog pop-up in your tests. Please have in mind that these actions require a user session but most probably your builds are created by windows service and you don't have a live session at the time the tests are run. If you plan to use UI automation with elements like dialogs/mouse/keyboard interaction you will need to run the tests in a live session environment. If you rearrange the tests and your application no to handle/use modal dialogs and keyboard/mouse events you can run the tests without live session.

Hope this helps.

All the best,
Nikolai
the Telerik team