Tests in headless mode stopped working

[Tomasz]

Hello Telerik Team,

 

Some time ago my test lists started failing with no steps being executed at all (0 test steps performed in each script). This only happens in headless mode and everything was working all right until the end of last year. The same tests executed in Chrome (browser) mode is finished correctly.

I've already tried creating a new test list, updating the .net framework and redownloading the repository with the tests, but to no avail. Do you know what might be the culprit here? I can provide more information if necessary.

 

Best regards,

Tomasz

 

Error:

------------------------------------------------------------
'2/28/2022 2:04:17 PM' - Executing test: 'DWOO - Functionality in the Members resources grid(ChromeHeadless)', path: 'Production\DWOO - UI regression\DWOO - Functionality in the Members resources grid.tstest.'
'2/28/2022 2:04:17 PM' - Using .Net Runtime version: '4.0.30319.42000' for test execution. Build version is '2022.1.215.0'.
'2/28/2022 2:04:17 PM' - Starting execution....
'2/28/2022 2:04:18 PM' - Failure detected during execution. Details:
------------------------------------------------------------
'2/28/2022 2:04:18 PM' - System.ServiceModel.FaultException: The server was unable to process the request due to an internal error.  For more information about the error, either turn on IncludeExceptionDetailInFaults (either from ServiceBehaviorAttribute or from the <serviceDebug> configuration behavior) on the server in order to send the exception information back to the client, or turn on tracing as per the Microsoft .NET Framework SDK documentation and inspect the server trace logs.

Server stack trace: 
   at System.ServiceModel.Channels.ServiceChannel.ThrowIfFaultUnderstood(Message reply, MessageFault fault, String action, MessageVersion version, FaultConverter faultConverter)
   at System.ServiceModel.Channels.ServiceChannel.HandleReply(ProxyOperationRuntime operation, ProxyRpc& rpc)
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at Telerik.TestingFramework.Hosts.Common.IBrowserLauncher.LaunchBrowser(ILauncherOptions launchOptions)
   at ArtOfTest.WebAii.Messaging.Process.HostsProxy.LaunchBrowser(ILauncherOptions launcherOptions)
   at ArtOfTest.WebAii.BrowserSpecialized.Chrome.ChromeActions.LaunchCDPManagedBrowser(String startUrl, BrowserType browserType, Boolean windowVisible)
   at ArtOfTest.WebAii.BrowserSpecialized.Chrome.ChromeActions.LaunchNewCDPManagedBrowser(Manager manager, Boolean windowVisible)
   at ArtOfTest.WebAii.Core.Manager.LaunchNewBrowser(BrowserType browserToLaunch, Boolean waitForBrowserToConnect, ProcessWindowStyle windowStyle, String arguments)
   at ArtOfTest.WebAii.Design.Execution.ExecutionEngine.InitializeWeb(ExecutionEngineCreateParams initParams)
   at ArtOfTest.WebAii.Design.Execution.TestExecuteProxy.CreateAndInitializeEngine(Test test, ExecutionEngineCreateParams cp)
   at ArtOfTest.WebAii.Design.Execution.TestExecuteProxy.ExecuteTest(ExecuteTestCommand command)
------------------------------------------------------------
'2/28/2022 2:04:28 PM' - Test completed!

 

 

[Elena]

Hello Tomasz,

Thank you for your prompt message. 

Based on the execution log I can say that this issue was already identified last week and we are working on resolving this. The good news is that this is limited to the Chrome headless and Chrome extension-less test execution and on specific OS versions, the normal mode of Chrome and the rest of the browsers work fine.

Once we have the fix this will be published with the latest browser support update mechanism and will not require the installation of a new build. 

Can you, please, share your OS version in the comments, so that we can include it in the testing, if it is not yet? 

Thank you for your cooperation in advance.

Regards,
Elena
Progress Telerik

[Tomasz]

Hello,

 

Thank you for the answer. I can confirm that tests are working correctly in a regular (non-headless) mode. My OS version is:

System: Windows 10 Enterprise, version 21H2

 

Best regards,

Tomasz

 

[Elena]

Hi Tomasz, 

Thanks for your prompt response. Here is the public item on our feedback portal- you can follow this to get news when this gets updated.

Regards,
Elena

[Tomasz]

Hi,

Since the last Service Pack update the tests are running correctly in headless mode again. Thank you very much Telerik Team, as this concludes the topic on my end. :)

 

Best regards,
Tomasz

[Elena]

Hi Tomasz, 

Thanks for confirming the issue is resolved! Let us know if there is anything unexpected you encounter.

Regards,
Elena

[Stephen]

Is there any update on this?

Is  headless mode required to run test lists in an Azure DevOps pipeline?

Thanks!

[Elena]

Hi Stephen, 

The bug with Chrome headless execution for specific WIndows OS build is resolved in our latest official R1 SP release (v.2022.1.412). You can use the Check for updates options to download and upgrade to this version. 

As to the Azure DevOps pipelines Chrome headless is a requirement only if you are using the Microsoft hosted agent to manage the pipeline. 

If you integrate Test Studio tests with the Azure self-hosted agent the test runs can be executed against any of the supported browsers including the headless mode of Chrome.

I hope this information will be helpful for you. Let me know in case of further questions.

Regards,
Elena