Is it feasible to automate progress ui application(s) using Test Studio? Does Test studio offer native interaction/ add-on(s) to automate progress application?

    When attempting to use the CommandLineClient (first time ever), on the scheduling server, in hopes to distribute tests across our 3 "runtime" servers I get the following error.

 

Telerik.TestStudio.Services.Common.Exceptions.SourceControlNotReachableException: Unable to reach source control server at: <our team's repo>
Command I'm running - Telerik.TestStudio.CommandLineClient.exe -l "C:\xxx\yyyy\Dev_Smoke.aiilist" -u"http://vm-01:8009" -d

 

I'm able to connect to our repo from the server I'm trying to execute this on... with the same user that's trying to execute.

What can I do to help troubleshoot this?

 

Hello,

I'm sort of confused why there are two CLI with test studio.  When am I suppose to use which?

It appears I can distribute tests using the command line client but not artoftest runner.  On the other hand the command line client doesn't accept setting overrides.

Why not combine both and get all the features in one common CLI?

So, we're moving into the cloud finally (Azure specifically), and while I did read through https://docs.telerik.com/teststudio/advanced-topics/build-server/azure-devops, I was a little disappointed to find that it recommends using a full blown VM for the test runners instead of something more ephemeral like a Docker container that hosts the ArtOfTest agent and then could be used on a more consumption / burst based model instead of having to being up all the time even when it's not doing anything.

Has anyone done anything like this?  Would it be possible to set this up at all using a Windows Server base image (Nano or Core - Nano preferably as it's so much smaller)?

I'll probably give this a shot over the next couple of weeks, but wanted to see if someone had already tried this path and had some tips (or landmines to avoid).

 

Thanks!

Brandon

I am currently using test studio with a product that displays multiple camera feeds split into a 3x3 grid. When ever I load the product with the recorder on Test Studio pops up 9 recorder menus each attached to the 9 camera feed windows. I am new to this software, so I apologize if I am missing something obvious, but where do I go to have it only display one recorder menu?

Thank you!

Is there a way to configure a Test Studio project to use certain TFS credentials when it gets the latest tests from source control?

I am running Test Studio tests in a different domain than the TFS server. It appears that that it uses the credentials of the Telerik Test Studio Runtime service account (tst\teleriksvc) when talking to TFS. These credentials, of course, are not valid since the service account is in a different domain than the TFS server.

My project is setup as follows:

• The project logged in TFS using generic TFS credentials (dev\teleriksvc) that we setup for the Telerik service account to use.
• Attached the project to source control.

We plan to execute test lists using CommandLineClient. We tried executing the tests with various configurations, but all of them result in an error saying the credentials are invalid for TFS. From the CMD stack trace:

Telerik.TestStudio.Services.Common.Exceptions.SourceControlNotReachableException: Unable to reach source control server at: http://devtfs.dev.com:8080/tfs
   at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<CheckForKnownResponseCode>d__35.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at Telerik.TestStudio.Shared.Communication.BaseCommunicationLayer.<HandleResponse>d__33.MoveNext()
--- End of stack trace from previous location where exception was thrown ---

....

We tried the following:

• Executed the test list with no additional configuration.
• Logged into TFS using dev\teleriksvc in browser. Execute test list.
• Modify the Telerik Scheduling Service account to "dev\teleriksvc" as noted here. I was unable to set updated account and received an error stating: "Error 1057: The account name is invalid or does note exist, or the password is invalid for the account name specified." I'm guessing this is a result of there not being an Active Directory Domain Trust between dev and test domains.
• Modified the project's setting.aiis file in the following way:
  • Set "TfsUserName": "teleriksvc" and "dev\\teleriksvc" and "dev\teleriksvc"
  • Set "TfsPassword": "{our password}"
  • Set "TfsDomain": "dev" and "" (empty)
  • I tried various combinations where the TfsUserName also includes the domain and where the TfsDomain is blank. None of these worked. What is the purpose of these configuration values if they don't work?

I tried running the CommandLineClient after each change noted above, and it resulted in the same stack trace error. If we remove the TFS integration with the project, the test list runs as expected using the CommandLineClient.

Ultimately, we simply want to provide the TFS username/password so that our service account provides those credentials instead of the credentials of the service account. How do we make this happen?

I am getting the "storage service unavailable" error dialog quite often.  As I recall I used to get this intermittently when I had the application installed locally, and it also happens with the installation we have on our server.  Both the application and the execution server are installed on the same machine.  I initially ignored it since it didn't seem to affect anything (aside from being really annoying) and was intermittent, but from what I can tell it is causing the execution server to run outdated versions of our tests.

It is really happening a lot now, and I don't know what is causing it.  Based on a few tests I noticed that I was able to get it to go away by running a test list remotely.  I saw some references to this online, and I tried the steps of "reapplying" everything which seems to reconfigure/reinstall MongoDB, the Storage Server, and the Scheduling Server.  I did notice that the one scheduled tests list I have seems to have stopped running possibly as a result of these actions so I need to look into that as well.

This seems to be the relevant error in the log file.  I assume UploadToCloudAsync is correct even though the service is installed locally in our case.

[01/29 09:37:41,Telerik.TestStudio.Desktop.exe(21088:1),TestStudio] StorageUploader.UploadToCloudAsync() : ------- Function Start -------
[01/29 09:37:42,Telerik.TestStudio.Desktop.exe(21088:1),TestStudio] StorageUploader.UploadToCloudAsync() : ------- Function End -------
[01/29 09:37:43,Telerik.TestStudio.Desktop.exe(21088:1),TestStudio] StandaloneHost.UpdateScheduledJobsToStorage() : EXCEPTION! (see below)
     Outer Exception Type: System.NullReferenceException
     Message: Object reference not set to an instance of an object.
     HRESULT: 0x80004003 (Official ID (if app.) = E_POINTER, Error Bit = FAILED, Facility = FACILITY_NULL, Code = 16387)
     Call Stack:
          at ArtOfTest.WebAii.Design.Repository.StorageUploader.<UploadToCloudAsync>d__3.MoveNext()
          --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
          at ArtOfTest.WebAii.Design.Repository.Commands.UploadToCloudCommand.<ExecuteAsync>d__11.MoveNext()
          --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
          at ArtOfTest.WebAii.Design.ProjectModel.StandaloneHost.<UpdateScheduledJobsToStorage>d__243.MoveNext()

How can I detect dialog (Logon) existence before handling it ?

Here is a short description of tests structures :

 

Authentication Test

1. Navigate to URL
2. Logon using Dialog
3. Wait for page content loading

Someother Test

1. Execute Authentication Test
2. Click on button...

Currently, in the application being tested, requirements have changed so that in the Authenticate Test, it is really needed to detect a dialog existence before handling it (step 2) : that means Step 2 can be bypassed sometimes but required some others (please, do not ask why :) ).

That leads to a fail (no dialog to is found for handling) or success (Dialog is found).

What we have tried is marking the ContinueOnFailure property of the Step 2 in Authenticate Test to True but, wrong idea : when calling Authenticate Test within Someother Test (test as step), ContinueOnFailure does not ignore the Logon failed step stopping Someother Test execution to step 1.

A workaround for this could be marking Step 1 in Someother Test ContinueOnFailure property also to true but Noo, we already have tons of tests calling it and we dislike this approach.

So, Is there a solution?

   

Hello Telerik,

 When running a test list through the command line, is there an option to attach the results file to the email sent? Trying to find some documentation on it and I'm coming up empty. Any help you could give would be greatly appreciated. Thanks all.

     We've just started using recordings of the automated tests. This was fine, until one day the resolution of the tests seems to have dropped in the recordings, and we can't put it back to what it was.  The Test Runner is on a machine with 3840x2160 resolution, but the recordings are now always in 1920x1080.  In the Test Runner settings, the setting to change the resolution only has one value (1920x1080) and in the dropdown does not offer anything else. 

Thanks for helping me find how I can change this configuration.