Functionalities for Test Studio

[Mihai]

Hello,

We want to use Test Studio or other tool for automated testing, but before we decide we have some questions.
Does the application has any of the below functionalities:
- email alert (I saw this was an option for some test but how about performance test, load test ... )
- can we use multiple users to run tests in the same time? How many?
- can we run scripts in the beginning/middle/end of the test?
- can we simulate response from an address that is unavailable from testing server? (Let's say the application calls an internet service and the test  server does not have internet access would be good if we simulate a response)

[Byron]

Hi Mihai,

Each of these is possible, although simulating site response requires additional software. Specifically:

Does the application has any of the below functionalities:

- Email alert

Yes. Email alerts are an option for scheduled tests. They can be configured at the time the test is scheduled. You can schedule a test list, which can be made up of web tests (which can also target Silverlight applications) or WPF tests, but not load or performance tests. 

- Can we use multiple users to run tests in the same time? How many?

Yes. If you wish to run the same test using multiple virtual users, you can do so using our load test features. If you wish to run different tests simultaneously, you can do so using multiple machines with installations of Test Studio Runtime Edition. The Runtime edition can execute tests, but cannot create or edit them.

- Can we run scripts in the beginning/middle/end of the test?

Yes. Using a coded step, you can insert C# or VB code at any point in your test.

- Can we simulate response from an address that is unavailable from testing server?

Yes. However, Test Studio does not provide this functionality built-in. Instead, you can use Fiddler trace to capture web traffic against the live site, then simulate its responses later. Fiddler will capture the browser's requests and respond to them as the website did; Test Studio will automate the browser as usual. If you are unfamiliar with how to do that please refer to this short video. You can download the Fiddler application from here.

All the best,
Byron
the Telerik team

[Byron]

Hi Mihai,

I would like to add:

Regarding scheduled tests, automated tests can be scheduled only for web or WPF tests, but manual and performance tests can be scheduled by changing the test list type for the scheduled list to 'Manual' or 'Performance'.

Kind regards,
Byron
the Telerik team

[Mihai]

Hi Byron,

Thanks for your responses. I would like to add one last question. We would like to test if the when the response time for some services/sites are above a certain level. Can we make tests for this and receive results by email when the request is above a specified time span?

Thanks,
Mihai

[Byron]

Hello Mihai,

There is not currently a feature to accomplish this automatically through the user interface.  You can receive email updates when a test list executing in performance mode completes. However, to receive emails from Test Studio only when the results of a performance test meet certain criteria, you will need to use code.

To do so, you will need to create a test studio extension. The following code sample is an example of accessing the performance results, specifically, writing the server and client time for each step in the performance test.

public override void OnAfterTestCompleted(TestResult result)
{
    string filePath = result.ProfilerResultsPath;
    ProfilerResultsFile resultsFile = new ProfilerResultsFile(null, filePath);
    foreach (ProfilerTestStep step in resultsFile.Steps)
    {
      Log.WriteLine(step._serverTime);
      Log.WriteLine(step._clientTime);
    }
}

You can also use C# to generate emails with output from your extension.

Please let us know if we can assist you further.
 
All the best,
Byron
the Telerik team