Performance tests result analysis

[Veenu]

Hi,

I am using Telerik's Test Studio for evaluating the same for functional testing of the application and so far we are successful with the evaluation of the tool. I was wondering if I can use the same for Performance testing of the application as the tool offers the same also. Till now we are using HTTP Watch for the performance testing of the application, but unlike Test Studio that doesn't offer automation of scripts. So, I tried the Test Studio for the same scenario as we use to do with HTTP Watch and found that there is difference of timings provided by both the tools i.e. if HTTP Watch shows 1.7 secs. then Test Studio gives 3.5 secs. in its result for multiple iterations there is approximately same difference among the results of the both tools.

Please let me know if there is any specific reason for this difference or how can I calibrate the results.

Thanks & regards,

Arvind Dhiman

[Rodney]

Hi Arvind,

Thank you for taking the time to evaluate Test Studio.

Let’s take a quick look at how Test Studio logs data during its performance tests.

Say you have the following test:

1.       1. Navigate to Page

2.       2. Click Button

The Navigate step occurs almost immediately, however this does not necessarily mean that the page is fully loaded. For that information, Test Studio relies on the Find Element time for the next step. That time is included in step one’s time. So, in our example above, if the Navigation takes 2 seconds and the button takes 10 seconds to be found, then step 1 will report a time of 12 seconds.

Ideally, the performance tools would offer similar results, but if HTTPWatch’s calculation mechanism differs even slightly, then you can quickly see how test results can vary.

For information on how to get the most from our Performance tests, you can review our document on Performance Testing. Please let me know if this helps. 

Regards,
Rodney
the Telerik team

[Veenu]

Hi Rodney

Thanks a lot for the valuable reply but I have already gone through this article and this doesn't solve my issue. What I need from Performance test results of Test studio is the total time taken (both client and server side) in rendering the complete page in browser after click of any link or button e.g.

1.) User click on a link from the Left Menu
2.) Page is rendered in browser with all js, css, aspx pages, images, ascx controls etc.

So I want the time from after step 1 (action taken) to page is rendered completely.

Do I need to search a element on page which is rendered at the end for getting such time? If yes then the time I require is the time taken in rendering that element or it will be the time for step 2 in above example.

Hope to hear from you soon

thanks and regards,
Arvind Dhiman

[Veenu]

Please let me know how to do the same. I am still waiting for a solution.


thanks & regards,
Arvind Dhiman

[Rodney]

Hi Arvind,

Thank you for your patience.

Based on your example, you want to calculate the time after the user clicks on the Left Menu, to the time the entire page is loaded.

If this is correct, your calculation will begin from the first click to the time the last element is loaded. This is includes all the js., Css.,  Aspx pages, images, ascx controls etc. According to your example, a result based on step 2 will provide you with the closest representation of that time.

Our documentation provides an  equation on how to Calculate Total Step Time:

Total Step Time = (Time that the Step Ended Execution + Time for the Next Step's Element to be Located) − Time that the Step Started Execution.

If you have any other questions regarding Test Studio's Performance Testing, please let me know. Unfortunately, I won't be able to address any more questions regarding the comparison between our software and HTTPwatch. We have the tools to research and assist with with our software's features but we cannot offer the same level of support regarding HTTPWatch. Being someone elses tool, we have no idea how it performs its measurements.

I hope this information helps.

Kind Regards,
Rodney
the Telerik team