Possibility of load testing

[Helen]

Hi,
I was wondering if there exists a possibility to create load-tests using WebUI test studio?
I mean launching n-number of instances at the same time to create reality-like load for the web application/server?

Thanks in advance,
Helen

[Daniel Levy]

Hello Helen,

WebUI Test Studio's Developer Edition used to have such functionality, however we noticed a pattern that caused us some concern. Many users were attempting to convert their functional tests to stress tests – the problem is that stress scenarios need to be carefully thought through right from the start  and recorded just for that purpose. Although cross-leverage is possible, most real world functional tests will not make good stress tests.

After consideration we decided it would be better to remove it from the product as it was promoting bad testing practices.

Hope this helps and please let us know if you have any additional questions!

Sincerely yours,

Daniel Levy

the Telerik team

[Helen]

Hi Daniel

Thanks a lot for clearing that out.

Helen

[karla]

Hi,

Just I'm reading this post, this functionality, will be added to WEbUi Test Studio in the future? when do you expect to add it?

Best Regards,

[Cody]

Hello karla,

We are planning on adding new Load & Performance features into the product. It is on our product roadmap but we cannot commit to a specific time frame at this time.

All the best,
Cody
the Telerik team

[Jeff]

Since Test Studio is already integrated with Visual Studio are you going to take advantage of Visual Studio's native load testing capabilities?  It already allows you to create load tests that leverage your existing web tests.  If you guys could take what they have and improve upon it that would be great.  The VS load testing features are at best adequate.  If you could add cloud-based load generation (very powerful and cost effective) and add functionality that will allow the user to adjust load/requests per second during runtime that would be very powerful and my company would jump at the opportunity to purchase the tool.

[Cody]

Hello Jeff,

As always thank you very much for your feedback! I have passed it along to our product manager and development team for consideration.

Our implementation for load & performance testing is in the architectural design phase right now. We're don't know if we can take advantage of the load testing feature that's already built into Visual Studio. It uses a very different technology compared to a Test Studio test. Visual Studio's load testing depends on Visual Studio web tests. Web tests work by sending HTTP requests directly to the server and then analyzing the responses it gets back. A load test simply sends a lot of HTTP requests directly to the server and doesn't really validate the responses. It only measures the timing of the responses.

Test Studio tests work by hooking into and driving the browser directly (which in turn communicates with the server) then studying the contents of the DOM (and Visual Tree in the case of Silverlight application testing). These are two very different worlds.

Kind regards,
Cody
the Telerik team

[Krish]

Hi Cody,

  I have created Load testing project and having following issues if you can provide guide lines for following as soon as possible that will be great help for us.

01. How to edit the load testing script(captured steps of the script) with while loop, if else conditions and loops..??

02. Is it possible to edit the recorded script with command such as Log.WriteLine().?? Simply how to add coded steps within the load test script..??

03. Can we manage no of virtual users within the load test project by editing load test script which meant recorded steps through while loop..??Simply our requirement is within 1 minute time we need only 5 or 7 users to execute and send 500 or more requests by one particular user. According to our business requirement one user consists with 500 or more records. So one user sends us 500 or more requests within one minutes. Addition to that we have 5 or 7 users to execute within one minute time. Thereby overall requests approximately close to (let's say 7 users) 3500. Please explain how to generate script for the above scenario. We do not need to increase no of concurrent(virtual) users. We just need to increase the no of requests by particular single user.

Note: - kindly answer for the all three queries..

Thanks..

[Cody]

Hello Krish,

Thank you for your questions. I will to my best to answer them completely for you:

1) At this time Test Studio load tests (unlike functional web tests) do not support conditional logic like Loops, IF/Else branching, etc.

2) We are actively working on adding the ability to include coded steps in our load tests. It will be included in our next Service Pack release, but is not currently available.

3) Since load tests do not support conditional logic, I don't think you can control the number of active Virtual Users the way you are thinking. Instead I recommend you consider creating multiple User Profiles with different activities and/or think times. A single load test can consist of as many User Profiles as you like and you can specify what percentage of the total load with come from each User Profile e.g. User Profile A can send 80% of the load and User Profile B can send 10% and User Profile C can send 10%. The total must be 100% for all User Profiles contained in the load test.

Kind regards,
Cody
the Telerik team

[Andrew]

when do u think you have support for the logical loop from the ui tests in the load test.

I have a ui test that I would like 2 run as a load test but it contains logical loops.

also does Telerik Load Tests handle dialogs for it the test needs to upload files to the site?

[Cody]

Hello,

when do u think you have support for the logical loop from the ui tests in the load test.

It's unclear to me if you're asking about recording a load test from a web test that contains loops, or when will a load test be able to run loops during the execution of the load test. So I will answer both ways.
1) While recording a load test from a web test, what's literally happening is all HTTP requests and responses that are generated, as a result of the web application running in a browser, are recorded and placed into the User Profile of the load test. If the web tests does loops, the HTTP traffic that occurs as part of that loop will be faithfully recorded. In the end you get one long sequence of HTTP requests that will make up the User Profile. Each loop will be recorded in sequence.
2) Adding the ability for a load test to run a loop has not been scheduled for implementation. I cannot give an ETA when it will be at this time.

I have a ui test that I would like 2 run as a load test but it contains logical loops.

This doesn't really present any problems. As explained above, the HTTP traffic for each and every loop will be recorded as one long single sequence of HTTP requests which will be played back when you execute your load test.

also does Telerik Load Tests handle dialogs for it the test needs to upload files to the site?

Our load test does not launch a browser. Because there's no browser:

1. There will never be a dialog (e.g. file upload/download) ever displayed during a load test. 
2. JavaScript will not run
3. The Silverlight run time engine will not run

Our load test will record and faithfully playback the HTTP traffic which simulates uploading or downloading a file to/from your web server. No actual file on your HDD will be used or created however. When simulating an upload it will echo back the canned file data that was used when the user profile was recorded. When simulating a download the file data will be discarded by the load test, but the web server will see a "successful download" as far as it can tell.

I hope this helps.

Regards,
Cody
Telerik

[Andrew]

ok,

the thing is that I need to be able to run a VU bound load test on my server that actually does upload files, waits for the files to be processed (the loop that checks for the page to change) and then continues on.

the files that are uploaded are processed via MSMQ so as the load (file submissions) increases the time the process will take longer. I need to simulate that process.

I have the web test written and it works great, but I just need to run it simulating 1000 users using the site over a 1 hour period to see how the server handles it and how long it will take each user to complete their task.

[Cody]

Hi Andrew,

I have to be up front and say that it doesn't sound like Test Studio Load Testing will fit your needs.

• As previously stated, a load test can simulate uploading and downloading files, but there's no way to make it upload or download real files from disk. It can only upload what was previously recorded as canned data, and download something that will use the same number of HTTP requests to finish the download. It cannot handle a variable sized download.
• There's no way to do logical loops during a load test. In your case you need a While or Until type of type. We won't even look at the response, except to pull the data for Dynamic Targets out of the response.
• If your web server will hold the TCP connection open indefinitely until the file has been processed we can work with that and measure how long it took to finish that one HTTP transaction. We just don't have any looping capability while the load test is running that checks the response waiting for state to change.

Regards,
Cody
Telerik