Test Evidence

[Joseph]

HI,

I was wondering if anyone could help me with a couple of questions.

1, What sort of test results/evidence can i get from running tests in test studio, at the moment we are running test studio then ticking off the tests in another product as done, we would really like to use test studio for the complete testing phase but not sure if there was any way to produce test results/evidence that we could send our customers that would show what tests we have carried out/passed etc.

2. we are interested in the stand alone feature of test studio, but i can sseem to fin much documentation about it anywhere on how it works. e.g. is it a standalone.exe? could we send it to one of our customers when they install our software to check it works correctely in their environment?

Thanks

Jo

[Cody]

Hello Jo,

Item 1) Are you looking at the test log? Every test that runs generates a log like this:

Overall Result: Pass
------------------------------------------------------------
'7/14/2013 5:00:40 PM' - Using .Net Runtime version: '4.0.30319.18052' for test execution. Build version is '2012.2.1527.0'.
'7/14/2013 5:00:40 PM' - Starting execution....
'7/14/2013 5:00:45 PM' - Detected custom code in test. Locating test assembly: Old_2011_2_1028_Project.dll.
'7/14/2013 5:00:45 PM' - Assembly Found: C:\Test Studio Execution Server\Output\TicketCount - 130183128213510649\bin\Old_2011_2_1028_Project.dll
'7/14/2013 5:00:45 PM' - Loading code class: 'Old_2011_2_1028_Project.TicketCounter'.
------------------------------------------------------------
------------------------------------------------------------
'7/14/2013 5:00:45 PM' - Using 'InternetExplorer' version '9.0' as default browser.
'7/14/2013 5:00:50 PM' - 'Pass' : 1. Navigate to : 'http://admin.telerik.com/Login.aspx?Context=Support&Control=~%2fUserControls%2fSupport%2fMyTeamSupportThreads.ascx&T=0&SearchType=0'
'7/14/2013 5:00:50 PM' - 'Pass' : 2. Enter text '[e-mail]' in 'TxtEmailText'
'7/14/2013 5:00:50 PM' - 'NotRun' : 3. Enter text 'pass' in 'TxtPasswordPassword'
'7/14/2013 5:00:50 PM' - 'Pass' : 4. Enter text '*****' in 'TxtPasswordPassword'
'7/14/2013 5:00:50 PM' - 'Pass' : 5. Click 'LblRememberMeSpan'
'7/14/2013 5:00:58 PM' - 'Pass' : 6. Click 'BtnLoginSubmit'
'7/14/2013 5:00:58 PM' - 'Pass' : 7. Enter text 'test' in 'SupportThreadsList1DatagridMessagesFilterTextBoxProductText'
'7/14/2013 5:00:59 PM' - 'Pass' : 8. Click 'DDProductFilter'
'7/14/2013 5:01:06 PM' - 'Pass' : 9. RadMenuItem('?SupportThreadsList1_datagridMessages_rfltMenu_detached'): item 'Contains' action -> 'Click'
'7/14/2013 5:01:06 PM' - LOG: Total number of threads for TS:68
'7/14/2013 5:01:07 PM' - LOG: Number of pages in admin:2
'7/14/2013 5:01:19 PM' - LOG: Ticket 712352 is waiting for answer
'7/14/2013 5:01:56 PM' - LOG: Ticket 712397 is waiting for answer
'7/14/2013 5:02:04 PM' - LOG: In total waiting for answer:2
'7/14/2013 5:02:04 PM' - LOG: Number of Standalone tickets:55
'7/14/2013 5:02:04 PM' - LOG: Number of Express tickets:   4
'7/14/2013 5:02:04 PM' - LOG: Number of Framework tickets: 3
'7/14/2013 5:02:04 PM' - LOG: Number of iOS tickets:       6
'7/14/2013 5:02:04 PM' - LOG: Summary: 68,59,6,3
'7/14/2013 5:02:04 PM' - 'Pass' : 10. [WebTest1_CodedStep] : New Coded Step
'7/14/2013 5:02:05 PM' - 'Pass' : 11. Click 'LogoutLink'
------------------------------------------------------------
'7/14/2013 5:02:05 PM' - Overall Result: Pass
'7/14/2013 5:02:05 PM' - Duration: [1 min: 19 sec: 971 msec]
------------------------------------------------------------
'7/14/2013 5:02:06 PM' - Test completed!

As you can see, there's a lot of information contained in there. Is there anything missing you'd like to add? 

Item 2) What sort of documentation do you find missing? All of our documentation is online and starts here:
http://www.telerik.com/automated-testing-tools/support/documentation/user-guide/overview.aspx

As for sending it to a customer, no you cannot do that. To run Test Studio tests you must install it using our installer. Just sending them a .EXE won't work because, even though it is a .EXE, it has many dependencies on many other DLL's and browser extensions being properly installed before it can run. This also means they will have to have a license of Test Studio so they can activate it.

Your only alternative would be to give up your license so your customer can use your license on their machine. The procedure for moving a Test Studio license from one machine to another is documented here:
http://www.telerik.com/automated-testing-tools/support/documentation/user-guide/knowledge-base/activation/swap-license.aspx

Does this answer all your questions?
Regards,
Cody
Telerik

[Joseph]

Hi Cody,

Thanks for the reply, the specific item I was talking about was the "Test Studio Run Time" and the lack of information that I can find on this product, Is this documented under a different name? or located in the documentation and I'm just not looking in the correct place?


Thanks

Jo

[Cody]

Hello Jo,

It sounds like there's a misunderstanding with regard to what, exactly, our Run-Time edition is. In short our Run-Time edition is the full Test Studio with the IDE pulled out of it. You can use it for running tests and many other tasks, but not developing and/or editing tests. Here's a comparison between the two.

So what this means in terms of documentation is that all of our current documentation posted online here applies equally to both, except for any section referring to creating and/or modifying tests. You can use our Run-Time edition for:

• Setting up a scheduling server
• Setting up an execution server
• Using it on a build server such as TFS
• Creating a load agent
• Creating a load reporting agent
• Creating a load controller
• Gathering Windows Performance Counters from an external server e.g. a web server or a SQL server
• Viewing results in our Results Viewer

Does this help clear up the confusion?

Regards,
Cody
Telerik