This is a migrated thread and some comments may be shown as answers.

Failure of test iteration during Quick Execute is almost impossible to notice

1 Answer 71 Views
General Discussions
This is a migrated thread and some comments may be shown as answers.
Konstantin
Top achievements
Rank 1
Konstantin asked on 12 Mar 2013, 08:16 PM
I have single trivial test which tries to navigate somewhere and executes 4 other steps.
I made it data bound so it does it for 3 different URLs. One of the navigations fails (bad URL).

When this test is part of the test list and it is run with the list, then its result looks quite clear: 14 out of 15 passed. Test has 5 steps, was run three times, so 15 total. In one case one step failed, so 14/15 looks right.

Now when I run the same test using Quick Execution it again executes 15 steps for exactly the same reason, but after that the status on top shows 5/5 passed! It only shows the last iteration, not all of them. This is VERY bad because unless sumebody is careful enough to open test run log and search for the word "Fail" there is no way to tell that one of the iterations actually failed.

Please let me know if I missed something.

Thank you!
Konstantin

1 Answer, 1 is accepted

Sort by
0
Accepted
Plamen
Telerik team
answered on 15 Mar 2013, 09:43 AM
Hi Konstantin,

When you are running a data driven test via Quick Execution, there is dropdown showing the iterations. In order to view the failed/passed/total steps for a specific iteration you need to select that iteration from the dropdown list(see screenshot).
 
However I agree with you that it will be useful to also have something like a summary showing the sum of all steps from all iterations, so I logged this as a feature request. You can track its progress and vote for it here: Public URL. We take these votes into account when we determine what to focus on in terms of features.

All the best,
Plamen
the Telerik team
Quickly become an expert in Test Studio, check out our new training sessions!
Test Studio Trainings
Tags
General Discussions
Asked by
Konstantin
Top achievements
Rank 1
Answers by
Plamen
Telerik team
Share this question
or