Failure of test iteration during Quick Execute is almost impossible to notice

[Konstantin]

I have single trivial test which tries to navigate somewhere and executes 4 other steps.
I made it data bound so it does it for 3 different URLs. One of the navigations fails (bad URL).

When this test is part of the test list and it is run with the list, then its result looks quite clear: 14 out of 15 passed. Test has 5 steps, was run three times, so 15 total. In one case one step failed, so 14/15 looks right.

Now when I run the same test using Quick Execution it again executes 15 steps for exactly the same reason, but after that the status on top shows 5/5 passed! It only shows the last iteration, not all of them. This is VERY bad because unless sumebody is careful enough to open test run log and search for the word "Fail" there is no way to tell that one of the iterations actually failed.

Please let me know if I missed something.

Thank you!
Konstantin

[Plamen]

Hi Konstantin,

When you are running a data driven test via Quick Execution, there is dropdown showing the iterations. In order to view the failed/passed/total steps for a specific iteration you need to select that iteration from the dropdown list(see screenshot).
 
However I agree with you that it will be useful to also have something like a summary showing the sum of all steps from all iterations, so I logged this as a feature request. You can track its progress and vote for it here: Public URL. We take these votes into account when we determine what to focus on in terms of features.

All the best,
Plamen
the Telerik team