Testlist marked as failed even if a test rerun passes

1 Answer 118 Views
Test Configuration Test Execution Test Results WPF Testing
Rohan
Top achievements
Rank 1
Rohan asked on 12 Nov 2021, 03:39 PM

I have a test list where there are few tests in it and its set to re-run failed tests. If a test fails it re-runs and passes after re-run but for some reason the entire test list is marked as failed in HTML results.

Is this expected ? is there a way to re- run entire test list ? or just mark the test list as passed after re-runs pass ?

1 Answer, 1 is accepted

Sort by
0
Plamen Mitrev
Telerik team
answered on 15 Nov 2021, 09:18 AM

Hi Rohan,

Thank you for starting a discussion on this topic. You are correct that there is some inconsistency in the way test list result is presented, when there is a failed test that passes on the re-run. In Test Studio's Result tab and in the Executive Dashboard the test list appears as passed, with the information that one of the tests failed and was ran again. However, when you export the results the same test list is marked as failed.

This is not expected behavior and I created a public bug report on your behalf and shared it with the rest of the team. They will evaluate it and plan it for future releases. Please add your vote and follow the public item to get updates of its progress.

I do not have a workaround to help you mark the test list result as passed, or to re-run the whole test list again automatically. But you can check the results in the Executive Dashboard, which will show the test list results as you expect them in this case. You can use this feature of Test Studio to quickly determine what is the real state of the test list execution per project. Let me know if that raises any follow up questions.

Thank you again for your feedback and for pointing out this misbehavior!

Regards,
Plamen Mitrev
Progress Telerik

Virtual Classroom, the free self-paced technical training that gets you up to speed with Telerik and Kendo UI products quickly just got a fresh new look + new and improved content including a brand new Test Studio course! Check it out at https://learn.telerik.com/.
Tags
Test Configuration Test Execution Test Results WPF Testing
Asked by
Rohan
Top achievements
Rank 1
Answers by
Plamen Mitrev
Telerik team
Share this question
or