Hi Team,
We are encountering this issue for quite a while now and have not been able to find a solution for the same.
We are trying to create a test list with 4-5 tests. All the tests were originally tested and all were passing, but after adding them to the list and running the list, we encounter issues in random steps spread throughout the entire list.
Even after debugging them, we face a different set of failures that weren't happening earlier. There also have been situations, where the entire list passed without any failure, but we are not able to understand the root cause for this inconsistency.
Is there any solution to resolve this behavior?
Thank You.
1 Answer, 1 is accepted
Hi Akshay,
Based on the description of the encountered issue during test list execution, it seems that there is a timing problem that causes inconsistent results. You mentioned that different steps fail during the test run and sometimes the whole test is successful. In this case, I would advise you to explore the test and recorded steps and add wait or verifications steps when the application redirects to a new page, or the content is reloaded.
You can also enable the AnnotateExecution option and add a small ExecutionDelay of 500 msec in the Test List Settings. That will slow down the execution and make it easier for you to observe it during the test run.
Let me know if you notice something unexpected happening during the test list execution and attach the step failure details from the failed test list step for me to analyze. That way I will get familiar with the executed test and explore the failure information that Test Studio generates.
I hope the above information and suggestion is helpful to you. Of course, I remain available to continue our discussion.
Regards,
Plamen Mitrev
Progress Telerik