Hello Yan Jun,
I analyzed the log and I see that there is an Unexpected dialog detected in several location during the test execution. The first test list execution with HanddleAndFailTest does correctly fail the test after handling the dialog. The next 2 test list execution also encounter an Unexpected dialog and based on the configuration either handle it and continue or take no action against the dialog. Those are all expected scenarios from my point of view.
I might be missing something important about the test scenario and the behavior of the application under test. To help me understand it better, please share more details, like the following.
- 2 short videos of the execution of a new test list, which contains only the test with unexpected dialog. Once with HandleAndFailTest and the next time with HandleAndContinue option.
- A way to reproduce the misbehavior against a publicly accessible application. If you manage to create a project that reproduces the issue, please zip it and attach it to your next reply.
- If you can't reproduce the issue on another application, please share the Test Studio project against the AUT you are testing. I will not be able to run it, but I will still analyze the configurations and get more familiar with the scenario.
- Please attach the zipped step failure details from tests that fail due to unexpected dialog.
I noticed that there are multiple failing tests steps because the test can not find the element or the expected value is not matching. I would advise you to fix those test and I assume that you are aware of those and working towards fixing them.
Thank you for your cooperation in this discussion. I hope I can help you with this issue after reviewing the above resources. If that does not help, we can schedule an online meeting and try to troubleshoot it remotely.