Thanks for all details shared so far. Let me, please, step in this discussion as we have recently discussed the scheduling setup on your end and this is somewhat related to the configuration.
As a first step. there is something to sort out for the automatic email notifications - this setting is available out of the box when executing test lists through the scheduling service. The Scheduling command line runner
, which mu colleague Daniel had suggested, will allow you to use the mentioned configuration and send emails with some additional adjustments (listed below). However, if you intend to use the local command line runner, which is called ArtOfTest.Runner.exe
, this email configuration will not be available.
Please, find below the necessary information to continue adjusting the test list execution on your end.
As a next step in this conversation I will describe the necessary settings for the email notifications. You seemed to have set already the required details for the SMTP server in the Scheduling configuration wizard (please refer to the screenshot you have attached in the initial post). However, I suspect that the port listed there will not work with the current details. What I mean is that you have checked the 'SSL' checkbox and thus the appropriate port should be 456
. Can you please verify with the responsible team on your end which should be the correct port to use to connect to the SMTP server and set that one accordingly in the Scheduling wizard?
Once the SMTP settings are correct as per the server requirements, you can apply the new settings by clicking on the 'Apply'
button. To ensure that the this works, please schedule any sample test list through the Test Studio UI and enable the email notification. Please, generate the application log
during that run so that you can provide it in case further investigation will be required. To collect meaningful records in the log, please clear this prior scheduling the sample test list. Then collect the file after it is finished and the result is populated in the Results tab in Test Studio.
Executing test list from the Scheduling Command line runner
If this works as expected, we can move to the next step - executing a test list via the scheduling command line runner. As you have collected a log file already for this type of execution, there are few things I noticed and need to be mentioned. It seems that your project is under source control in TFS - please, correct me if this assumption is incorrect.
However, if this is correct, there is a specific, which you are probably not aware of, but is important for the current setup. In the case when the project is TFS source controlled and test lists are executed via the Scheduling command line runner, the project will be automatically downloaded from the TFS. The respective setting when a test list is scheduled from the UI is to enable the 'Get Latest from TFS'
The reason to mention the above notes, is that probably the user under which runs the configured Scheduling service does not have access to the TFS. This user should be the one logged on the machine, which hosts the Scheduling service. To allow that service to access the TFS, you can change the account it will run under - this is described in details here
. The account to use is the one which can login successfully to the TFS.
When this is set correctly, you can verify if that works when starting an elevated command prompt and then execute a sample test list as described in the help article
. Please, generate the application log for this run as well, to collect and provide it for further analysis if this turns out to be necessary.
Sending Email from the Results tab
As a final note I will address what you mentioned about sending an email with the results from the Results tab
in Test Studio. Can you, please, elaborate more on that one?
- Do you see an email to be generated with the selected type of result format attached?
- If no, can you please generate the application log during the attempt to generate the email and send it for reference?
- If yes, please, let me know, if you have changed the default Telerik email address listed in the From
field of the generated email? This needs to be changed to the email account configured on that machine. Will an email be sent, if you change this to use the correct email user?
I do understand the above information is quite extensive and may rise additional questions, so please, if I have missed anything, do not hesitate to get back to me and place your queries. Still, I hope this will be useful for you and will help you adjust the remaining settings to continue using the scheduling feature in Test Studio.
Thank you in advance for your cooperation. I will be looking forward to hearing back from you.