Since the delete button is located in the control template of the appointment item, you need to modify the vertical and the horizontal control templates of the appointment.
I created and attached a sample project that shows how to set the Visibility="Collapsed"
property to the delete button in the two control templates, take a look at it. The project uses Implicit Styles
to customize the theme.
Hope this is helpful.
the Telerik team