Can you try hiding the panel/calendar with "display="false"", rather than toggling off its visibility.
If this does not eliminate the erroneous behavior, you can open a formal support ticket, and send us a small working project, demonstrating your setup, and showing the unwanted behavior. We will debug it locally, and get back to you with more information on the matter.
All the best,
the Telerik team