I am glad to hear that you liked our RadDocking Visual Studio example.
Regarding the reported behavior - indeed we had such an issue in RadWindow when the Windows DPI is higher than 100%. As the floating panes are hosted in RadWindows, I guess it is the same situation.
This issue is already fixed in our latest Q1 2016 SP release, so could you please download it and give it a try?
Do you need help with upgrading your AJAX, WPF or WinForms project? Check the Telerik API Analyzer
and share your thoughts.