We don't have plans distribute separate assemblies for different controls for now. You can use Assembly Minifier in your case and strip only the Controls that you use. (Unless you're using all controls in Navigation and Controls).
the Telerik team
Browse the videos here>>
to help you get started with RadControls for Silverlight