You can achieve this funtionality by attaching the OnKeyPress event to RadTextBox. Check for the keycode in the event handler and cancel the event based on requirement.
An example is shown in the documentation. I hope this would useful for you. OnKeyPress