By design, RadNumericTextBox doesn't have "remove" icon/button. If you use Internet Explorer, the browser itself renders one for all text inputs, otherwise you should not see such icon. This extra functionality cannot be controlled (i.e. to change that icon), because it's browser specific behavior.
Check out the Telerik Platform - the only platform that combines a rich set of UI tools with powerful cloud services to develop web, hybrid and native mobile apps.