The CustomValidator control never fires automatically unless you set the ControlToValidate property and set it to validate for empty text. It won't fire its ClientValidationFunction until a button is pressed to raise that event. If you want the RadUpload control to call the CustomValidator's Validate event, you handle the RadUpload's OnClientFileSelected client-side event and tell the CustomValidator to validate. Like so:
I hope that helps.