Of course, you can manually upgrade the Telerik.Web.UI.dll and other Telerik assemblies and this process is explained in details in the following KB article: Updating RadControls for ASP.NET AJAX to another version or license
The idea of the Upgrade Wizard is to simplify the upgrade process. It also can be configured to update the RadSpell and RadCaptcha external files.
the Telerik team
If you want to get updates on new releases, tips and tricks and sneak peeks at our product labs directly from the developers working on the RadControls for ASP.NET AJAX, subscribe to their blog feed