In order to return a value from a RadWindow you can use the its Argument property as explained here
You can find more information about using the RadWindow's callback function here
In case this does not help I will need to examine your code - please, open a new support ticket and send us a small reproduction project. Once I receive it I will do my best to help.
the Telerik team