Click event is not necessarily a select event.
The same way Drag Start and Drag End are raised with every click, I think Click should be raised even if Pan is raised, for what the user is obviously meaning to be a click and not a pan, that is - the mouse clicked then quickly released, with minimal movement.
I think this should be considered a bug. Please advise if I this will ever be fixed, or if there is some workaround (other than setting a key for either panning or clicking. I only need click, not select).