This would be the expected behaviour as by design the GridViewToggleButton and the RowDetailsVisibilityMode should not be used together. Please check this help article
for a reference.
Furthermore you do not need to set the ExpandMode as it is already single when the RowDetailsVisibilityMode is VisibleWhenSelected.
All the best,
the Telerik team