For future reference, I've found a solution to this problem:
The IQueryable that you set as the source of the QueryableCollectionView
MUST be ordered.
Otherwise, you'll get the behavior described in this post.
I guess this makes sense in some way;
If you're not ordering the IQueryable,
Entity Framework is unable to execute skip methods on it;
Underlying, this exceptions occurs:
is only supported for sorted input in LINQ to Entities. The method
must be called before the method