Well that sounds like a similar issue to the browser 'smooth scrolling' issue where the page keeps jumping to the top.
You could try changing the mouse wheel page movement settings and see if thats makes any difference