Are you using Guest Additions? Just go to the "Machine" menu and select "Disable Mouse Integration".
Unless you have "Enable absolute pointing device" enabled in your VM settings under "System", in which case you'll need to disable it. It emulates a tablet device whose position is represented by the host's mouse cursor position relative to the window's. In other words, it behaves like the Guest Additions' mouse integration, but without Guest Additions.