Lucky you i had fun for 3 hours.
If I upgraded my kernel then it made me install udev and thus remove hotplug so it wouldn't see my mouse.
If i didn't update my kernel X wouldn't load due to problems with my Nvidia card.
I found the fix by reinstalling the drivers using a guide here:
Debian-nVidia installation
The swap over to Xorg was never going to be smooth in my eyes