So I had f'ed up my xorg.conf apparently. Full story and explanation here: http://linuxtravels.blogspot.com/2006/12/i-wtfed.html
After a little playing around I was able to get it working again.
If xorg goes completely whack on you try this combo:
sudo dpkg-reconfigure -phigh xserver-xorg
Hope this helps someone thats having problems.