Thanks. Your question actually solved my problem. I went to check out the hardware specs and I changed some of the xorg.conf. I have an SiS 740 and I was running it on an SiS 620 driver. X worked fine so I thought I wasn't a driver issue. I have changed the driver to a Generic VESA and now it works. I'm still confused why running X on a different driver would have any effect on my console though.
I guess I'm still a newbie when it comes to X though