I am having this same problem
I am running a fresh install of Slackware 9.1, and as soon as i start x, the whole kaboodle crashes. No kernel panic, no error messages. sshd also seizes, and i can't initiate a new connection, and any pre-existing connections into the box lock up. I cant find ANY signs of where to start looking.