How do you start X? Do you use gdm as a login manager?
Do you boot directly in X?
Maybe it's simply misconfigured, but I feel smell of missing permissions to connect to Xserver...
can you boot to console (or go with "init 3") and then run startx as a user?