I have an nvidia card too. And I have had trouble compiling the nvidia drivers since I started with linux.

What I did was I added the "NoBandwidthTest" option on my x configuration file, along with replacing "nv" with "nvidia". It solved everything for my machine, but not after having lost a lot of time trying to figure it out first.