I'm not sure on this but if X preloads all it's fonts in memory and you have that many then I think I can see where your problem is...
Your best bet would be to just lose that directory and try starting X, just mv it somewhereout of the road and check to see if it works, if it does, then you know your problem and you know how to fix it