What kernel are you running?
Have you ever thought of recompiling it?
I once had a similar problem with a video card. X will probably detect what hardware it is. But when it called for it in the kernel i got an error message.
Either, compile it as a module. Or better yet., built into the kernel.