What version of Apache do you have installed? It might sound like a stupid question, but whether you have 1.3, 2.0, or 2.1 makes a difference here.
The short answer might be that if you are compiling mod_access in as a static module, you don't need the line LoadModule to load it as a dynamic module. Try commenting the line out.
To check what modules you have, try
That should give you a list of the modules that are compiled in.