Yup. At a bare minimum you have to change the ServerName directive to "localhost". Don't use the menu configuration thing, it's a piece of crap. Open up httpd.conf in your favorite text editor and edit it by hand. I think in RH8 it is at /etc/httpd/conf/httpd.conf
Remember to restart apache afterwards (apachectl restart)
Look for a section like this, and make sure it says localhost:
# ServerName allows you to set a host name which is sent back to clients for
# your server if it's different than the one the program would get (i.e., use
# "www" instead of the host's real name).
# Note: You cannot just invent host names and hope they work. The name you
# define here must be a valid DNS name for your host. If you don't understand
# this, ask your network administrator.
# If your host doesn't have a registered DNS name, enter its IP address here.
# You will have to access it by its address (e.g., http://22.214.171.124/)
# anyway, and this will make redirections work in a sensible way.
# 127.0.0.1 is the TCP/IP local loop-back address, often named localhost. Your
# machine always knows itself by this address. If you use Apache strictly for
# local testing and development, you may use 127.0.0.1 as the server name.