Not sure if this is what you are looking for or not, but look in the man page for xinetd.conf, particularly the sections on "only_from", "no_access", and "access_times". It doesn't really give you control to the user level but rather to the IP address level.
If that doesn't do the trick, try this:
http://acua.gist.net.au/