Then it is clear your isp's dns is slow/having problems. You could do some experimenting by removing all but one dns name in /etc/resolv.conf-- see if the slow server is one or the other.
Beyond that, you could set up your own dns to forward quereys to your local network. This would have the advantage of caching common quereys locally-- very fast resolution for sites that you go to often. It however, would be just as slow for sites you have never been to.
dan