If you still have the source code around that you installed from, cd into that directory and try make uninstall.
As long as make file is still present you should be ok.
N.B. Not all source code does the make uninstall.
If you deleted the source code directory you need untar the directory and do the configure exactly as orignally performed
configure; make uninstall
If you get 'no target uninstall' error, you'll just have to figure out what files get built and delete by hand.
If you look at the bottom of the screen for this forum you should see some links (similar threads) with hints on installing/uninstalling.