If you still have the source directory you could try
in the directory.
If you haven't and the source supports it you can download it again, configure it exactly as it is on your computer and then do the above.
If there's no make uninstall I think you've got to delete them manually. Unless you have a specific program that makes lists of source installs so you can uninstall (don't know what it's called)