There is no standard way to remove packages like that, you have to hope the installer has an uninstall function, or else do it manually. As for source installs, some might have a "make uninstall" target, but it is totally optional on the part of the developer.
Situations like these are why package managers were developed. You should always try to find a a proper package for your distro rather than using an installer script. Never install a source tarball directly to the system, you should instead build it into a binary package for your distro and install that.