If you have the source then:
This works if there is uninstall target Makefile script.
If not, this is how I do it.
find / -newer reference > uninstall.txt
chown user:user uninstall.txt
Then edit uninstall.txt in your favorite text editor to remove files not belonging to the software you want to uninstall.
Be very carefull!!!
cat uninstall.txt | xargs rm -Rf
and files will be removed.
I couldn't think of any other way...