I use checkinstall to install source packages as rpms. You use the following command sequence:
./configure
make
checkinstall
checkinstall will create a Debian, RPM, or Slackware package. Then you install that package. When you want to remove it you use rpm -e to uninstall the package.
To remove programs that you have already installed with make install you install the package a second time with checkinstall. Then remove it with rpm -e
You can download checkinstall from:
http://asic-linux.com.mx/~izto/checkinstall/