Welcome to LQ and Linux too. Well, I would like to ask which distro you are using, because there're plenty of tools for plenty of differents distro to help with installing/uninstalling of rpm's packages.
Anyway, try running
rpm -Uvh <package name here>
It should, instead of remove or install the previous package, update to the other one.
You can also run at the console:
whereis <package name here>
To see where it's installed.