Umm rpm -e removes
stuff, you were aware of that, weren't you?
OpenOffice's site has the install file for you (gzipped tar archive), and you can get the rpms as well I think, either trough Yum or just by installing the rpm(s)
rpm -Uvh openoffice-something.rpm
(or was it -uvh
or just -ivh
EDIT: in the latter case, of course, you will have to locate and download the rpm file(s) yourself -- like from rpm.pbone.net for example.