rm removed files, it "unlink" it. unlink är to detach its filename and the fysical storage on the disc. The space is free for any other file to overwrite if they want to. The file is gone. Do not remove important files, move them to a tmp directory, and when you know you dont need them delete them. I know this doesnt help you alot, theres some library you can reload to rescue files from RM. the library interfect the rm call and does not unlink the file but it moves it.. Ofcourse you have to had it installed before you removed the file =) .. Except from this theres a ext2 debug tool, when you go in to the filesystem and find the area on the disk, and you can link it against a new filename.
I would surgest that you reinstall the java*rpm and ignore the problem.. --force be to your help dealing with rpm.