I've had problems removing groups and buddies, too.
Sometimes if I delete a buddy, they'll show up again on next login -- under a new group called Orphans.
It IS irritating, but I think it's because it won't do anything but add users to the AIM database of your buddylist. Don't quote me on that, I haven't really looked into it
I'm not sure about yahoo.
-Shade