Yes, but "every single component" is a
very large set, an it may include applications you will want to use. (Note that GNOME and KDE share several components, and that both can, to a large extent, run applications written for the other desktop. Provided you have both X libraries installed.)
Try a
yum remove gnome-core to get a list of everything that you'll remove that depends on GNOME. (I'd recommend a
complete review of that list before proceeding.)
To remove only specified things, try the
rpm --nodeps -e <pachage name> command.
Just curious

, but why do you want to do this?