Yes, but "every single component" is a very
large set, an it may include applications you will want to use. (Note that GNOME and KDE share several components, and that both can, to a large extent, run applications written for the other desktop. Provided you have both X libraries installed.)
Try a yum remove gnome-core
to get a list of everything that you'll remove that depends on GNOME. (I'd recommend a complete
review of that list before proceeding.)
To remove only specified things, try the rpm --nodeps -e <pachage name>
, but why do you want to do this?