off hand, i can think of one easy solution, and one probably more difficult, and a third ultra-easy solution:
1) uninstall what you don't want using whatever PM you have avail.
2) don't install gnome with the base distro -- don't install anything GUI.. just install the base, and pick and choose what to install by hand from that point.
3) get used to having things you don't really need. remove them from your gnome menu if it bothers you to see such things in existance.
otherwise it depends on your distro as to how you customize these things during the initial install process...