Q: Why shouldn't I simply delete the stuff I never use, it's just taking up space?
A: This question is in the category of Famous Last Words..
(From the Frequently Unasked Questions)
You can adjust your GCC settings. In your /etc/profile:
export CXXFLAGS="-O2 -march=pentium4 -mcpu=pentium4"
export CPPFLAGS="-O2 -march=pentium4 -mcpu=pentium4"
export CFLAGS="-O2 -march=pentium4 -mcpu=pentium4"
replacing "pentium4" with your architecture. This could be "athlon-xp", "pentium1(2,3)", "K6(-2)" or if you want more generic "i386(486,etc)" There are others as well.