Doesn't make a big difference, in fact when optimizing it possibly may not make any difference, see "man gcc":
"-O also turns on -fomit-frame-pointer on machines where doing so does not interfere with debugging."
If you want to emerge everything from scratch, have a look at
"emerge -epv world"
(-v shows USE flags), then
"emerge -e world".