It depends. Like for example, if you install an x64 version, an i386 machine can't boot it. But if the version you installed is likely to work on a machine, it should work from a USB stick. That's if you are able to set the machine to boot off USB, you can't guarantee that you can reboot any machine however you like and set the boot order to whatever you want.
So I would say, "probably will work, if you're careful and you think about it".