Being able to boot from an external usb drive depends on your bios. Older computers often don't have a bios option to boot from usb, in which case you are just out of luck. You could try updating your bios.
Even if your bios does support booting from usb, it may not automatically do so. You should look at the boot order to see if you can add usb device to the list.