Yes you can install gcc. Yes you can use it. Go to this web site. Follow the instructions for what you want to do and how you want to do it.
They have specific instructions for installing to a usb drive from windows, or from linux. This is linux. You are going to have to be able to follow some simple instructions from the internet and make some choices on your own. I don't know if puppylinux, a full usb version of ubuntu or DSL would be better for you. You are going to have to chose. Then follow the instructions for whatever flavor you chose. You have to be able to do some basic things on your own, or find a geek friend to help you in person. There is only so much we can do to help you online.