The '>' is from your PS2 variable, which is the shell's way to show that you're continuing the command on another line. This usually happens when you start a quoted string, and haven't closed it before you hit enter. Try typing
and see the prompt change. PS1 is the one you usually see, and PS3 and PS4 are also defined. man bash for more details than you want to see.