The first version of Linux that I ever ran (Mandrake 8), I bought at the store. Luckily it had a thick instruction manual with it.
@CHastorf, I have never run Puppy, but generally you start out by booting from the cdrom. You may have to mess with your BIOS settings to get your computer to boot from a cd. Let us know if you run into problems or have questions.