Okay, in that case it's time to ask the big questions:
What's your distribution?
Are you using OSS or ALSA?
Does your sound work without headphones?
Did you install sound drivers yourself, or did the distribution set everything up automatically?
Alternatively you can check to see if there is any other mixers on your system.
kmix and amixer come to mind, but there are others out there.