If you're still having this problem, I had it too. I just ran 'alsamixer'
and lowered the PCM setting while increasing the headphone setting.
Got the volume I was missing and all the distortion went away.
Using xmms under Slack 10 listening to mp3's. Much happier now
cheers