try something like this
ssh user@host scp-command
when he asks for a pass, give the password from the user (see command).
then normally it should work
and if you already this is this way, then i don't have an idea.. maybe first do a ssh-keyswap and then try again (then you don't have to fill in a password) but i don't think that's the problem..