One option is to use expect. However, you shouldn't be seeing a prompt for a password when you log in.
Check if you have made the settings on the server that are suggested in the /etc/ssh/sshd_config file above the "UsePAM" line.
# If you just want the PAM account and session checks to run without
# PAM authentication, then enable this but set PasswordAuthentication
# and ChallengeResponseAuthentication to 'no'.
If these are enabled, they may be tried.
Using ssh-agent & ssh-add you can protect your private key with a passphrase but not be prompted for it after entering it using ssh-add. However this only works for the current shell, so you want ssh-add run by your ~/.profile script when you log in or start Quickbuild from the shell (or a subshell) from where you ran ssh-add.