Is the issue simply passing the LANG variable to the server? SSH is supposed to automatically do this by default but there is, or at least used to be, a
bug if
sshd is set up to use PAM for authentication. If that is the problem, one option would be to enter and export the LANG variable after logging in. You could automate that by having
.bash_profile (or /etc/bash_profile) check if you are logging in via SSH, and optionally check for the host name you are logging in from.