Alright, I tried accomplishing this but I don't think it will be easy
It looks like this isn't possible in one action in LDAP, and the standard scripts in phpLDAPadmin don't seem to support it either. But maybe it is possible with a hook in phpLDAPadmin.
Is there anyone with experience writing hooks for phpLDAPadmin?
There is almost no information available on this.