Here's what I usually do:
* run "ps -fu $USER"
* find the processes that correspond to the previous login session
* look for one that says "sshd: blahblah" or "bash" or something like that
* find its PID
* do "kill <that number>"
* repeat if that did not kill all of them