$ mv ~/.xsession ~/.xsession.old
$ cat > ~/.xsession
$ chmod u+x ~/.xsession
In short, add the line, exec startxfce4 to your .xsession file (replace or remove the old one if you used to start a different windowmanager). We save the old file in case there is some settings or information in it that you don't want to forget.