Yes. The X desktop and the vncserver desktop are completely separate.
On the machine that runs the vncserver, check the
~/.vnc/xstartup script, that is where that windowmanager desktop is started.
This is my own (tightvnc) xstartup script, it will run XFCE for you:
Code:
#!/bin/sh
# Slackware Linux VNC session startup script
unset SESSION_MANAGER
exec /etc/X11/xinit/xinitrc
Eric