It
is quite possible. Whatever machine you are using to access the server and run the desktop remotely will need a local X11 server. These are available for just about every platform out there, though, so it shouldn't be an issue.
You will need the ability to access your server via ssh and your server provider will need to allow X11 forwarding . . . They may not, since this will use hella-bandwidth.
Here is a good article to read:
http://www.codingdomain.com/linux/remote/x11/