Possibly over ssh session; but you should be more specific on how you want to do this. Do you mean that you want the remote box not to run X usually, but to start it when you tell it to, or that you want to see the remote box desktop on your own box, or what?
Read more about ssh, the secure shell: