Do you really need a GUI? Web and file servers function best when they have the maximum amount of memory (RAM) available for their use. The GUI uses an enormous amount of memory and will slow down the server. If you need to use graphics to edit the file you could try installing webmin. It will allow you to log into the server from port 10000.
https://server_or_ip:10000 (if using ssl to secure the server)
If you log in as root you can edit files using any web browser. I use this method on my web server so I don't have to have the GUI running.
You can edit /etc/inittab to stop the GUI from loading by changing
This will turn on multi-user without loading the GUI. You may use startx to start the GUI if you need it for a single session, or re-enable the GUI within inittab if you need to run it for more than a single session.