In my experience, none for what you are doing, unless you feel compelled to learn the command-line way.
Remember that most servers in data centers are headless, that is, they sit in racks and have no monitors or keyboards. Accordingly, sysadmins connect vis ssh and administer them through the terminal.
People have the notion that, because so-called "server" distros come with no GUI, that somehow a GUI on a server is inherently bad.
As far as I am concerned, that's just a notion. It's not inherently bad unless it soaks up resources the server otherwise needs. For a little home server, that's extremely unlikely. Use the tools that you feel comfortable using.