Wow your telling me local network activity is clogging on your local bandwidth. I aggree with whats said. Either upgrade your switch/router to a 100MB+/per sec or Learn how to use SSH. You can use putty if you are on a windows machine to connect to SSH. If you use a linux machine just open up a termain and type something like
SSH I find to be the best way to manage a server.
Good luck hope you find a good solution.