if the connection is made to a service then kill the service i guess...
generally a connection can (i could be wrong) only be made to a port that has a service listening.. otherwise the port will appear closed (if you not using iptables to DROP the ports)
I would suggest that if you dont already have a firewall setup DO IT! iptables is very good just learn how to use it