There are two ways. First, from your description, your network is using DHCP so a new IP address is assigned to each computer after each reboot. You can run ifconfig eth0 (or whatever NIC each box is using) and this will tell you the IP address. Secondly, you could simply instruct your router to use static IP address so that the IP address would always be the same on each computer.
Hope this helps