Okay, as far as the windows box goes...you're on your own, sorry. On the Linux side, there I can (maybe) help.
First of, how much do you know about networking? A "host" is a PC linked to an other one. I'd suggest you catalog wht needs to be linked. Draw it out. See the attachment. It does not need to adhere to conventions, as long as you know where what box is on the LAN.
Give every box an IP address. Stick to conventions. Some examples: 192.168.1.1/255.255.255.0 is prefered for the modem/router, a Linux box could have 192.168.1.5/255.255.255.0.
On Linux, you'd set this as follows
/sbin/ifconfig eth0 192.168.10.12 netmask 255.255.255.0 broadcast 192.168.10.255
are available on YoLinux, for example
I'd advise to give static IP addresses. If needed. If possible, your router has a DHCP server, that would make life easier.
In short, you need network cables and a switch
, hook everything up as drawn out. If you'd assign IP addresses, note these on the sheet.
And...enjoy, networking is great stuff to learn!