I've got an almost identical system set up in my house - I've got a Linksys wireless router attached to my DSL Modem, then 1 main machine runnning Linux 24/7, another machine with Win2000/Linux dual-boot system, 1 WinXP wireless laptop, and 1 really old Linux wireless laptop (using an old Orinoco PCMCIA wireless card). Also have an HP printer attached to the network with a D-Link Ethernet printer server. Whole system works really well, and I'd highly recommend using one of the newer wireless routers as the entry point to your network.
Just my $0.002