I just bought a linksys BEFSR41 router. I have a similar configuration - I have one Windows and one Linux computer in my apartment.
I gut it up and running within ten minutes of unpacking it. It's very easy to use and setup. I reccomend it.
I might be able to help you if you have questions configuring it as I have been playing with it for the past five days. Consequently, I know what to do and what not to do when tweaking the configuration.
-Robert
elconde@mediaone.net