Just an experiment I am doing for learning's sake, but is it possible to network two routers with different IP addresses? I basically plugged in a router into a router.

Computer A is on 192.168.2.1 router
Computer B is on 192.168.0.1 router

Computer A is unable to browse and share files with Computer B because they are on two different physical networks with different addresses, and vice versa. Both computer A and B have the same workgroup name with unique IP addresses.

Both computers are able to surf the internet flawlessly.

You could do that on Computer A:
route add -net 192.168.0.0 netmask 255.255.255.0 gw <IP.OF.ROUTER.HERE> dev eth0

And approximately on Computer B, the reverse thing ;]

add WINS server.
One first segment add to the smb.conf
wins support = yes

on the second segment add to the smb.conf:
wins server = IP_address_of_WINS_server_from_the_first_segment
wins proxy = yes

If you have only two machines, one is windows and the other linux, then make samba WINS server and point to it on the another box.