Firstly, you need to run the named
service, which is a nameserver. You may also need to set up named to use the appropriate DNS server(s) from your ISP.
Next, you need to set up Windows to use your Linux machine as the nameserver. You can do this by specifying manual settings in Linux, or by setting up a DHCP server on the Linux box, and leaving Windows on manual settings.
for various networking HOWTOs