Exe's are different, there are self extracting compression formats (sorta like .bin in linux) ... and with that we are no officially on really (and i mean REALLY shaky ground).
there is no true equivalent to .rpm, .deb in windows really because of the structuring that can be put in an .rpm . that said Windows actually handles it better in that the packages are more inclusive, the downside is that alot of redundancy hence is prone to exist in windows.
RPMs work fine on most distros because it has become a standard package format, that said, an redhat .rpm may not work fine on a SuSE base, because of differences (for instance in the XServer architecture). You can convert .rpm to .tar for example for use with Slackware via rpm2tar, which works surprisingly well.
RPM based distributions generally have dependency issues though, you download the rpm you want only to find you need more to get the original thing to work. .deb works better if you can resort to it's online facilities, and i found that debian has better search engines if you need to manually work on resolving dependencies cause you need the control.
.tar so far is great, but going from source seems to be the best, provided there are no bugs in the source