try to copy a dvd movie or something...I could imagine your swap is needed
and in my system, with 256 megs of ram, I do use swap from time to time when ripping some discs or doing some other fancy stuff..
"swap = double the amount of your ram" doesn't mean that if you have 4 gigabytes of ram, you would need 8 gigs of swap
it's a bit more relative...for small amounts of ram it is ok (like 32 or 64 or 128), but if you have a nice amount of ram, then you don't need that much swap. of course, I'd say it's still wise to make some - you can have unused swap, but when you really need it, you cannot create it more on-the-fly
so when you run out of memory and swap, you are out of memory and swap. better to have it too much then too little..