I have 768mb RAM and 512mb swap file. I don't remember the exact numbers but I the system uses about 300mb ram.
I was watching a DVD movie (BTW I use mplayer) the other night and my swap was actually being used. I think it was less then 100 but I still had lots of unused RAM.
I might try turning swap off and see what happens when playing a movie.