This would not be unusual with the Gnome desktop running. To get a better understanding of what is using the most memory, open a terminal and type:
This opens a list of running processes and breaks down percentages of memory usage, cpu usage, etc. Type ^c to end the program.
Also check the available memory by typing:
What you are interested in is the amount available in cache.
Hope this helps