I plan on upgrading my video card and I was wondering if you have to uninstall it like you do with windows before I pop it out and put the newer one in...If so, how would I go about doing it?

Would have been easier to give you a better answer if you had mentioned the cards involved. But in general if you are going from in the case of Nvidia an older to a newer card and using the driver from their site then no changes would be needed at all assuming you are not getting the absolutely newest card out there that they do not support in the driver yet. Now moving from ati to newer one from them can be problematic just because their drivers just plain suck in the way they go about having support or lack thereof for older cards in the newer driver you probably have to switch to the present driver. Any changes needed will occur in the X config file in Debian it is called XF86Config-4 and is in the /etc/X11 directory some distros leave off the -4.

Thanks a lot, I'm just going from nVidia to nVidia. Shouldn't be a problem :-D