I do use the command line abit but must admit there's not much urge to display my manliness by installing source rpms.
Besides #3 ) using apt-get is no less whimpy than using yum.
For regular rpms, I use the command: rpm -Uvh <name-of-rpm>
For source, you have to take a few more steps....
rpmbuild --rebuild filename.src.rpm
The rpm package is created in /usr/src/redhat/RPMS/i386
Then you use the rpm -Uvh <name-of-rpm>
Binaries usually come as a filename.gz or similar.
You unpack that and read the instructions in the readme or install file.
They usually have you do something like ....
./configure
make
make install