... could use a computer with only the kernel and a desktop,
no other programs until i compile them for it.
It is the other way round : A typical Desktop has up to 600
dependencies + all X . Check with any Linux.
Example : # yum remove gtk* xorg*
And you will be asked if you want to remove all the 600
packages, that depend on gtk, etc. etc.