It depends entirely on how you configure it. As an example Slackware 14.0 kernels:
These kernels have nearly everything bulit-in:
64-bit huge install kernel is 6048 KB
32-bit huge install kernel is 5668 KB
These kernels have mostly modules:
64-bit generic kernel is 3080 KB
64-bit generic kernel is 2785 KB
64-bit custom kernel is 2290 KB
Whether the kernel was built for a server or desktop is not relevant. More relevant would be:
Code:
┌─────────────────────────── Optimize for size ───────────────────────────┐
│ CONFIG_CC_OPTIMIZE_FOR_SIZE: │
│ │
│ Enabling this option will pass "-Os" instead of "-O2" to gcc │
│ resulting in a smaller kernel. │
│ │
│ If unsure, say Y. │
│ │
│ Symbol: CC_OPTIMIZE_FOR_SIZE [=n] │
│ Type : boolean │
│ Prompt: Optimize for size │
│ Defined at init/Kconfig:942 │
│ Location: │
│ -> General setup │