You probably don't need to re-install. I would assume that College linux would distrubute a package of the kernel source code just like every other distro. If I remember correctly, College is based on Slackware so if you can't find a College source, a Slackware package may do the trick. I would have a good rummage around the College linux site and see if they don't have a package.
<edit>
I did a little looking and it looks like you can get the source code
here . Make sure that you are running a 2.4.23 kernel however. Type
uname -a in a console to find out.