Sure, but I always usually keep two around at a given time, just in case and it doesn't hurt anything, except taking up a little bit of space.
And to tell you the truth, having a second kernel saved me once, when I got a kernel panic on the newer one.