Remove offending Kernel
images and headers.
Then when done.
Your old kernel is still installed. All you need do is remove the one that does not work out for you.
sudo dpkg --list | grep linux-image
dpkg --list | grep linux-headers
are your friends in doing this. Then go into synaptic. Copy and paste readout into synaptic search and uninstall.
Hold the shift key when first booting up to find your old kernel to boot into before uninstalling the new kernel.
Because you will need to running on the old kernel to uninstall the new one.