The number you mean, is stored in a file called .version and every time you recompile your kernel it's increased by 1.
If you want to remove it completely you should mess with the Makefile. Look for .version in Makefile to see how it's done.
You can always put a "0" in .version before recompiling, so every time your kernel will be version 1
Regards