no you don't have to apply every patch, unless you have lots of time
on your hands, and thats what you actually wanna do ...
all you have to do is go to kernel.org, and grab the full source, which if
i remember correctly it will be about 40 MB, and then recomple it ..
thats a link to my guide for reference, if you need it ..