Backup server - compression with multicore support
 

Does any body know how can I zip huge amount of data using multicore support ?


I know that tar doesnt support multiprocessing.

Is it possible to handle this problem using bash script ?


When tar is working only one core is runnig. How can I use tar command that it will be use all cores ?

Hi

Take a look at pbzip2:

http://compression.ca/pbzip2/

Combined with tar:

http://tldp.org/HOWTO/Bzip2-4.html

you can also use a parallel implementation of GZip, nicknamed PIGZ check it out here.

Regards
JKZfixme