LinuxQuestions.org
Latest LQ Deal: Linux Power User Bundle
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices


Reply
  Search this Thread
Old 04-15-2018, 08:50 AM   #31
ruario
Senior Member
 
Registered: Jan 2011
Location: Oslo, Norway
Distribution: Slackware
Posts: 2,324

Original Poster
Rep: Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353

Quote:
Originally Posted by ruario View Post
a multithreaded compressor (7zip outputting as bzip2) takes 20 seconds.
Hmm... I na´vely assumed that p7zip (outputting as bzip2) and lbzip2 would be similar in speed. Not true at all! On the same (mac) machine lbzip2 does it in around 7 seconds!

This also makes it six times faster than p7zip's multi-threaded output as XZ and 20 times faster than libarchive/bsdtar's single threaded XZ creation!

It also handly beats the mac copy of gzip, which takes around 12 seconds here.

lbzip2 is an absolute beast in terms of speed!

Last edited by ruario; 04-15-2018 at 08:57 AM.
 
Old 04-15-2018, 10:05 AM   #32
chrisretusn
Member
 
Registered: Dec 2005
Location: Philippines
Distribution: Slackware
Posts: 652

Rep: Reputation: Disabled
Quote:
Originally Posted by ruario View Post
I guess what matters depends on hardware and what the person packaging cares about more, speed or final size. So it is nice to have options.
Agree.

My times with txz
Code:
real    2m34.438s
user    2m54.774s
sys     0m1.804s
My times with tbz
Code:
real    0m9.310s
user    0m30.096s
sys     0m0.650s
 
2 members found this post helpful.
Old 04-15-2018, 11:05 AM   #33
ruario
Senior Member
 
Registered: Jan 2011
Location: Oslo, Norway
Distribution: Slackware
Posts: 2,324

Original Poster
Rep: Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353
2 mins 34 against 9 seconds. It really flies! How long does it take for tgz on your setup?
 
Old 04-16-2018, 06:13 AM   #34
chrisretusn
Member
 
Registered: Dec 2005
Location: Philippines
Distribution: Slackware
Posts: 652

Rep: Reputation: Disabled
I'm currently compiling webkit2gtk, umpteenth attempt , it's at 70% best so far, fingers are crossed, so times will be a bit higher than the would.

skypeforlinux.Slackbuild as tgz:

real 0m36.002s
user 0m34.101s
sys 0m1.185s

file size 98M txz is still king regarding file size.
 
Old 04-16-2018, 07:32 AM   #35
aaazen
Member
 
Registered: Dec 2009
Distribution: Slackware
Posts: 334

Rep: Reputation: 179Reputation: 179
I am starting to like using lbzip2 in current.

Backing up a 60gb Windows NTFS partition over a network takes about 60 minutes using gzip:
Code:
#ntfsclone -s --output - /dev/sda1 | gzip -c \
  | ssh -l root backup1 'gunzip -c | ntfsclone -r --overwrite /dev/sda1 -'
But using lbzip2 it takes only 36 minutes:
Code:
#ntfsclone -s --output - /dev/sda1 | lbzip2 -c \
  | ssh -l root backup1 'lbunzip2 -c | ntfsclone -r --overwrite /dev/sda1 -'
While lbzip2 is running I see all the computer cores of the sending machine used at over 90% not just one core.
(Run top and press 1)
 
1 members found this post helpful.
Old 04-17-2018, 02:41 AM   #36
gapan
Member
 
Registered: Feb 2007
Posts: 370

Rep: Reputation: 141Reputation: 141
So I ran some tests. I used a firefox package as input, original tar size is 160880KB. CPU is an i7-7700K @ 4.2GHz.

Code:
| Compression    | Size (KB) | Enc (s) | Dec (s) |
| -------------- | --------- | ------- | ------- |
| gzip -1        |    71,940 |    2.35 |    0.93 |
| gzip -2        |    70,784 |    2.47 |    0.90 |
| gzip -3        |    69,816 |    2.84 |    0.89 |
| gzip -4        |    68,232 |    3.04 |    0.87 |
| gzip -5        |    67,348 |    3.82 |    0.87 |
| gzip -6        |    66,932 |    5.01 |    0.85 |
| gzip -7        |    66,848 |    5.96 |    0.85 |
| gzip -8        |    66,728 |    8.90 |    0.84 |
| gzip -9        |    66,656 |   11.86 |    0.84 |
| bzip2 -1       |    65,336 |   10.56 |    3.92 |
| bzip2 -2       |    64,160 |   10.03 |    4.09 |
| bzip2 -3       |    63,572 |   10.10 |    4.25 |
| bzip2 -4       |    63,264 |   10.65 |    4.18 |
| bzip2 -5       |    63,164 |   10.82 |    4.24 |
| bzip2 -6       |    62,988 |   10.42 |    4.29 |
| bzip2 -7       |    62,996 |   10.67 |    4.28 |
| bzip2 -8       |    62,820 |   10.80 |    4.28 |
| bzip2 -9       |    62,772 |   11.02 |    4.19 |
| xz -0          |    61,752 |    8.73 |    2.49 |
| xz -1          |    59,804 |   10.92 |    2.43 |
| xz -2          |    57,188 |   15.88 |    2.24 |
| xz -3          |    56,152 |   21.89 |    2.17 |
| xz -4          |    54,064 |   30.82 |    2.23 |
| xz -5          |    52,956 |   38.01 |    2.22 |
| xz -6          |    52,688 |   42.17 |    2.21 |
| xz -7          |    52,340 |   43.90 |    2.19 |
| xz -8          |    52,120 |   45.17 |    2.23 |
| xz -9          |    52,068 |   48.44 |    2.17 |
| lbzip2 -n 1 -1 |    65,576 |    7.88 |    2.62 |
| lbzip2 -n 1 -2 |    64,332 |    7.38 |    2.81 |
| lbzip2 -n 1 -3 |    63,732 |    7.36 |    2.88 |
| lbzip2 -n 1 -4 |    63,404 |    7.26 |    2.96 |
| lbzip2 -n 1 -5 |    63,300 |    7.51 |    3.00 |
| lbzip2 -n 1 -6 |    63,124 |    7.44 |    3.04 |
| lbzip2 -n 1 -7 |    63,096 |    7.50 |    3.03 |
| lbzip2 -n 1 -8 |    62,888 |    7.42 |    3.03 |
| lbzip2 -n 1 -9 |    62,860 |    7.32 |    3.08 |
| lbzip2 -n 2 -1 |    65,576 |    3.92 |    1.38 |
| lbzip2 -n 2 -2 |    64,332 |    3.69 |    1.46 |
| lbzip2 -n 2 -3 |    63,732 |    3.70 |    1.51 |
| lbzip2 -n 2 -4 |    63,404 |    3.68 |    1.53 |
| lbzip2 -n 2 -5 |    63,300 |    3.68 |    1.56 |
| lbzip2 -n 2 -6 |    63,124 |    3.68 |    1.57 |
| lbzip2 -n 2 -7 |    63,096 |    3.73 |    1.59 |
| lbzip2 -n 2 -8 |    62,888 |    3.72 |    1.61 |
| lbzip2 -n 2 -9 |    62,860 |    3.68 |    1.78 |
| lbzip2 -n 3 -1 |    65,576 |    2.63 |    0.94 |
| lbzip2 -n 3 -2 |    64,332 |    2.52 |    1.04 |
| lbzip2 -n 3 -3 |    63,732 |    2.50 |    1.07 |
| lbzip2 -n 3 -4 |    63,404 |    2.48 |    1.08 |
| lbzip2 -n 3 -5 |    63,300 |    2.54 |    1.08 |
| lbzip2 -n 3 -6 |    63,124 |    2.51 |    1.10 |
| lbzip2 -n 3 -7 |    63,096 |    2.56 |    1.14 |
| lbzip2 -n 3 -8 |    62,888 |    2.54 |    1.16 |
| lbzip2 -n 3 -9 |    62,860 |    2.56 |    1.26 |
| lbzip2 -n 4 -1 |    65,576 |    2.39 |    0.80 |
| lbzip2 -n 4 -2 |    64,332 |    2.16 |    0.83 |
| lbzip2 -n 4 -3 |    63,732 |    2.13 |    0.87 |
| lbzip2 -n 4 -4 |    63,404 |    2.18 |    0.86 |
| lbzip2 -n 4 -5 |    63,300 |    2.28 |    0.91 |
| lbzip2 -n 4 -6 |    63,124 |    2.12 |    0.94 |
| lbzip2 -n 4 -7 |    63,096 |    2.22 |    1.04 |
| lbzip2 -n 4 -8 |    62,888 |    2.28 |    1.08 |
| lbzip2 -n 4 -9 |    62,860 |    2.23 |    1.13 |
| lbzip2 -n 5 -1 |    65,576 |    2.19 |    0.66 |
| lbzip2 -n 5 -2 |    64,332 |    1.93 |    0.74 |
| lbzip2 -n 5 -3 |    63,732 |    1.96 |    0.73 |
| lbzip2 -n 5 -4 |    63,404 |    1.88 |    0.76 |
| lbzip2 -n 5 -5 |    63,300 |    1.96 |    0.80 |
| lbzip2 -n 5 -6 |    63,124 |    1.92 |    0.87 |
| lbzip2 -n 5 -7 |    63,096 |    1.94 |    0.93 |
| lbzip2 -n 5 -8 |    62,888 |    1.94 |    1.04 |
| lbzip2 -n 5 -9 |    62,860 |    2.02 |    1.12 |
| lbzip2 -n 6 -1 |    65,576 |    1.85 |    0.61 |
| lbzip2 -n 6 -2 |    64,332 |    1.75 |    0.67 |
| lbzip2 -n 6 -3 |    63,732 |    1.79 |    0.66 |
| lbzip2 -n 6 -4 |    63,404 |    1.75 |    0.69 |
| lbzip2 -n 6 -5 |    63,300 |    1.76 |    0.75 |
| lbzip2 -n 6 -6 |    63,124 |    1.78 |    0.82 |
| lbzip2 -n 6 -7 |    63,096 |    1.84 |    0.93 |
| lbzip2 -n 6 -8 |    62,888 |    1.80 |    1.02 |
| lbzip2 -n 6 -9 |    62,860 |    1.89 |    1.11 |
| lbzip2 -n 7 -1 |    65,576 |    1.74 |    0.54 |
| lbzip2 -n 7 -2 |    64,332 |    1.64 |    0.58 |
| lbzip2 -n 7 -3 |    63,732 |    1.65 |    0.61 |
| lbzip2 -n 7 -4 |    63,404 |    1.65 |    0.64 |
| lbzip2 -n 7 -5 |    63,300 |    1.64 |    0.73 |
| lbzip2 -n 7 -6 |    63,124 |    1.69 |    0.85 |
| lbzip2 -n 7 -7 |    63,096 |    1.71 |    0.95 |
| lbzip2 -n 7 -8 |    62,888 |    1.71 |    1.04 |
| lbzip2 -n 7 -9 |    62,860 |    1.72 |    1.11 |
| lbzip2 -n 8 -1 |    65,576 |    1.75 |    0.56 |
| lbzip2 -n 8 -2 |    64,332 |    1.67 |    0.59 |
| lbzip2 -n 8 -3 |    63,732 |    1.63 |    0.63 |
| lbzip2 -n 8 -4 |    63,404 |    1.64 |    0.68 |
| lbzip2 -n 8 -5 |    63,300 |    1.64 |    0.73 |
| lbzip2 -n 8 -6 |    63,124 |    1.67 |    0.80 |
| lbzip2 -n 8 -7 |    63,096 |    1.71 |    0.92 |
| lbzip2 -n 8 -8 |    62,888 |    1.69 |    1.00 |
| lbzip2 -n 8 -9 |    62,860 |    1.76 |    1.08 |
| pigz -p 1 -1   |    71,876 |    2.12 |    0.57 |
| pigz -p 1 -2   |    70,724 |    2.16 |    0.56 |
| pigz -p 1 -3   |    69,812 |    2.54 |    0.55 |
| pigz -p 1 -4   |    68,240 |    2.75 |    0.58 |
| pigz -p 1 -5   |    67,356 |    3.52 |    0.54 |
| pigz -p 1 -6   |    66,944 |    4.74 |    0.53 |
| pigz -p 1 -7   |    66,856 |    5.76 |    0.53 |
| pigz -p 1 -8   |    66,744 |    8.53 |    0.54 |
| pigz -p 1 -9   |    66,668 |   11.61 |    0.53 |
| pigz -p 2 -1   |    71,816 |    1.04 |    0.45 |
| pigz -p 2 -2   |    70,652 |    1.10 |    0.46 |
| pigz -p 2 -3   |    69,720 |    1.31 |    0.44 |
| pigz -p 2 -4   |    68,240 |    1.40 |    0.43 |
| pigz -p 2 -5   |    67,356 |    1.80 |    0.43 |
| pigz -p 2 -6   |    66,944 |    2.51 |    0.42 |
| pigz -p 2 -7   |    66,856 |    2.83 |    0.43 |
| pigz -p 2 -8   |    66,744 |    4.27 |    0.42 |
| pigz -p 2 -9   |    66,668 |    5.67 |    0.42 |
| pigz -p 2 -11  |    64,856 |  356.33 |    0.44 |
| pigz -p 3 -1   |    71,816 |    0.71 |    0.45 |
| pigz -p 3 -2   |    70,652 |    0.78 |    0.46 |
| pigz -p 3 -3   |    69,720 |    0.92 |    0.44 |
| pigz -p 3 -4   |    68,240 |    0.94 |    0.43 |
| pigz -p 3 -5   |    67,356 |    1.21 |    0.42 |
| pigz -p 3 -6   |    66,944 |    1.71 |    0.42 |
| pigz -p 3 -7   |    66,856 |    1.89 |    0.42 |
| pigz -p 3 -8   |    66,744 |    2.88 |    0.42 |
| pigz -p 3 -9   |    66,668 |    3.82 |    0.42 |
| pigz -p 3 -11  |    64,856 |  261.25 |    0.45 |
| pigz -p 4 -1   |    71,816 |    0.65 |    0.45 |
| pigz -p 4 -2   |    70,652 |    0.69 |    0.45 |
| pigz -p 4 -3   |    69,720 |    0.83 |    0.45 |
| pigz -p 4 -4   |    68,240 |    0.85 |    0.45 |
| pigz -p 4 -5   |    67,356 |    1.05 |    0.43 |
| pigz -p 4 -6   |    66,944 |    1.40 |    0.45 |
| pigz -p 4 -7   |    66,856 |    1.67 |    0.42 |
| pigz -p 4 -8   |    66,744 |    2.39 |    0.42 |
| pigz -p 4 -9   |    66,668 |    3.17 |    0.42 |
| pigz -p 4 -11  |    64,856 |  252.28 |    0.44 |
| pigz -p 5 -1   |    71,816 |    0.55 |    0.45 |
| pigz -p 5 -2   |    70,652 |    0.59 |    0.45 |
| pigz -p 5 -3   |    69,720 |    0.68 |    0.46 |
| pigz -p 5 -4   |    68,240 |    0.74 |    0.43 |
| pigz -p 5 -5   |    67,356 |    0.95 |    0.42 |
| pigz -p 5 -6   |    66,944 |    1.21 |    0.45 |
| pigz -p 5 -7   |    66,856 |    1.42 |    0.43 |
| pigz -p 5 -8   |    66,744 |    1.99 |    0.43 |
| pigz -p 5 -9   |    66,668 |    2.69 |    0.41 |
| pigz -p 5 -11  |    64,856 |  241.74 |    0.44 |
| pigz -p 6 -1   |    71,816 |    0.51 |    0.45 |
| pigz -p 6 -2   |    70,652 |    0.55 |    0.44 |
| pigz -p 6 -3   |    69,720 |    0.62 |    0.44 |
| pigz -p 6 -4   |    68,240 |    0.70 |    0.44 |
| pigz -p 6 -5   |    67,356 |    0.83 |    0.43 |
| pigz -p 6 -6   |    66,944 |    1.08 |    0.42 |
| pigz -p 6 -7   |    66,856 |    1.26 |    0.44 |
| pigz -p 6 -8   |    66,744 |    1.81 |    0.42 |
| pigz -p 6 -9   |    66,668 |    2.41 |    0.42 |
| pigz -p 6 -11  |    64,856 |  235.25 |    0.44 |
| pigz -p 7 -1   |    71,816 |    0.47 |    0.46 |
| pigz -p 7 -2   |    70,652 |    0.53 |    0.46 |
| pigz -p 7 -3   |    69,720 |    0.57 |    0.44 |
| pigz -p 7 -4   |    68,240 |    0.64 |    0.43 |
| pigz -p 7 -5   |    67,356 |    0.80 |    0.43 |
| pigz -p 7 -6   |    66,944 |    1.02 |    0.43 |
| pigz -p 7 -7   |    66,856 |    1.16 |    0.42 |
| pigz -p 7 -8   |    66,744 |    1.66 |    0.41 |
| pigz -p 7 -9   |    66,668 |    2.18 |    0.41 |
| pigz -p 7 -11  |    64,856 |  229.09 |    0.44 |
| pigz -p 8 -1   |    71,816 |    0.50 |    0.45 |
| pigz -p 8 -2   |    70,652 |    0.54 |    0.45 |
| pigz -p 8 -3   |    69,720 |    0.61 |    0.44 |
| pigz -p 8 -4   |    68,240 |    0.67 |    0.44 |
| pigz -p 8 -5   |    67,356 |    0.81 |    0.44 |
| pigz -p 8 -6   |    66,944 |    1.03 |    0.42 |
| pigz -p 8 -7   |    66,856 |    1.20 |    0.45 |
| pigz -p 8 -8   |    66,744 |    1.69 |    0.43 |
| pigz -p 8 -9   |    66,668 |    2.18 |    0.42 |
| pigz -p 8 -11  |    64,856 |  226.03 |    0.44 |
| lzop -1        |    87,388 |    0.30 |    0.26 |
| lzop -3        |    86,932 |    0.31 |    0.26 |
| lzop -7        |    72,088 |    7.36 |    0.28 |
| lzop -8        |    71,784 |   15.23 |    0.28 |
| lzop -9        |    71,760 |   17.36 |    0.28 |
| lz4 -1         |    87,100 |    0.27 |    0.12 |
| lz4 -2         |    87,100 |    0.27 |    0.12 |
| lz4 -3         |    76,252 |    1.88 |    0.12 |
| lz4 -4         |    75,572 |    2.07 |    0.12 |
| lz4 -5         |    75,180 |    2.34 |    0.15 |
| lz4 -6         |    74,960 |    2.70 |    0.12 |
| lz4 -7         |    74,840 |    3.01 |    0.12 |
| lz4 -8         |    74,776 |    3.34 |    0.12 |
| lz4 -9         |    74,748 |    3.66 |    0.12 |
| lz4 -10        |    74,764 |    5.65 |    0.12 |
| lz4 -11        |    74,584 |    9.23 |    0.12 |
| lz4 -12        |    74,516 |   27.26 |    0.11 |
| lz4 -13        |    74,516 |   27.23 |    0.11 |
| lz4 -14        |    74,516 |   26.75 |    0.11 |
| lz4 -15        |    74,516 |   26.81 |    0.12 |
| lz4 -16        |    74,516 |   27.07 |    0.12 |
| zstd -T1 -1    |    72,440 |    0.37 |    0.18 |
| zstd -T1 -2    |    69,816 |    0.49 |    0.19 |
| zstd -T1 -3    |    67,472 |    0.65 |    0.20 |
| zstd -T1 -4    |    67,136 |    0.68 |    0.20 |
| zstd -T1 -5    |    65,980 |    1.33 |    0.20 |
| zstd -T1 -6    |    63,660 |    1.67 |    0.19 |
| zstd -T1 -7    |    63,228 |    2.00 |    0.19 |
| zstd -T1 -8    |    62,776 |    2.61 |    0.19 |
| zstd -T1 -9    |    62,608 |    2.98 |    0.19 |
| zstd -T1 -10   |    62,388 |    4.22 |    0.19 |
| zstd -T1 -11   |    61,320 |    5.24 |    0.19 |
| zstd -T1 -12   |    61,184 |    6.29 |    0.19 |
| zstd -T1 -13   |    60,916 |    8.89 |    0.19 |
| zstd -T1 -14   |    60,804 |    8.96 |    0.18 |
| zstd -T1 -15   |    60,004 |   11.13 |    0.18 |
| zstd -T1 -16   |    59,648 |   16.04 |    0.18 |
| zstd -T1 -17   |    58,284 |   20.36 |    0.20 |
| zstd -T1 -18   |    56,344 |   23.60 |    0.20 |
| zstd -T1 -19   |    56,024 |   27.15 |    0.20 |
| zstd -T2 -1    |    72,440 |    0.20 |    0.20 |
| zstd -T2 -2    |    69,816 |    0.26 |    0.19 |
| zstd -T2 -3    |    67,472 |    0.32 |    0.19 |
| zstd -T2 -4    |    67,136 |    0.37 |    0.20 |
| zstd -T2 -5    |    65,980 |    0.72 |    0.20 |
| zstd -T2 -6    |    63,660 |    1.04 |    0.19 |
| zstd -T2 -7    |    63,228 |    1.26 |    0.19 |
| zstd -T2 -8    |    62,776 |    1.83 |    0.18 |
| zstd -T2 -9    |    62,608 |    2.13 |    0.19 |
| zstd -T2 -10   |    62,388 |    2.50 |    0.18 |
| zstd -T2 -11   |    61,320 |    3.17 |    0.19 |
| zstd -T2 -12   |    61,184 |    3.73 |    0.18 |
| zstd -T2 -13   |    60,916 |    5.00 |    0.18 |
| zstd -T2 -14   |    60,804 |    5.50 |    0.19 |
| zstd -T2 -15   |    60,004 |    6.89 |    0.19 |
| zstd -T2 -16   |    59,648 |    9.17 |    0.18 |
| zstd -T2 -17   |    58,284 |   12.74 |    0.19 |
| zstd -T2 -18   |    56,344 |   15.27 |    0.20 |
| zstd -T2 -19   |    56,024 |   17.49 |    0.21 |
| zstd -T3 -1    |    72,440 |    0.18 |    0.18 |
| zstd -T3 -2    |    69,816 |    0.18 |    0.20 |
| zstd -T3 -3    |    67,472 |    0.24 |    0.19 |
| zstd -T3 -4    |    67,136 |    0.35 |    0.20 |
| zstd -T3 -5    |    65,980 |    0.61 |    0.21 |
| zstd -T3 -6    |    63,660 |    1.05 |    0.19 |
| zstd -T3 -7    |    63,228 |    1.40 |    0.19 |
| zstd -T3 -8    |    62,776 |    1.71 |    0.18 |
| zstd -T3 -9    |    62,608 |    2.01 |    0.18 |
| zstd -T3 -10   |    62,388 |    2.26 |    0.19 |
| zstd -T3 -11   |    61,320 |    2.80 |    0.19 |
| zstd -T3 -12   |    61,184 |    3.19 |    0.18 |
| zstd -T3 -13   |    60,916 |    4.06 |    0.18 |
| zstd -T3 -14   |    60,804 |    4.44 |    0.18 |
| zstd -T3 -15   |    60,004 |    5.52 |    0.18 |
| zstd -T3 -16   |    59,648 |    7.25 |    0.18 |
| zstd -T3 -17   |    58,284 |   10.62 |    0.19 |
| zstd -T3 -18   |    56,344 |   12.06 |    0.21 |
| zstd -T3 -19   |    56,024 |   14.16 |    0.20 |
| zstd -T4 -1    |    72,440 |    0.16 |    0.18 |
| zstd -T4 -2    |    69,816 |    0.18 |    0.19 |
| zstd -T4 -3    |    67,472 |    0.24 |    0.20 |
| zstd -T4 -4    |    67,136 |    0.49 |    0.20 |
| zstd -T4 -5    |    65,980 |    0.66 |    0.20 |
| zstd -T4 -6    |    63,660 |    1.13 |    0.19 |
| zstd -T4 -7    |    63,228 |    1.40 |    0.19 |
| zstd -T4 -8    |    62,776 |    1.78 |    0.18 |
| zstd -T4 -9    |    62,608 |    2.06 |    0.19 |
| zstd -T4 -10   |    62,388 |    2.29 |    0.19 |
| zstd -T4 -11   |    61,320 |    2.81 |    0.18 |
| zstd -T4 -12   |    61,184 |    3.28 |    0.19 |
| zstd -T4 -13   |    60,916 |    4.02 |    0.19 |
| zstd -T4 -14   |    60,804 |    4.50 |    0.19 |
| zstd -T4 -15   |    60,004 |    5.48 |    0.20 |
| zstd -T4 -16   |    59,648 |    7.48 |    0.18 |
| zstd -T4 -17   |    58,284 |    8.82 |    0.19 |
| zstd -T4 -18   |    56,344 |   11.09 |    0.21 |
| zstd -T4 -19   |    56,024 |   12.27 |    0.21 |
| zstd -T5 -1    |    72,440 |    0.13 |    0.19 |
| zstd -T5 -2    |    69,816 |    0.15 |    0.19 |
| zstd -T5 -3    |    67,472 |    0.29 |    0.20 |
| zstd -T5 -4    |    67,136 |    0.70 |    0.20 |
| zstd -T5 -5    |    65,980 |    0.72 |    0.21 |
| zstd -T5 -6    |    63,660 |    1.25 |    0.19 |
| zstd -T5 -7    |    63,228 |    1.54 |    0.19 |
| zstd -T5 -8    |    62,776 |    1.88 |    0.19 |
| zstd -T5 -9    |    62,608 |    2.14 |    0.19 |
| zstd -T5 -10   |    62,388 |    2.35 |    0.19 |
| zstd -T5 -11   |    61,320 |    2.81 |    0.19 |
| zstd -T5 -12   |    61,184 |    3.22 |    0.19 |
| zstd -T5 -13   |    60,916 |    3.80 |    0.18 |
| zstd -T5 -14   |    60,804 |    4.18 |    0.19 |
| zstd -T5 -15   |    60,004 |    5.22 |    0.19 |
| zstd -T5 -16   |    59,648 |    5.86 |    0.19 |
| zstd -T5 -17   |    58,284 |    9.05 |    0.19 |
| zstd -T5 -18   |    56,344 |   10.64 |    0.21 |
| zstd -T5 -19   |    56,024 |   12.58 |    0.21 |
| zstd -T6 -1    |    72,440 |    0.12 |    0.18 |
| zstd -T6 -2    |    69,816 |    0.15 |    0.19 |
| zstd -T6 -3    |    67,472 |    0.31 |    0.20 |
| zstd -T6 -4    |    67,136 |    0.79 |    0.20 |
| zstd -T6 -5    |    65,980 |    0.92 |    0.21 |
| zstd -T6 -6    |    63,660 |    1.36 |    0.19 |
| zstd -T6 -7    |    63,228 |    1.62 |    0.19 |
| zstd -T6 -8    |    62,776 |    2.07 |    0.21 |
| zstd -T6 -9    |    62,608 |    2.16 |    0.19 |
| zstd -T6 -10   |    62,388 |    2.36 |    0.19 |
| zstd -T6 -11   |    61,320 |    2.89 |    0.19 |
| zstd -T6 -12   |    61,184 |    3.33 |    0.18 |
| zstd -T6 -13   |    60,916 |    3.89 |    0.19 |
| zstd -T6 -14   |    60,804 |    4.23 |    0.19 |
| zstd -T6 -15   |    60,004 |    5.21 |    0.18 |
| zstd -T6 -16   |    59,648 |    5.95 |    0.18 |
| zstd -T6 -17   |    58,284 |    8.80 |    0.20 |
| zstd -T6 -18   |    56,344 |   10.30 |    0.21 |
| zstd -T6 -19   |    56,024 |   12.02 |    0.21 |
| zstd -T7 -1    |    72,440 |    0.12 |    0.19 |
| zstd -T7 -2    |    69,816 |    0.14 |    0.19 |
| zstd -T7 -3    |    67,472 |    0.38 |    0.20 |
| zstd -T7 -4    |    67,136 |    0.92 |    0.20 |
| zstd -T7 -5    |    65,980 |    0.95 |    0.20 |
| zstd -T7 -6    |    63,660 |    1.37 |    0.19 |
| zstd -T7 -7    |    63,228 |    1.67 |    0.19 |
| zstd -T7 -8    |    62,776 |    1.94 |    0.19 |
| zstd -T7 -9    |    62,608 |    2.19 |    0.18 |
| zstd -T7 -10   |    62,388 |    2.39 |    0.18 |
| zstd -T7 -11   |    61,320 |    2.78 |    0.19 |
| zstd -T7 -12   |    61,184 |    3.29 |    0.18 |
| zstd -T7 -13   |    60,916 |    3.72 |    0.19 |
| zstd -T7 -14   |    60,804 |    4.12 |    0.18 |
| zstd -T7 -15   |    60,004 |    5.09 |    0.20 |
| zstd -T7 -16   |    59,648 |    5.66 |    0.18 |
| zstd -T7 -17   |    58,284 |    8.58 |    0.19 |
| zstd -T7 -18   |    56,344 |   10.81 |    0.20 |
| zstd -T7 -19   |    56,024 |   12.11 |    0.20 |
| zstd -T8 -1    |    72,440 |    0.12 |    0.18 |
| zstd -T8 -2    |    69,816 |    0.14 |    0.19 |
| zstd -T8 -3    |    67,472 |    0.39 |    0.19 |
| zstd -T8 -4    |    67,136 |    0.97 |    0.21 |
| zstd -T8 -5    |    65,980 |    0.98 |    0.21 |
| zstd -T8 -6    |    63,660 |    1.47 |    0.19 |
| zstd -T8 -7    |    63,228 |    1.69 |    0.19 |
| zstd -T8 -8    |    62,776 |    1.92 |    0.19 |
| zstd -T8 -9    |    62,608 |    2.21 |    0.18 |
| zstd -T8 -10   |    62,388 |    2.41 |    0.19 |
| zstd -T8 -11   |    61,320 |    2.91 |    0.18 |
| zstd -T8 -12   |    61,184 |    3.31 |    0.18 |
| zstd -T8 -13   |    60,916 |    3.97 |    0.18 |
| zstd -T8 -14   |    60,804 |    4.18 |    0.18 |
| zstd -T8 -15   |    60,004 |    5.10 |    0.18 |
| zstd -T8 -16   |    59,648 |    6.03 |    0.18 |
| zstd -T8 -17   |    58,284 |    8.73 |    0.19 |
| zstd -T8 -18   |    56,344 |   10.44 |    0.20 |
| zstd -T8 -19   |    56,024 |   11.98 |    0.21 |
| brotli -0      |    76,488 |    0.41 |    0.52 |
| brotli -1      |    75,492 |    0.47 |    0.47 |
| brotli -2      |    66,828 |    1.09 |    0.41 |
| brotli -3      |    66,632 |    1.23 |    0.40 |
| brotli -4      |    64,188 |    2.31 |    0.39 |
| brotli -5      |    60,572 |    3.88 |    0.38 |
| brotli -6      |    59,040 |    5.73 |    0.37 |
| brotli -7      |    58,260 |   11.05 |    0.37 |
| brotli -8      |    57,792 |   25.56 |    0.37 |
| brotli -9      |    57,368 |   69.86 |    0.38 |
| brotli -10     |    53,872 |  188.23 |    0.53 |
| brotli -11     |    52,704 |  312.27 |    0.51 |
 
4 members found this post helpful.
Old 04-17-2018, 12:22 PM   #37
ruario
Senior Member
 
Registered: Jan 2011
Location: Oslo, Norway
Distribution: Slackware
Posts: 2,324

Original Poster
Rep: Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353Reputation: 1353
Fantastic gapan. I need to spend some time looking at that
 
Old 04-17-2018, 04:13 PM   #38
gapan
Member
 
Registered: Feb 2007
Posts: 370

Rep: Reputation: 141Reputation: 141
Some graphs might help:
http://people.salixos.org/gapan/comp...n/Results.html
 
2 members found this post helpful.
Old 04-17-2018, 06:21 PM   #39
allend
Senior Member
 
Registered: Oct 2003
Location: Melbourne
Distribution: Slackware-current
Posts: 4,890

Rep: Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674Reputation: 1674
TL;DR
Code:
bash-4.4$ cat <(echo "Sorted by size") <(head -2 co.txt) <(sort -t \| -k 3 co.txt | head)
Sorted by size
| Compression    | Size (KB) | Enc (s) | Dec (s) |
| -------------- | --------- | ------- | ------- |
| xz -9          |    52,068 |   48.44 |    2.17 |
| xz -8          |    52,120 |   45.17 |    2.23 |
| xz -7          |    52,340 |   43.90 |    2.19 |
| xz -6          |    52,688 |   42.17 |    2.21 |
| brotli -11     |    52,704 |  312.27 |    0.51 |
| xz -5          |    52,956 |   38.01 |    2.22 |
| brotli -10     |    53,872 |  188.23 |    0.53 |
| xz -4          |    54,064 |   30.82 |    2.23 |
| zstd -T8 -19   |    56,024 |   11.98 |    0.21 |
| zstd -T6 -19   |    56,024 |   12.02 |    0.21 |
bash-4.4$ cat <(echo "Sorted by encoding") <(head -2 co.txt) <(sort -t \| -k 4 co.txt | head)
Sorted by encoding
| Compression    | Size (KB) | Enc (s) | Dec (s) |
| -------------- | --------- | ------- | ------- |
| zstd -T6 -1    |    72,440 |    0.12 |    0.18 |
| zstd -T8 -1    |    72,440 |    0.12 |    0.18 |
| zstd -T7 -1    |    72,440 |    0.12 |    0.19 |
| zstd -T5 -1    |    72,440 |    0.13 |    0.19 |
| zstd -T7 -2    |    69,816 |    0.14 |    0.19 |
| zstd -T8 -2    |    69,816 |    0.14 |    0.19 |
| zstd -T5 -2    |    69,816 |    0.15 |    0.19 |
| zstd -T6 -2    |    69,816 |    0.15 |    0.19 |
| zstd -T4 -1    |    72,440 |    0.16 |    0.18 |
| zstd -T3 -1    |    72,440 |    0.18 |    0.18 |
bash-4.4$ cat <(echo "Sorted by decoding") <(head -2 co.txt) <(sort -t \| -k 5 co.txt | head)
Sorted by decoding
| Compression    | Size (KB) | Enc (s) | Dec (s) |
| -------------- | --------- | ------- | ------- |
| lz4 -12        |    74,516 |   27.26 |    0.11 |
| lz4 -13        |    74,516 |   27.23 |    0.11 |
| lz4 -14        |    74,516 |   26.75 |    0.11 |
| lz4 -1         |    87,100 |    0.27 |    0.12 |
| lz4 -10        |    74,764 |    5.65 |    0.12 |
| lz4 -11        |    74,584 |    9.23 |    0.12 |
| lz4 -15        |    74,516 |   26.81 |    0.12 |
| lz4 -16        |    74,516 |   27.07 |    0.12 |
| lz4 -2         |    87,100 |    0.27 |    0.12 |
| lz4 -3         |    76,252 |    1.88 |    0.12 |
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Adding gzip compression to a netcat proxy haggismn Linux - Networking 3 03-04-2012 04:31 AM
Recommend GOOD video games that you've recently played H_TeXMeX_H General 7 09-16-2010 11:34 PM
adding different file formats to kaffeine player hbob49 Linux - Software 3 10-26-2007 02:21 PM
kaffeine recently played history rafc Linux - Software 3 07-04-2004 04:06 AM
Came a-cross some linux compression formats but not sure how to open them in Windows maximalred Linux - Distributions 1 06-09-2004 06:13 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware

All times are GMT -5. The time now is 12:45 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration