google brotli - what you really want to know ;)

ruario · 10-21-2015, 01:07 AM

Quote:

Originally Posted by gapan

There's still the matter of creating the .tbr packages in the first place of course.

Ok, so in that case I have added "experimental Brotli support" to fmakepkg and mkpkg (again you need the bro executable installed). I set the Brotli quality level to 5. In my own quick tests this generally gives you better than BZip2 default compression but takes around the same time as GZip default compression.

EDIT: I have updated the scripts again so that you can easily tweak the quality level. Simply set the variable BROTLI_QUALITY to your desired value, e.g. to use the super fast Brotli level 1.

Code:

export BROTLI_QUALITY=1

Note: Brotli quality level 1, is generally better than GZip 9 but much faster!

ruario · 10-21-2015, 01:14 AM

Quote:

Originally Posted by gapan

There's still the matter of creating the .tbr packages in the first place of course. For now, you can convert existing .txz packages with a combination of:

Code:

xzdec package.txz > package.tar
bro --input package.tar --output package.tbr

If you don't want to use my alternative makepkg scripts and/or want to do conversions. It is easier to do this:

Code:

xzdec package.txz | bro > package.tbr

or for a specific quality level:

Code:

xzdec package.txz | bro --quality 5 > package.tbr

No real need to make the intermediary tar package.

gapan · 10-21-2015, 04:46 AM

Quote:

Originally Posted by Didier Spaier

George, did you have a chance to try usm?

Not yet, but I have been aware of it and been meaning to try it.

Quote:

Originally Posted by Didier Spaier

I guess it wouldn't be too complicated to just replace calls to {install,remove}pkg in it by calls to spkg instead? Just saying...

Yes, that would be trivial.

Code:

s/installpkg/spkg -i/
s/upgradepkg/spkg -u/
s/removepkg/spkg -d/

Quote:

Originally Posted by ruario

Ok, so in that case I have added "experimental Brotli support" to fmakepkg and mkpkg...

Oh, that's great! Tried fmakepkg as a replacement for makepkg in my own scripts to create .tbr packages. Works as advertised!

Quote:

Originally Posted by ruario

It is easier to do this:

Code:

xzdec package.txz | bro > package.tbr

Yeah, of course you're right. I just created all test cases for my tests for gzip/xz/bro packages with an intermediate package and I guess it kind of stuck with me.

ruario · 10-27-2015, 02:55 PM

Quite an interesting article on this subject https://blog.cloudflare.com/results-...menting-brotli