LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


View Poll Results: What compression do you use in squashfs
gzip (deflate) 0 0%
xz (lzma) 1 100.00%
bzip2 0 0%
lzo 0 0%
lz4 0 0%
zstandard 0 0%
lzip (lzma) 0 0%
other 0 0%
Voters: 1. You may not vote on this poll

Reply
  Search this Thread
Old 04-17-2020, 11:35 PM   #1
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Rep: Reputation: Disabled
What compression do you use in squashfs/kernel?


So the question for squashfs (most likely livecd/usb) users and/or kernel users. What compression method do you use?

Same question for kernel/busybox.

Most popular is lzma (xz) and deflate (gzip) but I know some were using lz4 or lzo but the latter in special applications (embedded, or requiring speed or low memory overhead)

I have an "ulterior motive" in this question - there is relatively new compression (zstandard) I mean that some claim is popular. Well from my experience with compression and compressors it's not, not to mention the compressor itself is overbloated - one and half megabyte for single compressor is, I don;t know how to call it other than bloatware. And the compressor is not that fantastic either.
But I'm trying to establish the facts. So what is it for you?

PS. I also encourage everyone to vote in poll, that's what it's for.

Last edited by tansy; 04-19-2020 at 06:16 PM. Reason: reorganize
 
Old 04-18-2020, 01:37 AM   #2
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 14,175
Blog Entries: 9

Rep: Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920
Quote:
Originally Posted by tansy View Post
there is relatively new compression (zstandard) I mean that some claim is popular. Well from my experience with compression and compressors it's not, not to mention the compressor itself is overbloated - one and half megabyte for single compressor is, I don;t know how to call it other than bloatware.
So why don't you just ask that question instead?

AFAIU, Arch Linux uses zstandard for its packages now. That is good enough for me.

Linux live systems include the tools needed to decompress the squashfs into RAM, so once that is done the compression is passť and irrelevant.
I find the question what they use of minor interest; even if I planned to create sth like that myself: Surely it depends on the size of the image and the projected space available (meaning: does it have to fit on a CD or some such). With those two figures, just use what fits best.
Generally speaking, the higher the compression the slower it is to unpack. Might also be a factor.
 
Old 04-18-2020, 01:36 PM   #3
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Original Poster
Rep: Reputation: Disabled
I want to establish whether it's popular not strictly who uses it. For example if 5 people use it, what does it tell? And if 5 out of 10, or 5 out of 10000 use it what does it tell? There is a difference is it?
 
Old 04-18-2020, 01:37 PM   #4
pan64
LQ Guru
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 14,305

Rep: Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618Reputation: 4618
but you will hardly get enough votes here.
 
Old 04-18-2020, 03:02 PM   #5
RockDoctor
Senior Member
 
Registered: Nov 2003
Location: Minnesota, US
Distribution: Fedora, Ubuntu, Linux Mint
Posts: 1,730

Rep: Reputation: 402Reputation: 402Reputation: 402Reputation: 402Reputation: 402
I don't make live CDs or squash kernels, but I do use zstd when backing up my filesystem with fsarchiver
 
Old 04-19-2020, 06:15 PM   #6
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by RockDoctor View Post
I do use zstd when backing up my filesystem with fsarchiver
Is it better than lzma (xz/lzip/7z)?

What is your kernel/busybox compressor, do you know?
 
Old 04-19-2020, 09:27 PM   #7
RockDoctor
Senior Member
 
Registered: Nov 2003
Location: Minnesota, US
Distribution: Fedora, Ubuntu, Linux Mint
Posts: 1,730

Rep: Reputation: 402Reputation: 402Reputation: 402Reputation: 402Reputation: 402
zstd seems to be faster than xz compression for my situation, backing up a single-partition Linux install. Howver, there's a point of diminishing returns. Backing up my current Fedora installation:
Code:
8233 MB installation
zstd compression level 9:  3094 MB in 10:42
zstd compression level 19: 2926 MN in 24:32
It wasn't worth the extra time!
 
Old 04-21-2020, 01:28 AM   #8
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 14,175
Blog Entries: 9

Rep: Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920
Quote:
Originally Posted by tansy View Post
Is it better than...
The question is - pointless.
There's various requirements, and different compression algorithms fulfil them differently:
  • compression rate
  • speed of compression/decompression
  • availability on other systems
  • size of executable (as you pointed out)
  • ...possibly more...
The question is: what is the best for your particular situation?

zstd has good compression - currently the highest possible AFAIU - but I doubt it's very fast.
One can also adjust compression ratio (not only zstd has that feature). As you can see in the previous post, higher rates result in much higher compression times. But that is not necessarily true for the decompression.

You haven't yet told us your specific use case - beyond your vague opening statement.
 
Old 05-22-2020, 10:59 AM   #9
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Original Poster
Rep: Reputation: Disabled
Sorry, I wasn't around for long time. Independent, external conditions...


Quote:
Originally Posted by ondoho
The question is - pointless.
There's various requirements...
Maybe for you. If you read my question post you would know it's to establish actual state of things and popularity not requirements. If I asked what is the browser or distro you use, would you tell me "There's various requirements..."?

And zstd does not have highest compression ratio, lzma has. Zstd is faster though. But the question was about something else.

I don't mind your or anyone elses reasons to use it, I want to know how popular are different codecs to establish facts against claims.
 
Old 05-22-2020, 01:17 PM   #10
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 14,175
Blog Entries: 9

Rep: Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920
Quote:
Originally Posted by tansy View Post
If you read my question post you would know it's to establish actual state of things and popularity not requirements.
Which is very different from asking "is compression A better than compression B".
Quote:
Originally Posted by tansy View Post
If I asked what is the browser or distro you use, would you tell me "There's various requirements..."?
That's pretty close to exactly what I would answer, yes. I definitely wouldn't say "it's the best because I use it".
 
Old 05-22-2020, 08:34 PM   #11
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by ondoho
Quote:
Originally Posted by tansy
If you read my question post you would know it's to establish actual state of things and popularity not requirements.
Which is very different from asking "is compression A better than compression B".
Yeah, I understand... specially I never asked that (which compression is better...)

Quote:
Originally Posted by ondoho
Quote:
Originally Posted by tansy
If I asked what is the browser or distro you use, would you tell me "There's various requirements..."?
That's pretty close to exactly what I would answer, yes. I definitely wouldn't say "it's the best because I use it".
I understand that too. I would answer: firefox or dolphin or opera, but it's just me, I'm far too ordinary, that's true.
 
Old 05-23-2020, 08:58 AM   #12
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 14,175
Blog Entries: 9

Rep: Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920Reputation: 3920
Quote:
Originally Posted by tansy View Post
Yeah, I understand... specially I never asked that (which compression is better...)
I beg to differ:
Quote:
Originally Posted by tansy View Post
Is it better than lzma (xz/lzip/7z)?
 
Old 05-23-2020, 05:16 PM   #13
tansy
LQ Newbie
 
Registered: May 2019
Distribution: slackware, slax
Posts: 11

Original Poster
Rep: Reputation: Disabled
In my topic question?
Yeah, right.
If you have something to say about topic question, I'm all ears. Otherwise, let others to answer. You're off topic.
 
  


Reply

Tags
compression, squashfs


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Customize Live CD: SquashFS optimal compression Weapon S Ubuntu 2 07-05-2017 11:41 PM
Is it possible to PXE-boot squashfs-based distro without having to use nfs/http/ftp ? Linux.tar.gz Linux - Networking 3 12-18-2012 11:54 AM
Slax with SquashFS-4 new compression algorithm and layered compression ratios? lincaptainhenryjbrown Linux - Software 2 06-19-2009 05:29 PM
How to use squashfs images? kushalkoolwal Linux - Software 1 03-24-2009 06:03 PM
Use squashfs as / ? SnowSurfAir Linux - General 5 06-06-2008 02:41 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 07:11 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration