LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices


Reply
  Search this Thread
Old 03-13-2011, 08:48 PM   #1
silvyus_06
Member
 
Registered: Oct 2010
Distribution: Ubuntu 10.04 , Linux Mint Debian Edition , Microsoft Windows 7
Posts: 390

Rep: Reputation: 50
Best compression tool?


I know, i know, perhaps this might have been asked before but the infos can be outdated.. we are 2011 for gods sake..

Just.. answer the question..

(it really depends on the type of file, just say what you use it for, what you compressed, what was the output.. etc.)
 
Old 03-13-2011, 09:04 PM   #2
silvyus_06
Member
 
Registered: Oct 2010
Distribution: Ubuntu 10.04 , Linux Mint Debian Edition , Microsoft Windows 7
Posts: 390

Original Poster
Rep: Reputation: 50
also is this some dream???
http://img204.imageshack.us/img204/2542/92688595.png
 
Old 03-14-2011, 12:14 AM   #3
cantab
Member
 
Registered: Oct 2009
Location: England
Distribution: Kubuntu, Ubuntu, Debian, Proxmox.
Posts: 553

Rep: Reputation: 115Reputation: 115
Extreme compression ratios are possible on certain file types. I don't think I've ever had 1%, but I've had in single digits on some MIDIs.

Honestly, with disk space and bandwidth always rising, what matters is compatibility. So just go with gzip or bzip2 if it's going to be mainly needed on Linux, or zip or maybe rar if it's being shared with Windows people.
 
Old 03-14-2011, 04:02 AM   #4
H_TeXMeX_H
LQ Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301
The best is xz or lzma or 7zip (with lzma), at least for compressible, non-random files.

For multimedia, I'd say h264 for video and aac for audio (or vorbis). Sometimes xvid is equivalent to h264, but it's rare.
 
Old 03-14-2011, 04:24 AM   #5
lupusarcanus
Senior Member
 
Registered: Mar 2009
Location: USA
Distribution: Arch
Posts: 1,022
Blog Entries: 19

Rep: Reputation: 146Reputation: 146
I've always found .rar to be effective. 7zip is nice, though the Windows program itself is a memory hog.
 
Old 03-14-2011, 04:42 AM   #6
MrCode
Member
 
Registered: Aug 2009
Location: Oregon, USA
Distribution: Arch
Posts: 864
Blog Entries: 31

Rep: Reputation: 148Reputation: 148
I think I'll agree with H_TeXMeX_H on this one; *.xz is really good...Arch uses it for its packages, and it really speeds things up download-wise (compression ratio is usually excellent).
 
Old 03-14-2011, 05:25 AM   #7
SigTerm
Member
 
Registered: Dec 2009
Distribution: Slackware 12.2
Posts: 379

Rep: Reputation: 234Reputation: 234Reputation: 234
Quote:
Originally Posted by silvyus_06 View Post
I know, i know, perhaps this might have been asked before but the infos can be outdated.. we are 2011 for gods sake..

Just.. answer the question..

(it really depends on the type of file, just say what you use it for, what you compressed, what was the output.. etc.)
7z or rar/winrar. maximum compression, solid archive. "rar a -s -m5 archive.rar files" or "7z a -ms=on -mx=9 archive.7z files". Results are more or less same (if you didn't delete rarfiles.lst by accident), except that 7z eats too much resources for that. There are tools that can compress better, but they aren't that stable and literally take forever.

Quote:
Originally Posted by silvyus_06 View Post
also is this some dream???
1TB file that contains only zeros will compress into ~20 kilobytes on any decent archive. Also see "archive bomb".

Quote:
Originally Posted by H_TeXMeX_H View Post
I'd say h264 for video...xvid...
That's lossy video encoding - different story.
 
Old 03-14-2011, 05:43 AM   #8
H_TeXMeX_H
LQ Guru
 
Registered: Oct 2005
Location: $RANDOM
Distribution: slackware64
Posts: 12,928
Blog Entries: 2

Rep: Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301Reputation: 1301
Quote:
Originally Posted by SigTerm View Post
That's lossy video encoding - different story.
Yes, but the OP mention any file type. For loss-less audio use flac. For video ... I don't know of any.
 
Old 03-14-2011, 08:33 AM   #9
dugan
LQ Guru
 
Registered: Nov 2003
Location: Canada
Distribution: distro hopper
Posts: 11,219

Rep: Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309Reputation: 5309
Quote:
Originally Posted by H_TeXMeX_H View Post
For video ... I don't know of any.
HuffYUV and Lagarith, which are open.

The Quicktime Animation codec, which is proprietary.

These are all designed for compressing video for editing, so they use intra-frame compression. The cost is that file sizes are large. SD-resolution HuffYUV video is around 5MB/s.

Last edited by dugan; 03-14-2011 at 08:41 AM.
 
Old 03-14-2011, 08:34 AM   #10
MrCode
Member
 
Registered: Aug 2009
Location: Oregon, USA
Distribution: Arch
Posts: 864
Blog Entries: 31

Rep: Reputation: 148Reputation: 148
Quote:
For loss-less audio use flac. For video ... I don't know of any.
There are some video presets for libx264 in ffmpeg that go by "lossless_*". Not sure if this is losslessly compressed or straight uncompressed video, but I'm betting on the former.

EDIT: Ninja'd...dugan beat me to it.
 
Old 03-14-2011, 09:42 AM   #11
silvyus_06
Member
 
Registered: Oct 2010
Distribution: Ubuntu 10.04 , Linux Mint Debian Edition , Microsoft Windows 7
Posts: 390

Original Poster
Rep: Reputation: 50
i pretty much liked 7zip too.. actually is one of the first things i install on new os installations: p7zip on linux or the 7zip GUI for windows.
i agree, it uses lots of memory, but todays standard is at least 2GB ram or more. that is plenty to use with 7z even with windows.
i don't like rar because i have to pay for it..i always felt that rar was a monopoly (everyone split their files with rar for rapidshare, megaupload etc.)
for splitting files i want to get out of the monopoly...
whats your opinion about PAQ compression algorithm?
is bzip2 compression ratiio as close as to the one of 7z?
is zip any good?
 
Old 03-14-2011, 10:30 AM   #12
MTK358
LQ 5k Club
 
Registered: Sep 2009
Posts: 6,443
Blog Entries: 3

Rep: Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723Reputation: 723
If compression speed is not a big issue, xz is by far the best.

It takes very long to compress, but the ratio is better than any other formats I used and it extracts very fast.

Also, I think that the fact that Arch Linux and Slackware are switching to it for their package format sure says something.
 
Old 03-14-2011, 11:39 AM   #13
Jeebizz
Senior Member
 
Registered: May 2004
Distribution: Slackware15.0 64-Bit Desktop, Debian 11 non-free Toshiba Satellite Notebook
Posts: 4,180

Rep: Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377Reputation: 1377
Quote:
Originally Posted by H_TeXMeX_H View Post
For video ... I don't know of any.
Dirac and Theora supposedly are lossless.
 
Old 03-14-2011, 11:53 AM   #14
silvyus_06
Member
 
Registered: Oct 2010
Distribution: Ubuntu 10.04 , Linux Mint Debian Edition , Microsoft Windows 7
Posts: 390

Original Poster
Rep: Reputation: 50
Quote:
Originally Posted by MTK358 View Post
If compression speed is not a big issue, xz is by far the best.

It takes very long to compress, but the ratio is better than any other formats I used and it extracts very fast.

Also, I think that the fact that Arch Linux and Slackware are switching to it for their package format sure says something.
it gave me kinda the same results as 7z..

anyways, seems that PAQ format is a winner in ratios...
 
Old 03-14-2011, 12:01 PM   #15
DavidMcCann
LQ Veteran
 
Registered: Jul 2006
Location: London
Distribution: PCLinuxOS, Debian
Posts: 6,137

Rep: Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314Reputation: 2314
Linux Format magazine did a review of archivers a few months' ago.

For a mixed directory, the best compression was 44% with lzip and 43% with lrzip and 7z, compared with 39% for gzip.But gzip was 22 times faster.

For a set of 100MB files, the best compression was 36% with lrzip, compared with 30% with gzip. Here, gzip was 4 times faster.

For a stack of jpegs, compression was between 2% and 3%: they're already compressed. But gzip was still twice as fast as the nearest competitor.

For decompression gzip won hands down: 53 seconds, compared with 127 for 7z, and 164 for lzip and lrzip.

The conclusion was, if you're desparate for space use lrzip; if you want to save time, use gzip.

Last edited by DavidMcCann; 03-14-2011 at 12:02 PM.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Compression help dimpu Linux - Newbie 10 09-29-2010 01:30 AM
Compression/archive tool that utilizes mutliple cores? hawk__0 Linux - Software 3 10-01-2009 11:13 PM
Slax with SquashFS-4 new compression algorithm and layered compression ratios? lincaptainhenryjbrown Linux - Software 2 06-19-2009 05:29 PM
default KDE compression tool has some problems with ntfs kaiwan Linux - Software 1 07-13-2008 04:02 AM
best compression drigz Linux - Software 2 06-05-2004 07:38 AM

LinuxQuestions.org > Forums > Non-*NIX Forums > General

All times are GMT -5. The time now is 09:30 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration