Best directory size report command?

kenw232 · 02-04-2014, 07:12 PM

I'm trying to get a quick overview of my web folder sizes.
like /var/http/www.whatever.com

I was using something like
du -sk * | sort -n | perl -ne '\''($s,$f)=split(m{\t});for (qw(K M G)) {if($s<1024) {printf("%.1f",$s);print "$_\t$f"; last};$s=$s/1024}'

to get report like
848.0K www.whatever.com
1.4M www.whatever2.com

but that command does not work on my new slackware 14.1 server now. It was fine on my older slackware 10 server.

Does anyone have any suggestions on something that can generate a report like that? also sorted?

willysr · 02-04-2014, 07:14 PM

Why not du -h ?

TobiSGD · 02-04-2014, 07:32 PM

I usually use ncdu for tasks like that. It is an interactive tool, but when used with the -o option it will save a report to a file that can later be opened with ncdu using the -f option.

bosth · 02-04-2014, 08:05 PM

du -sh *

qweasd · 02-04-2014, 08:36 PM

du is great, and so is filelight

kenw232 · 02-04-2014, 09:13 PM

Quote:

Originally Posted by TobiSGD

I usually use ncdu for tasks like that. It is an interactive tool, but when used with the -o option it will save a report to a file that can later be opened with ncdu using the -f option.

Can Ncdu output just a raw text report?

lems · 02-05-2014, 01:21 AM

There is also a small utility called dirsize. Its primary purpose is for use with shell prompts, but can be used as a stand-alone program as well. From the web site:

Quote:

This tool outputs the aggregate size of all files in one or more directories, defaulting to the current directory. It does not recurse.

So it might not be exactly what you're looking for.

TobiSGD · 02-05-2014, 03:45 AM

Quote:

Originally Posted by kenw232

Can Ncdu output just a raw text report?

Those reports are raw text and contain filename, real size, size on disk and inode number. Here is an example, run on my /etc/slackpkg directory:

Code:

[1,0,{"progname":"ncdu","progver":"1.10","timestamp":1391593344},
[{"name":"/etc/slackpkg","asize":4096,"dsize":8192,"dev":2049,"ino":6333},
{"name":"blacklist","asize":1021,"dsize":4096,"ino":1227235},
{"name":"blacklist~","asize":1004,"dsize":4096,"ino":1135329},
{"name":"greylist","asize":543,"dsize":4096,"ino":7156},
{"name":"mirrors","asize":25508,"dsize":28672,"ino":1773597},
{"name":"mirrors~","asize":25511,"dsize":28672,"ino":7685},
{"name":"notifymsg.conf","asize":1750,"dsize":4096,"ino":7069},
{"name":"slackpkg.conf","asize":5893,"dsize":8192,"ino":7687},
{"name":"slackpkg.conf~","asize":5894,"dsize":8192,"ino":7688},
{"name":"slackpkgplus.conf","asize":4459,"dsize":8192,"ino":1773592},
{"name":"slackpkgplus.conf.new~","asize":5136,"dsize":8192,"ino":445708},
{"name":"slackpkgplus.conf.orig","asize":2259,"dsize":4096,"ino":507979},
{"name":"slackpkgplus.conf~","asize":4488,"dsize":8192,"ino":6349},
[{"name":"templates","asize":1,"ino":13813}]]]

NoStressHQ · 02-05-2014, 08:05 AM

Quote:

Originally Posted by kenw232

Can Ncdu output just a raw text report?

ncdu is "just" a ncurse gui over du... So to output text, just use du...

Habitual · 02-05-2014, 08:56 AM

I've used this for years:

Code:

#!/bin/bash
/usr/bin/du -sk ./* | /usr/bin/sort -n | /usr/bin/awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

outputs similar to:

Code:

12K	./Desktop
14.2M	./wun
51M	./Bin
171.1M	./Pictures
17.5G	./Documents
26.5G	./Downloads
32.3G	./VboxVMs
Total: 74.7G

Edit: Obviously, I ran this in my ~ directory - YMMV

pan64 · 02-05-2014, 09:02 AM

this is already implemented (total is not included):
du -sh * | sort -h

kenw232 · 02-05-2014, 01:32 PM

Quote:

Originally Posted by lems

There is also a small utility called dirsize. Its primary purpose is for use with shell prompts, but can be used as a stand-alone program as well. From the web site:
So it might not be exactly what you're looking for.

dirsize is nice but I'm not smart enough to sort it by size. dirsize -H * | sort -n doesn't cut it?

kenw232 · 02-05-2014, 01:35 PM

Code:

#!/bin/bash
/usr/bin/du -sk ./* | /usr/bin/sort -n | /usr/bin/awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

This is a good replacement for my problem. Thanks.

Habitual · 02-05-2014, 01:47 PM

Quote:

Originally Posted by kenw232

Code:

#!/bin/bash
/usr/bin/du -sk ./* | /usr/bin/sort -n | /usr/bin/awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

This is a good replacement for my problem. Thanks.

Glad you like it and it helps you out.