[SOLVED] How to sum bytes, kilobytes, megabytes and gigabytes using awk command

roopakl · 11-30-2012, 01:10 AM

I know if we do du -chs /home/* we can get the size of each directory and also total size in the end. But also would like to confirm the total size with awk command, But I don't know how to? So any help would really be apreciated.
Here is is output of

Code:

du -sh /home/* | awk '{ print $1 }' > /tmp/test_file

cat /tmp/test_file
24K
556M
1.2G
6.2M
17M
24K
30G
1.6G
28K

Now how to get the total size using awk command by reading each line of /tmp/test_file
Thanks in advance for your kind help.

druuna · 11-30-2012, 02:04 AM

The problem is du's -h switch, which prints human readable output (4k 1.8G etc). Besides that a computer isn't to good with the human readable output, it also round down/up the values shown so the end result isn't as accurate as can be.

Would this help:

Code:

du -sk * | awk '{ total = total + $1 } END { print total }'

This uses du's -k option to force output to be in k bytes (blocksize is 1k).

roopakl · 11-30-2012, 03:02 AM

Thank you very much druuna,

Quote:

du -sk * | awk '{ total = total + $1 } END { print total }'

This worked great. But is there any way to convert total kb into human readable format i.e(kb/mg/gb) instead of manually counting like?

Code:

**,***,***
gb, mb, kb

I mean the total should show like

Code:

800 K
or
2.6 M
or
41 G etc.....

druuna · 11-30-2012, 03:34 AM

You can do all sorts of arithmetic with the total variable:

Code:

$ du -sk * | awk '{ total = total + $1 } END { print total " k - " total/1024 " M - "  total/1024**2 " G"  }'
2082248 k - 2033.45 M - 1.98579 G

This shows the total (standard in k bytes), divided by 1024 to get Mb or devided by 1024^2 to get Gb.

roopakl · 11-30-2012, 04:02 AM

Thanks for your kind help druuna.

Code:

du -sk * | awk '{ total = total + $1 } END { print total " k - " total/1024 " M - " total/1024/1024 " G"  }'

Worked great. I request you to post awk and sed tutorials links. I know, I can google for it. But I wanted to know which sites you people would suggest.

Once again thank you very much druuna.

druuna · 11-30-2012, 04:22 AM

These are useful links in my opinion:

Sed/Awk resources:

Not awk/sed related, but useful nonetheless:

Bash resources:

roopakl · 11-30-2012, 04:31 AM

The above links are enough for me. I'll follow those. Thank you very much druuna, have a nice day

Habitual · 11-30-2012, 06:05 AM

Quote:

I know if we do du -chs /home/* we can get the size of each directory and also total size in the end. But also would like to confirm the total size with awk command...

since you mentioned "each directory", this may help.

Code:

du -sk ./* | /usr/bin/sort -n | /usr/bin/awk 'BEGIN{ pref[1]="K";  pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x  > 1024 ) { x = (x + 1023)/1024; y++; }  printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while(  total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total:  %g%s\n",int(total*10)/10,pref[y]); }'

output:

4K ./Public
4K ./x
4K ./x~
12K ./Templates
32K ./Desktop
7.5M ./Videos
44.3M ./Bin
154.5M ./Pictures
4.5G ./Documents
6.1G ./Music
7.7G ./VirtualBox
8.7G ./Downloads
Total: 24.4G

roopakl · 11-30-2012, 12:02 PM

Quote:

du -sk ./* | /usr/bin/sort -n | /usr/bin/awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

Excellent Habitual, Thank you very much.